[00:00] This is good. There might be also a distinction of confirmed and unconfirmed pages. Like in this case the dns crap would be unconfirmed. [00:00] Just a thought. [00:01] Yeah, I need to write some analyzers for "soft 404s" at the least -- and if this DNS thing is common... [00:01] Could be ISP proxy not DNS, so look at two places. [00:01] I understand the issue, thanks. [00:02] it's almost always a DNS resolver provided by ISPs via DHCP [00:02] and some well-known formerly-good dns servers like 4.2.2.1 [00:03] anyway, I'm off for the evening, ciao [00:03] *** wumpus has quit IRC () [00:07] *** Stiletto has joined #archiveteam [00:11] *** BlueMaxim has joined #archiveteam [00:14] *** fmope has joined #archiveteam [00:27] i wish i could choose "archive team choice" and blacklist filefront. i'm assuming i have the hdd space free for all projects *except* for that one [00:28] but that seems like a harder thing to code [00:30] as far as that goes, you upload it away in 5GB chunks anyhow [00:30] ouch [00:30] if using archivebot that is [00:31] just ATW [00:31] mm [00:31] oops, probably in the wrong channel, then [00:32] if you wanted to, say, make a URL list, I certainly have the capacity to archive more things [00:36] i don't have many things of value to suggest. looks like Ivan has backed up my fave yt channel, bosnianbill. is there a way to see a list of things ivan has backed up? [00:43] not sure. I doubt it. [00:43] other than presence in the archive. [00:44] *** Stiletto has quit IRC (Ping timeout: 260 seconds) [00:53] ranma, if you're using the vm it can't use more than 60GB no matter what [00:55] 60gb is right on the limit of my hdd space. sometimes it's a little more :( [01:03] delete drive, make smaller [01:17] *** khaoohs has joined #archiveteam [01:35] *** WinterFox has joined #archiveteam [02:27] *** slpeeds has joined #archiveteam [02:29] *** Coderjoe has quit IRC (Read error: Operation timed out) [02:29] *** fmope has quit IRC (Ping timeout: 370 seconds) [02:33] *** Stiletto has joined #archiveteam [02:34] *** Coderjoe has joined #archiveteam [02:48] *** fmope has joined #archiveteam [02:56] *** slpeeds has quit IRC (Ping timeout: 633 seconds) [03:03] *** slpeeds has joined #archiveteam [03:03] *** fmope has quit IRC (Remote host closed the connection) [03:16] *** bwn has quit IRC (Read error: Operation timed out) [03:21] *** Stiletto has quit IRC () [03:23] *** Stiletto has joined #archiveteam [03:25] *** GLaDOS has quit IRC (Read error: Operation timed out) [03:45] *** bwn has joined #archiveteam [03:59] *** dashcloud has quit IRC (Read error: Operation timed out) [04:02] *** dashcloud has joined #archiveteam [04:28] *** brayden_ has joined #archiveteam [04:28] *** swebb sets mode: +o brayden_ [04:31] *** brayden_ has quit IRC (Read error: Connection reset by peer) [04:32] *** brayden_ has joined #archiveteam [04:32] *** swebb sets mode: +o brayden_ [04:32] *** brayden has quit IRC (Read error: Operation timed out) [04:51] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:57] *** Sk1d has joined #archiveteam [05:02] *** brayden has joined #archiveteam [05:02] *** swebb sets mode: +o brayden [05:06] *** brayden_ has quit IRC (Read error: Operation timed out) [05:19] *** bwn has quit IRC (Quit: Quit) [05:24] Whoever queued http://chemistry.mdma.ch/hiveboard/palladium it is refusing connection repeatedly. [05:39] *** Yoshimura has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [05:47] *** Yoshimura has joined #archiveteam [05:50] *** bwn has joined #archiveteam [05:54] *** dashcloud has quit IRC (Read error: Operation timed out) [05:57] *** dashcloud has joined #archiveteam [06:03] *** slpeeds has quit IRC (Remote host closed the connection) [06:03] *** fmope has joined #archiveteam [06:07] *** bwn has quit IRC (Quit: bwn) [06:08] *** bwn has joined #archiveteam [06:11] *** nichlas has joined #archiveteam [06:11] WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD [06:12] hmm.. shouldn't that work? [06:13] *** nichlas has quit IRC (Client Quit) [06:14] Yoshimura: welcome to the world of being banned from websites [06:16] I consider it unethical. [06:16] There should be rate limit in terms of wait and time it takes to get response, unless the crawler is doing too many parallel threads. [06:17] (On the server side of course. Not responding it ... meh but you know. 403s are the real evil.) [06:21] *** Medowar has joined #archiveteam [06:43] *** JesseW has joined #archiveteam [07:07] *** dserodio has quit IRC (Read error: Operation timed out) [07:12] *** dserodio has joined #archiveteam [07:27] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:42] *** ariscop has quit IRC (Leaving) [07:47] *** atomotic has joined #archiveteam [07:55] can anyone get mkv to play in browser? [07:55] i ask cause i found a program called ted2mkv [07:56] and i like it it cause it saves all metadata and subtitle files into one mkv file [07:56] *** metalcamp has joined #archiveteam [08:01] *** schbirid has joined #archiveteam [08:09] The VLC-Plugin should be able to make it work. [08:09] *** acridAxid has quit IRC (Ping timeout: 246 seconds) [08:09] *** atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [08:10] *** atomotic has joined #archiveteam [08:10] *** acridAxid has joined #archiveteam [08:16] or not. No video with supported format and mime type found [08:56] *** davidar has joined #archiveteam [08:58] MKV: https://pics.yougave.me/amnesia.mkv [09:01] *** dashcloud has quit IRC (Read error: Operation timed out) [09:05] *** dashcloud has joined #archiveteam [09:06] *** ariscop has joined #archiveteam [10:25] *** bwn has quit IRC (Read error: Operation timed out) [10:40] *** bwn has joined #archiveteam [10:43] *** VADemon has joined #archiveteam [10:55] *** Emcy_ has joined #archiveteam [10:55] *** Emcy has quit IRC (Ping timeout: 246 seconds) [10:59] so i'm trying to use ffmpeg to covert mkv to mp4 [10:59] good news is i can do that but the metadata tags are lost [11:25] godane: because mp4 container doesn't support as many options as mkv, hence mkv is widely used on the internets [11:27] but mkv doesn't play directly in browser [12:01] it does. ranmas link does play in my browser, with the vlc plugin [12:01] *** atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [12:01] i'm thinking it more like the way mp4 is used on the web [12:02] like stream the file in any browser without some plugin [12:03] also does anyone know of a way to keep all metadata when using ffmpeg [12:04] i'm trying to convert mkv to mp4 but will not save the metadata tags at all [12:11] i'm pissed the scene switched from mp4 to mkv for SD content [12:11] i don't see a single point in doing so [12:16] *** atomotic has joined #archiveteam [12:31] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [12:43] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [12:45] *** gravitybo has joined #archiveteam [12:46] *** gravitybo has quit IRC (Client Quit) [12:46] *** metalcamp has joined #archiveteam [12:55] godane: convert or move? [12:56] both being containers, you should be able to just repackage it back into an mp4 file [13:07] *** atomotic has joined #archiveteam [13:08] *** RichardG_ has joined #archiveteam [13:11] *** WinterFox has quit IRC (Remote host closed the connection) [13:11] *** RichardG has quit IRC (Read error: Operation timed out) [13:15] *** scyther has joined #archiveteam [13:17] i want to move a mkv to mp4 [13:18] but i think just rename will not do [13:22] godane: but the video will still BE mkv even if you choose to call it something else [13:22] i want it to be mp4 for web usage [13:22] but the meteadata is not being past over to the mp4 [13:23] a rename does not help your cause [13:23] i wasn't renaming it [13:23] i using ffmpeg to convert it [13:23] oh... "will not do" [13:23] I missed the not part [13:23] sorry [13:24] then we agree [13:37] well, mkv is just a container. it can contain mpeg data inside it for the video stream [13:38] godane: can you use something like mkvmerge to seperate it into another container like mp4? [13:38] *** RichardG_ is now known as RichardG [13:49] *** BlueMaxim has quit IRC (Quit: Leaving) [13:51] atrocity: how do you do that [14:10] *** RichardG has quit IRC (Ping timeout: 244 seconds) [14:11] *** RichardG has joined #archiveteam [14:12] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:17] *** RichardG_ has joined #archiveteam [14:21] *** RichardG has quit IRC (Ping timeout: 633 seconds) [14:25] *** RichardG_ is now known as RichardG [14:26] ok, maybe makemkv doesn't do it, but this article does give programs that can copy the stream from .mkv straight to .mp4 so it doesn't re-encode (no quiality loss): https://www.thurrott.com/music-videos/1176/rip-blu-ray-videos-part-2-remux-mkv-mp4 [14:27] also... if ffmpeg is doing it okay for you, you can always edit the file in vlc and edit hte metadata on the files after the fact [14:27] more work, but you can do it [14:35] *** Start has quit IRC (Quit: Disconnected.) [14:41] i guess ffmpeg works if you use "copy" in the command-line, too [14:47] Please move this mp4 mkv thing to #archiveteam-bs [14:48] *** Medowar has quit IRC (Quit: Connection closed for inactivity) [14:53] *** philpem has joined #archiveteam [14:57] *** Rye has quit IRC (Read error: Connection reset by peer) [15:00] *** Dark0ne_ has joined #archiveteam [15:04] *** RichardG_ has joined #archiveteam [15:04] godane: ffmpeg -i input.mkv -c:v copy -c:a copy output.mp4 [15:05] But the audio and such formats have to be supported by mp4. Which is not always the case, and that's why mkv exists [15:05] get it to mp4 is not my problem [15:05] it was keeping the metadata [15:06] *** RichardG has quit IRC (Read error: Operation timed out) [15:06] So what the heck is your problem then? [15:06] i want the metadata to be in the mp4 [15:07] *** dashcloud has quit IRC (Read error: Operation timed out) [15:07] godane: -map_metadata 0 [15:08] Please move this mp4 mkv thing to #archiveteam-bs [15:10] *** dashcloud has joined #archiveteam [15:12] *** mismatch_ has quit IRC (Ping timeout: 499 seconds) [15:20] *** _Crocatow has joined #archiveteam [15:24] *** Crocatowa has quit IRC (Read error: Operation timed out) [15:31] *** JesseW has joined #archiveteam [15:32] *** mismatch_ has joined #archiveteam [15:32] <@arkiver> Please move this mp4 mkv thing to #archiveteam-bs [15:42] *** signius has joined #archiveteam [15:45] *** arkiver2 has joined #archiveteam [15:45] *** swebb sets mode: +o arkiver2 [15:46] *** Start has joined #archiveteam [15:48] *** Medowar has joined #archiveteam [15:49] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [15:54] *** JesseW has quit IRC (Ping timeout: 370 seconds) [15:59] *** RichardG_ has quit IRC (Ping timeout: 244 seconds) [16:02] *** yakfish has quit IRC (Read error: Operation timed out) [16:07] *** Start has quit IRC (Quit: Disconnected.) [16:11] *** Start has joined #archiveteam [16:14] *** yakfish has joined #archiveteam [16:15] *** Atom__ has quit IRC (Read error: Connection reset by peer) [16:17] *** Start has quit IRC (Quit: Disconnected.) [16:18] *** PMT has quit IRC (Quit: leaving) [16:29] *** Start has joined #archiveteam [16:32] *** tomwsmf-a has joined #archiveteam [16:38] Considering the number of people who mistake "WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD" for a bot command and then leave right after not getting a reply, I wonder if we should implement a bot to just reply: "Hi, I am a bot, and as such, don't know the secret word. But if you wait around, one the actual live people will probably tell you what it is." But maybe the current way works better as a filter. ;-) [16:40] I still don't know what that is good for, but if one day I need to know I'm pretty sure of the answer. [16:40] Wiki spam protectin [16:41] Ah [16:41] JW_work: Yes, filter works, it splits people that are serious and those that do not care or are just trying. [16:41] If they were serious, they would tell you what they want and leave, so we know it. [17:01] LEt's not do that. [17:01] (Make a bot) [17:01] heh, it was mostly a joke [17:02] *** Start_ has joined #archiveteam [17:02] *** Start has quit IRC (Read error: Connection reset by peer) [17:11] *** Morbus has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** SimpBrain has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** Starholme has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** toad1 has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** mhazinsk has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** MrRadar has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** Froggypwn has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** redlob has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** beardicus has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** MMovie has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** Zebranky has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** mistym has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** Kenshin has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** coretx_ has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** RedType has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** balrog has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** mr-b has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** chfoo- has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** aMunster has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** Mayonaise has quit IRC (ny.us.hub ircd.choopa.net) [17:11] *** remsen has quit IRC (ny.us.hub ircd.choopa.net) [17:12] *** Morbus has joined #archiveteam [17:12] *** SimpBrain has joined #archiveteam [17:12] *** Starholme has joined #archiveteam [17:12] *** toad1 has joined #archiveteam [17:12] *** mhazinsk has joined #archiveteam [17:12] *** MrRadar has joined #archiveteam [17:12] *** Froggypwn has joined #archiveteam [17:12] *** redlob has joined #archiveteam [17:12] *** beardicus has joined #archiveteam [17:12] *** MMovie has joined #archiveteam [17:12] *** Zebranky has joined #archiveteam [17:12] *** mistym has joined #archiveteam [17:12] *** Kenshin has joined #archiveteam [17:12] *** coretx_ has joined #archiveteam [17:12] *** RedType has joined #archiveteam [17:12] *** balrog has joined #archiveteam [17:12] *** mr-b has joined #archiveteam [17:12] *** chfoo- has joined #archiveteam [17:12] *** ircd.choopa.net sets mode: +oooo beardicus mistym balrog chfoo- [17:12] *** remsen has joined #archiveteam [17:12] *** aMunster has joined #archiveteam [17:12] *** Mayonaise has joined #archiveteam [17:12] *** swebb sets mode: +o beardicus [17:12] *** swebb sets mode: +o mistym [17:12] *** swebb sets mode: +o balrog [17:33] *** Start_ has quit IRC (Quit: Disconnected.) [17:34] *** Start has joined #archiveteam [17:34] *** jspiros has quit IRC (leaving) [17:34] *** jspiros has joined #archiveteam [17:37] *** Start has quit IRC (Client Quit) [17:40] *** Start has joined #archiveteam [17:49] *** bithippo has joined #archiveteam [17:50] If someone hasn't yet, could they have ArchiveBot grab https://twitter.com/ADLavinsky/status/723346989958582272 ? [17:50] Didn't see it in the pipeline/job report. Thank you! [17:51] bithippo: Thanks for the pointer [17:56] @MrRadar: no problemn [17:57] *** bithippo has quit IRC (Quit: Page closed) [18:02] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [18:14] *** Start has quit IRC (Quit: Disconnected.) [18:21] *** Start has joined #archiveteam [18:34] *** scyther has quit IRC (Read error: Connection reset by peer) [18:49] *** RichardG has joined #archiveteam [18:52] *** bwn has quit IRC (Ping timeout: 246 seconds) [19:01] *** RichardG has quit IRC (Ping timeout: 272 seconds) [19:06] *** RichardG has joined #archiveteam [19:24] *** bwn has joined #archiveteam [19:29] *** Medowar has quit IRC (Quit: Connection closed for inactivity) [19:42] *** tomwsmf-a has joined #archiveteam [19:43] *** scyther has joined #archiveteam [19:43] *** Start has quit IRC (Quit: Disconnected.) [20:07] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [21:30] *** scyther has quit IRC (Read error: Connection reset by peer) [21:33] *** scyther has joined #archiveteam [21:37] *** BnA-Rob1n has quit IRC (Quit: Connection closed for inactivity) [21:44] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [21:50] *** Rye has joined #archiveteam [21:58] *** schbirid has quit IRC (Quit: Leaving) [22:06] *** scyther has quit IRC (Read error: Connection reset by peer) [22:36] *** RichardG has quit IRC (Ping timeout: 244 seconds) [22:38] *** Start has joined #archiveteam [22:39] *** RichardG has joined #archiveteam [22:53] *** RichardG has quit IRC (Ping timeout: 499 seconds) [22:54] *** RichardG has joined #archiveteam [23:00] new gamefront items are in. [23:00] only 8500 or so [23:00] It's the newest files [23:00] A day before the website shuts down we'll do another grab of the latest files [23:01] Support for forums will be in this weekend, grab of forums will start next wekk [23:01] week* [23:01] Everything else like articles, gamepages, etc., will be grabbed with archivebot [23:01] After all that we should have a full copy of gamefront. [23:02] cool, I'll turn my warrior back on [23:02] :) [23:05] *** SmileyG has joined #archiveteam [23:06] *** Smiley has quit IRC (Read error: Operation timed out) [23:17] *** Yoshimura has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [23:17] *** Yoshimura has joined #archiveteam [23:37] *** Dark0ne_ has quit IRC (Quit: Page closed) [23:52] *** Emcy has joined #archiveteam [23:56] *** Emcy_ has quit IRC (Ping timeout: 370 seconds) [23:58] *** arkiver2 has joined #archiveteam