[00:00] *** Darkstar has joined #archiveteam-bs [00:04] *** Zerote has quit IRC (Read error: Operation timed out) [00:05] *** chfoo-_ is now known as chfoo [00:16] *** enowaldo has joined #archiveteam-bs [00:16] *** eythian has quit IRC (Remote host closed the connection) [00:18] *** eythian has joined #archiveteam-bs [00:21] *** Stilettoo has joined #archiveteam-bs [00:24] *** Stiletto has quit IRC (Ping timeout: 268 seconds) [00:25] *** enowaldo has quit IRC (Ping timeout: 265 seconds) [00:30] *** Stiletto has joined #archiveteam-bs [00:32] *** qw3rty114 has joined #archiveteam-bs [00:33] *** Stilettoo has quit IRC (Ping timeout: 268 seconds) [00:38] *** Stilettoo has joined #archiveteam-bs [00:39] *** enowaldo has joined #archiveteam-bs [00:41] *** Stiletto has quit IRC (Ping timeout: 252 seconds) [00:54] *** h3ndr1k has joined #archiveteam-bs [01:00] *** enowaldo has quit IRC (Read error: Operation timed out) [02:06] *** paul2520 has quit IRC (Read error: Operation timed out) [02:06] *** dxrt_ has quit IRC (Read error: Operation timed out) [02:06] *** kiska1 has quit IRC (Read error: Operation timed out) [02:06] *** JH88 has quit IRC (Read error: Operation timed out) [02:07] *** step has quit IRC (Read error: Operation timed out) [02:07] *** TigerbotH has quit IRC (Read error: Operation timed out) [02:09] *** PhrackD has quit IRC (Read error: Operation timed out) [02:10] *** PotcFdk has quit IRC (Read error: Operation timed out) [02:12] *** qw3rty114 has quit IRC (Read error: Operation timed out) [02:12] *** HashbangI has quit IRC (Read error: Operation timed out) [02:14] *** systwi has quit IRC (Ping timeout: 600 seconds) [02:14] *** jspiros has quit IRC (Ping timeout: 600 seconds) [02:27] *** qw3rty114 has joined #archiveteam-bs [02:27] *** kiska1 has joined #archiveteam-bs [02:28] *** svchfoo1 sets mode: +o kiska1 [02:31] *** systwi has joined #archiveteam-bs [02:31] *** dxrt_ has joined #archiveteam-bs [02:31] *** dxrt sets mode: +o dxrt_ [02:31] *** BlueMax has joined #archiveteam-bs [02:32] *** paul2520 has joined #archiveteam-bs [02:33] *** PotcFdk has joined #archiveteam-bs [02:35] *** HashbangI has joined #archiveteam-bs [02:36] *** step has joined #archiveteam-bs [02:37] *** PhrackD has joined #archiveteam-bs [02:38] *** TigerbotH has joined #archiveteam-bs [02:50] *** enowaldo has joined #archiveteam-bs [02:55] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [03:00] *** jspiros has joined #archiveteam-bs [03:10] *** enowaldo has joined #archiveteam-bs [03:23] *** enowaldo has quit IRC (Read error: Operation timed out) [03:24] *** qw3rty115 has joined #archiveteam-bs [03:29] *** qw3rty114 has quit IRC (Read error: Operation timed out) [03:47] *** odemgi has joined #archiveteam-bs [03:49] *** odemgi_ has quit IRC (Ping timeout: 252 seconds) [03:50] *** odemg has quit IRC (Ping timeout: 265 seconds) [03:51] *** BlueMax has quit IRC (Quit: Leaving) [04:02] *** odemg has joined #archiveteam-bs [04:28] *** BlueMax has joined #archiveteam-bs [05:07] *** BartoCH has quit IRC (Quit: WeeChat 2.4) [05:45] *** deevious has joined #archiveteam-bs [05:52] *** deevious has quit IRC (Quit: deevious) [05:53] *** m007a83_ is now known as m007a83 [05:56] *** deevious has joined #archiveteam-bs [06:08] *** godane has quit IRC (Ping timeout: 265 seconds) [06:08] *** Zerote has joined #archiveteam-bs [06:24] *** enowaldo has joined #archiveteam-bs [06:25] *** godane has joined #archiveteam-bs [06:29] *** enowaldo has quit IRC (Read error: Operation timed out) [07:15] *** benjinsmi has joined #archiveteam-bs [07:17] *** benjins has quit IRC (Ping timeout: 252 seconds) [07:19] *** enowaldo has joined #archiveteam-bs [07:24] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [07:30] *** Zerote has quit IRC (Read error: Operation timed out) [07:36] *** Kaz has quit IRC (Ping timeout: 265 seconds) [07:37] *** revi has quit IRC (Read error: Connection reset by peer) [07:38] *** JSharp has quit IRC (Ping timeout: 615 seconds) [07:40] *** Zerote has joined #archiveteam-bs [07:43] *** JSharp has joined #archiveteam-bs [07:43] *** Kaz has joined #archiveteam-bs [07:43] *** revi has joined #archiveteam-bs [07:45] *** af10b3e5e has quit IRC (Remote host closed the connection) [07:45] *** af10b3e5e has joined #archiveteam-bs [08:02] who in here recommended during the google+ project dumping the warcs into AWS S3? http://xor.meo.ws/83a4fc09/5ed8/4e63/9743/06c38724a3fe.png that's without the 13tb of traffic i /actually/ have to pay to get that data out again :$ [08:04] *** TC01 has quit IRC (Read error: Operation timed out) [08:05] *** balrog has quit IRC (Read error: Operation timed out) [08:05] *** benjinsmi has quit IRC (Ping timeout: 252 seconds) [08:05] *** HashbangI has quit IRC (Read error: Operation timed out) [08:05] *** m007a83_ has joined #archiveteam-bs [08:05] *** HashbangI has joined #archiveteam-bs [08:05] *** balrog has joined #archiveteam-bs [08:06] *** fredgido has joined #archiveteam-bs [08:08] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [08:10] *** d5f4a3622 has joined #archiveteam-bs [08:12] *** odemgi_ has joined #archiveteam-bs [08:12] *** fredgido_ has quit IRC (Ping timeout: 252 seconds) [08:12] *** deevious has quit IRC (Quit: deevious) [08:12] *** af10b3e5e has quit IRC (Ping timeout: 252 seconds) [08:12] *** Lord_Nigh has quit IRC (Ping timeout: 252 seconds) [08:12] *** sknebel_ has joined #archiveteam-bs [08:13] *** benjins has joined #archiveteam-bs [08:13] *** TC01 has joined #archiveteam-bs [08:14] *** RichardG_ has joined #archiveteam-bs [08:15] *** ndiddy_ has joined #archiveteam-bs [08:16] *** sknebel has quit IRC (Ping timeout: 252 seconds) [08:16] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [08:16] *** odemgi has quit IRC (Ping timeout: 252 seconds) [08:16] *** wp494 has quit IRC (Ping timeout: 252 seconds) [08:16] *** RichardG has quit IRC (Ping timeout: 252 seconds) [08:16] *** ndiddy has quit IRC (Ping timeout: 252 seconds) [08:16] *** yuitimoth has quit IRC (Ping timeout: 252 seconds) [08:16] *** _niklas has quit IRC (Quit: No Ping reply in 180 seconds.) [08:16] *** yuitimoth has joined #archiveteam-bs [08:16] *** Lord_Nigh has joined #archiveteam-bs [08:17] *** wp494 has joined #archiveteam-bs [08:17] *** i0npulse has joined #archiveteam-bs [08:19] *** i0npulse has quit IRC (se.hub irc.underworld.no) [08:19] *** jut has quit IRC (se.hub irc.underworld.no) [08:19] *** ats has quit IRC (se.hub irc.underworld.no) [08:19] *** Ganonmast has quit IRC (se.hub irc.underworld.no) [08:19] *** Frogging has quit IRC (se.hub irc.underworld.no) [08:19] *** ColdIce has quit IRC (se.hub irc.underworld.no) [08:19] *** jodizzle has quit IRC (se.hub irc.underworld.no) [08:19] *** Flashfire has quit IRC (se.hub irc.underworld.no) [08:19] *** coderobe has quit IRC (se.hub irc.underworld.no) [08:19] *** ranma has quit IRC (se.hub irc.underworld.no) [08:19] *** kiska has quit IRC (se.hub irc.underworld.no) [08:19] *** _niklas has joined #archiveteam-bs [08:20] *** ats_ has joined #archiveteam-bs [08:26] RIP netsplit. Also I think it was marked [08:28] *** omarroth` has joined #archiveteam-bs [08:29] *** omarroth has quit IRC (Ping timeout: 615 seconds) [08:33] *** i0npulse has joined #archiveteam-bs [08:33] *** jut has joined #archiveteam-bs [08:33] *** Ganonmast has joined #archiveteam-bs [08:33] *** Frogging has joined #archiveteam-bs [08:33] *** ColdIce has joined #archiveteam-bs [08:33] *** jodizzle has joined #archiveteam-bs [08:33] *** Flashfire has joined #archiveteam-bs [08:33] *** coderobe has joined #archiveteam-bs [08:33] *** ranma has joined #archiveteam-bs [08:33] *** kiska has joined #archiveteam-bs [08:33] *** irc.underworld.no sets mode: +o kiska [08:36] *** Silvan has quit IRC (Read error: Operation timed out) [08:47] *** SilSte has joined #archiveteam-bs [09:35] *** kyonko has joined #archiveteam-bs [10:16] *** Fusl has quit IRC (Excess Flood) [10:17] rip efnet [10:17] *** Fusl has joined #archiveteam-bs [10:17] *** Fusl_ sets mode: +o Fusl [10:19] lol [10:20] Fusl: what did you do? [10:22] what have i NOT done is a better question [10:32] *** enowaldo has joined #archiveteam-bs [10:39] *** enowaldo has quit IRC (Ping timeout: 252 seconds) [10:45] *** BlueMax has quit IRC (Read error: Connection reset by peer) [10:59] *** jut has quit IRC (Ping timeout: 252 seconds) [11:11] *** wp494 has quit IRC (Read error: Operation timed out) [11:11] *** enowaldo has joined #archiveteam-bs [11:12] *** wp494 has joined #archiveteam-bs [11:17] *** Cameron_D has quit IRC (Quit: :(){ :|:& };:) [11:20] *** enowaldo has quit IRC (Read error: Operation timed out) [11:24] *** jut has joined #archiveteam-bs [11:25] *** wyatt8740 has joined #archiveteam-bs [11:32] *** deevious has joined #archiveteam-bs [11:46] *** Odd0002 has quit IRC (Quit: ZNC - http://znc.in) [11:46] *** Odd0002 has joined #archiveteam-bs [11:49] *** Cameron_D has joined #archiveteam-bs [11:49] *** Cameron_D has quit IRC (Client Quit) [12:10] *** wyatt8740 has quit IRC (Read error: Connection reset by peer) [12:45] *** odemgi_ has quit IRC (Read error: Connection reset by peer) [12:46] *** odemgi_ has joined #archiveteam-bs [12:49] *** Fionera has joined #archiveteam-bs [12:55] *** VerifiedJ has joined #archiveteam-bs [13:13] *** enowaldo has joined #archiveteam-bs [14:07] *** Zerote has quit IRC (Read error: Operation timed out) [14:08] *** morgan_ has joined #archiveteam-bs [14:12] *** morgan_ has quit IRC (Client Quit) [14:32] *** Zerote has joined #archiveteam-bs [15:00] *** deevious has quit IRC (Quit: deevious) [15:10] *** enowaldo has quit IRC (Read error: Operation timed out) [15:38] *** Albardin has joined #archiveteam-bs [15:38] *** Fusl sets mode: +o Albardin [15:39] *** kiskabak has joined #archiveteam-bs [15:39] *** Fusl sets mode: +o kiskabak [15:39] *** enowaldo has joined #archiveteam-bs [15:44] *** Albardin has quit IRC (The Lounge - https://thelounge.github.io) [16:07] anyone here know what http://fileformats.archiveteam.org/ is? Flashfire asked this in september 2018 already but hasnt gotten a reply to that [16:08] aaronsw.archiveteam.org points to 199.48.254.94, seems down, should be removed if server no longer exists [16:09] It's a wiki for documenting file formats [16:09] ^ [16:09] ic [16:10] I have no idea who maintains it [16:11] fileformats.archiveteam.org{"MX":null,"AAAA":null,"SOA":null,"CNAME":null,"A":["208.86.226.169"],"TXT":null,"NS":null} [16:11] justsolve.archiveteam.org{"TXT":null,"NS":null,"CNAME":null,"AAAA":null,"SOA":null,"MX":null,"A":["208.86.226.169"]} [16:11] digitize.archiveteam.org{"AAAA":null,"MX":null,"CNAME":null,"NS":null,"TXT":null,"A":["208.86.226.169"],"SOA":null} [16:11] they all seem to be running on the same server [16:12] > This Site's URL is permanently http://fileformats.archiveteam.org! [16:13] digitize.archiveteam.org is a "How to digitise X" wiki [16:13] Different from justsolve/fileformats which seem to point to the same wiki [16:27] *** ndiddy_ is now known as ndiddy [16:40] *** enowaldo has quit IRC (Ping timeout: 252 seconds) [17:40] *** enowaldo has joined #archiveteam-bs [18:32] *** Stiletto has joined #archiveteam-bs [18:34] *** Stilettoo has quit IRC (Ping timeout: 265 seconds) [18:42] *** BartoCH has joined #archiveteam-bs [18:51] *** d5f4a3622 has quit IRC (Ping timeout: 265 seconds) [19:03] *** larryv has joined #archiveteam-bs [19:06] just noticed that items on IA where the item name ends with a dot are very screwy; the torrents don't work correctly, and downloading files ends up with very strange local filenames with %2f in them and other stuff [19:08] *** RichardG_ is now known as RichardG [19:13] see https://archive.org/details/user_manual_s.a.m./ for an example [19:19] *** enowaldo has quit IRC (Ping timeout: 252 seconds) [19:49] *** Stilettoo has joined #archiveteam-bs [19:52] *** Stiletto has quit IRC (Ping timeout: 246 seconds) [20:17] *** Stilettoo has quit IRC () [20:26] *** Stiletto has joined #archiveteam-bs [20:45] *** Stiletto has quit IRC () [20:48] *** Stiletto has joined #archiveteam-bs [20:55] *** VerifiedJ has quit IRC (Quit: Leaving) [21:15] *** systwi_ has joined #archiveteam-bs [21:18] *** enowaldo has joined #archiveteam-bs [21:21] *** systwi has quit IRC (Ping timeout: 600 seconds) [21:28] *** enowaldo has quit IRC (Ping timeout: 252 seconds) [21:42] *** Odd0002 has quit IRC (ZNC - http://znc.in) [21:45] *** Odd0002 has joined #archiveteam-bs [22:42] *** Stiletto has quit IRC () [23:08] *** enowaldo has joined #archiveteam-bs [23:21] so for the Minecraft forum [23:21] when we save it, after it goes read only [23:21] is it possible for us to get a list of all links on the site? [23:21] because many users use adfly+mediafire and it's kinda important to archive all of those [23:21] but urlteam doesn't really successfully scrape adfly yet, nor are there any large scale scrapes going on [23:22] and as far as I know, we've never done a mediafire scrape [23:22] so individually archiving the links might be the best solution [23:22] although, I'm unsure how we should store the adfly links properly in warcs [23:24] *** BlueMax has joined #archiveteam-bs [23:24] Does mediafire use some kind of wait to download? [23:27] nope [23:27] the problem is adfly [23:36] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [23:36] *** webdownlo has joined #archiveteam-bs [23:53] *** killsushi has joined #archiveteam-bs [23:59] *** Zerote has quit IRC (Ping timeout: 252 seconds)