[01:14] *** dxrt_ has quit IRC (Ping timeout: 268 seconds) [01:15] *** dxrt_ has joined #archiveteam-bs [01:15] *** dxrt sets mode: +o dxrt_ [01:54] *** hook54321 sets mode: +o wp494 [01:54] *** hook54321 sets mode: +o wp494 [01:56] *** hook54321 sets mode: +o godane [01:56] *** hook54321 sets mode: +o HCross [02:53] *** BlueMax has quit IRC (Quit: Leaving) [02:54] *** BlueMax has joined #archiveteam-bs [03:32] *** atrocity has quit IRC () [03:35] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [03:36] *** BartoCH has joined #archiveteam-bs [03:47] *** qw3rty117 has joined #archiveteam-bs [03:54] *** qw3rty116 has quit IRC (Read error: Operation timed out) [04:04] *** RichardG has quit IRC (Ping timeout: 360 seconds) [04:06] *** odemg has quit IRC (Read error: Operation timed out) [04:13] *** odemg has joined #archiveteam-bs [04:53] *** BlueMax has quit IRC (Leaving) [05:19] *** tuluu has joined #archiveteam-bs [05:20] *** BlueMax has joined #archiveteam-bs [05:22] *** tuluu has quit IRC (Read error: Operation timed out) [05:24] *** tuluu has joined #archiveteam-bs [05:46] *** noirscape has quit IRC (west.us.hub hub.efnet.us) [05:46] *** bad_faith has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Fusl has quit IRC (west.us.hub hub.efnet.us) [05:46] *** nyaomi has quit IRC (west.us.hub hub.efnet.us) [05:46] *** underscor has quit IRC (west.us.hub hub.efnet.us) [05:46] *** SmileyG has quit IRC (west.us.hub hub.efnet.us) [05:46] *** MrRadar2 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** tsr has quit IRC (west.us.hub hub.efnet.us) [05:46] *** BnAboyZ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Sue has quit IRC (west.us.hub hub.efnet.us) [05:46] *** w0rp has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Spydar007 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** BnARobin has quit IRC (west.us.hub hub.efnet.us) [05:46] *** bsmith093 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Jonimus has quit IRC (west.us.hub hub.efnet.us) [05:46] *** hook54321 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** dxrt_ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** dashcloud has quit IRC (west.us.hub hub.efnet.us) [05:46] *** nightpool has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Gfy has quit IRC (west.us.hub hub.efnet.us) [05:46] *** SN4T14_ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** omglolbah has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Deewiant has quit IRC (west.us.hub hub.efnet.us) [05:46] *** espes__ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** TC01 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Selavi has quit IRC (west.us.hub hub.efnet.us) [05:46] *** midas1 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** obskyr has quit IRC (west.us.hub hub.efnet.us) [05:46] *** svchfoo1 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Mateon1 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** pikhq has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Lord_Nigh has quit IRC (west.us.hub hub.efnet.us) [05:46] *** betamax has quit IRC (west.us.hub hub.efnet.us) [05:46] *** medowar has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Administr has quit IRC (west.us.hub hub.efnet.us) [05:46] *** decay__ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Jens has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Frogging has quit IRC (west.us.hub hub.efnet.us) [05:46] *** joepie91 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Rai-chan has quit IRC (west.us.hub hub.efnet.us) [05:46] *** i0npulse has quit IRC (west.us.hub hub.efnet.us) [05:46] *** purplebot has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Aoede has quit IRC (west.us.hub hub.efnet.us) [05:46] *** BartoCH has quit IRC (west.us.hub hub.efnet.us) [05:46] *** lindalap has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Darkstar has quit IRC (west.us.hub hub.efnet.us) [05:46] *** zhongfu has quit IRC (west.us.hub hub.efnet.us) [05:46] *** bwn has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Odd0002 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** DFJustin has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Famicoman has quit IRC (west.us.hub hub.efnet.us) [05:46] *** victorbje has quit IRC (west.us.hub hub.efnet.us) [05:46] *** jrwr has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Ctrl-S___ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** voltagex has quit IRC (west.us.hub hub.efnet.us) [05:46] *** xarph has quit IRC (west.us.hub hub.efnet.us) [05:46] *** kevinr has quit IRC (west.us.hub hub.efnet.us) [05:46] *** deathy has quit IRC (west.us.hub hub.efnet.us) [05:46] *** jiphex has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Vito` has quit IRC (west.us.hub hub.efnet.us) [05:46] *** JSharp has quit IRC (west.us.hub hub.efnet.us) [05:46] *** octarine has quit IRC (west.us.hub hub.efnet.us) [05:46] *** dan- has quit IRC (west.us.hub hub.efnet.us) [05:46] *** ItsYoda has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Kaz has quit IRC (west.us.hub hub.efnet.us) [05:46] *** dogsrcool has quit IRC (west.us.hub hub.efnet.us) [05:46] *** riking has quit IRC (west.us.hub hub.efnet.us) [05:46] *** bitspill has quit IRC (west.us.hub hub.efnet.us) [05:46] *** DrasticAc has quit IRC (west.us.hub hub.efnet.us) [05:46] *** blahah has quit IRC (west.us.hub hub.efnet.us) [05:46] *** ThisAsYou has quit IRC (west.us.hub hub.efnet.us) [05:46] *** c0mpass has quit IRC (west.us.hub hub.efnet.us) [05:46] *** fallenoak has quit IRC (west.us.hub hub.efnet.us) [05:46] *** arkiver has quit IRC (west.us.hub hub.efnet.us) [05:46] *** sec^nd has quit IRC (west.us.hub hub.efnet.us) [05:46] *** plue has quit IRC (west.us.hub hub.efnet.us) [05:46] *** jsa has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Meroje has quit IRC (west.us.hub hub.efnet.us) [05:46] *** lexicon has quit IRC (west.us.hub hub.efnet.us) [05:46] *** synm0nger has quit IRC (west.us.hub hub.efnet.us) [05:46] *** t2t2 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Tenebrae has quit IRC (west.us.hub hub.efnet.us) [05:46] *** eientei95 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Kenshin has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Hecatz has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Muad-Dib has quit IRC (west.us.hub hub.efnet.us) [05:46] *** ReimuHaku has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Jon has quit IRC (west.us.hub hub.efnet.us) [05:46] *** nyany has quit IRC (west.us.hub hub.efnet.us) [05:46] *** altlabel has quit IRC (west.us.hub hub.efnet.us) [05:46] *** BlueMax has quit IRC (west.us.hub hub.efnet.us) [05:46] *** qw3rty117 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** PotcFdk has quit IRC (west.us.hub hub.efnet.us) [05:46] *** FireFly has quit IRC (west.us.hub hub.efnet.us) [05:46] *** sep332 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** C4K3 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** REiN^ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** beardicus has quit IRC (west.us.hub hub.efnet.us) [05:46] *** bmcginty has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Mayonaise has quit IRC (west.us.hub hub.efnet.us) [05:46] *** wp494 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** atomicthu has quit IRC (west.us.hub hub.efnet.us) [05:46] *** antomatic has quit IRC (west.us.hub hub.efnet.us) [05:46] *** mundus201 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** robink has quit IRC (west.us.hub hub.efnet.us) [05:46] *** paulf has quit IRC (west.us.hub hub.efnet.us) [05:46] *** rbraun has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Zebranky has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Yurume has quit IRC (west.us.hub hub.efnet.us) [05:46] *** swebb has quit IRC (west.us.hub hub.efnet.us) [05:46] *** wabu has quit IRC (west.us.hub hub.efnet.us) [05:46] *** acridAxid has quit IRC (west.us.hub hub.efnet.us) [05:46] *** JAA has quit IRC (west.us.hub hub.efnet.us) [05:46] *** closure has quit IRC (west.us.hub hub.efnet.us) [05:46] *** ivan has quit IRC (west.us.hub hub.efnet.us) [05:46] *** robogoat has quit IRC (west.us.hub hub.efnet.us) [05:46] *** zeeboots has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Petri152 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** SilSte has quit IRC (west.us.hub hub.efnet.us) [05:46] *** brayden has quit IRC (west.us.hub hub.efnet.us) [05:46] *** mistym has quit IRC (west.us.hub hub.efnet.us) [05:46] *** HCross has quit IRC (west.us.hub hub.efnet.us) [05:46] *** SimpBrain has quit IRC (west.us.hub hub.efnet.us) [05:46] *** dcmorton has quit IRC (west.us.hub hub.efnet.us) [05:46] *** phuzion has quit IRC (west.us.hub hub.efnet.us) [05:46] *** chfoo has quit IRC (west.us.hub hub.efnet.us) [05:46] *** cf has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Fletcher_ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** odemg has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Atom has quit IRC (west.us.hub hub.efnet.us) [05:46] *** MrRadar has quit IRC (west.us.hub hub.efnet.us) [05:46] *** unlobito has quit IRC (west.us.hub hub.efnet.us) [05:46] *** twigfoot has quit IRC (west.us.hub hub.efnet.us) [05:46] *** m007a83_ has quit IRC (west.us.hub hub.efnet.us) [05:46] *** balrog has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Laverne has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Igloo has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Cameron_D has quit IRC (west.us.hub hub.efnet.us) [05:46] *** SketchCow has quit IRC (west.us.hub hub.efnet.us) [05:46] *** kvieta has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Jusque has quit IRC (west.us.hub hub.efnet.us) [05:46] *** slyphic has quit IRC (west.us.hub hub.efnet.us) [05:46] *** dxrt has quit IRC (west.us.hub hub.efnet.us) [05:46] *** astrid has quit IRC (west.us.hub hub.efnet.us) [05:46] *** atlogbot has quit IRC (west.us.hub hub.efnet.us) [05:46] *** Somebody2 has quit IRC (west.us.hub hub.efnet.us) [05:46] *** yipdw has quit IRC (west.us.hub hub.efnet.us) [05:46] *** namespace has quit IRC (west.us.hub hub.efnet.us) [06:11] *** Despatche has quit IRC (Quit: Read error: Connection reset by peer) [06:11] *** Despatche has joined #archiveteam-bs [06:16] *** DFJustin has joined #archiveteam-bs [06:16] *** kvieta has joined #archiveteam-bs [06:16] *** MrRadar has joined #archiveteam-bs [06:16] *** Jens has joined #archiveteam-bs [06:16] *** Deewiant has joined #archiveteam-bs [06:16] *** espes__ has joined #archiveteam-bs [06:16] *** Frogging has joined #archiveteam-bs [06:16] *** TC01 has joined #archiveteam-bs [06:16] *** arkiver has joined #archiveteam-bs [06:16] *** joepie91 has joined #archiveteam-bs [06:16] *** svchfoo1 has joined #archiveteam-bs [06:16] *** Selavi has joined #archiveteam-bs [06:16] *** Rai-chan has joined #archiveteam-bs [06:16] *** i0npulse has joined #archiveteam-bs [06:16] *** Aoede has joined #archiveteam-bs [06:16] *** purplebot has joined #archiveteam-bs [06:16] *** sec^nd has joined #archiveteam-bs [06:16] *** midas1 has joined #archiveteam-bs [06:16] *** plue has joined #archiveteam-bs [06:16] *** obskyr has joined #archiveteam-bs [06:16] *** jsa has joined #archiveteam-bs [06:16] *** eientei95 has joined #archiveteam-bs [06:16] *** Meroje has joined #archiveteam-bs [06:16] *** lexicon has joined #archiveteam-bs [06:16] *** synm0nger has joined #archiveteam-bs [06:16] *** t2t2 has joined #archiveteam-bs [06:16] *** Tenebrae has joined #archiveteam-bs [06:16] *** Jon has joined #archiveteam-bs [06:16] *** ReimuHaku has joined #archiveteam-bs [06:16] *** Muad-Dib has joined #archiveteam-bs [06:16] *** Hecatz has joined #archiveteam-bs [06:16] *** Kenshin has joined #archiveteam-bs [06:16] *** altlabel has joined #archiveteam-bs [06:16] *** decay__ has joined #archiveteam-bs [06:16] *** fallenoak has joined #archiveteam-bs [06:16] *** c0mpass has joined #archiveteam-bs [06:16] *** ThisAsYou has joined #archiveteam-bs [06:16] *** blahah has joined #archiveteam-bs [06:16] *** DrasticAc has joined #archiveteam-bs [06:16] *** bitspill has joined #archiveteam-bs [06:16] *** riking has joined #archiveteam-bs [06:16] *** dogsrcool has joined #archiveteam-bs [06:16] *** omglolbah has joined #archiveteam-bs [06:16] *** Kaz has joined #archiveteam-bs [06:16] *** hub.efnet.us sets mode: +oooo Frogging joepie91 svchfoo1 Kaz [06:16] *** ItsYoda has joined #archiveteam-bs [06:16] *** dan- has joined #archiveteam-bs [06:16] *** SN4T14_ has joined #archiveteam-bs [06:16] *** Administr has joined #archiveteam-bs [06:16] *** Gfy has joined #archiveteam-bs [06:16] *** medowar has joined #archiveteam-bs [06:16] *** nightpool has joined #archiveteam-bs [06:16] *** betamax has joined #archiveteam-bs [06:16] *** octarine has joined #archiveteam-bs [06:16] *** JSharp has joined #archiveteam-bs [06:16] *** Vito` has joined #archiveteam-bs [06:16] *** jiphex has joined #archiveteam-bs [06:16] *** deathy has joined #archiveteam-bs [06:16] *** kevinr has joined #archiveteam-bs [06:16] *** xarph has joined #archiveteam-bs [06:16] *** voltagex has joined #archiveteam-bs [06:16] *** Ctrl-S___ has joined #archiveteam-bs [06:16] *** jrwr has joined #archiveteam-bs [06:16] *** victorbje has joined #archiveteam-bs [06:16] *** Famicoman has joined #archiveteam-bs [06:16] *** nyany has joined #archiveteam-bs [06:16] *** Lord_Nigh has joined #archiveteam-bs [06:16] *** Fusl has joined #archiveteam-bs [06:16] *** nyaomi has joined #archiveteam-bs [06:16] *** underscor has joined #archiveteam-bs [06:16] *** SmileyG has joined #archiveteam-bs [06:16] *** MrRadar2 has joined #archiveteam-bs [06:16] *** tsr has joined #archiveteam-bs [06:16] *** BnAboyZ has joined #archiveteam-bs [06:16] *** Sue has joined #archiveteam-bs [06:16] *** w0rp has joined #archiveteam-bs [06:16] *** Spydar007 has joined #archiveteam-bs [06:16] *** BnARobin has joined #archiveteam-bs [06:16] *** bsmith093 has joined #archiveteam-bs [06:16] *** Jonimus has joined #archiveteam-bs [06:16] *** hook54321 has joined #archiveteam-bs [06:16] *** pikhq has joined #archiveteam-bs [06:16] *** Odd0002 has joined #archiveteam-bs [06:16] *** bwn has joined #archiveteam-bs [06:16] *** bad_faith has joined #archiveteam-bs [06:16] *** zhongfu has joined #archiveteam-bs [06:16] *** Darkstar has joined #archiveteam-bs [06:16] *** lindalap has joined #archiveteam-bs [06:16] *** noirscape has joined #archiveteam-bs [06:16] *** dashcloud has joined #archiveteam-bs [06:16] *** Mateon1 has joined #archiveteam-bs [06:16] *** dxrt_ has joined #archiveteam-bs [06:16] *** hub.efnet.us sets mode: +oooo jrwr MrRadar2 hook54321 dxrt_ [06:16] *** BartoCH has joined #archiveteam-bs [06:16] *** me_ has joined #archiveteam-bs [06:16] *** Mayonaise has joined #archiveteam-bs [06:16] *** BlueMax has joined #archiveteam-bs [06:16] *** odemg has joined #archiveteam-bs [06:16] *** qw3rty117 has joined #archiveteam-bs [06:16] *** Atom has joined #archiveteam-bs [06:16] *** PotcFdk has joined #archiveteam-bs [06:16] *** FireFly has joined #archiveteam-bs [06:16] *** sep332 has joined #archiveteam-bs [06:16] *** C4K3 has joined #archiveteam-bs [06:16] *** REiN^ has joined #archiveteam-bs [06:16] *** beardicus has joined #archiveteam-bs [06:16] *** unlobito has joined #archiveteam-bs [06:16] *** twigfoot has joined #archiveteam-bs [06:16] *** bmcginty has joined #archiveteam-bs [06:16] *** m007a83_ has joined #archiveteam-bs [06:16] *** wp494 has joined #archiveteam-bs [06:16] *** SilSte has joined #archiveteam-bs [06:16] *** atomicthu has joined #archiveteam-bs [06:16] *** balrog has joined #archiveteam-bs [06:16] *** Laverne has joined #archiveteam-bs [06:16] *** Igloo has joined #archiveteam-bs [06:16] *** Cameron_D has joined #archiveteam-bs [06:16] *** antomatic has joined #archiveteam-bs [06:16] *** mundus201 has joined #archiveteam-bs [06:16] *** brayden has joined #archiveteam-bs [06:16] *** robink has joined #archiveteam-bs [06:16] *** mistym has joined #archiveteam-bs [06:16] *** HCross has joined #archiveteam-bs [06:16] *** paulf has joined #archiveteam-bs [06:16] *** SketchCow has joined #archiveteam-bs [06:16] *** Jusque has joined #archiveteam-bs [06:16] *** SimpBrain has joined #archiveteam-bs [06:16] *** rbraun has joined #archiveteam-bs [06:16] *** slyphic has joined #archiveteam-bs [06:16] *** dxrt has joined #archiveteam-bs [06:16] *** hub.efnet.us sets mode: +oooo wp494 HCross SketchCow dxrt [06:16] *** astrid has joined #archiveteam-bs [06:16] *** atlogbot has joined #archiveteam-bs [06:16] *** Somebody2 has joined #archiveteam-bs [06:16] *** namespace has joined #archiveteam-bs [06:16] *** dcmorton has joined #archiveteam-bs [06:16] *** Zebranky has joined #archiveteam-bs [06:16] *** Yurume has joined #archiveteam-bs [06:16] *** swebb has joined #archiveteam-bs [06:16] *** wabu has joined #archiveteam-bs [06:16] *** hub.efnet.us sets mode: +ovo astrid atlogbot Somebody2 [06:16] *** acridAxid has joined #archiveteam-bs [06:16] *** JAA has joined #archiveteam-bs [06:16] *** closure has joined #archiveteam-bs [06:16] *** ivan has joined #archiveteam-bs [06:16] *** phuzion has joined #archiveteam-bs [06:16] *** robogoat has joined #archiveteam-bs [06:16] *** zeeboots has joined #archiveteam-bs [06:16] *** Petri152 has joined #archiveteam-bs [06:16] *** chfoo has joined #archiveteam-bs [06:16] *** cf has joined #archiveteam-bs [06:16] *** Fletcher_ has joined #archiveteam-bs [06:16] *** hub.efnet.us sets mode: +oo JAA chfoo [06:36] *** schbirid has joined #archiveteam-bs [07:24] *** m007a83_ has quit IRC (Read error: Connection reset by peer) [07:29] *** m007a83 has joined #archiveteam-bs [07:29] *** m007a83 has quit IRC (Client Quit) [07:32] *** m007a83 has joined #archiveteam-bs [07:47] *** BlueMaxim has joined #archiveteam-bs [07:52] *** BlueMax has quit IRC (Read error: Operation timed out) [08:20] Sanqui: Oh, nice, didn't know about {{Job|...}}. [08:20] JAA: It's my child. I made it two days ago :p [08:20] Excellent idea! [08:21] Also, you just reminded me that I should update my grab of Romhacking downloads. [08:21] I just want the wiki to be a no hassle documentation of what we're doing. [08:23] Are you an admin on the wiki, btw? I do want to make some changes [08:24] Nope [08:28] My GIGA grab is almost done. 1.6 million URLs retrieved, 210k to go. 24.8 GiB of WARCs so far. [08:37] *** tuluu has quit IRC (Remote host closed the connection) [08:41] JAA: I've got a THDN download script too :p [08:41] *RHDN [08:42] :-) [08:42] Also grabbing the descriptions because why not [08:42] The more, the merrier. [08:43] Yeah, I grabbed the entire website minus downloads through ArchiveBot last summer, and the downloads manually with my scripts and wpull. [08:44] Cool [08:45] Still need to upload that to IA though. [08:45] That and a ton of other stuff. [08:45] I love how they tried to stop bots with the "copy this sequence" part [08:45] When all it requires is changing regex [08:45] Haha, yeah, that was a fun 10 seconds to fix that. [08:58] JAA: Whaat? *I* grabbed the entire website minus downloads through ArchiveBot last summer! [08:58] JAA, Sanqui; potato tomato [09:00] Also the entirety of RHDN's downloads is only 5.2GB [09:00] Sanqui: 2017-08-02 08:23:51 UTC <@JAA> !a http://www.romhacking.net/ [...] [09:00] Yep [09:01] JAA: Oh, don't worry, I believe you :p [09:01] :-P [09:01] But yeah, I archived it earlier when it went down for a bit. [09:01] Ah [09:01] https://www.archiveteam.org/index.php?title=Romhacking.net [09:01] I guess we grabbed it twice then. [09:02] *** tuluu has joined #archiveteam-bs [09:03] *** REiN^ has quit IRC (Read error: Connection reset by peer) [09:03] JAA: anyway, please grab the @eevee twitter account [09:04] *** REiN^ has joined #archiveteam-bs [09:04] Yeah, the scrape is running. [09:04] ah, thank you [09:04] > Downloading a file now requires copying a password into a form, restraining archival attempts. [09:04] >>restraining [09:04] Found ~70k tweets so far. [09:06] *** tuluu has quit IRC (Remote host closed the connection) [09:06] eientei95: To be fair, it does restrain archival attempts in the sense that we can't just throw it into ArchiveBot or another automated tool. [09:06] *** tuluu has joined #archiveteam-bs [09:07] True [09:14] TIL that makes a difference. [09:15] Makes sense, but I never thought about it. [09:16] that giga screenshot, lol. [09:17] :-) [09:30] *** wp494_ has joined #archiveteam-bs [09:36] *** wp494 has quit IRC (Read error: Operation timed out) [09:58] *** BlueMaxim has quit IRC (Leaving) [10:32] *** me_ has quit IRC (Read error: Operation timed out) [10:33] *** FireFly has quit IRC (Read error: Operation timed out) [10:35] *** FireFly has joined #archiveteam-bs [10:35] *** me_ has joined #archiveteam-bs [11:00] *** godane has quit IRC (Read error: Operation timed out) [11:14] *** godane has joined #archiveteam-bs [11:56] *** me_ has quit IRC (Read error: Operation timed out) [11:57] *** FireFly has quit IRC (Read error: Operation timed out) [11:58] *** me_ has joined #archiveteam-bs [11:58] *** FireFly has joined #archiveteam-bs [12:08] *** me_ has quit IRC (Read error: Operation timed out) [12:10] *** FireFly has quit IRC (Read error: Operation timed out) [12:11] *** odemg has quit IRC (Read error: Operation timed out) [12:11] *** me_ has joined #archiveteam-bs [12:12] *** FireFly has joined #archiveteam-bs [12:16] *** odemg has joined #archiveteam-bs [12:56] *** me_ has quit IRC (Read error: Operation timed out) [12:56] *** FireFly has quit IRC (Read error: Operation timed out) [13:04] All hail archiving twice [13:14] two independent archivals mean less much chance for missing or errornous stuff [13:23] Where does archive bot store the warcs it makes? [13:24] JAA: I see you grab is going pretty good [13:24] is there still a need for a warrior project you think? [13:26] arkiver: Not sure. Although I think it's doing well, I haven't actually verified the contents at all yet. [13:26] It has slowed down significantly since it's now mainly retrieving large threads with many pages (which are slower to generate on the server side). [13:27] A little under 100k remaining now. [13:27] *** zino has joined #archiveteam-bs [13:29] So yeah, at the moment, I have no idea how much longer it'll take. [13:30] The remaining count is dropping slowly, about 9k per hour. [13:32] It probably doesn't make sense to run a full warrior project. If anything, maybe one for threads with more than N pages. (I could get that list from my grab relatively easily.) [13:32] But yeah, really hard to estimate currently. It might be fine. [13:34] DrasticAc: The WARCs are first uploaded to FOS and from there to this IA collection: https://archive.org/details/archivebot Use http://archive.fart.website/archivebot/viewer/ or https://github.com/JustAnotherArchivist/archivebot-archives for searching. [13:35] Ah, cool beans. [13:41] *** Administr has quit IRC (Ping timeout: 252 seconds) [13:44] *** godane has quit IRC (Ping timeout: 252 seconds) [13:44] Oh, thanks for catching that, Sanqui. [13:45] I'll update the other pages where I used that as well. [13:45] * JAA has no idea how to use MediaWiki. [13:54] *** beardicus has quit IRC (bye) [13:58] *** beardicus has joined #archiveteam-bs [14:10] *** RichardG has joined #archiveteam-bs [14:10] *** me_ has joined #archiveteam-bs [14:17] *** godane has joined #archiveteam-bs [14:24] *** FireFly has joined #archiveteam-bs [14:31] *** RichardG has quit IRC (Read error: Connection reset by peer) [14:32] *** RichardG has joined #archiveteam-bs [14:54] !status [14:54] Well, almost the right channel [15:02] *** C4K3 has quit IRC (leaving) [15:02] *** C4K3 has joined #archiveteam-bs [16:43] archivebot business: i contacted falconk re his pipelines, he knows about the issues and will get to it when he has time between putting out fires [17:18] HCross: I'm interested in purevolume. sorry, just saw your comment. [17:20] 2 million GIGA forum URLs done, 31k currently in queue. 32.2 GiB of WARCs up to now. [17:22] HCross: grabbing artist playlists currently (site reports 3m artists, only got 300k showing tracks). no way to get list of all artists b/c browse page only shows up to 1000 artists, and geofencing via zipcode is not...possible (90210 shows 86k artists, for example). [17:35] Are there any resources for getting full link lists for a given website? I know there are sitemaps, but if robots.txt doesn't list them, and google doesn't goof and show you a sitemap url, then you're out of luck with a given site. Anywhere else I can look, assuming the site itself doesnt ahve a way to list everything? [17:48] Sweet! https://web.archive.org/web/timemap/json can show a list of urls. [17:58] I was thinking of that as a starting point at least [17:58] common crawl as well [18:01] http://web.archive.org/web/timemap/xd?url=*.purevolume.com&filter=statuscode:200&collapse=urlkey&fl=original [18:20] *** ndiddy has joined #archiveteam-bs [18:25] *** RichardG has quit IRC (Read error: Connection reset by peer) [18:26] bad_faith: any reason not to just use cdx directly? http://web.archive.org/cdx/search/cdx?url=*.purevolume.com&limit=5&showResumeKey=true&output=json&fl=original&collapse=urlkey&filter=statuscode:200 [18:26] *** RichardG has joined #archiveteam-bs [18:27] bad_faith: can't tell if they're the same backend. [18:27] generally, no. [18:27] They are different somehow. I have found domains that are strangely excluded from CDX but not wayback machine itself but are available through the timemap endpoint [18:35] bad_faith: thank you. [18:48] bad_faith: I'm possibly goofing, but I can't get your timemap endpoint to do offsets or resumption. Need to do some more looking though. [18:56] *** godane has quit IRC (Ping timeout: 252 seconds) [19:07] *** godane has joined #archiveteam-bs [19:07] *** svchfoo1 sets mode: +o godane [19:08] Uh oh, one of my GIGA wpull processes crashed with a seg fault. [19:13] digitize tapes for 2018-04-13: https://www.patreon.com/posts/digitize-tapes-18161599 [19:14] SketchCow: i really need those vhs boxes with return labels [19:14] only cause i have filled 3 home depot small boxes with tapes [19:36] so i'm at 190k items for the year [19:37] 26k items for just this month so far [19:48] *** ndiddy has quit IRC () [20:43] Anyone here proficient with gdb? I ssh'd into a host, attached to a running process with gdb. Then the SSH connection failed. gdb is still running and blocking the process. How can I instruct gdb to detach from the process? [20:44] I have some crazy ideas like attaching to the gdb process with gdb, reopening stdin through a FIFO, and sending it "detach", but I have no idea if that would work. [20:45] Letting gdb continue to run would also be fine for me, as long as the original process (the tracee) continues to run. [20:51] why don't you just kill gdb [20:51] Because that, as far as I know, also kills the process gdb is attached to. [20:52] it shouldn't but let me test [20:52] kill -9 of gdb doesn't affect the process it's attached to [20:52] verified [20:53] that only is an issue if the process is a child of gdb [20:55] Ah [20:55] Yeah, that actually makes sense. [20:55] If the process is started from within gdb, they're probably in the same process group, I guess. [20:56] Which means that the SIGKILL gets sent to both gdb and the inferior. [20:57] So, I bought a domain... [20:57] goatse.sx [20:58] Time to bring back the legend. [20:58] This counts as archival, right? [21:00] Yep, it worked, thanks astrid! :-) [21:00] JAA: yay! [21:06] Jens: yay! [21:06] Somewhat related question... how do I get a capture from archive.org without all their JS and HTML garbage embedded? [21:07] You add id_ at the end of the timestamp. [21:08] Oh nice. [21:11] oh nice indeed! [21:11] i had no idea [21:15] (or im_ ) [21:21] im_ still rewrites links and adds some scripts. [21:21] Just like if_ [21:22] id_ is the only one that returns the raw original content, as far as I know. [21:23] ah interesting [21:24] im_ and if_ are actually used inside the Wayback Machine when you browse stuff, for images/other embedded content and frames, respectively. [21:25] I don't think id_ is used anywhere. I only know about it because I read about it somewhere on our wiki IIRC. [21:29] Yeah, a secret [21:29] *** ndiddy has joined #archiveteam-bs [21:49] *** Mateon1 has quit IRC (Ping timeout: 252 seconds) [21:50] *** Mateon1 has joined #archiveteam-bs [21:53] *** Lord_Nigh has quit IRC (Quit: ZNC - http://znc.in) [22:15] *** Lord_Nigh has joined #archiveteam-bs [22:17] *** schbirid has quit IRC (Leaving) [22:22] My GIGA grab is almost done. It's just retrying about 31k remaining errors now. [22:30] *** ola_norsk has joined #archiveteam-bs [22:30] are there any words about the 'wikifying' of IA item metadata? [22:31] in the meantime, i'm having some iterest in trying to found out what this discussion is about https://archive.org/details/AudioRecording_201610 :D [22:32] sounds like a heated debate of sorts, in a language i don't know [22:34] "Topic: M" and "Description: M" not giving me many clues [22:34] -ot please [22:34] wikification of IA item metadata was mentioned here previously [22:35] /part [22:35] ahgh [22:35] *** ola_norsk has left [22:49] *** MrRadar2 sets mode: +o MrRadar [23:19] *** BlueMax has joined #archiveteam-bs [23:35] *** godane has quit IRC (Ping timeout: 260 seconds) [23:51] *** godane has joined #archiveteam-bs