[00:34] *** ndiddy has quit IRC (Read error: Operation timed out) [01:05] *** Flashfire has joined #archiveteam-bs [01:13] *** Flashfire has quit IRC (Quit: Page closed) [01:26] *** dashcloud has quit IRC (Ping timeout: 260 seconds) [01:27] *** Kaz has quit IRC (Ping timeout: 260 seconds) [01:27] *** h3x has quit IRC (Read error: Operation timed out) [01:29] *** Kaz has joined #archiveteam-bs [01:30] *** svchfoo1 sets mode: +o Kaz [01:31] *** dashcloud has joined #archiveteam-bs [01:31] *** Vito` has joined #archiveteam-bs [02:20] *** ndiddy has joined #archiveteam-bs [03:33] *** tapedrive has quit IRC (Ping timeout: 260 seconds) [04:11] so i did 5k items in 2 days [04:12] *** floogulin has quit IRC (Read error: Connection reset by peer) [04:13] *** jrwr has quit IRC (Read error: Connection reset by peer) [04:13] *** victorbje has quit IRC (Read error: Connection reset by peer) [04:13] *** xarph has quit IRC (Read error: Connection reset by peer) [04:13] *** Vito` has quit IRC (Read error: Connection reset by peer) [04:13] *** octarine has quit IRC (Read error: Connection reset by peer) [04:13] *** jiphex has quit IRC (Read error: Connection reset by peer) [04:14] *** floogulin has joined #archiveteam-bs [04:14] *** floogulin has quit IRC (Connection closed) [04:15] *** qw3rty111 has joined #archiveteam-bs [04:17] *** qw3rty119 has quit IRC (Read error: Operation timed out) [04:37] *** antomati_ has joined #archiveteam-bs [04:40] *** antomatic has quit IRC (Ping timeout: 250 seconds) [04:47] *** ndiddy has quit IRC (Ping timeout: 260 seconds) [05:00] *** rsznik has joined #archiveteam-bs [06:35] *** tuluu has quit IRC (Remote host closed the connection) [06:38] *** tuluu has joined #archiveteam-bs [07:01] *** BlueMax has joined #archiveteam-bs [07:13] *** dashcloud has quit IRC (Read error: Operation timed out) [07:13] *** dashcloud has joined #archiveteam-bs [07:25] *** WubTheCap has quit IRC (Read error: Connection reset by peer) [07:33] *** WubTheCap has joined #archiveteam-bs [08:32] *** dashcloud has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** tuluu has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** odemg has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** tsr has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** hook54321 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** BnARobin has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** t2t2 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** kevinr has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** phuzion has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** ranavalon has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** cf has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Fletcher_ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Fletcher has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** brayden has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** WubTheCap has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** luckcolor has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** blahah has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** ThisAsYou has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** DrasticAc has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** riking has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** c0mpass has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** fallenoak has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** DedSec has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** bitspill has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** ld1 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** jsa has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** zhongfu has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** MrRadar2 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Tenebrae has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** BnAboyZ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** second has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Polylith_ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** betamax has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Famicoman has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Silvan has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Kenshin has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** dan- has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** ItsYoda has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Hecatz has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Muad-Dib has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Meroje has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** trvz has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** plue has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** BartoCH has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** arbin has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** robink has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Sanqui has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** DFJustin has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** lexicon has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** ReimuHaku has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Jon has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Selavi has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** arkiver has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** omglolbah has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** vantec has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** RichardG has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Stilett0 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** bsmith094 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** i0npulse has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Jens has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** purplebot has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** PurpleSym has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** medowar has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** HCross2 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** decay_ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Boppen has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** atomicthu has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Kagee has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Xibalba has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** nyany has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** altlabel has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** klondike has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Kaz has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** espes___ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** godane has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Sk1d has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Gfy has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Lord_Nigh has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** TC01 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Igloo has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** yuitimoth has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** robogoat has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** SN4T14 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Rai-chan has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Aoede has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** svchfoo1 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** antomati_ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** nyaomi has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Despatche has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Smiley has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** kisspunch has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Fusl has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** SketchCow has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** underscor has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Valentine has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** midas has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** wacky has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Ing3b0rg has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** closure has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** chazchaz_ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** BlueMax has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** rsznik has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** qw3rty111 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Mayonaise has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** bwn has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** jtn2 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Dimtree has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** will has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** REiN^ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** C4K3 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** PotcFdk has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** squires has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** chfoo has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** FireFly has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** PoorHomie has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** beardicus has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** zino has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** powerKitt has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** superkuh has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Darkstar has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** w0rp has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Zebranky_ has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** midas1 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Soulflare has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** phirephly has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** chazchaz has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** astrid has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** c4rc4s has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** mr_archiv has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** nightpool has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** atlogbot has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Soni has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Atom-- has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** slyphic has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** unlobito has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** twigfoot has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** yipdw has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** mistym has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** kvieta has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Laverne has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** namespace has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Yurume has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Coderjo has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** dxrt has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** indrora has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** MrRadar has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** dcmorton has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** eprillios has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Somebody2 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Cameron_D has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Mateon1 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** swebb has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** ivan has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** midas4 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** zeeboots has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Jusque has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** jspiros has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Petri152 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** wabu has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** balrog has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** JAA has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Jonimus has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** pikhq has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** wp494 has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** acridAxid has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** Frogging has quit IRC (irc.Prison.NET west.us.hub) [08:32] *** joepie91 has quit IRC (irc.Prison.NET west.us.hub) [08:33] *** mundus has quit IRC (Read error: Operation timed out) [08:33] *** achip has quit IRC (Read error: Operation timed out) [08:35] *** Pixi has quit IRC (Ping timeout: 255 seconds) [08:55] *** logchfoo1 starts logging #archiveteam-bs at Sat Mar 03 08:55:43 2018 [08:55] *** logchfoo1 has joined #archiveteam-bs [09:00] *** odemg has quit IRC (Ping timeout: 244 seconds) [09:07] *** h3x has joined #archiveteam-bs [09:08] *** achip has joined #archiveteam-bs [09:16] *** achip has quit IRC (west.us.hub irc.Prison.NET) [09:31] *** h3x has quit IRC (Read error: Operation timed out) [09:31] *** odemg has joined #archiveteam-bs [09:33] *** h3x has joined #archiveteam-bs [09:37] *** odemg has quit IRC (Read error: Connection reset by peer) [10:15] *** astrid has joined #archiveteam-bs [10:16] *** svchfoo1 sets mode: +o astrid [10:16] *** achip has joined #archiveteam-bs [10:49] *** BlueMax has quit IRC (Leaving) [10:51] *** victorbje has joined #archiveteam-bs [11:00] *** jrwr has joined #archiveteam-bs [11:12] *** jiphex has joined #archiveteam-bs [11:15] *** octarine has joined #archiveteam-bs [11:16] *** xarph has joined #archiveteam-bs [11:38] *** odemg has joined #archiveteam-bs [12:04] *** odemg has quit IRC (Read error: Connection reset by peer) [12:12] *** odemg has joined #archiveteam-bs [13:37] *** odemg has quit IRC (Read error: Connection reset by peer) [14:10] *** atrocity has joined #archiveteam-bs [14:32] *** ndiddy has joined #archiveteam-bs [14:34] *** Mateon1 has quit IRC (Read error: Operation timed out) [14:34] *** Mateon1 has joined #archiveteam-bs [14:58] *** ndiddy has quit IRC () [15:25] *** odemg has joined #archiveteam-bs [15:53] so i have another copy of Alien Autopsy Fact or Fiction [15:53] oh? [15:54] this one is from Fox 11 Los Angeles [15:54] powerKitt: you can watch my copy here: https://archive.org/details/Alien_Autopsy_Fact_or_Fiction_FOX_WOC_1995-08-28 [15:57] *** RichardG has quit IRC (Read error: Connection reset by peer) [15:58] *** RichardG has joined #archiveteam-bs [16:10] *** Vito` has joined #archiveteam-bs [16:24] so i noticed this: https://www.ebay.com/itm/Lot-of-13-Rock-Video-Monthly-VHS-1993-1994-1995/273052289340 [16:32] here is another set: https://www.ebay.com/itm/SET-OF-31-ROCK-VIDEO-MONTHLY-VHS-TAPES-4x1993-14x1994-13x1995-2-sealed-nice/253423745800 [16:50] For the record, I've finally resumed the Charlie Rose video grab. [16:52] How does https://archive.org/details/vhsvault work, by the way? [16:54] *** Stilett0 has quit IRC (Ping timeout: 252 seconds) [17:17] *** odemg has quit IRC (Read error: Connection reset by peer) [17:35] *** dashcloud has quit IRC (Read error: Operation timed out) [17:42] *** odemg has joined #archiveteam-bs [17:46] *** dashcloud has joined #archiveteam-bs [18:59] *** odemg has quit IRC (Read error: Connection reset by peer) [19:07] *** rbraun has joined #archiveteam-bs [19:08] ok question y'all [19:08] there is a website with a bunch of stuff on it that has been unreliable for a while now [19:08] i want to archive it but much of it is behind a robots.txt [19:08] archive.org still respects that for "save now" [19:09] (as well as for search, apparently, and for spidering sometimes which is no-duh, that's what it's there for) [19:09] if the site goes away, robots.txt likely won't be an issue [19:10] my options are, i guess... [19:10] (a) download the site into a WARC, upload it somehow? [19:10] (b) same as above but upload the content to another site / collection [19:10] (c) set up a proxy somewhere and "save now" the site thru the proxy [19:11] (d) ??? [19:11] *** odemg has joined #archiveteam-bs [19:11] i believe if i do it carefully there won't be any bandwidth cost to the current host [19:13] what's the best option? [19:16] looking at about 200GB of data, i think [19:20] rbraun: depending on the site, #archivebot might be your best option [19:21] which will automate the download the site into a WARC -> upload to IA/Wayback machine process [19:22] hmmm [19:26] *** sampler has joined #archiveteam-bs [19:26] test [19:26] There we go [19:26] sampler: warrior v3 can be grabbed from here: https://warriorhq.archiveteam.org/downloads/warrior3/ [19:26] is it different from this one? https://www.archiveteam.org/index.php?title=ArchiveTeam_Warrior [19:26] i downloaded the virtualbox appliance [19:26] when did you download it? [19:27] hmm maybe a month ago? [19:27] sounds like they updated the link? [19:27] alright, you'll need to download in again then, link has been updated [19:28] ahh i see [19:28] thanks [19:29] *** odemg has quit IRC (Read error: Operation timed out) [19:30] *** sampler has quit IRC (Quit: Page closed) [19:30] *** robink has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.) [19:39] *** odemg has joined #archiveteam-bs [19:40] *** espes___ has quit IRC (Ping timeout: 250 seconds) [19:41] *** robink has joined #archiveteam-bs [20:01] *** espes__ has joined #archiveteam-bs [20:07] so i bought a ton of tapes from savers today [20:09] there is alot of weird stuff [20:10] like kidsongs tapes and prayer bear volume 2 and 3 [20:11] there are also stuff like superbook video bible tapes [20:36] talking about the warrior, is the docker image still okay to use? 6 weeks old, 6b26369b07e8 for the latest hash. [20:38] https://warriorhq.archiveteam.org/downloads/warrior3/ this is the new one [20:40] https://github.com/ArchiveTeam/warrior-dockerfile doesn't look like it's been updated [20:52] *** ribby has joined #archiveteam-bs [20:53] Hello, I got problems with uploading. If someone can, I will pm/query. [20:54] Hi ribby go ahead and let us know, (But be aware we are not archive.org) [20:54] what are you then? [20:54] archiveteam.org [20:54] what's the difference? [20:54] https://www.archiveteam.org/index.php?title=Who_We_Are [20:58] I think there was a storm and my uploads didn't go through. Yes, I did encounter an xml error before. Cancel changes and all. Tried uploading, but there was no status message other than the task waiting in line? [20:59] info@archive.org [21:01] I already emailed them, but it's going to take a while :( [21:02] must be the weekends. [21:12] *** ribby has quit IRC (Leaving) [21:13] *** BlueMax has joined #archiveteam-bs [21:15] *** Stilett0 has joined #archiveteam-bs [21:21] Question: I can see a lot of links to a specific path on google, but I can't find another list of the documents anywhere obvious (no index, etc). [21:22] Is there an easy way to programatically get a list of such a few hundred docs (pdfs) from google for archiving? [21:23] My google search is like "site:http://a.com/b/c/d/" , and just gives me a list of the PDFs. [21:25] what site is it, specifically? [21:31] you want a cli version of google? [21:35] Yeah, [21:35] powerKitt: Why do you ask? [21:36] There are a few of them. [21:37] I read this might be one route: https://developers.google.com/custom-search/ [21:37] I'm mostly just curious [21:37] *** dogsrcool has joined #archiveteam-bs [21:41] *** Stiletto has joined #archiveteam-bs [21:43] *** Stilett0 has quit IRC (Ping timeout: 246 seconds) [22:24] so someone build a Lilo and Stitch inspired playhouse : https://imgur.com/a/7vgSs [23:00] *** jschwart has quit IRC (Quit: Konversation terminated!) [23:02] *** tuluu has quit IRC (Read error: Operation timed out) [23:03] *** tuluu has joined #archiveteam-bs [23:23] *** espes__ has quit IRC (Ping timeout: 633 seconds) [23:40] *** Stilett0 has joined #archiveteam-bs [23:45] *** Stiletto has quit IRC (Ping timeout: 492 seconds)