[00:16] *** tapedrive has joined #archiveteam-bs [00:16] *** betamax_ has joined #archiveteam-bs [00:18] *** tapedriv1 has quit IRC (Read error: Operation timed out) [00:18] *** betamax has quit IRC (Read error: Operation timed out) [00:20] *** odemg has quit IRC (Ping timeout: 265 seconds) [00:24] *** odemg has joined #archiveteam-bs [00:57] *** Mateon1 has quit IRC (Read error: Operation timed out) [00:58] *** Mateon1 has joined #archiveteam-bs [01:46] teej_: FWIW, I'm in favor of switching over the software table to use shields.io [01:46] but I don't care that much either way [01:48] Somebody2: Thanks for your support. Perhaps we can continue discussing this with JAA after the Tumblr grab is running smoothly. [01:49] SketchCow: packages i sent from last week got delivered [02:14] *** hdch has joined #archiveteam-bs [02:40] *** Stilett0 has joined #archiveteam-bs [02:41] *** Stiletto has quit IRC (Ping timeout: 246 seconds) [02:51] *** arlen has joined #archiveteam-bs [02:55] *** betamax_ has quit IRC (Read error: Operation timed out) [02:55] *** tapedrive has quit IRC (Read error: Operation timed out) [02:59] *** tapedrive has joined #archiveteam-bs [02:59] *** betamax has joined #archiveteam-bs [03:03] *** betamax has quit IRC (Ping timeout: 246 seconds) [03:04] *** betamax has joined #archiveteam-bs [03:05] *** tapedrive has quit IRC (Ping timeout: 255 seconds) [03:06] *** tapedrive has joined #archiveteam-bs [03:09] *** SketchCow has quit IRC (Ping timeout: 633 seconds) [03:12] *** SketchCow has joined #archiveteam-bs [03:12] *** swebb sets mode: +o SketchCow [03:14] *** erine has quit IRC (Read error: Operation timed out) [03:17] *** adinbied has quit IRC (Quit: Left Channel.) [03:22] *** erine has joined #archiveteam-bs [03:26] *** adinbied has joined #archiveteam-bs [03:32] *** tuluu has quit IRC (Read error: Connection refused) [03:32] *** tuluu has joined #archiveteam-bs [03:39] *** tapedriv1 has joined #archiveteam-bs [03:39] *** betamax_ has joined #archiveteam-bs [03:40] *** betamax has quit IRC (Read error: Operation timed out) [03:42] *** tapedrive has quit IRC (Ping timeout: 265 seconds) [03:42] *** kyounko has quit IRC (Max SendQ exceeded) [03:43] *** kyounko has joined #archiveteam-bs [03:47] *** arlen has quit IRC (arlen) [03:54] *** tuluu has quit IRC (Remote host closed the connection) [03:56] *** tuluu has joined #archiveteam-bs [04:05] voltagex_ I haven't tested the binary yet, but one of my friends is sending patches to you in github [04:08] *** qw3rty114 has joined #archiveteam-bs [04:09] I heard tests don't pass also , tracking that down [04:11] *** svchfoo3 has quit IRC (Read error: Operation timed out) [04:11] *** cf has quit IRC (Read error: Operation timed out) [04:12] *** cf has joined #archiveteam-bs [04:12] *** chazchaz has quit IRC (Read error: Operation timed out) [04:12] *** chazchaz has joined #archiveteam-bs [04:13] *** odemgi_ has joined #archiveteam-bs [04:14] *** odemgi has quit IRC (Read error: Operation timed out) [04:14] *** qw3rty113 has quit IRC (Read error: Operation timed out) [04:15] *** svchfoo3 has joined #archiveteam-bs [04:16] *** odemg has quit IRC (Ping timeout: 265 seconds) [04:17] *** svchfoo1 sets mode: +o svchfoo3 [04:25] *** tapedriv1 has quit IRC (Ping timeout: 255 seconds) [04:25] *** tapedrive has joined #archiveteam-bs [04:28] *** odemg has joined #archiveteam-bs [04:29] *** odemg has quit IRC (Read error: error:1408F10B:SSL routines:SSL3_GET_RECORD:wrong version number) [04:29] *** odemg has joined #archiveteam-bs [04:51] *** tuluu has quit IRC (Remote host closed the connection) [04:52] *** tuluu has joined #archiveteam-bs [04:55] ftp://ftp.niwa.co.nz/ can anyone else check if there is anything in here? [05:09] *** LFlare43 has quit IRC (Quit: The Lounge - https://thelounge.chat) [05:33] *** tuluu has quit IRC (Read error: Connection refused) [05:33] *** tuluu has joined #archiveteam-bs [05:43] *** arlen has joined #archiveteam-bs [06:04] *** Stiletto has joined #archiveteam-bs [06:06] *** Stilett0 has quit IRC (Ping timeout: 252 seconds) [06:07] my upload is shitty... is there a way to slow down Warrior to only download as fast as i can upload? [06:08] for tumblr [06:08] *** Stilett0 has joined #archiveteam-bs [06:09] *** Stiletto has quit IRC (Ping timeout: 264 seconds) [06:34] *** arlen has quit IRC (arlen) [07:11] *** arlen has joined #archiveteam-bs [07:24] *** wp494 has quit IRC (Ping timeout: 364 seconds) [07:25] *** wp494 has joined #archiveteam-bs [07:58] *** Jusque has quit IRC (Quit: ZNC - http://znc.in) [07:59] *** Jusque has joined #archiveteam-bs [08:02] *** DarkWorld has quit IRC (Ping timeout: 633 seconds) [08:03] *** DarkWorld has joined #archiveteam-bs [08:06] *** wacky_ has quit IRC (Read error: Operation timed out) [08:09] *** wacky has joined #archiveteam-bs [08:12] *** godane has quit IRC (Read error: Connection reset by peer) [08:13] *** Jusque has quit IRC (Quit: ZNC - http://znc.in) [08:14] *** Jusque has joined #archiveteam-bs [08:17] *** arlen has quit IRC (arlen) [08:20] *** tuluu has quit IRC (Read error: Connection refused) [08:22] *** tuluu has joined #archiveteam-bs [08:28] *** JensRex has quit IRC (Remote host closed the connection) [08:29] *** Jens has joined #archiveteam-bs [08:31] *** anarcat has quit IRC (Read error: Connection reset by peer) [08:36] *** anarcat has joined #archiveteam-bs [08:50] *** BlueMaxim has joined #archiveteam-bs [08:51] *** DFJustin has quit IRC (Ping timeout: 260 seconds) [08:51] *** Muad-Dib has quit IRC (Ping timeout: 260 seconds) [08:51] *** riking has quit IRC (Ping timeout: 260 seconds) [08:52] *** obskyr has quit IRC (Ping timeout: 260 seconds) [08:52] *** obskyr has joined #archiveteam-bs [08:52] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [08:52] *** Coderjo has quit IRC (Ping timeout: 260 seconds) [08:52] *** mr_archiv has quit IRC (Ping timeout: 260 seconds) [08:52] *** moufu has quit IRC (Ping timeout: 260 seconds) [08:52] *** bakJAA has quit IRC (Ping timeout: 260 seconds) [08:52] *** robogoat_ has quit IRC (Ping timeout: 260 seconds) [08:52] *** Fusl has quit IRC (Ping timeout: 260 seconds) [08:52] *** JonimusP has quit IRC (Ping timeout: 260 seconds) [08:52] *** bitspill has quit IRC (Ping timeout: 260 seconds) [08:53] *** cf has quit IRC (Ping timeout: 260 seconds) [08:53] *** BlueMax has quit IRC (Ping timeout: 260 seconds) [08:53] *** sec^nd has quit IRC (Ping timeout: 260 seconds) [08:53] *** zhongfu has quit IRC (Ping timeout: 260 seconds) [08:53] *** Meroje has quit IRC (Ping timeout: 260 seconds) [08:53] *** plue_ has quit IRC (Ping timeout: 260 seconds) [08:53] *** decay has quit IRC (Ping timeout: 260 seconds) [08:53] *** eientei95 has quit IRC (Ping timeout: 260 seconds) [08:53] *** apache2_ has quit IRC (Ping timeout: 260 seconds) [08:53] *** eLbot has quit IRC (Ping timeout: 260 seconds) [08:53] *** Hecatz has quit IRC (Ping timeout: 260 seconds) [08:54] *** robogoat has joined #archiveteam-bs [08:54] *** decay has joined #archiveteam-bs [08:54] *** Coderjo has joined #archiveteam-bs [08:55] *** eientei95 has joined #archiveteam-bs [08:56] *** bakJAA has joined #archiveteam-bs [08:56] *** JAA sets mode: +o bakJAA [08:56] *** plue has joined #archiveteam-bs [08:56] *** swebb sets mode: +o bakJAA [08:58] *** eLbot has joined #archiveteam-bs [08:59] *** second_ has joined #archiveteam-bs [08:59] *** BartoCH has joined #archiveteam-bs [09:00] *** moufu has joined #archiveteam-bs [09:00] *** Meroje has joined #archiveteam-bs [09:05] *** mr_archiv has joined #archiveteam-bs [09:05] *** Fusl has joined #archiveteam-bs [09:06] *** riking has joined #archiveteam-bs [09:06] *** JonimusP has joined #archiveteam-bs [09:06] *** swebb sets mode: +o JonimusP [09:08] *** bitspill has joined #archiveteam-bs [09:12] *** riking has quit IRC (Ping timeout: 260 seconds) [09:12] *** chr1sm has quit IRC (Ping timeout: 260 seconds) [09:12] *** JSharp has quit IRC (Ping timeout: 260 seconds) [09:12] *** Vito` has quit IRC (Ping timeout: 260 seconds) [09:12] *** victorbje has quit IRC (Read error: Connection reset by peer) [09:12] *** octarine has quit IRC (Read error: Connection reset by peer) [09:12] *** xarph has quit IRC (Read error: Connection reset by peer) [09:12] *** DrasticAc has quit IRC (Read error: Connection reset by peer) [09:12] *** ThisAsYou has quit IRC (Read error: Connection reset by peer) [09:12] *** Ctrl-S_ has quit IRC (Read error: Connection reset by peer) [09:12] *** deathy has quit IRC (Read error: Connection reset by peer) [09:12] *** davidar has quit IRC (Read error: Connection reset by peer) [09:12] *** HCross has quit IRC (Write error: Connection reset by peer) [09:12] *** voltagex_ has quit IRC (Read error: Connection reset by peer) [09:12] *** deathy has joined #archiveteam-bs [09:12] *** octarine has joined #archiveteam-bs [09:12] *** xarph has joined #archiveteam-bs [09:12] *** davidar has joined #archiveteam-bs [09:12] *** chr1sm has joined #archiveteam-bs [09:12] *** DrasticAc has joined #archiveteam-bs [09:12] *** voltagex_ has joined #archiveteam-bs [09:12] *** ThisAsYou has joined #archiveteam-bs [09:12] *** riking has joined #archiveteam-bs [09:12] *** victorbje has joined #archiveteam-bs [09:13] *** Vito` has joined #archiveteam-bs [09:13] *** JSharp has joined #archiveteam-bs [09:13] *** HCross has joined #archiveteam-bs [09:13] *** Ctrl-S_ has joined #archiveteam-bs [09:13] *** svchfoo3 sets mode: +o HCross [09:13] *** svchfoo1 sets mode: +o HCross [09:20] *** DFJustin has joined #archiveteam-bs [09:20] *** swebb sets mode: +o DFJustin [09:20] *** apache2 has joined #archiveteam-bs [09:21] *** Muad-Dib has joined #archiveteam-bs [09:21] *** zhongfu has joined #archiveteam-bs [09:22] *** cf has joined #archiveteam-bs [09:23] *** Hecatz has joined #archiveteam-bs [09:29] *** phirephl- has quit IRC (Read error: Operation timed out) [09:33] *** phirephly has joined #archiveteam-bs [09:41] *** DarkWorld has quit IRC (Read error: Operation timed out) [09:55] *** DarkWorld has joined #archiveteam-bs [10:10] *** tuluu has quit IRC (Read error: Connection refused) [10:10] *** tuluu has joined #archiveteam-bs [10:32] anyone know what this is? (origin, timeframe) https://cdn.discordapp.com/attachments/425897648470622210/521946116615438338/20181210_230609.jpg [10:33] oh, nm [10:48] *** phirephly has quit IRC (Read error: Operation timed out) [10:50] *** phirephly has joined #archiveteam-bs [10:57] ranma https://en.numista.com/catalogue/arabie_saoudite-1.html [11:21] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [11:22] *** m007a83 has joined #archiveteam-bs [11:54] *** tuluu has quit IRC (Remote host closed the connection) [11:55] *** tuluu has joined #archiveteam-bs [12:14] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [12:31] *** godane has joined #archiveteam-bs [13:43] *** Smiley has joined #archiveteam-bs [13:44] *** SmileyG has quit IRC (Read error: Operation timed out) [16:02] *** hdch has quit IRC (Ping timeout: 265 seconds) [16:26] *** wp494 has quit IRC (Ping timeout: 252 seconds) [16:26] *** wp494 has joined #archiveteam-bs [16:27] *** schbirid has joined #archiveteam-bs [16:52] voltagex_: https://transfer.sh/3CSxa/wget-lua.patch [16:52] git checkout 122a9f08a3d681c5e95918e4b6267f705487eab4 [16:52] then apply [16:53] *** twoTBHetz has joined #archiveteam-bs [16:54] Hi i got the following problem: I am interested in a conference in Japan which uses youtube for live streams but does not put any recordings online. Is there a know way to archive such live streams [16:55] I got 7+1/2 hours to set something up [16:57] ivan might know something about that. [17:11] is ivan in irc? [17:24] *** C4K3 has quit IRC (Quit: leaving) [17:25] *** hdch has joined #archiveteam-bs [17:28] *** C4K3 has joined #archiveteam-bs [18:06] *** arlen has joined #archiveteam-bs [18:17] afaik youtube-dl can do this [18:18] you'll want to test it on some random 24/7 music livestream first though, as it requires having certain dependencies installed [18:18] cc twoTBHetz [18:19] joepie91, my problem is that i do not know the links before hand and do not want to stay awake all night [18:24] *** jut has quit IRC (Ping timeout: 252 seconds) [18:26] *** jut has joined #archiveteam-bs [18:30] *** benjinsmi has joined #archiveteam-bs [18:35] *** benjins has quit IRC (Read error: Operation timed out) [19:18] *** nyaomi has quit IRC (Ping timeout: 633 seconds) [19:21] *** nyaomi has joined #archiveteam-bs [19:21] *** hdch has quit IRC (Ping timeout: 265 seconds) [19:38] *** hook54321 has quit IRC (Quit: Connection closed for inactivity) [19:54] *** DarkWorld has quit IRC (Remote host closed the connection) [19:54] *** DarkWorld has joined #archiveteam-bs [19:56] *** Stiletto has joined #archiveteam-bs [19:59] *** Stilett0 has quit IRC (Ping timeout: 268 seconds) [20:00] joepie91, arkiver got a message about http://landcover.org/shutdown/ site is a mess, throw it in archivebot, I'm grabbing the ftp and will upload in #effteepee fashion [20:03] *** second_ has quit IRC (Quit: ZNC 1.6.5 - http://znc.in) [20:04] *** nyaomi has quit IRC (Ping timeout: 268 seconds) [20:09] *** nyaomi has joined #archiveteam-bs [20:23] *** Verified_ has joined #archiveteam-bs [20:26] *** VerifiedJ has quit IRC (Ping timeout: 252 seconds) [20:33] odemg: I threw it into ArchiveBot. I hope there aren't too many of those datasets linked from the site. [20:43] *** second_ has joined #archiveteam-bs [20:47] *** arlen has quit IRC (Read error: Connection reset by peer) [20:48] *** arlen has joined #archiveteam-bs [20:50] *** trvz has joined #archiveteam-bs [20:52] *** buckket has joined #archiveteam-bs [20:53] *** pnJay has joined #archiveteam-bs [21:00] *** arlen has quit IRC (arlen) [21:02] *** levelch has joined #archiveteam-bs [21:30] *** schbirid has quit IRC (Remote host closed the connection) [21:33] *** riley has joined #archiveteam-bs [21:54] *** arlen has joined #archiveteam-bs [21:54] *** Dj-Wawa has joined #archiveteam-bs [21:57] yipdw: you breaking the internet again with your Git repo of EEEEs [21:58] https://news.ycombinator.com/item?id=18655936 [22:14] *** Stilett0 has joined #archiveteam-bs [22:14] *** Gfy has joined #archiveteam-bs [22:14] is there a wiki page or something on scaling warrior? It's not getting anywhere near saturating my connection, but is using 372/400mb of ram, and is only running 2 items instead of the configured 6 (needs restart?) [22:14] also, do I need to expand the disk or anything if I expect it to grab over 60gb? [22:17] *** Stiletto has quit IRC (Ping timeout: 492 seconds) [22:18] *** DarkWorld has quit IRC (Ping timeout: 600 seconds) [22:18] riley: if you click "shutdown the warrior" and then click "keep running" it will run more items [22:19] cool, ty [22:19] *** DarkWorld has joined #archiveteam-bs [22:19] idk about the scalling/performance issues tho [22:28] *** BlueMax has joined #archiveteam-bs [22:30] scaling* [22:48] So, I don't know where all of the site data went. [22:48] For VC sites, like https://www.vc.edu/ [22:50] 20000 students wihout enrollment... Wow. That's really bad. [22:56] I think the topic for #archiveteam should be more specific. [22:57] *** Mateon1 has quit IRC (Read error: Operation timed out) [22:57] *** Mateon1 has joined #archiveteam-bs [23:04] hard to do with 160 characters [23:04] nobody reads topics anyway [23:06] *** arlen has quit IRC (arlen) [23:07] teej_: Re main channel, sorry, I should've been more specific. Only major sites should be mentioned there, not every little thing shutting down. The latter are still worth archiving, but can just be added to ArchiveBot without announcing it to all of ArchiveTeam since they're generally not that important. [23:13] okay, next q: if I'm hoping to permanently kill the VM to just use the docker containers, is there a "stop getting projects just upload the completed ones" function, or do jobs get requeued if completed but not uploaded after some time? [23:17] riley: I think there are some misconceptions here. Your VM claims items, then works on them. When they're done, it uploads the file and tells the tracker about it. At that point, everything's done, and all data is deleted from the VM. [23:19] So what you can do is stop the VM gracefully, i.e. let it finish processing the items it's already doing. I'm not sure exactly how to do that with the warrior VM though; you'll have to wait for someone else for that. [23:19] Or you can just kill the VM, which means that all progress made on those items will be lost. [23:20] They'll get requeued eventually (not automatically though, only manually). [23:20] so i got a new chair for christmas [23:21] its marketed as a gaming chair [23:28] Ahh, I assumed there was a separate upload queue or something [23:28] I tried to set the job cap to 0 but it requires 1<=x<=6 [23:28] Nice godane but Christmas Day isn’t here yet [23:29] Riley if you hit the shutdown button once on the web Interface it finishes what it’s working on and shuts down [23:29] ohh cool, ty [23:30] it was too big to hide [23:30] my brother needed help getting it out of the truck also [23:32] *** ats has joined #archiveteam-bs [23:39] *** hook54321 has joined #archiveteam-bs