[00:01] *** WIDOW has left [00:07] *** godane has quit IRC (Quit: Leaving.) [00:12] tammy_: I'm off to bed. Let me know if you have questions or encounter any problems. (I'll read the logs.) [00:12] JAA: when installing wpull: !!! WARNING !!! The Trollius project is now deprecated! [00:12] Hah, talk about timing. [00:12] my skeptisism levels are over 9000 [00:12] :) [00:15] *** godane has joined #archiveteam-bs [00:15] Yeah, I think I had that as well. Trollius was replaced in version 2.0, but that's buggy. I think you can just ignore it. [00:16] so just create script.py in my mounted array folder and run the command in gistfile1.txt ? [00:16] Yep [00:25] JAA: it's going to town [00:26] Nice! [00:29] incoming rate: 5145 kbps [00:29] bouncing lots [00:31] Did you keep the concurrency and wait values from my command? [00:31] yeah, I left it all alone [00:33] I got 800 kB/s in my test earlier. Some 'Connection closed', but not too many. (And wpull will retry those at the end anyway.) [00:33] oh good, cause I'm seeing some connection closed's as well [00:37] Alright, really off to bed now, cya tomorrow [00:37] see ya [00:38] *** JAA has quit IRC (Quit: Page closed) [01:23] *** chfoo has quit IRC (Read error: Operation timed out) [01:24] *** Meroje has quit IRC (Ping timeout: 260 seconds) [01:28] *** chfoo has joined #archiveteam-bs [01:37] *** Meroje has joined #archiveteam-bs [01:38] *** kristian_ has quit IRC (Quit: Leaving) [01:41] *** pizzaiolo has left [03:09] *** icedice has quit IRC (Quit: Leaving) [04:23] *** DopefishJ has joined #archiveteam-bs [04:24] *** DFJustin has quit IRC (Read error: Operation timed out) [04:26] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:32] *** Sk1d has joined #archiveteam-bs [04:32] *** Sk1d has quit IRC (Connection closed) [04:34] *** Sk1d has joined #archiveteam-bs [04:34] *** Sk1d has quit IRC (Connection Closed) [05:15] *** woktenna has left Leaving [07:00] *** wp494 has quit IRC (Read error: Connection reset by peer) [07:09] *** schbirid has joined #archiveteam-bs [07:25] *** wp494 has joined #archiveteam-bs [07:40] *** Jonison has joined #archiveteam-bs [07:49] *** odemg has quit IRC (Remote host closed the connection) [08:33] *** GE has joined #archiveteam-bs [09:30] *** BlueMaxim has quit IRC (Read error: Operation timed out) [09:32] *** BlueMaxim has joined #archiveteam-bs [09:42] *** BlueMaxim has quit IRC (Quit: Leaving) [09:53] *** GE has quit IRC (Remote host closed the connection) [10:40] *** odemg has joined #archiveteam-bs [11:25] *** Boppen has quit IRC (Ping timeout: 194 seconds) [11:27] *** GE has joined #archiveteam-bs [12:01] *** godane has quit IRC (Quit: Leaving.) [12:02] *** godane has joined #archiveteam-bs [12:04] *** pizzaiolo has joined #archiveteam-bs [12:08] *** bsmith093 has quit IRC (Ping timeout: 250 seconds) [13:49] someone run this [13:49] wget http://datahoarder2.eieidoh.net:2052/contact/chaturbate_links_13Apr.txt && cat chaturbate_links_13Apr.txt | parallel --jobs 8 'wget -m -np -c -U "DataHoarder:$(date +%s)" --reject "index.html*" {}' [13:50] uh [13:50] are you trying to get a mirror or smth? [13:51] yeah, just writing up release for r/Datahoarder /contact is 7TB the video content is 1.7PB [13:59] *** Stilett0 is now known as Stiletto [14:14] *** kniffy has quit IRC (Quit: --) [14:18] *** fie has quit IRC (Read error: Connection reset by peer) [14:27] odemg: where do you get all this storage? [14:31] *** fie has joined #archiveteam-bs [14:32] *** pnJay has joined #archiveteam-bs [14:35] -rw-r--r-- 1 root root 576594901908 Apr 11 05:31 2017-04-10.download.nvidia.com.zip [14:35] -rw-r--r-- 1 root root 17268187 Apr 13 14:29 2017-04-10.download.nvidia.com.zip.txt [14:35] ha HA [14:42] sexy [14:51] https://groups.google.com/forum/#!topic/phantomjs/9aI5d-LDuNE [14:52] looks like the maintainer of phantomjs is stepping down [14:57] *** kniffy has joined #archiveteam-bs [15:00] *** kristian_ has joined #archiveteam-bs [15:10] that was a matter of time, really [15:39] Kaz, can we give it to archivebot? [15:40] turns out i can only keep it online for the month [15:53] *** Jonison has quit IRC (Read error: Connection reset by peer) [16:19] *** Boppen has joined #archiveteam-bs [16:34] sounds too big [16:34] *** DopefishJ is now known as DFJustin [16:35] *** Smiley has quit IRC (Read error: Connection reset by peer) [16:35] *** ndiddy has joined #archiveteam-bs [16:35] *** Smiley has joined #archiveteam-bs [16:36] also there's not much value in warcing temporary URLs like that, it would be better to upload to IA as items [16:50] DFJustin, how do i automate getting 7tb into ia [16:51] 100,000's of files [16:53] *** odemg2 has joined #archiveteam-bs [16:55] DFJustin, that's the only thing holding me back pushing to ia is i want to set and forget [17:03] *** kristian_ has quit IRC (Quit: Leaving) [17:03] *** odemg has quit IRC (Ping timeout: 633 seconds) [17:06] *** pizzaiolo has quit IRC (Ping timeout: 255 seconds) [17:08] *** pizzaiolo has joined #archiveteam-bs [17:13] https://internetarchive.readthedocs.io/en/latest/cli.html#upload [17:14] it's more work but I just did an archivebot job that blew up after 50gb so there's no way 7tb is in the cards [17:17] alternatively you can set up your own archivebot locally https://github.com/ludios/grab-site [17:19] hmm I guess that doesn't have the auto-uploader piece [17:22] nope [17:23] is there a oneliner to use on a dir with python ia? [17:26] IA will accept a .csv so maybe that will do what you want? [17:28] yeah I looked at the .csv format and I'm not a fan of manually writing shit in and I'm too high to figure out how I'd ls/tree > csv [17:28] why is there a 2 after my name [17:53] You're twice the man the rest of us are [17:54] except for HCross2 and hook54321 [17:55] Mainly because I can't be bothered to RDP into my server atm [17:55] odemg2: you pinged out (connection died silently), you could /nick odemg back to it [17:55] impressive collection! [17:55] *** odemg2 is now known as odemg [18:15] *** yuitimoth has quit IRC (Ping timeout: 260 seconds) [18:21] *** yuitimoth has joined #archiveteam-bs [18:41] *** GE has quit IRC (Remote host closed the connection) [18:47] *** signius has joined #archiveteam-bs [18:48] *** signius has quit IRC (Client Quit) [18:59] *** signius has joined #archiveteam-bs [19:27] *** icedice has joined #archiveteam-bs [20:01] *** C4K3_ has joined #archiveteam-bs [20:03] *** C4K3 has quit IRC (Read error: Operation timed out) [20:05] *** zino has quit IRC (Remote host closed the connection) [20:12] *** GE has joined #archiveteam-bs [20:17] *** VeganMars has quit IRC (Quit: ZNC - http://znc.in) [20:18] *** VeganMars has joined #archiveteam-bs [20:23] *** signius has quit IRC (Leaving) [20:25] *** C4K3_ is now known as C4K3 [20:47] *** pnJay has quit IRC (Quit: Leaving) [20:53] SketchCow: https://www.dropbox.com/s/pw9kl909dxtk5l9/arcade%20asset%20holders.txt?dl=0 [20:54] and https://twitter.com/JohnAndersen21/status/851151734319853568 [20:54] who owns what IP in the arcade/video game world is a fucking mess [21:00] https://www.reddit.com/r/DataHoarder/comments/6583s2/the_petabyte_porn_problem_public_webcam_social [21:14] That is a messy and complicated document [21:14] Also, lists Nintendo as "does not care" and definitely cares [21:14] Was going to put this into the MAME documentation myself, based on takedowns [21:14] #2: JUNE 1984. [21:15] *** pizzaiol1 has joined #archiveteam-bs [21:19] *** pizzaiolo has quit IRC (Read error: Operation timed out) [21:20] wait a sec, why is recommended project ipernity when it's currently stalled out due to a wave of 403s [21:21] and URLTeam seems to be chugging along fine [21:35] *** schbirid has quit IRC (Quit: Leaving) [21:42] *** antomatic has quit IRC (Ping timeout: 250 seconds) [21:43] SketchCow: lemme add that then [21:44] SketchCow: updated [21:45] SketchCow: i'd love to add your version of to MAME docs if you submit a pr [21:45] i'm also guessing bandai-namco cares due to pac man, but i don't recall any mention of that by you [22:02] *** antomatic has joined #archiveteam-bs [22:05] *** GE has quit IRC (Remote host closed the connection) [22:08] *** pizzaiol1 has quit IRC (Ping timeout: 260 seconds) [22:09] *** pizzaiolo has joined #archiveteam-bs [22:21] *** htw has quit IRC (Quit.) [22:21] *** htw has joined #archiveteam-bs [22:21] *** htw has quit IRC (Client Quit) [22:22] *** htw has joined #archiveteam-bs [22:22] *** htw has quit IRC (Client Quit) [22:38] *** RichardG has quit IRC (Read error: Connection reset by peer) [22:39] *** RichardG has joined #archiveteam-bs [22:45] *** Stiletto has quit IRC (Ping timeout: 260 seconds) [22:50] *** htw has joined #archiveteam-bs [22:52] *** htw has quit IRC (Client Quit) [22:52] *** htw has joined #archiveteam-bs [23:18] *** Stilett0 has joined #archiveteam-bs [23:37] *** BlueMaxim has joined #archiveteam-bs [23:49] *** Odd0002 has joined #archiveteam-bs [23:49] port forwarding is running but the "server" is giving me no data [23:50] Odd0002: if possible, set the adapter to bridge mode, so it gets its own IP on the network [23:52] *** RichardG_ has joined #archiveteam-bs [23:52] even running wget localhost:8001 inside the VM responds with "HTTP request sent, awaiting response... No data received." [23:54] *** RichardG has quit IRC (Ping timeout: 370 seconds) [23:55] no, even when it gets its own IP, http://192.168.1.25:8001/ still says that no data is being sent