[00:00] The prefix seems to be tott: [00:06] chfoo: this may be useful https://github.com/asit-dhal/redis-dump-and-load [00:13] JesseW: ok, i got that working: https://tracker.archiveteam.org/~chfoo/secret/redis_tott_dump.gz [00:14] got it, thanks [00:17] and successfully loaded, thanks [00:18] feel free to take down the file now if you'd prefer [01:46] sorry can't help myself, jessew: rofl in bs [01:47] bwn: ? [01:47] i don't know why but your last message and the silence in -bs cracked me up [01:47] sorry, heh [01:48] np. glad you enjoyed it [02:37] *** bwn has quit IRC (Ping timeout: 492 seconds) [04:52] *** bwn has joined #urlteam [04:59] We're up to March 2015 on migre.me! [05:00] Close to just a year behind! [06:11] *** GLaDOS has quit IRC (Read error: Connection reset by peer) [06:15] *** GLaDOS has joined #urlteam [06:51] *** JesseW has quit IRC (Read error: Operation timed out) [07:46] *** bwn has quit IRC (Ping timeout: 492 seconds) [08:37] *** bwn has joined #urlteam [11:14] *** mksplg has quit IRC (WeeChat 0.4.2) [13:20] *** WinterFox has quit IRC (Remote host closed the connection) [13:42] *** GLaDOS has quit IRC (Quit: Oh crap, I died.) [13:46] *** GLaDOS has joined #urlteam [15:35] *** Mayonaise has quit IRC (ircd.choopa.net irc.choopa.net) [15:42] *** Mayonaise has joined #urlteam [15:52] *** Start has quit IRC (Quit: Disconnected.) [15:55] *** Start has joined #urlteam [16:00] *** JesseW has joined #urlteam [16:13] *** Mayonaise has quit IRC (Read error: Operation timed out) [17:02] *** Mayonaise has joined #urlteam [17:40] *** Mayonaise has quit IRC (Ping timeout: 633 seconds) [17:41] *** Mayonaise has joined #urlteam [18:00] *** Mayonaise has quit IRC (Ping timeout: 633 seconds) [18:46] *** dashcloud has quit IRC (Read error: Connection reset by peer) [18:49] *** dashcloud has joined #urlteam [18:49] *** svchfoo1 sets mode: +o dashcloud [18:55] *** Mayonaise has joined #urlteam [19:19] *** JesseW has quit IRC (Ping timeout: 370 seconds) [19:37] *** dashcloud has quit IRC (Read error: Operation timed out) [19:51] *** dashcloud has joined #urlteam [19:52] *** svchfoo1 sets mode: +o dashcloud [20:20] *** bwn has quit IRC (Ping timeout: 246 seconds) [20:42] *** JesseW has joined #urlteam [20:55] *** bwn has joined #urlteam [21:57] *** dashcloud has quit IRC (Read error: Operation timed out) [22:01] *** dashcloud has joined #urlteam [22:01] *** svchfoo1 sets mode: +o dashcloud [22:52] *** ranma has joined #urlteam [22:52] is the URLTeam 2 project expected to use almost no hdd space? [22:52] yeah, URLs aren't that big [22:53] and it only loads about 50 before sending them up to the staging server [22:53] ah kk [22:54] ranma: if you're interested, we can always use help investigating more shorteners; see http://archiveteam.org/index.php?title=URLTeam for details. [22:54] i got inspired to grab archive team warrior after seeing the defcon video [22:54] awesome, welcome! [22:54] but sadly not enough space for mass downloading projects :( [22:54] eh, URLTeam still loves you. :-) [22:54] we'll take all sorts [22:55] but even the mass downloading projects don't use a whole lot [22:55] i heard the VM is set for 60GB? [22:55] yeah, I think so [22:55] i think 60G is the data partition for the vm [22:55] I suppose that can be seen as a large amount in some senses. :-) [22:55] i've gone all ssd for silence reasons and am not rich, so only have a teeny half tb ssd [22:56] well, that's still 500GB -- 60 shouldn't be too painful. :-) [22:56] o [22:56] i'm a data hoarder [22:56] so it would take a lot of organizing x) [22:56] *ah*, that could be more of an issue, yeah [22:57] you and me both [22:57] the ever "5gb free"-itis :D [22:57] offline storage? [22:58] moved in with roomies and have a small room, so my small fileserver isn't up [22:58] well, it's all helpful [22:59] might look into freeing space, tho [22:59] BTW, if you are hording anything that is legal, do dump a copy on IA if it isn't already there [22:59] i.e. creative commons licensed stuff, etc [22:59] or public domain [23:00] it's interesting Adam Curtis blessed them with a docu or two of his [23:00] hm, not familiar with the name [23:00] BBC/less than 15 years old content [23:00] he does documentaries [23:00] hm [23:00] https://en.wikipedia.org/wiki/Adam_Curtis [23:01] interesting, at least to me [23:01] yeah, looks neta [23:01] er, neat [23:02] sadly, i don't have access to PD stuff [23:03] tho a friend of a friend has a facebook group that discusses/links public domain stuff [23:03] well, you have access to lots (much of it on IA), but I presume you meant access to not-already-digitalized stuff :-) [23:04] oh, was just thinking digitized [23:05] Well, you (and everyone else) certainly have access to a whole lot of that. [23:05] Project Gutenberg, Wikimedia Commons, IA, etc. [23:06] yeah, when i jailbroke my psp, first thing i did was downloaded Alice in Wonderland from Project Gutenberg [23:06] nice [23:06] the equivalent of calculating digits of pi on a new processor chip [23:07] jesseW: speaking of offline storage, i have a set of 24" hard drive platters circa ~1970s that has ~200MB of _something_ on it [23:07] whew... [23:08] bwn: How close are you to San Francisco? [23:08] can't remember where i picked it up, might not be anything [23:08] hah [23:08] Stephen Fry just showed a platter that held 8MB [23:08] i'm about 2 hours out, i don't know if it's worth anyone's time though, heh [23:09] http://imgur.com/rN5Q9oX [23:09] http://imgur.com/Hf2DuLB [23:09] A 2 hour drive? You bet it's worth someones time. Please *do* email SketchCow & info@archive.org and offer it. [23:09] http://imgur.com/icaw0pI [23:10] ranma: that last one is ... impressive. [23:11] yeah, that's a large platter [23:13] jessew: i will, if they're interested it's all theirs.. i could always try to drop it off next time i'm down that way [23:15] i had never really thought about it since i'm not sure of the condition and what/if anything is on there [23:15] great! Do check ahead of time, and any information you can remember about where you got it would certainly be welcome -- but I'm pretty certain they'll know someone who will know someone who will be delighted to work on getting the data off it. [23:15] btw, the archive team warrior wouldn't let me connect to localhost:8001 [23:16] hm, that's odd [23:16] would that probably be because i had another vm running? [23:16] probably? [23:16] ask in #warrior [23:16] i ended up resorting to nmapping myself [23:16] as they didn't show on router [23:17] will ask maybe later [23:17] yeah, if you've got it solved, no hurry [23:21] why does it say i'm downloading 3MB/sec? [23:21] you might need to connect through the ip if the port forwarding setup doesn't like the vm settings? [23:21] or uploading [23:22] or is that the entire project? [23:23] must be project [23:44] do any of you guys do the other archiving projects? [23:45] i've been running google code and pdfflush lately [23:45] just wondering if it notably slows down a standard cable internet connection [23:46] er the other archive team warrior projects [23:47] you should be alright as long as you keep the concurrency down, it also depends on the project [23:49] oh, heh, i think i found 60gb [23:49] copied, but didn't get around to transcoding Generation Kill blurays [23:50] setting multiple rsync threads can probably saturate your link through [23:50] s/through/though [23:52] lol, this is going to take me forever to get anywhere on a leaderboard [23:52] does johtso have a crapton of boxes? [23:52] and ip addresses [23:55] probably [23:56] *** SimpBrain has quit IRC (Ping timeout: 244 seconds) [23:56] *** SimpBrain has joined #urlteam [23:56] aha [23:56] http://archiveteam.org/index.php?title=ArchiveTeam_Warrior#Help.21_The_warrior_is_eating_all_my_bandwidth.21 [23:57] the wiki just died, so I can't see that URL. :-( [23:58] I find my bottleneck with this is not having enough jobs from the tracker for the hosts I do have running. Probably johtso's and his army is eating all the jobs [23:58] Help! The warrior is eating all my bandwidth! [23:58] You can limit the warrior's bandwidth quite easily for VirtualBox as long as you are running a relatively recent version. The option is not offered with a GUI however. [23:58] VBoxManage bandwidthctl archiveteam-warrior-2 add netlimit --type network --limit 3 [23:58] will limit the warrior instance called archiveteam-warrior-2 (the default name of the warrior vm currently) to 3Mb/s. Adjust as needed. (limit units: k=kilobit, m=megabit, g=gigabit, K=kilobyte, M=megabyte, G=gigabyte) [23:59] johtso and BnA-Rob1n are the folks currently running giant firehoses. Atluxity used to, but isn't right now. If you want more jobs, just investigate more shorteners, and I'll gladly add them. :-) [23:59] You can extend the size of the leaderboard to see yourself.