#urlteam 2016-04-10,Sun

↑back Search

Time Nickname Message
00:00 🔗 JesseW The prefix seems to be tott:
00:06 🔗 JesseW chfoo: this may be useful https://github.com/asit-dhal/redis-dump-and-load
00:13 🔗 chfoo JesseW: ok, i got that working: https://tracker.archiveteam.org/~chfoo/secret/redis_tott_dump.gz
00:14 🔗 JesseW got it, thanks
00:17 🔗 JesseW and successfully loaded, thanks
00:18 🔗 JesseW feel free to take down the file now if you'd prefer
01:46 🔗 bwn sorry can't help myself, jessew: rofl in bs
01:47 🔗 JesseW bwn: ?
01:47 🔗 bwn i don't know why but your last message and the silence in -bs cracked me up
01:47 🔗 bwn sorry, heh
01:48 🔗 JesseW np. glad you enjoyed it
02:37 🔗 bwn has quit IRC (Ping timeout: 492 seconds)
04:52 🔗 bwn has joined #urlteam
04:59 🔗 JesseW We're up to March 2015 on migre.me!
05:00 🔗 JesseW Close to just a year behind!
06:11 🔗 GLaDOS has quit IRC (Read error: Connection reset by peer)
06:15 🔗 GLaDOS has joined #urlteam
06:51 🔗 JesseW has quit IRC (Read error: Operation timed out)
07:46 🔗 bwn has quit IRC (Ping timeout: 492 seconds)
08:37 🔗 bwn has joined #urlteam
11:14 🔗 mksplg has quit IRC (WeeChat 0.4.2)
13:20 🔗 WinterFox has quit IRC (Remote host closed the connection)
13:42 🔗 GLaDOS has quit IRC (Quit: Oh crap, I died.)
13:46 🔗 GLaDOS has joined #urlteam
15:35 🔗 Mayonaise has quit IRC (ircd.choopa.net irc.choopa.net)
15:42 🔗 Mayonaise has joined #urlteam
15:52 🔗 Start has quit IRC (Quit: Disconnected.)
15:55 🔗 Start has joined #urlteam
16:00 🔗 JesseW has joined #urlteam
16:13 🔗 Mayonaise has quit IRC (Read error: Operation timed out)
17:02 🔗 Mayonaise has joined #urlteam
17:40 🔗 Mayonaise has quit IRC (Ping timeout: 633 seconds)
17:41 🔗 Mayonaise has joined #urlteam
18:00 🔗 Mayonaise has quit IRC (Ping timeout: 633 seconds)
18:46 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
18:49 🔗 dashcloud has joined #urlteam
18:49 🔗 svchfoo1 sets mode: +o dashcloud
18:55 🔗 Mayonaise has joined #urlteam
19:19 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
19:37 🔗 dashcloud has quit IRC (Read error: Operation timed out)
19:51 🔗 dashcloud has joined #urlteam
19:52 🔗 svchfoo1 sets mode: +o dashcloud
20:20 🔗 bwn has quit IRC (Ping timeout: 246 seconds)
20:42 🔗 JesseW has joined #urlteam
20:55 🔗 bwn has joined #urlteam
21:57 🔗 dashcloud has quit IRC (Read error: Operation timed out)
22:01 🔗 dashcloud has joined #urlteam
22:01 🔗 svchfoo1 sets mode: +o dashcloud
22:52 🔗 ranma has joined #urlteam
22:52 🔗 ranma is the URLTeam 2 project expected to use almost no hdd space?
22:52 🔗 JesseW yeah, URLs aren't that big
22:53 🔗 JesseW and it only loads about 50 before sending them up to the staging server
22:53 🔗 ranma ah kk
22:54 🔗 JesseW ranma: if you're interested, we can always use help investigating more shorteners; see http://archiveteam.org/index.php?title=URLTeam for details.
22:54 🔗 ranma i got inspired to grab archive team warrior after seeing the defcon video
22:54 🔗 JesseW awesome, welcome!
22:54 🔗 ranma but sadly not enough space for mass downloading projects :(
22:54 🔗 JesseW eh, URLTeam still loves you. :-)
22:54 🔗 JesseW we'll take all sorts
22:55 🔗 JesseW but even the mass downloading projects don't use a whole lot
22:55 🔗 ranma i heard the VM is set for 60GB?
22:55 🔗 JesseW yeah, I think so
22:55 🔗 bwn i think 60G is the data partition for the vm
22:55 🔗 JesseW I suppose that can be seen as a large amount in some senses. :-)
22:55 🔗 ranma i've gone all ssd for silence reasons and am not rich, so only have a teeny half tb ssd
22:56 🔗 JesseW well, that's still 500GB -- 60 shouldn't be too painful. :-)
22:56 🔗 ranma o
22:56 🔗 ranma i'm a data hoarder
22:56 🔗 ranma so it would take a lot of organizing x)
22:56 🔗 JesseW *ah*, that could be more of an issue, yeah
22:57 🔗 bwn you and me both
22:57 🔗 ranma the ever "5gb free"-itis :D
22:57 🔗 JesseW offline storage?
22:58 🔗 ranma moved in with roomies and have a small room, so my small fileserver isn't up
22:58 🔗 JesseW well, it's all helpful
22:59 🔗 ranma might look into freeing space, tho
22:59 🔗 JesseW BTW, if you are hording anything that is legal, do dump a copy on IA if it isn't already there
22:59 🔗 JesseW i.e. creative commons licensed stuff, etc
22:59 🔗 JesseW or public domain
23:00 🔗 ranma it's interesting Adam Curtis blessed them with a docu or two of his
23:00 🔗 JesseW hm, not familiar with the name
23:00 🔗 ranma BBC/less than 15 years old content
23:00 🔗 ranma he does documentaries
23:00 🔗 JesseW hm
23:00 🔗 ranma https://en.wikipedia.org/wiki/Adam_Curtis
23:01 🔗 ranma interesting, at least to me
23:01 🔗 JesseW yeah, looks neta
23:01 🔗 JesseW er, neat
23:02 🔗 ranma sadly, i don't have access to PD stuff
23:03 🔗 ranma tho a friend of a friend has a facebook group that discusses/links public domain stuff
23:03 🔗 JesseW well, you have access to lots (much of it on IA), but I presume you meant access to not-already-digitalized stuff :-)
23:04 🔗 ranma oh, was just thinking digitized
23:05 🔗 JesseW Well, you (and everyone else) certainly have access to a whole lot of that.
23:05 🔗 JesseW Project Gutenberg, Wikimedia Commons, IA, etc.
23:06 🔗 ranma yeah, when i jailbroke my psp, first thing i did was downloaded Alice in Wonderland from Project Gutenberg
23:06 🔗 JesseW nice
23:06 🔗 JesseW the equivalent of calculating digits of pi on a new processor chip
23:07 🔗 bwn jesseW: speaking of offline storage, i have a set of 24" hard drive platters circa ~1970s that has ~200MB of _something_ on it
23:07 🔗 JesseW whew...
23:08 🔗 JesseW bwn: How close are you to San Francisco?
23:08 🔗 bwn can't remember where i picked it up, might not be anything
23:08 🔗 ranma hah
23:08 🔗 ranma Stephen Fry just showed a platter that held 8MB
23:08 🔗 bwn i'm about 2 hours out, i don't know if it's worth anyone's time though, heh
23:09 🔗 ranma http://imgur.com/rN5Q9oX
23:09 🔗 ranma http://imgur.com/Hf2DuLB
23:09 🔗 JesseW A 2 hour drive? You bet it's worth someones time. Please *do* email SketchCow & info@archive.org and offer it.
23:09 🔗 ranma http://imgur.com/icaw0pI
23:10 🔗 JesseW ranma: that last one is ... impressive.
23:11 🔗 bwn yeah, that's a large platter
23:13 🔗 bwn jessew: i will, if they're interested it's all theirs.. i could always try to drop it off next time i'm down that way
23:15 🔗 bwn i had never really thought about it since i'm not sure of the condition and what/if anything is on there
23:15 🔗 JesseW great! Do check ahead of time, and any information you can remember about where you got it would certainly be welcome -- but I'm pretty certain they'll know someone who will know someone who will be delighted to work on getting the data off it.
23:15 🔗 ranma btw, the archive team warrior wouldn't let me connect to localhost:8001
23:16 🔗 JesseW hm, that's odd
23:16 🔗 ranma would that probably be because i had another vm running?
23:16 🔗 JesseW probably?
23:16 🔗 JesseW ask in #warrior
23:16 🔗 ranma i ended up resorting to nmapping myself
23:16 🔗 ranma as they didn't show on router
23:17 🔗 ranma will ask maybe later
23:17 🔗 JesseW yeah, if you've got it solved, no hurry
23:21 🔗 ranma why does it say i'm downloading 3MB/sec?
23:21 🔗 bwn you might need to connect through the ip if the port forwarding setup doesn't like the vm settings?
23:21 🔗 ranma or uploading
23:22 🔗 ranma or is that the entire project?
23:23 🔗 ranma must be project
23:44 🔗 ranma do any of you guys do the other archiving projects?
23:45 🔗 bwn i've been running google code and pdfflush lately
23:45 🔗 ranma just wondering if it notably slows down a standard cable internet connection
23:46 🔗 ranma er the other archive team warrior projects
23:47 🔗 bwn you should be alright as long as you keep the concurrency down, it also depends on the project
23:49 🔗 ranma oh, heh, i think i found 60gb
23:49 🔗 ranma copied, but didn't get around to transcoding Generation Kill blurays
23:50 🔗 bwn setting multiple rsync threads can probably saturate your link through
23:50 🔗 bwn s/through/though
23:52 🔗 ranma lol, this is going to take me forever to get anywhere on a leaderboard
23:52 🔗 ranma does johtso have a crapton of boxes?
23:52 🔗 ranma and ip addresses
23:55 🔗 Frogging probably
23:56 🔗 SimpBrain has quit IRC (Ping timeout: 244 seconds)
23:56 🔗 SimpBrain has joined #urlteam
23:56 🔗 ranma aha
23:56 🔗 ranma http://archiveteam.org/index.php?title=ArchiveTeam_Warrior#Help.21_The_warrior_is_eating_all_my_bandwidth.21
23:57 🔗 JesseW the wiki just died, so I can't see that URL. :-(
23:58 🔗 Frogging I find my bottleneck with this is not having enough jobs from the tracker for the hosts I do have running. Probably johtso's and his army is eating all the jobs
23:58 🔗 ranma Help! The warrior is eating all my bandwidth!
23:58 🔗 ranma You can limit the warrior's bandwidth quite easily for VirtualBox as long as you are running a relatively recent version. The option is not offered with a GUI however.
23:58 🔗 ranma VBoxManage bandwidthctl archiveteam-warrior-2 add netlimit --type network --limit 3
23:58 🔗 ranma will limit the warrior instance called archiveteam-warrior-2 (the default name of the warrior vm currently) to 3Mb/s. Adjust as needed. (limit units: k=kilobit, m=megabit, g=gigabit, K=kilobyte, M=megabyte, G=gigabyte)
23:59 🔗 JesseW johtso and BnA-Rob1n are the folks currently running giant firehoses. Atluxity used to, but isn't right now. If you want more jobs, just investigate more shorteners, and I'll gladly add them. :-)
23:59 🔗 JesseW You can extend the size of the leaderboard to see yourself.

irclogger-viewer