Time |
Nickname |
Message |
00:00
🔗
|
JesseW |
The prefix seems to be tott: |
00:06
🔗
|
JesseW |
chfoo: this may be useful https://github.com/asit-dhal/redis-dump-and-load |
00:13
🔗
|
chfoo |
JesseW: ok, i got that working: https://tracker.archiveteam.org/~chfoo/secret/redis_tott_dump.gz |
00:14
🔗
|
JesseW |
got it, thanks |
00:17
🔗
|
JesseW |
and successfully loaded, thanks |
00:18
🔗
|
JesseW |
feel free to take down the file now if you'd prefer |
01:46
🔗
|
bwn |
sorry can't help myself, jessew: rofl in bs |
01:47
🔗
|
JesseW |
bwn: ? |
01:47
🔗
|
bwn |
i don't know why but your last message and the silence in -bs cracked me up |
01:47
🔗
|
bwn |
sorry, heh |
01:48
🔗
|
JesseW |
np. glad you enjoyed it |
02:37
🔗
|
|
bwn has quit IRC (Ping timeout: 492 seconds) |
04:52
🔗
|
|
bwn has joined #urlteam |
04:59
🔗
|
JesseW |
We're up to March 2015 on migre.me! |
05:00
🔗
|
JesseW |
Close to just a year behind! |
06:11
🔗
|
|
GLaDOS has quit IRC (Read error: Connection reset by peer) |
06:15
🔗
|
|
GLaDOS has joined #urlteam |
06:51
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
07:46
🔗
|
|
bwn has quit IRC (Ping timeout: 492 seconds) |
08:37
🔗
|
|
bwn has joined #urlteam |
11:14
🔗
|
|
mksplg has quit IRC (WeeChat 0.4.2) |
13:20
🔗
|
|
WinterFox has quit IRC (Remote host closed the connection) |
13:42
🔗
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
13:46
🔗
|
|
GLaDOS has joined #urlteam |
15:35
🔗
|
|
Mayonaise has quit IRC (ircd.choopa.net irc.choopa.net) |
15:42
🔗
|
|
Mayonaise has joined #urlteam |
15:52
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
15:55
🔗
|
|
Start has joined #urlteam |
16:00
🔗
|
|
JesseW has joined #urlteam |
16:13
🔗
|
|
Mayonaise has quit IRC (Read error: Operation timed out) |
17:02
🔗
|
|
Mayonaise has joined #urlteam |
17:40
🔗
|
|
Mayonaise has quit IRC (Ping timeout: 633 seconds) |
17:41
🔗
|
|
Mayonaise has joined #urlteam |
18:00
🔗
|
|
Mayonaise has quit IRC (Ping timeout: 633 seconds) |
18:46
🔗
|
|
dashcloud has quit IRC (Read error: Connection reset by peer) |
18:49
🔗
|
|
dashcloud has joined #urlteam |
18:49
🔗
|
|
svchfoo1 sets mode: +o dashcloud |
18:55
🔗
|
|
Mayonaise has joined #urlteam |
19:19
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
19:37
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
19:51
🔗
|
|
dashcloud has joined #urlteam |
19:52
🔗
|
|
svchfoo1 sets mode: +o dashcloud |
20:20
🔗
|
|
bwn has quit IRC (Ping timeout: 246 seconds) |
20:42
🔗
|
|
JesseW has joined #urlteam |
20:55
🔗
|
|
bwn has joined #urlteam |
21:57
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
22:01
🔗
|
|
dashcloud has joined #urlteam |
22:01
🔗
|
|
svchfoo1 sets mode: +o dashcloud |
22:52
🔗
|
|
ranma has joined #urlteam |
22:52
🔗
|
ranma |
is the URLTeam 2 project expected to use almost no hdd space? |
22:52
🔗
|
JesseW |
yeah, URLs aren't that big |
22:53
🔗
|
JesseW |
and it only loads about 50 before sending them up to the staging server |
22:53
🔗
|
ranma |
ah kk |
22:54
🔗
|
JesseW |
ranma: if you're interested, we can always use help investigating more shorteners; see http://archiveteam.org/index.php?title=URLTeam for details. |
22:54
🔗
|
ranma |
i got inspired to grab archive team warrior after seeing the defcon video |
22:54
🔗
|
JesseW |
awesome, welcome! |
22:54
🔗
|
ranma |
but sadly not enough space for mass downloading projects :( |
22:54
🔗
|
JesseW |
eh, URLTeam still loves you. :-) |
22:54
🔗
|
JesseW |
we'll take all sorts |
22:55
🔗
|
JesseW |
but even the mass downloading projects don't use a whole lot |
22:55
🔗
|
ranma |
i heard the VM is set for 60GB? |
22:55
🔗
|
JesseW |
yeah, I think so |
22:55
🔗
|
bwn |
i think 60G is the data partition for the vm |
22:55
🔗
|
JesseW |
I suppose that can be seen as a large amount in some senses. :-) |
22:55
🔗
|
ranma |
i've gone all ssd for silence reasons and am not rich, so only have a teeny half tb ssd |
22:56
🔗
|
JesseW |
well, that's still 500GB -- 60 shouldn't be too painful. :-) |
22:56
🔗
|
ranma |
o |
22:56
🔗
|
ranma |
i'm a data hoarder |
22:56
🔗
|
ranma |
so it would take a lot of organizing x) |
22:56
🔗
|
JesseW |
*ah*, that could be more of an issue, yeah |
22:57
🔗
|
bwn |
you and me both |
22:57
🔗
|
ranma |
the ever "5gb free"-itis :D |
22:57
🔗
|
JesseW |
offline storage? |
22:58
🔗
|
ranma |
moved in with roomies and have a small room, so my small fileserver isn't up |
22:58
🔗
|
JesseW |
well, it's all helpful |
22:59
🔗
|
ranma |
might look into freeing space, tho |
22:59
🔗
|
JesseW |
BTW, if you are hording anything that is legal, do dump a copy on IA if it isn't already there |
22:59
🔗
|
JesseW |
i.e. creative commons licensed stuff, etc |
22:59
🔗
|
JesseW |
or public domain |
23:00
🔗
|
ranma |
it's interesting Adam Curtis blessed them with a docu or two of his |
23:00
🔗
|
JesseW |
hm, not familiar with the name |
23:00
🔗
|
ranma |
BBC/less than 15 years old content |
23:00
🔗
|
ranma |
he does documentaries |
23:00
🔗
|
JesseW |
hm |
23:00
🔗
|
ranma |
https://en.wikipedia.org/wiki/Adam_Curtis |
23:01
🔗
|
ranma |
interesting, at least to me |
23:01
🔗
|
JesseW |
yeah, looks neta |
23:01
🔗
|
JesseW |
er, neat |
23:02
🔗
|
ranma |
sadly, i don't have access to PD stuff |
23:03
🔗
|
ranma |
tho a friend of a friend has a facebook group that discusses/links public domain stuff |
23:03
🔗
|
JesseW |
well, you have access to lots (much of it on IA), but I presume you meant access to not-already-digitalized stuff :-) |
23:04
🔗
|
ranma |
oh, was just thinking digitized |
23:05
🔗
|
JesseW |
Well, you (and everyone else) certainly have access to a whole lot of that. |
23:05
🔗
|
JesseW |
Project Gutenberg, Wikimedia Commons, IA, etc. |
23:06
🔗
|
ranma |
yeah, when i jailbroke my psp, first thing i did was downloaded Alice in Wonderland from Project Gutenberg |
23:06
🔗
|
JesseW |
nice |
23:06
🔗
|
JesseW |
the equivalent of calculating digits of pi on a new processor chip |
23:07
🔗
|
bwn |
jesseW: speaking of offline storage, i have a set of 24" hard drive platters circa ~1970s that has ~200MB of _something_ on it |
23:07
🔗
|
JesseW |
whew... |
23:08
🔗
|
JesseW |
bwn: How close are you to San Francisco? |
23:08
🔗
|
bwn |
can't remember where i picked it up, might not be anything |
23:08
🔗
|
ranma |
hah |
23:08
🔗
|
ranma |
Stephen Fry just showed a platter that held 8MB |
23:08
🔗
|
bwn |
i'm about 2 hours out, i don't know if it's worth anyone's time though, heh |
23:09
🔗
|
ranma |
http://imgur.com/rN5Q9oX |
23:09
🔗
|
ranma |
http://imgur.com/Hf2DuLB |
23:09
🔗
|
JesseW |
A 2 hour drive? You bet it's worth someones time. Please *do* email SketchCow & info@archive.org and offer it. |
23:09
🔗
|
ranma |
http://imgur.com/icaw0pI |
23:10
🔗
|
JesseW |
ranma: that last one is ... impressive. |
23:11
🔗
|
bwn |
yeah, that's a large platter |
23:13
🔗
|
bwn |
jessew: i will, if they're interested it's all theirs.. i could always try to drop it off next time i'm down that way |
23:15
🔗
|
bwn |
i had never really thought about it since i'm not sure of the condition and what/if anything is on there |
23:15
🔗
|
JesseW |
great! Do check ahead of time, and any information you can remember about where you got it would certainly be welcome -- but I'm pretty certain they'll know someone who will know someone who will be delighted to work on getting the data off it. |
23:15
🔗
|
ranma |
btw, the archive team warrior wouldn't let me connect to localhost:8001 |
23:16
🔗
|
JesseW |
hm, that's odd |
23:16
🔗
|
ranma |
would that probably be because i had another vm running? |
23:16
🔗
|
JesseW |
probably? |
23:16
🔗
|
JesseW |
ask in #warrior |
23:16
🔗
|
ranma |
i ended up resorting to nmapping myself |
23:16
🔗
|
ranma |
as they didn't show on router |
23:17
🔗
|
ranma |
will ask maybe later |
23:17
🔗
|
JesseW |
yeah, if you've got it solved, no hurry |
23:21
🔗
|
ranma |
why does it say i'm downloading 3MB/sec? |
23:21
🔗
|
bwn |
you might need to connect through the ip if the port forwarding setup doesn't like the vm settings? |
23:21
🔗
|
ranma |
or uploading |
23:22
🔗
|
ranma |
or is that the entire project? |
23:23
🔗
|
ranma |
must be project |
23:44
🔗
|
ranma |
do any of you guys do the other archiving projects? |
23:45
🔗
|
bwn |
i've been running google code and pdfflush lately |
23:45
🔗
|
ranma |
just wondering if it notably slows down a standard cable internet connection |
23:46
🔗
|
ranma |
er the other archive team warrior projects |
23:47
🔗
|
bwn |
you should be alright as long as you keep the concurrency down, it also depends on the project |
23:49
🔗
|
ranma |
oh, heh, i think i found 60gb |
23:49
🔗
|
ranma |
copied, but didn't get around to transcoding Generation Kill blurays |
23:50
🔗
|
bwn |
setting multiple rsync threads can probably saturate your link through |
23:50
🔗
|
bwn |
s/through/though |
23:52
🔗
|
ranma |
lol, this is going to take me forever to get anywhere on a leaderboard |
23:52
🔗
|
ranma |
does johtso have a crapton of boxes? |
23:52
🔗
|
ranma |
and ip addresses |
23:55
🔗
|
Frogging |
probably |
23:56
🔗
|
|
SimpBrain has quit IRC (Ping timeout: 244 seconds) |
23:56
🔗
|
|
SimpBrain has joined #urlteam |
23:56
🔗
|
ranma |
aha |
23:56
🔗
|
ranma |
http://archiveteam.org/index.php?title=ArchiveTeam_Warrior#Help.21_The_warrior_is_eating_all_my_bandwidth.21 |
23:57
🔗
|
JesseW |
the wiki just died, so I can't see that URL. :-( |
23:58
🔗
|
Frogging |
I find my bottleneck with this is not having enough jobs from the tracker for the hosts I do have running. Probably johtso's and his army is eating all the jobs |
23:58
🔗
|
ranma |
Help! The warrior is eating all my bandwidth! |
23:58
🔗
|
ranma |
You can limit the warrior's bandwidth quite easily for VirtualBox as long as you are running a relatively recent version. The option is not offered with a GUI however. |
23:58
🔗
|
ranma |
VBoxManage bandwidthctl archiveteam-warrior-2 add netlimit --type network --limit 3 |
23:58
🔗
|
ranma |
will limit the warrior instance called archiveteam-warrior-2 (the default name of the warrior vm currently) to 3Mb/s. Adjust as needed. (limit units: k=kilobit, m=megabit, g=gigabit, K=kilobyte, M=megabyte, G=gigabyte) |
23:59
🔗
|
JesseW |
johtso and BnA-Rob1n are the folks currently running giant firehoses. Atluxity used to, but isn't right now. If you want more jobs, just investigate more shorteners, and I'll gladly add them. :-) |
23:59
🔗
|
JesseW |
You can extend the size of the leaderboard to see yourself. |