Time |
Nickname |
Message |
00:02
🔗
|
oli |
100mbpt |
00:02
🔗
|
oli |
but had 2 or 3 systems going at various times |
00:02
🔗
|
oli |
right now 3 at a time |
00:02
🔗
|
oli |
so about 300mbit :P |
00:05
🔗
|
Wyatt|Wor |
Aah, I see. Still that's some really good throughput. I've been getting...looks like about 500GB/week with my 100Mbit connection. |
00:07
🔗
|
oli |
not running 24/7 ? |
00:47
🔗
|
Wyatt|Wor |
No, running pretty much 24/7 with three clients. |
01:02
🔗
|
Coderjoe |
spending a lot of time waiting for wget to figure out what it wants to do |
01:03
🔗
|
AdamCaudi |
I really should invest in a faster vps for memac... |
01:11
🔗
|
oli |
yes overtook Coderjoe :D |
01:11
🔗
|
oli |
and hi underscor |
01:11
🔗
|
oli |
underscor: check status board, |
01:11
🔗
|
oli |
810GB here in 48 hours or something :p |
01:11
🔗
|
Coderjoe |
bastard. :P |
01:11
🔗
|
oli |
ahah |
01:11
🔗
|
Coderjoe |
woo |
01:12
🔗
|
oli |
i ordered another dedicated box but that prob wont be deployed till monday |
01:12
🔗
|
oli |
or tuesday if people are on holidays then i guess :( |
01:12
🔗
|
Coderjoe |
just a little too much capsaicin in that sub |
01:12
🔗
|
oli |
haha |
01:12
🔗
|
underscor |
hahaha |
01:13
🔗
|
oli |
btw for those running their own servers: EasterBunny2012 |
01:13
🔗
|
oli |
use that promocode with pingdom |
01:13
🔗
|
oli |
free business account for a year |
01:14
🔗
|
oli |
oh wait, appears it might be over :( |
01:14
🔗
|
Coderjoe |
bah |
01:14
🔗
|
Coderjoe |
freeze warning from the NWS |
01:14
🔗
|
oli |
NWS? |
01:15
🔗
|
Coderjoe |
national weather service |
02:03
🔗
|
DoubleJ |
Jeez. At this rate I'll be lucky to stay in the top ten. |
02:35
🔗
|
yipdw |
FYI, we're up and running in #fanfriction |
04:42
🔗
|
underscor |
I'M EIGHTEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEN |
04:42
🔗
|
underscor |
:D |
04:42
🔗
|
zgrant |
Many Happy Returns! Now get out there and vote. |
04:43
🔗
|
zgrant |
Also, Alice Coppers, "I"m 18", just sprang into my head. I'm much too old. |
04:44
🔗
|
underscor |
hahah |
04:44
🔗
|
underscor |
:D |
05:25
🔗
|
Wyatt|Wor |
If I kill one of these curl processes that's stuck in the giant retry loop, what happens? |
05:49
🔗
|
shaqfu |
underscor: 'grats; now go enlist :D |
05:49
🔗
|
shaqfu |
(kidding!) |
05:50
🔗
|
underscor |
haha |
05:50
🔗
|
underscor |
thanks |
05:51
🔗
|
chronomex |
shaqfu: no, it's a federal law that you have to ... |
05:51
🔗
|
shaqfu |
chronomex: For the draft, yeah |
05:51
🔗
|
chronomex |
yus |
05:51
🔗
|
shaqfu |
(don't get me started on the draft...) |
05:51
🔗
|
chronomex |
<3 |
05:52
🔗
|
shaqfu |
I think I'm the one person on the planet in favor of it |
05:54
🔗
|
shaqfu |
Oh, you can also own guns now! Depending on jurisdiction |
06:49
🔗
|
Coderjoe |
Wyatt|Wor: i think that the file(s) it is trying to upload never get uploaded and potentially marked as complete anyway |
06:51
🔗
|
Wyatt|Wor |
Ah. Because I've had it happen once before that it went through a hundred failures and then, as far as I could tell, after that it started a new curl process that worked fine on the first try. |
06:51
🔗
|
Wyatt|Wor |
Was it just a coincidence? |
06:51
🔗
|
Coderjoe |
alard would be able to tell you for certain |
07:18
🔗
|
Wyatt|Wor |
Are you still getting 503? Are we just hitting IA too hard? |
07:18
🔗
|
Coderjoe |
i'm not using s3 |
07:18
🔗
|
Wyatt|Wor |
Ah |
07:19
🔗
|
Coderjoe |
http://archive.org/catalog.php?history=1&identifier=archiveteam-mobileme-hero-444x |
07:19
🔗
|
Coderjoe |
the queue on that has dissipated, though |
07:19
🔗
|
Coderjoe |
still lists the "server readonly" item, though |
07:23
🔗
|
Wyatt|Wor |
Ah, I see, looks like I've got a job over here: http://archive.org/catalog.php?history=1&identifier=archiveteam-mobileme-hero-480x |
07:24
🔗
|
Wyatt|Wor |
I suppose it just got backed up. |
09:41
🔗
|
nitro2k01 |
In case anyone wants to help the world by reporting spam... http://www.youtube.com/watch?v=7NdGGU19M1M |
11:05
🔗
|
oli |
yes |
11:05
🔗
|
oli |
made it into top 10 |
11:05
🔗
|
oli |
lol |
11:40
🔗
|
oli |
wolkommen Woet |
11:41
🔗
|
Woet |
hello |
11:41
🔗
|
oli |
:D |
11:56
🔗
|
oli |
nice to have woet on board |
11:57
🔗
|
oli |
he is smasshing it |
12:02
🔗
|
Woet |
http://memac.heroku.com/ |
12:02
🔗
|
Woet |
am I doing it right? |
12:03
🔗
|
emijrp |
is there any documentation for doing trackers? |
12:09
🔗
|
oli |
woet yes you are :D |
12:16
🔗
|
alard |
emijrp: Doing trackers? |
12:16
🔗
|
emijrp |
that app Woet linked |
12:17
🔗
|
Woet |
emijrp: http://www.archiveteam.org/index.php?title=MobileMe |
12:19
🔗
|
alard |
emijrp: This one? https://github.com/ArchiveTeam/universal-tracker |
12:20
🔗
|
emijrp |
maybe |
12:21
🔗
|
alard |
Well, that's what memac, focity, splinder are running on. And the new fanfiction tracker. |
12:23
🔗
|
emijrp |
can it run in any server? |
12:23
🔗
|
alard |
Yes, if you can run a Ruby rack application. |
12:24
🔗
|
alard |
The live updates use node.js. The whole thing needs Redis. |
12:24
🔗
|
emijrp |
we need that thing in #wikiteam who can help? |
12:25
🔗
|
alard |
I could help you with the configuration. |
13:18
🔗
|
SketchCow |
I didn't run anything on Fortress for a day. |
13:18
🔗
|
SketchCow |
Within that say, 51% of the drive with mobileme sets filled. |
13:18
🔗
|
SketchCow |
So that... that's a party. |
13:20
🔗
|
SketchCow |
Actually, I forgot Fortunecity is on there. |
13:20
🔗
|
SketchCow |
That's the next question - curating Fortunecity. |
13:22
🔗
|
oli |
how're you SketchCow ? |
13:23
🔗
|
SketchCow |
They gotta put a valve on my sexy so it doesn't explode |
13:26
🔗
|
oli |
neat |
13:42
🔗
|
godane |
i found some good things when mirror pdfs from cpu magazine |
13:43
🔗
|
godane |
1. 2012 and 2011 pdf torrents maybe from cpu magazine |
13:43
🔗
|
godane |
same md5sum on may 2012 |
13:43
🔗
|
godane |
and one from 2011 |
13:45
🔗
|
godane |
2. cpu magazine website hosts 5 magazines |
13:46
🔗
|
godane |
comsumer electronics tips, first glimpse, pc today, smart computing, and refernce series |
13:46
🔗
|
godane |
*reference series |
13:57
🔗
|
SketchCow |
Boy, I wish instead of discussing ways to improve access to at-risk digital works and coming up with ways to spread the message on the need to back things up, this was a 24-hour anaemic version of #bookwarez |
14:05
🔗
|
SketchCow |
Also fun: I think we're breaking archive.org's s3 |
14:05
🔗
|
SketchCow |
I ALMOST, but did not delete 2tb of uploaded files that were not actually uploaded |
14:06
🔗
|
SketchCow |
Which means I get to add a brand new step in uploading, where I later run a script that checks to see if a file exists on the server, the final one, and THEN deletes. |
14:06
🔗
|
godane |
shouldn't use some sort of snapshot file system |
14:07
🔗
|
SketchCow |
Try that again using sparkling, clear english. |
14:07
🔗
|
godane |
something like zfs |
14:07
🔗
|
godane |
it has snapshot support i think |
14:08
🔗
|
SketchCow |
Were you trying to say "Shouldn't you use some sort of snapshot file system?" |
14:08
🔗
|
SketchCow |
Or were you saying "You shouldn't use some sort of snapshot file system?" |
14:08
🔗
|
SketchCow |
Or "You shouldn't use a snapshot file system!" |
14:08
🔗
|
godane |
i mean should have |
14:10
🔗
|
alard |
Isn't it enough to check the result of the curl upload? |
14:10
🔗
|
SketchCow |
No. |
14:10
🔗
|
SketchCow |
No, no it's not. |
14:11
🔗
|
alard |
It can still go wrong if it says 200 - thanks for your upload? |
14:11
🔗
|
SketchCow |
YEs. |
14:11
🔗
|
alard |
That's awkward. |
14:11
🔗
|
SketchCow |
Rarely, but yes. |
14:12
🔗
|
SketchCow |
Like, enough for me to want to add that extra step, that last verification. |
14:16
🔗
|
SketchCow |
And on top of that, a number of failures on the hardware side. |
14:16
🔗
|
SketchCow |
Just where I want to get on top of that, we have so much data coming in now. |
14:36
🔗
|
oli |
blame Woet if he breaks it |
14:36
🔗
|
oli |
he has a few gbits going to it now i think, lol |
14:37
🔗
|
oli |
overtook db48x :D |
14:46
🔗
|
emijrp |
#WikiTeam needs more volunteers to download 10,000 wikis. TaskForce http://code.google.com/p/wikiteam/wiki/TaskForce |
14:48
🔗
|
balrog_ph |
How is URLTeam coming along? |
15:16
🔗
|
underscor |
We didn't really break s3, IA is having network issues |
15:16
🔗
|
underscor |
and large packet loss between the s3 headends and the datanodes |
15:16
🔗
|
frame_at |
ok, thanks for the update |
15:16
🔗
|
underscor |
so s3 backed up and caused "issues" |
15:17
🔗
|
underscor |
(they're working on it) |
15:36
🔗
|
oli |
almost 100TB of memac done :D |
17:08
🔗
|
shaqfu |
Where can I find the Wikileaks cables set? TPB doesn't seem to have it |
17:09
🔗
|
shaqfu |
(probably putting myself on all sorts of watchlists asking...) |
17:58
🔗
|
godane |
hey everyone |
17:59
🔗
|
godane |
how do you guys get past a robot? |
18:03
🔗
|
Schbirid |
i usually turn on RADAR ransparency |
18:03
🔗
|
Schbirid |
*T |
18:06
🔗
|
chronomex |
pull the circuit breakers |
19:20
🔗
|
DFJustin |
shaqfu: http://archive.org/details/wikileaks-cables-csv |
19:58
🔗
|
Schbirid |
http://www.facebook.com/photo.php?pid=11709588&l=e63df9b592&id=517581288&_fb_noscript=1 |
19:58
🔗
|
Schbirid |
godane: if you want a real answer, ask a better question ;) |
20:03
🔗
|
kennethre |
mmm, the smell of pipes being flooded with data |
20:08
🔗
|
shaqfu |
DFJustin: Thanks |
20:08
🔗
|
shaqfu |
Need to research work |
20:45
🔗
|
DFJustin |
http://arstechnica.com/gaming/news/2012/04/what-ever-happened-to-the-american-arcade.ars |
20:53
🔗
|
shaqfu |
Demographics, cost, taste |
20:53
🔗
|
Soojin |
it died already back in 1985 or so |
21:07
🔗
|
godane |
Schbirid: i'm trying to get a lot at files on computerpoweruser.com |
21:08
🔗
|
godane |
but articles/pdfmagazine path is blocked |
21:08
🔗
|
godane |
in robots.txt |
21:08
🔗
|
godane |
i can download files once i know the name of it |
21:09
🔗
|
godane |
but i don't know if i'm missing anything in there |
21:11
🔗
|
kennethre |
you know i've never understood the point of robots.txt outside of seo |
21:13
🔗
|
emijrp |
godane: what are you using, wget? |
21:14
🔗
|
godane |
i tryed wget |
21:14
🔗
|
godane |
the -e robots=off doesn't work |
21:14
🔗
|
godane |
i'm also getting 403 error |
21:15
🔗
|
godane |
*403 forbidden error |
21:16
🔗
|
chronomex |
try changing your user agent |
21:16
🔗
|
chronomex |
"eat delicious poop" is a popular one |
21:16
🔗
|
chronomex |
or for greater transparency |
21:16
🔗
|
chronomex |
"archiveteam/from_the_future" |
21:17
🔗
|
godane |
still 403 error |
21:17
🔗
|
chronomex |
hrm |
21:17
🔗
|
chronomex |
do you need to send a referer? |
21:18
🔗
|
godane |
yes |
21:19
🔗
|
godane |
i use --referer and it did nothing |
21:23
🔗
|
godane |
wget: unable to resolve host address 'www.computerpowermagazine.com' |
21:33
🔗
|
oli |
23:33:37 up 1 day, 10:44, 28 users, load average: 20.67, 17.40, 13.79 |
21:33
🔗
|
oli |
:( |
21:42
🔗
|
oli |
lol one of my wget threads |
21:42
🔗
|
oli |
went nuts |
21:42
🔗
|
oli |
and ate 22GB of RAM :( |
21:43
🔗
|
emijrp |
wget sucks sometimes |
21:49
🔗
|
chronomex |
wget sucks ram :) |
22:08
🔗
|
Schbirid |
godane: example url? |
22:09
🔗
|
godane |
www.computerpoweruser.com/articles/pdfmagazine/ |
22:11
🔗
|
Schbirid |
what would be a referrer? |
22:11
🔗
|
Schbirid |
and what are the filenames? |
22:12
🔗
|
godane |
add good/cpu_0406.pdf |
22:13
🔗
|
godane |
you will get june 2004 pdf of cpu magazine |
22:13
🔗
|
Schbirid |
ok, i am downloading it just fine |
22:13
🔗
|
godane |
its fine all the names thats the problem |
22:13
🔗
|
godane |
cause some have weird names |
22:15
🔗
|
Schbirid |
do you know those names? |
22:15
🔗
|
godane |
not really |
22:16
🔗
|
godane |
i have seen some with R___0803.pdf on smart computing site |
22:16
🔗
|
Schbirid |
some https://encrypted.google.com/search?q=site%3Awww.computerpoweruser.com+inurl%3Apdfmagazine+inurl%3Agood&btnG=Search&hl=en&gbv=1&prmd=imvns&filter=0 |
22:16
🔗
|
godane |
oh |
22:17
🔗
|
godane |
never did that before |
22:17
🔗
|
Schbirid |
:) |
22:17
🔗
|
godane |
its still not every url |
22:19
🔗
|
godane |
smart computing is worser then cpu magazine |
22:20
🔗
|
godane |
it disables everything in the url root |
22:20
🔗
|
godane |
good news is i got all pdfs that i could get |
22:23
🔗
|
Schbirid |
:) |
22:23
🔗
|
Schbirid |
good night |