| Time |
Nickname |
Message |
|
01:07
🔗
|
|
RedType has quit IRC (Ping timeout: 252 seconds) |
|
01:07
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
01:23
🔗
|
|
RedType has joined #archiveteam-bs |
|
01:35
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
01:43
🔗
|
|
zyphlar__ is now known as zyphlar |
|
02:01
🔗
|
|
DMackey- has joined #archiveteam-bs |
|
02:06
🔗
|
|
DMackey has quit IRC (Read error: Operation timed out) |
|
02:33
🔗
|
|
ens has left |
|
03:39
🔗
|
|
remsen has joined #archiveteam-bs |
|
04:05
🔗
|
|
vitzli has joined #archiveteam-bs |
|
04:14
🔗
|
|
remsen has quit IRC (Read error: Operation timed out) |
|
04:24
🔗
|
|
SilSte has quit IRC (Read error: Operation timed out) |
|
04:25
🔗
|
|
aaaaaaaaa has quit IRC (Leaving) |
|
04:38
🔗
|
|
SilSte has joined #archiveteam-bs |
|
05:10
🔗
|
|
vitzli has quit IRC (Leaving) |
|
05:41
🔗
|
kyan |
Anyone know what files like tmp-wpull-warcsesrsp-4p603of8.tmp and tmp-wpull-resp_cb-frl2x0wd.tmp are? |
|
05:41
🔗
|
kyan |
I've got 8 really big ones (8–9gb) |
|
05:42
🔗
|
|
remsen has joined #archiveteam-bs |
|
05:51
🔗
|
|
vitzli has joined #archiveteam-bs |
|
05:51
🔗
|
|
remsen has quit IRC (Leaving) |
|
05:51
🔗
|
|
remsen has joined #archiveteam-bs |
|
05:55
🔗
|
SketchCow |
If I get hit by the bus, you better buy a new fucking bus |
|
05:56
🔗
|
SketchCow |
https://anachips.files.wordpress.com/2014/12/canadian-bus-crash_o_1203746.jpg |
|
06:01
🔗
|
|
bwn has joined #archiveteam-bs |
|
06:09
🔗
|
|
remsen has quit IRC (Leaving) |
|
06:09
🔗
|
|
remsen has joined #archiveteam-bs |
|
06:11
🔗
|
|
primus104 has joined #archiveteam-bs |
|
06:45
🔗
|
|
nightpool has quit IRC (Ping timeout: 310 seconds) |
|
07:05
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
07:12
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
07:15
🔗
|
ersi |
Hah |
|
07:33
🔗
|
|
DMackey- has quit IRC (Read error: Connection reset by peer) |
|
07:33
🔗
|
|
DMackey has joined #archiveteam-bs |
|
07:42
🔗
|
ersi |
Mmmh, I'd like a private train.. just like HCross has |
|
08:04
🔗
|
yipdw |
argh so many Cyber Monday emails |
|
08:04
🔗
|
yipdw |
it's so much better if you read it with the true definition of cyber, though |
|
08:05
🔗
|
|
brayden has joined #archiveteam-bs |
|
08:05
🔗
|
|
swebb sets mode: +o brayden |
|
08:05
🔗
|
ersi |
cyber ;) ;) |
|
08:05
🔗
|
ersi |
asl etc |
|
08:10
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
08:10
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
08:15
🔗
|
|
WinterFox has joined #archiveteam-bs |
|
08:17
🔗
|
WinterFox |
Does the internet archive do anything special to seed so many torrents? My transmission daemon started to struggle at 409 |
|
08:17
🔗
|
WinterFox |
Started getting errors about too many files open and after I added one torrent with a lot of web seeds the daemon would hit 100% cpu usage and segfault |
|
08:18
🔗
|
vitzli |
Does it even seed? I had the impression that it just takes files from the torrent and disconnects |
|
08:19
🔗
|
WinterFox |
It does stop seeding the torrent you upload with but then makes its own one for every collection |
|
08:19
🔗
|
WinterFox |
Which is a fair bit by now |
|
08:19
🔗
|
WinterFox |
I *think* one of the problems I had was hitting the limit of file descriptors the user could use |
|
08:25
🔗
|
ersi |
Oh, that of course impacts how many torrents the client will handle |
|
08:25
🔗
|
ersi |
if you have many with bazillions of files.. then yeah, you ain't gonna be able to load all that many |
|
08:26
🔗
|
ersi |
most of my 1200+ torrents only have one or five large files in 'em |
|
08:41
🔗
|
|
arkiver2 has joined #archiveteam-bs |
|
08:43
🔗
|
|
Microguru has joined #archiveteam-bs |
|
09:07
🔗
|
|
schbirid has joined #archiveteam-bs |
|
09:15
🔗
|
WinterFox |
ersi, The internet archive has stupidly large amounts of files. I guess its not all on one daemon though |
|
09:31
🔗
|
|
primus104 has joined #archiveteam-bs |
|
10:19
🔗
|
godane |
SketchCow: i'm archiving Marty Roberts ''Staying Real in Israel" podcast |
|
10:19
🔗
|
godane |
i noticed it in your podcast vault items |
|
10:22
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
10:23
🔗
|
godane |
that guys blog may have all of the mp3 |
|
10:23
🔗
|
godane |
the blog is in archivebot right now |
|
10:23
🔗
|
godane |
i'm brute forcing the mp3 paths |
|
10:37
🔗
|
|
bwn has joined #archiveteam-bs |
|
10:58
🔗
|
|
vitzli has quit IRC (Quit: Leaving) |
|
11:36
🔗
|
|
bwn has quit IRC (Read error: Connection reset by peer) |
|
11:37
🔗
|
|
bwn has joined #archiveteam-bs |
|
11:55
🔗
|
|
arkiver2 has quit IRC (Quit: Nettalk6 - www.ntalk.de) |
|
12:03
🔗
|
|
WinterFox has quit IRC (Remote host closed the connection) |
|
12:09
🔗
|
|
DMackey- has joined #archiveteam-bs |
|
12:12
🔗
|
|
DMackey has quit IRC (Ping timeout: 310 seconds) |
|
12:48
🔗
|
joepie91 |
webseeds :) |
|
13:01
🔗
|
|
BlueMaxim has quit IRC (Read error: Connection reset by peer) |
|
13:10
🔗
|
|
vitzli has joined #archiveteam-bs |
|
13:12
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
13:20
🔗
|
|
vtyl has quit IRC (Read error: Operation timed out) |
|
13:22
🔗
|
|
lytv has joined #archiveteam-bs |
|
13:44
🔗
|
|
kyan has quit IRC (Leaving) |
|
14:13
🔗
|
|
remsen has quit IRC (Read error: Connection reset by peer) |
|
14:25
🔗
|
|
signius has quit IRC (Ping timeout: 310 seconds) |
|
14:36
🔗
|
|
signius has joined #archiveteam-bs |
|
14:42
🔗
|
|
primus104 has joined #archiveteam-bs |
|
14:44
🔗
|
|
Microguru has quit IRC (Read error: Connection reset by peer) |
|
15:03
🔗
|
|
brayden has quit IRC (Quit: Leaving) |
|
15:03
🔗
|
|
brayden has joined #archiveteam-bs |
|
15:03
🔗
|
|
swebb sets mode: +o brayden |
|
15:04
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
15:21
🔗
|
|
remsen has joined #archiveteam-bs |
|
15:51
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
15:53
🔗
|
|
primus104 has joined #archiveteam-bs |
|
16:12
🔗
|
|
nightpool has joined #archiveteam-bs |
|
16:33
🔗
|
SketchCow |
Hi, working my ass off in the information cube. |
|
16:34
🔗
|
SketchCow |
I of course was going to tell him, but if he comes back, ximm@archive.org designed the torrent system (took him a year) and he worked heavily with Bittorrent, Inc, to engineer it. |
|
16:34
🔗
|
HCross |
SketchCow, did you say weather we could go ahead with that 19TB of mouse genomes? |
|
16:50
🔗
|
|
nightpool has quit IRC (Ping timeout: 183 seconds) |
|
16:56
🔗
|
|
atlogbot has quit IRC (Ping timeout: 369 seconds) |
|
16:56
🔗
|
|
swebb has quit IRC (Read error: Operation timed out) |
|
17:05
🔗
|
schbirid |
HCross: i would not bother with huge academic datasets |
|
17:15
🔗
|
|
Start has joined #archiveteam-bs |
|
17:15
🔗
|
|
swebb has joined #archiveteam-bs |
|
17:16
🔗
|
|
atlogbot has joined #archiveteam-bs |
|
17:17
🔗
|
|
nightpool has joined #archiveteam-bs |
|
17:26
🔗
|
HCross |
ok |
|
17:26
🔗
|
phuzion |
HCross: I guess this is a better channel to ask that question. What's your upstream? |
|
17:27
🔗
|
HCross |
12Mbps but throttles |
|
17:27
🔗
|
phuzion |
That's better than I've got at home. I've got something like 1.5mbps, which sucks. |
|
17:28
🔗
|
HCross |
I wont get that to the IA though |
|
17:29
🔗
|
HCross |
ill pop them on my external HDD and try tomorrow on a faster link |
|
17:29
🔗
|
phuzion |
HCross: Just create a torrent, and let IA pull it that way if you're concerned about the connection being interrupted. |
|
17:32
🔗
|
phuzion |
Can we please set this to the FTP project logo? http://www.courthousenews.com/2014/04/03/ftp-police.jpg This man is clearly passionate about the file transfer protocol. |
|
17:34
🔗
|
HCross |
Ill do the torrent. My British ISP isnt known as the best for reliability |
|
17:40
🔗
|
phuzion |
Gotcha. Are you ware of how the whole torrent system works? |
|
17:42
🔗
|
HCross |
yep |
|
17:42
🔗
|
HCross |
they traffic shape horrifically when you upload a lot |
|
17:43
🔗
|
HCross |
we are talking a 12Mbps link becomes under 3Mbps after 2.25GB in an hour |
|
17:51
🔗
|
ersi |
lol the UK |
|
17:51
🔗
|
HCross |
more like "lol Liberty Global" |
|
17:51
🔗
|
ersi |
lolk |
|
17:51
🔗
|
godane |
russian lego catalogs: https://archive.org/details/godaneinbox?sort=-publicdate&and[]=subject%3A%22Katalog%20Lego%22 |
|
17:51
🔗
|
ersi |
United LOL |
|
18:06
🔗
|
godane |
https://archive.org/details/murzilka-1924-01 |
|
18:12
🔗
|
HCross |
phuzion, thanks. The torrent is now working and doing ok at speed |
|
18:15
🔗
|
|
sigkell has quit IRC (Ping timeout: 252 seconds) |
|
18:15
🔗
|
|
antonizoo has quit IRC (Ping timeout: 252 seconds) |
|
18:16
🔗
|
|
signius has quit IRC (Read error: Operation timed out) |
|
18:16
🔗
|
|
sigkell has joined #archiveteam-bs |
|
18:17
🔗
|
|
antonizoo has joined #archiveteam-bs |
|
18:18
🔗
|
|
Kazzy has quit IRC (Read error: Operation timed out) |
|
18:18
🔗
|
HCross |
Sure enough, Hi traffic shaping |
|
18:19
🔗
|
|
is-_ has quit IRC (Read error: Operation timed out) |
|
18:19
🔗
|
|
Kazzy has joined #archiveteam-bs |
|
18:21
🔗
|
|
is- has joined #archiveteam-bs |
|
18:22
🔗
|
vitzli |
godane, are you grabbing magazines from rutracker.org? |
|
18:24
🔗
|
godane |
i'm grabbing some |
|
18:25
🔗
|
vitzli |
I wanted to offer grabing "Vokrug sveta", but it's already in IA |
|
18:26
🔗
|
godane |
yes but looks incomplete |
|
18:27
🔗
|
godane |
also some of items look odd |
|
18:27
🔗
|
godane |
like this one: https://archive.org/details/vokrugsveta1999-01 |
|
18:27
🔗
|
phuzion |
HCross: Cool, glad to see it's working. |
|
18:29
🔗
|
HCross |
except it seems to be screwing with my upstream network atm |
|
18:29
🔗
|
HCross |
packets are taking 100ms to leave my street |
|
18:31
🔗
|
|
signius has joined #archiveteam-bs |
|
18:31
🔗
|
phuzion |
They're leaving your LAN but hitting latency at the second or third hop? |
|
18:33
🔗
|
HCross |
second hop. Its my pile of rubbish cable co |
|
18:33
🔗
|
phuzion |
Throw some mains current onto the line and incentivize them to upgrade infrastructure :) |
|
18:33
🔗
|
yipdw |
Rubbish Cable Company, just a bit better than Shag in a Skip Satellite Internet |
|
18:33
🔗
|
phuzion |
jk don't do that. |
|
18:34
🔗
|
HCross |
Put it this way, it was owned by Richard Branson at one point |
|
18:35
🔗
|
joepie91 |
*cough* VM |
|
18:36
🔗
|
HCross |
yep. Stuck the torrent file on 2 EU seedboxes and using them to take the transatlantic load off |
|
18:36
🔗
|
HCross |
VM |
|
18:37
🔗
|
|
remsen has quit IRC (Read error: Operation timed out) |
|
18:38
🔗
|
SimpBrain |
hah good internet speed, just unreliable at times |
|
18:39
🔗
|
HCross |
Yep - and also lovers of price increases |
|
18:39
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
18:40
🔗
|
SimpBrain |
wont touch them again with a barge pole |
|
18:40
🔗
|
vitzli |
godane, that's silly, the item is in fb2 compressed format, hence .zip extension |
|
18:40
🔗
|
SimpBrain |
rather have slower internet than intermittent |
|
18:42
🔗
|
HCross |
The IA seems to be coping well with the 4 things that are feeding the torrent |
|
18:43
🔗
|
HCross |
its faster for me to seed to a server in the EU and then have the IA suckle off that |
|
18:43
🔗
|
vitzli |
using fb2 for that kind of media (photo-heavy magazines/books) is silly |
|
18:51
🔗
|
|
Start has joined #archiveteam-bs |
|
18:53
🔗
|
HCross |
just had the shout of "STOP USING ALL THE INTERNET" come from downstairs |
|
18:55
🔗
|
joepie91 |
funny, I never have that here.. |
|
18:55
🔗
|
joepie91 |
:P |
|
18:55
🔗
|
SimpBrain |
haha |
|
18:55
🔗
|
HCross |
Stuck it on pause until people have gone to bed |
|
18:55
🔗
|
SimpBrain |
my speed battle is vs the on demand services |
|
18:56
🔗
|
HCross |
My speed battle is versus my father and his world of warships |
|
18:56
🔗
|
|
Barry has quit IRC (Ping timeout: 310 seconds) |
|
18:56
🔗
|
|
Barry has joined #archiveteam-bs |
|
18:58
🔗
|
SimpBrain |
docstoc has 0 items left |
|
18:59
🔗
|
arkiver |
requeued 50000 items |
|
19:13
🔗
|
|
vitzli has quit IRC (Leaving) |
|
19:17
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
19:20
🔗
|
|
Start has joined #archiveteam-bs |
|
19:24
🔗
|
|
Start has quit IRC (Client Quit) |
|
20:23
🔗
|
godane |
so i'm ripping Network World from google books |
|
20:23
🔗
|
godane |
i have 1986 to 1988 so far |
|
20:29
🔗
|
godane |
looks like guys only have 23 Network World files |
|
20:30
🔗
|
godane |
i think i can fill that gap so you guys can have a collection |
|
20:32
🔗
|
HCross |
matthusb_, I think you are needed in #effteepee |
|
20:32
🔗
|
arkiver |
matthusby: do you have a log for iaurl:archiveteam_ftp_items_2015112801:az3.engr.oregonstate.edu_110 ? |
|
20:33
🔗
|
arkiver |
of the ftp grab |
|
20:33
🔗
|
arkiver |
the size of your item was way under the size it should be |
|
20:33
🔗
|
arkiver |
or you had some really really good compression |
|
20:37
🔗
|
|
bwn has quit IRC (Ping timeout: 255 seconds) |
|
20:45
🔗
|
|
Marcelo has joined #archiveteam-bs |
|
20:49
🔗
|
|
Start has joined #archiveteam-bs |
|
20:58
🔗
|
schbirid |
crappy provider but some cheap vms at http://oneprovider.com/onecloud/ssd-virtual-servers today |
|
21:04
🔗
|
|
Muad-Dib has joined #archiveteam-bs |
|
21:14
🔗
|
|
bwn has joined #archiveteam-bs |
|
21:18
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
21:22
🔗
|
|
aaaaaaaaa has joined #archiveteam-bs |
|
21:26
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
21:33
🔗
|
HCross |
Tracker having issues? Error 500 a lot overhere |
|
21:36
🔗
|
aaaaaaaaa |
whoa, the munin graphs look bad. |
|
21:36
🔗
|
HCross |
I am going quite hard, do I need to slow down? |
|
21:39
🔗
|
aaaaaaaaa |
I'm not a sysadmin, but the activity on it is definitely different the normal |
|
21:40
🔗
|
aaaaaaaaa |
xmc: may want to check the tracker. |
|
21:43
🔗
|
Kazzy |
HCross: vmedia? ouch |
|
21:43
🔗
|
HCross |
yep |
|
21:44
🔗
|
Kazzy |
thought i had it bad at 80/20 with no caps |
|
21:44
🔗
|
|
kyan has joined #archiveteam-bs |
|
21:47
🔗
|
phuzion |
aaaaaaaaa: Huh, yeah there's definitely something up since friday morning. |
|
21:52
🔗
|
aaaaaaaaa |
I wonder if the software is starting to creak under the load or something like that. |
|
21:58
🔗
|
phuzion |
What I noticed that was that disk latency jumped and throughput flatlined. |
|
21:59
🔗
|
* |
phuzion out |
|
22:06
🔗
|
|
nightpool has quit IRC (Read error: Operation timed out) |
|
22:09
🔗
|
|
nightpool has joined #archiveteam-bs |
|
22:09
🔗
|
|
DMackey has joined #archiveteam-bs |
|
22:11
🔗
|
|
DMackey- has quit IRC (Ping timeout: 310 seconds) |
|
22:16
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
22:28
🔗
|
|
kyan has quit IRC (Quit: This computer has gone to sleep) |
|
22:31
🔗
|
|
nightpool has quit IRC (Ping timeout: 252 seconds) |
|
22:48
🔗
|
|
nightpool has joined #archiveteam-bs |
|
22:49
🔗
|
Marcelo |
What's going on with the tracker? |
|
23:01
🔗
|
|
balrog has quit IRC (Read error: Operation timed out) |
|
23:07
🔗
|
|
balrog has joined #archiveteam-bs |
|
23:12
🔗
|
|
kyan has joined #archiveteam-bs |
|
23:24
🔗
|
|
bauruine has joined #archiveteam-bs |
|
23:50
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
23:51
🔗
|
|
Apathy has quit IRC (Read error: Operation timed out) |
|
23:51
🔗
|
|
Apathy has joined #archiveteam-bs |
|
23:55
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
23:58
🔗
|
xmc |
hmm, yeah, sure looks fucky |
|
23:58
🔗
|
xmc |
i just got out of work school, i'll poke at it in a few hours |