#archiveteam 2012-11-26,Mon

↑back Search

Time Nickname Message
00:24 🔗 dashcloud SketchCow: did you find yourself needing to limit how fast you downloaded from FTP sites, or is that not really an issue?
00:53 🔗 SketchCow No.
00:53 🔗 SketchCow Most are so dead they don't notice.
00:56 🔗 SketchCow One trick I'm finding that is working is searching for certain magic words, specifically dead famous FTP sites, means I'm finding mirrors and in those mirrors are often mirrors of OTHER websites.
00:56 🔗 SketchCow Example: https://www.google.com/search?q=ftp+garbo
00:56 🔗 chronomex it's mirrors all the way down
00:57 🔗 SketchCow http://darkwing.uoregon.edu/~joe/best-ftp-sites.html see?
00:58 🔗 SketchCow http://153.19.251.222/mirror/ has shitty mirrors
00:58 🔗 SketchCow But that's a start
00:58 🔗 SketchCow and so on and so on
01:03 🔗 dashcloud here's a copy of chapter 10 from Internet Games Directory- a listing of what FTP sites were good then: http://pastebin.com/NA610GXe
01:04 🔗 dashcloud (the book is from 1996)
01:06 🔗 dashcloud I've started grabbing Halycon and the first mirror listed for it
06:33 🔗 soultcer chronomex: Could you take a look at the tracker host? It's been down for over a day and we need it to finish the webshots stuff. Maybe it's just a simple problem that can easily be fixed
06:33 🔗 chronomex sure
06:33 🔗 chronomex 22:33:39 up 1 day, 12:39, 1 user, load average: 1.05, 0.96, 0.96
06:33 🔗 chronomex you sure?
06:34 🔗 Deewiant http://tracker.archiveteam.org/webshots/
06:35 🔗 chronomex hmm, alard set that up, and I don't know how he configured it
06:36 🔗 soultcer alard hasn't been around the last two days, maybe he is busy with work/private life
06:36 🔗 chronomex k
06:37 🔗 trythil I've set up tracker before
06:37 🔗 trythil and can take a peek
06:37 🔗 trythil oh, yeah
06:37 🔗 trythil I know what's wrong there
06:37 🔗 trythil Redis is just offline
06:38 🔗 chronomex ok cool, know what I should do from here?
06:38 🔗 chronomex oh spiffy, there it goes
06:38 🔗 yipdw if there's a script to start Redis, it just needs to be restarted
06:38 🔗 chronomex thanks!
06:38 🔗 yipdw np
06:39 🔗 yipdw I wonder why it crashed
06:39 🔗 yipdw was it OOM-killed?
06:39 🔗 chronomex good question
06:39 🔗 soultcer What kind of VPS is the tracker running, btw?
06:40 🔗 chronomex it's on a linode
06:40 🔗 chronomex linode 512 to be precise
06:40 🔗 soultcer Yay, redis came up clean this time for all trackers it seems
06:41 🔗 yipdw Redis can be pretty memory-hungry
06:41 🔗 soultcer Damn that Linode thing is expensive
06:41 🔗 yipdw and 512 MB is probably pushing it
06:41 🔗 yipdw so
06:41 🔗 chronomex if you have suggestions to move it elsewhere, soultcer, I'm game
06:41 🔗 chronomex but my laziness outweighs a small amount of cost savings
06:42 🔗 yipdw the tracker does generate a lot of data, but last I checked it doesn't generate that many keys
06:42 🔗 yipdw and keys are what you can't swap to disk in Redis
06:42 🔗 chronomex plus, linode gave me a sweet tshirt at sxsw
06:42 🔗 yipdw maybe that changed; I haven't looked at the tracker code since alard added multi-project capability
06:42 🔗 chronomex no, there are still only few dozen/hundred keys
06:42 🔗 yipdw oh
06:42 🔗 soultcer I thought redis remove the swap-to-disk feature again
06:42 🔗 yipdw yeah, that should be fine
06:43 🔗 yipdw oh, so it was removed
06:44 🔗 yipdw well never mind then, I guess we do have to take into account value size
07:08 🔗 ivan` http://thenextweb.com/google/2012/11/25/google-shuts-down-dedicated-motorola-mobility-sites-for-asia-europe-middle-east-and-africa/
07:40 🔗 Nemo_bis Too bad, it rains.
07:40 🔗 Nemo_bis I planned to reach the far special post office which allows me to send SketchCow those magazines by bike.
07:49 🔗 godane i uploaded 6 issues of pctoday magazine so far
07:49 🔗 godane http://archive.org/details/pctoday-magazine-v2i6
07:50 🔗 godane its only issue 6 thur 12 of volume 2 so far
10:24 🔗 chronomex yipdw: looks like redis shat the bed ~an hour ago, i just kicked it back into life
10:24 🔗 chronomex i am going to bed and do not have high hopes
10:25 🔗 SmileyG lol that might explain my issues.
10:25 🔗 SmileyG giff access?
10:26 🔗 * SmileyG realises this is his lifes objective
10:26 🔗 SmileyG to run stuff like this for other people
10:28 🔗 * ersi rolls eyes
10:30 🔗 SmileyG :O
10:30 🔗 SmileyG hmmm restarted warrior now works :/ weird.
15:16 🔗 closure was someone archiving ftp.funet.fi recently? I'd like to get a copy of the usenet archive portion
15:20 🔗 Deewiant closure: <@balrog> oh yeah, the archives I'm uploading include a copy of ftp.funet.fi from 2008
15:22 🔗 closure did he say where?
15:23 🔗 Deewiant Nope. And that was almost a week ago.
15:24 🔗 DFJustin iirc they're going onto an IA server where sketchcow will then package them up into items
15:36 🔗 balrog_ closure, Deewiant: uploaded it to SketchCow's box
15:37 🔗 SketchCow 1989_01_BYTE_14-01_PC_Communications_and_Annual_Awards_and_Digitizing_Tablets.pdf
15:37 🔗 SketchCow WHEEEEE 1989 of 03 and Volume 14 and 03
15:37 🔗 SketchCow 1989_03_BYTE_14-03_Mac_Supplement_286_vs_386sx_Object_Oriented_Programming.pdf
15:37 🔗 SketchCow WHEEEEE 1989 of 04 and Volume 14 and 04
15:37 🔗 SketchCow 1989_04_BYTE_14-04_CASE_and_UPSes_and_Graphics_Suppliment.pdf
15:37 🔗 SketchCow etc
15:37 🔗 SketchCow Allow me a little to upload 4.3 gb of Bytes
15:37 🔗 SketchCow Then we'll get to the other
15:45 🔗 ersi chronomex: Something seems to be up with the tracker again, etc. (Meant to write that in this channel)
15:52 🔗 SmileyG its on fire.
16:07 🔗 SketchCow There it go
16:07 🔗 SketchCow (The Byte Upload)
16:18 🔗 ersi SmileyG: Thanks for your comment.
16:18 🔗 SmileyG ersi: quite alright.
16:18 🔗 SmileyG Its licenced cc-by-sa
16:19 🔗 SketchCow Aaaaand up they go
16:24 🔗 SketchCow The deriver is NOT going to like those. 200mb in some cases.
16:25 🔗 chronomex ersi: ugh, gimme a few hours to wake up and go to work and shit
16:27 🔗 ersi chronomex: Sure thang. Just thought I'd poke you the earlier the better :)
16:27 🔗 chronomex yeah, thx for adding it to my agenda
16:39 🔗 chronomex just kicked the server, will investigate later
16:39 🔗 ersi coolers
16:39 🔗 chronomex # /etc/init.d/redis-server restart ; /etc/init.d/nginx restart
16:39 🔗 chronomex if that doesn't fix it, I don't know what else will!
16:43 🔗 chronomex Out of memory: Kill process 21534 (redis-server) score 284 or sacrifice child
16:43 🔗 chronomex Killed process 21534 (redis-server) total-vm:309624kB, anon-rss:111352kB, file-rss:260kB
16:43 🔗 chronomex oh yep
16:43 🔗 chronomex fuck
16:44 🔗 Aranje sacrifice child: the only logical option
16:45 🔗 SmileyG nom nom nom, that mem tastes good.
16:45 🔗 SmileyG How much mem is it eating btw?
16:46 🔗 soultcer Does linode allow you to upgrade RAM?
16:46 🔗 chronomex yeah, but you have to upgrade the whole thing at once
16:47 🔗 chronomex 300M, according to that whine line
16:47 🔗 SmileyG 300Mb... how much in the box~? :S
16:47 🔗 SmileyG generate giant /swap
16:48 🔗 chronomex the box is only 512M
16:49 🔗 SmileyG :/
19:12 🔗 SketchCow The Byte magazine is STILL being derived.
19:12 🔗 SketchCow Go team
20:05 🔗 SketchCow http://techcrunch.com/2012/11/26/twitter-ceo-dick-costolo-twitter-sees-a-billion-tweets-every-two-and-a-half-days-users-can-download-their-entire-archive-by-year-end/
20:13 🔗 SmileyG o_O
20:15 🔗 swebb I seriously dout it though.
20:15 🔗 swebb doubt it
20:33 🔗 ersi Haha, Dick. Great name.
20:33 🔗 SmileyG :D
20:54 🔗 SketchCow http://archive.org/details/ftpsites
21:34 🔗 bsmith094 for file renames, i apparently need to use regexps, (at least for anything other than basic ones) and i cant figure this out. i want from the beginning of the name to the first instance of " - " removed, minus the quotes
21:35 🔗 godane SketchCow: i upload my iso yesterday and its still not in http folder: http://archive.org/details/cdrom-linuxformatmagazine-142
21:35 🔗 godane please don't tell me it go lost in the mail
21:35 🔗 godane takes 5 hours just to upload it
21:36 🔗 godane ok i know why
21:36 🔗 DFJustin if you see the word "torrent" crossed out on the left that means it's still processing
21:36 🔗 godane its waiting to run
21:37 🔗 godane its just weird that i got 2 items waiting to run
21:38 🔗 DFJustin processing times are highly variable depending on the phase of the moon and how much clop fanart underscor is running through the servers
21:39 🔗 godane good news is none of my pctoday magazines are not breaking
21:39 🔗 godane or stop derive cause its having a problem
21:40 🔗 underscor :D
21:40 🔗 godane DFJustin: Is the iso losted?
21:41 🔗 godane you ran it and there is no iso in http folder
21:41 🔗 godane https://ia601508.us.archive.org/34/items/cdrom-linuxformatmagazine-142/
21:41 🔗 DFJustin hit refresh
21:42 🔗 DFJustin also I ran nothing
21:42 🔗 godane it must have been underscor or someone here
22:10 🔗 SketchCow http://archive.org/details/byte-magazine-1989-04 took 6 hours to process
22:55 🔗 godane is archive.org having connection issues?
23:02 🔗 godane pctoday magazine is uploaded
23:02 🔗 godane up to end of 2011
23:35 🔗 Cowering SketchCow, are you missing any BYTE mags? I probably have at least 10 years of them in the attic

irclogger-viewer