[00:06] <xmc> yup
[04:15] <SketchCow> chfoo: Can you switch away from fos if you can?
[04:17] <chfoo> SketchCow: ok, switching to one midas  has set up
[04:17] <SketchCow> Great
[04:35] <SketchCow> Has it happened?
[04:35] <SketchCow> I'm just watching the machine be sad.
[04:37] <chfoo> SketchCow: i double checked the tracker and the fos target is disabled
[04:51] <SketchCow> Man, something is sad over there.
[05:05] <SketchCow> FOS has been revealed to be on a host with a sick disk.
[05:33] <godane> sick disk is not good
[06:03] <SketchCow> Machine is back - they'll hot swap the bad disk out tomorrow.
[06:03] <SketchCow> I'm slamming through the files.
[06:03] <SketchCow> While listening to atari podcast, while imaging Apple II disks.
[06:12] <godane> thats just nuts
[06:13] <godane> i'm just mirroring theblaze network and looking up old (web) episodes of mad money
[06:14] <godane> also the guy in mad money was on glenn beck show this past week
[06:39] <DFJustin> fyi one of the archivebot slots is waiting to rsync to fos
[06:57] <SketchCow> Re-enacted, and uploading the latest batch of archivebot
[07:05] <SketchCow> https://archive.org/details/Newsbytes_Volume3_May1983_July1993 is cool
[07:09] <godane> the desc say its between may 1983 to july 1994
[07:09] <godane> but title say july 1993
[07:12] <SketchCow> Switched description.
[09:24] <SketchCow> OK, that .pl FTP site one.
[09:24] <SketchCow> I got a lot of it, but I'm not doing more.
[09:24] <SketchCow> 7 months was enough. :)
[09:25] <SketchCow> one/won
[09:27] <Baljem> good god
[09:27] <Baljem> how big is 7 months' worth?  that sounds horrendously huge
[09:29] <SketchCow> I gave up after 8tb
[09:37] <Schbirid> what site?
[09:47] <SketchCow> ftp.icm.edu.pl
[09:55] <Schbirid> blimey that is a huge ls file
[09:56] <Schbirid> 30m files, 2m symlinks
[09:56] <Schbirid> (not files, lines)
[09:59] <SketchCow> OK, that made things better.
[10:00] <SketchCow> That drive is down to 1.1tb
[10:00] <SketchCow> 1.2G    ARCHIVEBOT
[10:00] <SketchCow> 13G     ALARD
[10:00] <SketchCow> 15G     HOMELAND
[10:00] <SketchCow> 920G    HACKERCONS
[10:00] <SketchCow> 92K     DNADOWN
[10:00] <SketchCow> 39G     JSMESS
[10:00] <SketchCow> 17G     MUSICBRAINZ
[10:00] <SketchCow> 4.0K    archivebot.sh
[10:00] <SketchCow> Not so bad.
[10:00] <SketchCow> Obviously Hacker Con material is next.
[10:06] <Nemo_bis> Hm https://archive.org/search.php?query=ftp+uploader%3Ajscott&sort=-publicdate
[10:07] <Nemo_bis> Too bored to look manually
[10:09] * Nemo_bis patiently loading http://archive.org/metamgr.php?f=histogram&group=size&w_identifier=ftp.icm.edu.pl*
[10:13] <SketchCow> It's terrible
[10:13] <SketchCow> I think they duplicated a ton of repositoris.
[10:13] <SketchCow> ies
[10:16] <Schbirid> afaik ftp exposes what is a symlink and what not, no idea if there are scriptable clients that handle that smartly though
[10:21] <SketchCow> curl is fine with it, wget is fine with it.
[10:21] <SketchCow> You can choose.
[12:30] <danneh_> hmm, kinda irritating how wget doesn't tell you if it's gonna overwrite a warc file
[12:30] <danneh_> I presumed it'd append if it already existed, just lost 'bout 1.1GB of progress because silly me thought it appended instead of overwrote
[15:36] <SketchCow> godane: One note - avoid french computer magazines.
[16:03] <Nemo_bis> SketchCow: very aggressive take downs?
[22:07] <gui77> the opera tracker is rate-limited? o.0
[22:09] <Nemo_bis> Because we were too fast maybe?
[22:09] <Nemo_bis> I think it reduces speed when we start to get too many 5xx errors or so?
[22:10] <gui77> maybe... but they're showing up so fast from some users on the tracker lol it was a little hard to believe
[22:13] <yipdw> 980 requests/minute
[22:13] <yipdw> it's not an automatic change
[22:13] <yipdw> an admin has to go in and do it
[22:15] <Atluxity> this should be enough to get everything