[00:31] <noahc> Good argument for proactive archiving of user content.
[00:34] <omf_> Does anyone know what the default behavior of the warrior is for using a new tracking instance
[00:57] <nertzy> I got all hot and bothered about Upcoming going away so I came back and fired up my warrior again, only to find out it had already been backed up! So happy!
[02:14] <SketchCow> Yeah, we're hardcore
[04:42] <godane> i'm using the warrior
[06:36] <vividemin> is it possible to run the seesaw script on multiple projects from the same ip?
[11:45] <ZoeB> Hi! I'm not sure if anyone's interested, but I wrote a quick Python script that archives messages from e-mail mailing lists and USENET newsgroups. Would anyone like a copy?
[12:00] <SmileyG> ZoeB: do you have it on github?
[12:00] <ZoeB> I do! It's at https://github.com/ZoeB/arcmesg
[12:01] <SmileyG> brill :)
[12:01] <ZoeB> I only wrote it today, so it's currently missing documentation etc
[12:01] <ZoeB> But hey, it works!
[12:02] <SmileyG> thats the important bit :)
[12:02] <godane> thats good
[12:03] <godane> i was thinking about that so we could start doing full offline archives of stuff like linux kernel mailing list
[12:03] <InitHello> looks solid
[12:04] <godane> may want to do it by year or something cause i think that would be like 200gb or something otherwise
[12:04] <flaushy> did anyone talk to gmame? they might have great archives
[12:09] <ZoeB> Yeah, I need to add a bunch of features, such as export-to-mbox-format, sorted by month, that sort of thing
[12:13] <tef> ZoeB: how does it work ?
[12:13] <tef> ah I see pop3/nntp archiving
[12:13] <tef> fwiw, warc is not going to be the most pleasant output format :v
[12:18] <ZoeB> Sorry, I'm also cooking lunch...
[12:18] <ZoeB> Yeah, you give it a list of POP3 and NNTP accounts, and it downloads and optionally deletes from POP3 all the messages
[12:19] <ZoeB> It makes a SHA1 of the unique identifier for each message, and uses that for the directory and filename, Git style
[12:19] <ZoeB> Hopefully I'll add mbox import/export in a little bit
[12:20] <ZoeB> I'm amenable to feature suggestions, bugfixes, patches, etc. :)
[12:21] <InitHello> I'm assuming you plan on using optparse at some point
[12:24] <ZoeB> I hadn't heard of it, but *now* I'm planning on using it, thanks!
[12:25] <ZoeB> hmm... argparse it is!
[12:28] <GLaDOS> The one thing I didn't miss about quassel: doesn't group mode changes for op/deop, etc. together.
[12:49] <SmileyG> dangit every item we finish in streetfiles seems to add 10 more XD
[16:30] <gerry> http://www.reddit.com/r/news/comments/1dcf2o/angelina_jolie_hot_collection/
[16:38] <ZoeB> IRC has spam now?
[16:40] <Baljem> spam's all I see on some of my other networks :/
[16:41] <ZoeB> Cleary I'm not getting out enough.  Or too much, if IRC doesn't count.
[17:00] <benuski> posterous is actively banning us, right? so if I was able to download 60 blogs today before it just stopped for the last hour, I should move on to something else, right?
[17:14] <SmileyG> tywes#
[17:57] <SmileyG> switched my work box to streetfiles too - lets finish this
[18:00] <SmileyG> 29hours...
[18:35] <omf_> Anyone else having timeout issues when uploading to IA? I don't mean backing off, I mean in the middle of an upload it stops.
[18:35] <omf_> First time I have seen this happen
[18:54] <DFJustin> yes seeing that today along with other slowness
[19:14] <godane> some one grab this: http://www.youtube.com/watch?feature=player_embedded&v=Z-KZsXMD8gw
[19:25] <chronomex> godane: ok. grabbing. what is it?
[19:27] <SmileyG> how can you grab a live feed?
[19:28] <chronomex> I've got plenty of free disk, I can grab it
[19:28] <SmileyG> I'm just wondeirng how you manage it :P
[19:29] <chronomex> youtube-dl does it happily :P
[19:52] <chronomex> godane: this is insane, why are you having me archive this
[19:55] <Ymgve> chronomex: because it is insane
[19:56] <chronomex> godane is a very strange man
[19:56] <sep332> i think it's funny :)
[20:01] <SmileyG> chronomex: it's... historical
[20:27] <joepie91> http://www.theverge.com/2013/4/29/4283086/comicsalliance-blog-the-latest-aol-property-to-be-shut-down
[20:27] <joepie91> I'm not sure what AOL is up to, but it sounds like a super emergency rescue save is in order
[20:33] <omf_> I am grabbing the comics site
[20:33] <joepie91> Joystiq and Engadget are also AOL, right?
[20:37] <SilSte> is there already a grabber project?
[20:38] <chronomex> it seems aol doesn't know what they're up to either
[20:38] <SilSte> prevention? ^^ :D
[20:38] <joepie91> somewhat surprised that they're still around
[20:39] <SilSte> :D
[20:40] <sep332> AOL music was canceled last week http://mashable.com/2013/04/26/aol-music-closes/
[20:42] <SilSte> what about the archiving?
[20:49] <omf_> Its a good thing you all read the wiki, right? http://archiveteam.org/index.php?title=Current_Projects
[20:50] <SilSte> yeah... but I'm missing the how-to or warrior ;-)
[21:04] <SmileyG> hmmmmm streetfiles is slowing down :<
[21:05] <Baljem> yes, the tracker was paused for a while to let the site recover, alard's now gradually raising the rate limit.  currently 1 item/minute
[21:06] <SmileyG> ah ok
[21:06] <alard> Actually I've just stopped it again.
[21:06] <Baljem> SmileyG: #streetsoffire for all the latest hot goss ;)
[21:06] <Baljem> doh
[21:07] <SmileyG> yeah i expcted to see it in the tracker channel :P
[21:08] <joepie91> omf_: the wiki frontpage is always outdated ;)
[21:08] <omf_> talk to SketchCow
[21:08] <omf_> or soultcer
[21:14] <alard> Hi people running those 40 warriors to archive Streetfiles: It's nice you want to help, but perhaps it's more effective if you help with a different warrior project. We're sending too much traffic to Streetfiles at the moment, so we're limiting the number of items given out per minute. (To 0 per minute, even.) Your warrior is probably just waiting for work, so perhaps it's better to let it work on Formspring.
[21:20] <SmileyG> hehe we really need that upgrade to warrior to have a backup project
[21:21] <SilSte> +1
[21:28] <SmileyG> Suggesting it now
[21:35] <SmileyG> https://github.com/ArchiveTeam/warrior-code2/issues/1
[21:35] <SmileyG> Feel free to add comments too
[21:36] <alard> Isn't that what ArchiveTeam's Choice should do?
[21:37] <soultcer> omf_, I can't edit the wiki front page, sorry.
[21:48] <thingles> btw... for those of you here that oversee the archiveteam wiki, I've got WikiApiary monitoring it. You may find it useful: http://wikiapiary.com/wiki/Archiveteam
[21:49] <thingles> and, in the spirit of "Saving your shit"... I've got the experimental archive capability on using the wikiteam's DumpGenerator. http://wikiapiary.com/wiki/Archiveteam/Backup_log
[21:59] <frame_at> alard: I'd love to switch to "ArchiveTeam's Choice" but my IP is still banned by Posterous. It would be interesting to make the client check for ban-like situations before switch a project. Unless the warrior does this already.
[22:00] <TrojanEel> Isn't Formspring ArchiveTeam's Choice now?
[22:00] <frame_at> (yes I'm aware that the choice is currently Formspring)
[22:01] <frame_at> you just beat me to it :)
[22:01] <frame_at> it was posterous a while ago, which made all my instances do nothing.
[22:01] <frame_at> so I moved them to a manual project and left the house :)
[22:01] <TrojanEel> gotcha :-)
[22:35] <SilSte> streetfiles down!
[22:40] <SmileyG> it's in maitiance, I don't think it was us
[22:47] * Cameron_D places a bet on it never coming out maintnance
[22:47] <SilSte> Cameron_D: what do you bet?
[22:51] <SilSte> tracker stopped?
[23:47] <VonGuard> http://www.flapdangle.com/photos/gallery/newyork/800x800/DCP01104.JPG