| Time |
Nickname |
Message |
|
00:31
🔗
|
noahc |
Good argument for proactive archiving of user content. |
|
00:34
🔗
|
omf_ |
Does anyone know what the default behavior of the warrior is for using a new tracking instance |
|
00:57
🔗
|
nertzy |
I got all hot and bothered about Upcoming going away so I came back and fired up my warrior again, only to find out it had already been backed up! So happy! |
|
02:14
🔗
|
SketchCow |
Yeah, we're hardcore |
|
04:42
🔗
|
godane |
i'm using the warrior |
|
06:36
🔗
|
vividemin |
is it possible to run the seesaw script on multiple projects from the same ip? |
|
11:45
🔗
|
ZoeB |
Hi! I'm not sure if anyone's interested, but I wrote a quick Python script that archives messages from e-mail mailing lists and USENET newsgroups. Would anyone like a copy? |
|
12:00
🔗
|
SmileyG |
ZoeB: do you have it on github? |
|
12:00
🔗
|
ZoeB |
I do! It's at https://github.com/ZoeB/arcmesg |
|
12:01
🔗
|
SmileyG |
brill :) |
|
12:01
🔗
|
ZoeB |
I only wrote it today, so it's currently missing documentation etc |
|
12:01
🔗
|
ZoeB |
But hey, it works! |
|
12:02
🔗
|
SmileyG |
thats the important bit :) |
|
12:02
🔗
|
godane |
thats good |
|
12:03
🔗
|
godane |
i was thinking about that so we could start doing full offline archives of stuff like linux kernel mailing list |
|
12:03
🔗
|
InitHello |
looks solid |
|
12:04
🔗
|
godane |
may want to do it by year or something cause i think that would be like 200gb or something otherwise |
|
12:04
🔗
|
flaushy |
did anyone talk to gmame? they might have great archives |
|
12:09
🔗
|
ZoeB |
Yeah, I need to add a bunch of features, such as export-to-mbox-format, sorted by month, that sort of thing |
|
12:13
🔗
|
tef |
ZoeB: how does it work ? |
|
12:13
🔗
|
tef |
ah I see pop3/nntp archiving |
|
12:13
🔗
|
tef |
fwiw, warc is not going to be the most pleasant output format :v |
|
12:18
🔗
|
ZoeB |
Sorry, I'm also cooking lunch... |
|
12:18
🔗
|
ZoeB |
Yeah, you give it a list of POP3 and NNTP accounts, and it downloads and optionally deletes from POP3 all the messages |
|
12:19
🔗
|
ZoeB |
It makes a SHA1 of the unique identifier for each message, and uses that for the directory and filename, Git style |
|
12:19
🔗
|
ZoeB |
Hopefully I'll add mbox import/export in a little bit |
|
12:20
🔗
|
ZoeB |
I'm amenable to feature suggestions, bugfixes, patches, etc. :) |
|
12:21
🔗
|
InitHello |
I'm assuming you plan on using optparse at some point |
|
12:24
🔗
|
ZoeB |
I hadn't heard of it, but *now* I'm planning on using it, thanks! |
|
12:25
🔗
|
ZoeB |
hmm... argparse it is! |
|
12:28
🔗
|
GLaDOS |
The one thing I didn't miss about quassel: doesn't group mode changes for op/deop, etc. together. |
|
12:49
🔗
|
SmileyG |
dangit every item we finish in streetfiles seems to add 10 more XD |
|
16:30
🔗
|
gerry |
http://www.reddit.com/r/news/comments/1dcf2o/angelina_jolie_hot_collection/ |
|
16:38
🔗
|
ZoeB |
IRC has spam now? |
|
16:40
🔗
|
Baljem |
spam's all I see on some of my other networks :/ |
|
16:41
🔗
|
ZoeB |
Cleary I'm not getting out enough. Or too much, if IRC doesn't count. |
|
17:00
🔗
|
benuski |
posterous is actively banning us, right? so if I was able to download 60 blogs today before it just stopped for the last hour, I should move on to something else, right? |
|
17:14
🔗
|
SmileyG |
tywes# |
|
17:57
🔗
|
SmileyG |
switched my work box to streetfiles too - lets finish this |
|
18:00
🔗
|
SmileyG |
29hours... |
|
18:35
🔗
|
omf_ |
Anyone else having timeout issues when uploading to IA? I don't mean backing off, I mean in the middle of an upload it stops. |
|
18:35
🔗
|
omf_ |
First time I have seen this happen |
|
18:54
🔗
|
DFJustin |
yes seeing that today along with other slowness |
|
19:14
🔗
|
godane |
some one grab this: http://www.youtube.com/watch?feature=player_embedded&v=Z-KZsXMD8gw |
|
19:25
🔗
|
chronomex |
godane: ok. grabbing. what is it? |
|
19:27
🔗
|
SmileyG |
how can you grab a live feed? |
|
19:28
🔗
|
chronomex |
I've got plenty of free disk, I can grab it |
|
19:28
🔗
|
SmileyG |
I'm just wondeirng how you manage it :P |
|
19:29
🔗
|
chronomex |
youtube-dl does it happily :P |
|
19:52
🔗
|
chronomex |
godane: this is insane, why are you having me archive this |
|
19:55
🔗
|
Ymgve |
chronomex: because it is insane |
|
19:56
🔗
|
chronomex |
godane is a very strange man |
|
19:56
🔗
|
sep332 |
i think it's funny :) |
|
20:01
🔗
|
SmileyG |
chronomex: it's... historical |
|
20:27
🔗
|
joepie91 |
http://www.theverge.com/2013/4/29/4283086/comicsalliance-blog-the-latest-aol-property-to-be-shut-down |
|
20:27
🔗
|
joepie91 |
I'm not sure what AOL is up to, but it sounds like a super emergency rescue save is in order |
|
20:33
🔗
|
omf_ |
I am grabbing the comics site |
|
20:33
🔗
|
joepie91 |
Joystiq and Engadget are also AOL, right? |
|
20:37
🔗
|
SilSte |
is there already a grabber project? |
|
20:38
🔗
|
chronomex |
it seems aol doesn't know what they're up to either |
|
20:38
🔗
|
SilSte |
prevention? ^^ :D |
|
20:38
🔗
|
joepie91 |
somewhat surprised that they're still around |
|
20:39
🔗
|
SilSte |
:D |
|
20:40
🔗
|
sep332 |
AOL music was canceled last week http://mashable.com/2013/04/26/aol-music-closes/ |
|
20:42
🔗
|
SilSte |
what about the archiving? |
|
20:49
🔗
|
omf_ |
Its a good thing you all read the wiki, right? http://archiveteam.org/index.php?title=Current_Projects |
|
20:50
🔗
|
SilSte |
yeah... but I'm missing the how-to or warrior ;-) |
|
21:04
🔗
|
SmileyG |
hmmmmm streetfiles is slowing down :< |
|
21:05
🔗
|
Baljem |
yes, the tracker was paused for a while to let the site recover, alard's now gradually raising the rate limit. currently 1 item/minute |
|
21:06
🔗
|
SmileyG |
ah ok |
|
21:06
🔗
|
alard |
Actually I've just stopped it again. |
|
21:06
🔗
|
Baljem |
SmileyG: #streetsoffire for all the latest hot goss ;) |
|
21:06
🔗
|
Baljem |
doh |
|
21:07
🔗
|
SmileyG |
yeah i expcted to see it in the tracker channel :P |
|
21:08
🔗
|
joepie91 |
omf_: the wiki frontpage is always outdated ;) |
|
21:08
🔗
|
omf_ |
talk to SketchCow |
|
21:08
🔗
|
omf_ |
or soultcer |
|
21:14
🔗
|
alard |
Hi people running those 40 warriors to archive Streetfiles: It's nice you want to help, but perhaps it's more effective if you help with a different warrior project. We're sending too much traffic to Streetfiles at the moment, so we're limiting the number of items given out per minute. (To 0 per minute, even.) Your warrior is probably just waiting for work, so perhaps it's better to let it work on Formspring. |
|
21:20
🔗
|
SmileyG |
hehe we really need that upgrade to warrior to have a backup project |
|
21:21
🔗
|
SilSte |
+1 |
|
21:28
🔗
|
SmileyG |
Suggesting it now |
|
21:35
🔗
|
SmileyG |
https://github.com/ArchiveTeam/warrior-code2/issues/1 |
|
21:35
🔗
|
SmileyG |
Feel free to add comments too |
|
21:36
🔗
|
alard |
Isn't that what ArchiveTeam's Choice should do? |
|
21:37
🔗
|
soultcer |
omf_, I can't edit the wiki front page, sorry. |
|
21:48
🔗
|
thingles |
btw... for those of you here that oversee the archiveteam wiki, I've got WikiApiary monitoring it. You may find it useful: http://wikiapiary.com/wiki/Archiveteam |
|
21:49
🔗
|
thingles |
and, in the spirit of "Saving your shit"... I've got the experimental archive capability on using the wikiteam's DumpGenerator. http://wikiapiary.com/wiki/Archiveteam/Backup_log |
|
21:59
🔗
|
frame_at |
alard: I'd love to switch to "ArchiveTeam's Choice" but my IP is still banned by Posterous. It would be interesting to make the client check for ban-like situations before switch a project. Unless the warrior does this already. |
|
22:00
🔗
|
TrojanEel |
Isn't Formspring ArchiveTeam's Choice now? |
|
22:00
🔗
|
frame_at |
(yes I'm aware that the choice is currently Formspring) |
|
22:01
🔗
|
frame_at |
you just beat me to it :) |
|
22:01
🔗
|
frame_at |
it was posterous a while ago, which made all my instances do nothing. |
|
22:01
🔗
|
frame_at |
so I moved them to a manual project and left the house :) |
|
22:01
🔗
|
TrojanEel |
gotcha :-) |
|
22:35
🔗
|
SilSte |
streetfiles down! |
|
22:40
🔗
|
SmileyG |
it's in maitiance, I don't think it was us |
|
22:47
🔗
|
* |
Cameron_D places a bet on it never coming out maintnance |
|
22:47
🔗
|
SilSte |
Cameron_D: what do you bet? |
|
22:51
🔗
|
SilSte |
tracker stopped? |
|
23:47
🔗
|
VonGuard |
http://www.flapdangle.com/photos/gallery/newyork/800x800/DCP01104.JPG |