[00:59] <underscor> Nemo_bis: Good. 2GB so far
[00:59] <underscor> only 4 finished wikis though
[00:59] <underscor> geez these take a while
[00:59] <underscor> lots of Server is slow... Waiting some seconds and retrying...
[00:59] <underscor> :(
[01:12] <Nemo_bis> underscor: you need many instances at a time
[01:13] <Nemo_bis> some hundreds probably
[01:18] <underscor> yeah, I'm spinning up a bunch
[05:01] <underscor> Nemo_bis: Uploader.py isn't doing anything
[05:01] <underscor> do you know why it would do that?
[05:01] <underscor> http://p.defau.lt/?0vmgCtwo8derfr3oPU8zDQ
[05:02] <underscor> same output even if I run it multiple times
[05:03] <underscor> oh, maybe my mistake
[05:03] <underscor> one second
[06:26] <Nemo_bis> underscor: ok?
[06:27] <Nemo_bis> seems it si
[06:30] <underscor> yeah
[06:30] <underscor> my fault
[06:31] <underscor> fixed it
[06:31] <underscor> some of these wikis are dead though
[06:31] <underscor> do I need to mark that somewhere or just ignore it and move on?
[06:33] <underscor> ^ Nemo_bis
[06:54] <Nemo_bis> underscor: just move on
[06:54] <Nemo_bis> not some, most of them
[06:54] <underscor> yeah
[06:54] <underscor> :(
[06:54] <underscor> okay, will do
[06:54] <Nemo_bis> there's lots of DB errors and other broken configs
[06:55] <underscor> yeah
[06:56] <Nemo_bis> underscor: when you're done with a batch, it's useful to run launcher.py over it again (keeping all 7z on the dir) and paste the output like this: http://p.defau.lt/?xFZdHVoVpJBhI5fA5icN3g
[06:56] <Nemo_bis> so that we can see what are the errors for the wikis which have not been downloaded
[06:57] <Nemo_bis> note that you can't leave launcher.py completely alone, quite often it will be stuck
[06:57] <underscor> yeah
[07:04] <underscor> Nemo_bis: Is p.defau.lt your site?
[07:14] <Nemo_bis> underscor: no
[07:14] <underscor> oh okay
[07:14] <underscor> I just always see you use it :)
[08:29] <underscor> Nemo_bis: does this actually download the media too?
[08:29] <underscor> seems like not a lot of data going through the pipe
[08:48] <underscor> hi emijrp :)
[08:51] <emijrp> hi underscor
[10:49] <emijrp> 12:40 <jubo2> It was a real heavy weight taken off my shoulders when Wikiteam took the action of backing http://develop.consumerium.org/wiki/ onto archive.org .. before that it was me and my neck on the line should backups fail and catastrophical wiki data loss encurs
[10:49] <emijrp> 12:40 <jubo2> that was 1.5 months ago
[10:49] <emijrp> 12:42 <jubo2> for over 10 yrs I needed to worry about looming data loss catastrophe should like the server hall and my flat and my friend's flat burn down simultaneously
[10:50] <emijrp> from #wikimedia-tech on freenode
[11:21] <SketchCow> A little dramatic for such a small wiki
[11:40] <emijrp> 1000+ pages
[11:47] <SketchCow> Is it? I couldn't determine that from the page listings.
[11:47] <SketchCow> It looked to be 200 at most.
[11:53] <Nemo_bis> he's quite a dramatic guy, yes
[11:54] <Nemo_bis> and newbies too
[11:54] <Nemo_bis> *newbiesh
[18:10] <underscor> wow, he's more fanatical about data loss than even I am
[18:50] <emijrp> Nemo_bis: you canc laim my list in the task force
[18:51] <emijrp> up bandwidth in spain is shitty
[18:51] <emijrp> and i can not upload a damn
[19:55] <emijrp> 2500 wikis...
[19:56] <emijrp> using a script of 1000 lines
[19:56] <emijrp> that is a performance of 2,5 wikis/line
[19:56] <emijrp> and growing, go go go
[21:35] <underscor> <underscor> does this actually download the media too?
[21:35] <underscor> <underscor> seems like not a lot of data going through the pipe
[22:36] <Nemo_bis> underscor: yes it does, most wikis don't have much files
[22:36] <Nemo_bis> except some I already downloaded of course :/
[22:38] <Nemo_bis> underscor: like this which you promised to download for me a while ago http://archive.org/details/wiki-citywiki.ugr.es