[11:12] <Nemo_bis> Sigh, EditThis is so full of spam. 8k pages each with thousands revisions of hundreds KB just at the title [[index.php]]... you make the sum.
[11:22] <Dud1> So the wiki I'm backing up is nearly 600mb and only gotten through ~6/7k pages, there are about 372 thousand titles left to do...what size is it going to be in the end?
[11:23] <Nemo_bis> Dud1: the fi.runescape wikia?
[11:24] <Dud1> Yeah
[11:24] <Nemo_bis> probably several GB
[11:24] <Nemo_bis> check the wikia dumps on archive.org to see if there's a previous dump of that wiki, I thought I had linked you one?
[11:28] <Dud1> The only rswiki on archive is https://archive.org/details/wiki-wikirshunhu and that is a different one.
[11:39] <Nemo_bis> no, you have to check wikia dumps
[11:40] <Nemo_bis> like https://archive.org/download/wikia_dump_20121204/r.zip/
[11:41] <Nemo_bis> http://archive.org/download/wikia_dump_20121204/f.zip/f%2Ffi%2Ffirunescape%2Fpages_full.xml.gz is 20 MB gzipped
[11:41] <Nemo_bis> if you're downloading the English one it was 3 GB compressed
[11:41] <Nemo_bis> so, probably less than 30 GB uncompressed
[11:57] <Dud1> I am sorry, but I'm confused now. Should I continue the way I was going or what?
[12:10] <Nemo_bis> Dud1: sure, unless you lack disk space
[12:11] <Nemo_bis> but if you want to dump the finnish one then you have to use the api to the finnish one :)
[12:13] <Dud1> I have 124gb so I'll keep going, I cna delete stuff if needed. I'll keep with the english one first then try the rest (never noticed that site had other languages XD)
[12:14] <Dud1> Thanks :)
[12:16] <Nemo_bis> then use 7z a -mx9 to compress it, much better for full dumps
[14:04] <Nemo_bis> Out of few dozens Wikia wikis which also have an image dump, there is buytwitterfollowers_images.tar. Go figure.