| Time |
Nickname |
Message |
|
11:12
🔗
|
Nemo_bis |
Sigh, EditThis is so full of spam. 8k pages each with thousands revisions of hundreds KB just at the title [[index.php]]... you make the sum. |
|
11:22
🔗
|
Dud1 |
So the wiki I'm backing up is nearly 600mb and only gotten through ~6/7k pages, there are about 372 thousand titles left to do...what size is it going to be in the end? |
|
11:23
🔗
|
Nemo_bis |
Dud1: the fi.runescape wikia? |
|
11:24
🔗
|
Dud1 |
Yeah |
|
11:24
🔗
|
Nemo_bis |
probably several GB |
|
11:24
🔗
|
Nemo_bis |
check the wikia dumps on archive.org to see if there's a previous dump of that wiki, I thought I had linked you one? |
|
11:28
🔗
|
Dud1 |
The only rswiki on archive is https://archive.org/details/wiki-wikirshunhu and that is a different one. |
|
11:39
🔗
|
Nemo_bis |
no, you have to check wikia dumps |
|
11:40
🔗
|
Nemo_bis |
like https://archive.org/download/wikia_dump_20121204/r.zip/ |
|
11:41
🔗
|
Nemo_bis |
http://archive.org/download/wikia_dump_20121204/f.zip/f%2Ffi%2Ffirunescape%2Fpages_full.xml.gz is 20 MB gzipped |
|
11:41
🔗
|
Nemo_bis |
if you're downloading the English one it was 3 GB compressed |
|
11:41
🔗
|
Nemo_bis |
so, probably less than 30 GB uncompressed |
|
11:57
🔗
|
Dud1 |
I am sorry, but I'm confused now. Should I continue the way I was going or what? |
|
12:10
🔗
|
Nemo_bis |
Dud1: sure, unless you lack disk space |
|
12:11
🔗
|
Nemo_bis |
but if you want to dump the finnish one then you have to use the api to the finnish one :) |
|
12:13
🔗
|
Dud1 |
I have 124gb so I'll keep going, I cna delete stuff if needed. I'll keep with the english one first then try the rest (never noticed that site had other languages XD) |
|
12:14
🔗
|
Dud1 |
Thanks :) |
|
12:16
🔗
|
Nemo_bis |
then use 7z a -mx9 to compress it, much better for full dumps |
|
14:04
🔗
|
Nemo_bis |
Out of few dozens Wikia wikis which also have an image dump, there is buytwitterfollowers_images.tar. Go figure. |