Time |
Nickname |
Message |
14:22
🔗
|
Schbirid |
starting to upload the image dumps |
14:26
🔗
|
Schbirid |
s3cmd --add-header x-archive-auto-make-bucket:1 --add-header "x-archive-meta-mediatype:web" --add-header "x-archive-meta-subject:wiki, wikiteam, MediaWiki, Wikia, dumps, images" --add-header "x-archive-meta-title: Wikia wikis image dumps, 0 to 9 (February 2014)" --add-header 'x-archive-meta-description:A dump of images from Wikia wikis. This item/archive contains the images of wikis starting with the numbers 0 to 9. Archived in Febr |
14:26
🔗
|
Schbirid |
uary 2014' put wikia_images_dump_201402_0..9.tar s3://wikia_images_dump_201402 |
14:26
🔗
|
Schbirid |
looking good? |
14:26
🔗
|
Schbirid |
i took https://archive.org/details/wikia_dump_20140125 as template |
14:31
🔗
|
Nemo_bis |
don't add _images to the identifier |
14:32
🔗
|
Schbirid |
why not? |
14:32
🔗
|
Nemo_bis |
because then I can't search by wikia_dump etc. |
14:32
🔗
|
Nemo_bis |
no reason to break the continuity |
14:33
🔗
|
Schbirid |
hm, my reasoning was that differentiating between xml and images dumps would be nice |
14:33
🔗
|
Schbirid |
wikia_dump_images_201402 maybe? |
14:35
🔗
|
* |
Schbirid gets a trout |
14:37
🔗
|
Schbirid |
search works well enough with tags https://archive.org/search.php?query=subject%3A%22Wikia%22%20AND%20subject%3A%22dumps%22 , i will use wikia_dump_images_201402 unless you argue better in thenext few minutes :P |
14:40
🔗
|
Nemo_bis |
all those identifiers contain different things, they all are partial dumps but they all are wikia dumps |
14:40
🔗
|
Nemo_bis |
do whatever you want but be aware that I won't follow your model |
14:42
🔗
|
Schbirid |
that's a good argument :) |
14:45
🔗
|
Schbirid |
do you really want the archive to be named 0.zip/0.tar? i MUCH prefer verbose filenames |
14:46
🔗
|
Schbirid |
i fancy wikia_dump_201402_images-0..9.tar , wikia_dump_201402_images-a.tar etc |
14:49
🔗
|
Nemo_bis |
ok, that doesn't matter because for the reason above we don't have a consistent naming of contained files |
14:49
🔗
|
Schbirid |
ok |
14:49
🔗
|
Nemo_bis |
wth, this wiki so far gave me 107 GB of XML http://www.kvalitaknih.cz/index.php/Speci%C3%A1ln%C3%AD:Statistika |
14:50
🔗
|
Schbirid |
will up wikia_dump_201402-0..9/wikia_dump_201402_images-0..9.tar |
14:50
🔗
|
Schbirid |
i have single items because it is way too much :D |
14:55
🔗
|
Nemo_bis |
Hm. Ok. Admins will love you for that. :) |
14:57
🔗
|
Schbirid |
i think the total is much more than 1TB |
15:04
🔗
|
Nemo_bis |
eek |
15:04
🔗
|
Nemo_bis |
so you did all those wikis? |
15:05
🔗
|
Schbirid |
i am doing a lot of re-running to verify them, right now i am "done" up to ~d |
15:05
🔗
|
Schbirid |
but ran earlier up to s |
15:05
🔗
|
Schbirid |
and i have ~800G |
15:39
🔗
|
Schbirid |
god damn that subject keyword syntax... |
15:39
🔗
|
Schbirid |
first item is up https://archive.org/details/wikia_dump_201402-0..9 |
20:56
🔗
|
Schbirid |
https://archive.org/details/wikia_dump_201402-a |
20:57
🔗
|
Schbirid |
oops, too early |
20:58
🔗
|
Schbirid |
b and c over night |
21:07
🔗
|
Nemo_bis |
well done |