| Time |
Nickname |
Message |
|
19:33
🔗
|
Nemo_bis |
hello emijrp |
|
19:33
🔗
|
Nemo_bis |
see my reply on list |
|
19:34
🔗
|
Nemo_bis |
if you could write a quick and dirty solution then I'm sure others would be able to improve it (I'll try as well, for metadata details and similar things) |
|
19:44
🔗
|
Nemo_bis |
sorry for not seeing your reply: to reduce list-addiction I download emails from the lists account only every 20 min :) |
|
19:45
🔗
|
Nemo_bis |
ah, emijrp, for the hardcoded s3 key you should ask alard, that's what his seesaw-s3 script does for mobileme |
|
19:51
🔗
|
emijrp |
im not sure if harcode the key, or display an input |
|
19:51
🔗
|
Nemo_bis |
emijrp, input is better IMHO |
|
19:51
🔗
|
emijrp |
how do you ask for a s3 key? |
|
19:51
🔗
|
Nemo_bis |
at least for now |
|
19:51
🔗
|
Nemo_bis |
emijrp, info AT archive.org |
|
19:52
🔗
|
Nemo_bis |
it was quite easy to get one for me, they just told me to use s3 when I asked the a way to upload 8+ Gb files |
|
19:54
🔗
|
alard |
emijrp: http://archive.org/account/s3.php |
|
19:54
🔗
|
Nemo_bis |
alard, is it available since the beginning? |
|
19:54
🔗
|
Nemo_bis |
I discovered it only after a lot of headaches so I don't know |
|
19:55
🔗
|
alard |
I don't know. I haven't been using s3 until recently. |
|
19:55
🔗
|
Nemo_bis |
Same here... |
|
19:59
🔗
|
Nemo_bis |
But emijrp can tell us, if he sees it it's for everyone without requesting I suppose. |
|
20:00
🔗
|
alard |
I've never done anything special to get s3 keys. Just make an account, go to that page and ask for them. |
|
20:00
🔗
|
alard |
I don't run the memac uploads from my own account, even. |
|
20:05
🔗
|
emijrp |
what is this |
|
20:05
🔗
|
emijrp |
--header 'x-amz-auto-make-bucket:1' \ |
|
20:05
🔗
|
emijrp |
--header 'x-archive-queue-derive:0' \ |
|
20:05
🔗
|
emijrp |
--header 'x-archive-size-hint:9638436173' \ |
|
20:06
🔗
|
alard |
http://archive.org/help/abouts3.txt |
|
20:06
🔗
|
alard |
auto-make-bucket: Make an item. |
|
20:06
🔗
|
alard |
queue-derive:0 Do not derive things. |
|
20:07
🔗
|
alard |
size-hint: Allows the system to place the item on a server with enough space (it doesn't know the size when you start uploading, but you do). |
|
20:12
🔗
|
emijrp |
Nemo_bis: there are some values that cannot be automated, license, description.. |
|
20:12
🔗
|
emijrp |
i can make an uploader, but those fields must be fillled by hand |
|
20:12
🔗
|
Nemo_bis |
emijrp, the description is wiki's sitename + URL + boilerplate about wikiteam |
|
20:12
🔗
|
Nemo_bis |
license can be extracted from API |
|
20:12
🔗
|
Nemo_bis |
(often) |
|
20:12
🔗
|
emijrp |
a free electrocardiography (ECG) tutorial and textbook to which anyone can contribute, designed for medical professionals such as cardiac care nurses and physicians. |
|
20:13
🔗
|
Nemo_bis |
yeah, but that's not so necessary |
|
20:13
🔗
|
Nemo_bis |
one can always add it later |
|
20:13
🔗
|
Nemo_bis |
emijrp, https://www.mediawiki.org/wiki/API:Meta |
|
20:14
🔗
|
Nemo_bis |
like https://www.mediawiki.org/w/api.php?action=query&meta=siteinfo&siprop=rightsinfo |
|
20:14
🔗
|
Nemo_bis |
output can vary a bit across versions and configs |
|
20:17
🔗
|
emijrp |
give me your WT.log |
|
20:17
🔗
|
emijrp |
a sample |
|
20:18
🔗
|
Nemo_bis |
emijrp, it should be empty |
|
20:19
🔗
|
Nemo_bis |
it currently is for me; it's just a way to see the progress info on the terminal |
|
20:19
🔗
|
Nemo_bis |
When the upload failed, I had some HTML crap with a 500 error by archive.org, last time. |
|
20:22
🔗
|
emijrp |
s3 keys are given by a automate e-mail, or manually approved? |
|
20:22
🔗
|
Nemo_bis |
I have no idea! |
|
20:22
🔗
|
Nemo_bis |
What do you see at s3.php? |
|
20:23
🔗
|
alard |
emijrp: They appear on the page, at least for me. You click a button once to get your initial set, then click the button again to get more. |
|
20:23
🔗
|
emijrp |
k |
|
20:40
🔗
|
emijrp |
Nemo_bis: the curl command you pasted only uploads the -wikidump file |
|
20:40
🔗
|
emijrp |
one curl per file? |
|
20:40
🔗
|
Nemo_bis |
emijrp, I don't know if you can do two |
|
20:40
🔗
|
emijrp |
how do yuo do it? |
|
20:41
🔗
|
Nemo_bis |
I do another curl with just the filename etc. |
|
20:41
🔗
|
Nemo_bis |
no metadata |
|
20:41
🔗
|
emijrp |
ok |
|
20:42
🔗
|
Nemo_bis |
plus --header 'x-archive-queue-derive:0' --header 'x-archive-size-hint:9638436173' if you want |
|
20:42
🔗
|
Nemo_bis |
but the hint is less useful on second upload AFAIK |
|
20:43
🔗
|
emijrp |
and make-bucket? |
|
20:44
🔗
|
Nemo_bis |
no |
|
20:46
🔗
|
emijrp |
why do you put nofollow on the description links? |
|
20:48
🔗
|
Nemo_bis |
emijrp, they get added anyway |
|
20:48
🔗
|
Nemo_bis |
I'm lazy, I copy them from previous items so there's the nofollow as well |
|
20:59
🔗
|
emijrp |
this curl command is cool |
|
20:59
🔗
|
emijrp |
we can made a script to upload all the Creative Commons videos from YouTube, download and upload, download and upload, etc |
|
21:01
🔗
|
Nemo_bis |
Yeah |
|
21:15
🔗
|
emijrp |
Nemo_bis: --location is needed always? |
|
21:15
🔗
|
Nemo_bis |
emijrp, I think so |
|
21:16
🔗
|
Nemo_bis |
but I don't remember exactly |
|
21:16
🔗
|
Nemo_bis |
sometimes you can even use -C to resume failed uploads, but doesn't work consistently |
|
21:17
🔗
|
Nemo_bis |
emijrp, I mean that I read the man some time ago and that I'm always using --location so it surely works like that but I don't remember if you can do in another way. |
|
21:27
🔗
|
emijrp |
how do you check if upload is ok? md5? |
|
21:30
🔗
|
Nemo_bis |
emijrp, curl exit code? |
|
21:31
🔗
|
Nemo_bis |
but md5 is an option as well, if the file is uploaded |
|
21:31
🔗
|
Nemo_bis |
usually it either fails or succeeds, AFAICS |
|
21:32
🔗
|
emijrp |
do you add wiki- to all the items? |
|
21:32
🔗
|
Nemo_bis |
emijrp, yes, we were requested to do so by the collection admins |
|
21:33
🔗
|
Nemo_bis |
and the same applies to the Wiki - prefix in the title |
|
21:33
🔗
|
Nemo_bis |
underscor told us |