| Time |
Nickname |
Message |
|
07:53
🔗
|
mutoso |
Anyone know why I'm getting a syntax error with the TaskForce script? |
|
08:00
🔗
|
Nemo_bis |
mutoso, what syntax error? |
|
08:00
🔗
|
Nemo_bis |
and what version are you using? |
|
08:02
🔗
|
mutoso |
File "dumpgenerator.py", line 44 |
|
08:02
🔗
|
mutoso |
print 'Sleeping... %d seconds...' % (config['delay']) |
|
08:02
🔗
|
mutoso |
^ |
|
08:02
🔗
|
mutoso |
Nemo_bis, 2.7 |
|
08:04
🔗
|
Nemo_bis |
again this delay thing? |
|
08:04
🔗
|
Nemo_bis |
did you set any delay in the options? |
|
08:05
🔗
|
mutoso |
Nope. |
|
08:05
🔗
|
Nemo_bis |
Did you change the script? |
|
08:05
🔗
|
mutoso |
Nope. |
|
08:05
🔗
|
mutoso |
and I just redownloaded it. |
|
08:13
🔗
|
mutoso |
Well, if I can't fix this. I may have to give up list020 to someone else. :( |
|
08:22
🔗
|
Nemo_bis |
mutoso, I don't understand how this can happen, it works here |
|
08:36
🔗
|
mutoso |
No idea either. |
|
09:55
🔗
|
Nemo_bis |
mutoso, did you redownload launcher.py too? |
|
13:29
🔗
|
emijrp |
who can wget this http://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/ |
|
13:38
🔗
|
SketchCow |
I can do that. |
|
13:38
🔗
|
emijrp |
go go go |
|
13:39
🔗
|
SketchCow |
2.14M/s |
|
13:39
🔗
|
emijrp |
lol |
|
13:40
🔗
|
Nemo_bis |
but but but |
|
13:40
🔗
|
Nemo_bis |
Ariel said they're not stable nor checked yet etc. etc. |
|
13:41
🔗
|
SketchCow |
I'm bzip2ing these things. |
|
13:41
🔗
|
Nemo_bis |
bz2 for images? |
|
13:41
🔗
|
SketchCow |
Is that what they are? |
|
13:42
🔗
|
SketchCow |
Regardless, it's a space-saver. |
|
13:42
🔗
|
Nemo_bis |
hm |
|
13:42
🔗
|
Nemo_bis |
yes theyre images |
|
13:43
🔗
|
Nemo_bis |
mostly JPG http://stats.wikimedia.org/reportcard/#fragment-101 |
|
13:47
🔗
|
Gfy |
http://wikipapers.referata.com/wiki/WikiTeam_dumps |
|
13:48
🔗
|
SketchCow |
694,599,680 5.06M/s in 4m 14s |
|
13:53
🔗
|
emijrp |
there are several 90GB tars |
|
13:53
🔗
|
emijrp |
so, it is not as fast as i thought |
|
14:01
🔗
|
SketchCow |
It's coming along nicely. |
|
14:05
🔗
|
Nemo_bis |
emijrp I wanna TaskFore wikis uploader :) |
|
14:05
🔗
|
Nemo_bis |
*TaskForce |
|
14:05
🔗
|
emijrp |
and i wanna 10 porn actresses in my door |
|
14:09
🔗
|
SketchCow |
http://archive.org/details/archiveteam-bumblebee-usr-thread |
|
14:09
🔗
|
Nemo_bis |
emijrp, hm, doesn't seem the same thing |
|
17:51
🔗
|
Nemo_bis |
emijrp, are you waiting for something on my end wrt truncated YouTube video descriptions? |
|
17:52
🔗
|
Nemo_bis |
I understood you were going to look into it (I wouldn't know where to start), am I correct? |
|
17:54
🔗
|
emijrp |
i dont know why are truncated |
|
17:54
🔗
|
emijrp |
it doesnt fails always |
|
17:55
🔗
|
Nemo_bis |
emijrp, is it a blocker? |
|
17:55
🔗
|
Nemo_bis |
or should we archive first, fix later? |
|
17:57
🔗
|
emijrp |
not sure |
|
18:20
🔗
|
emijrp |
how many videos left ? Nemo_bis |
|
18:21
🔗
|
Nemo_bis |
emijrp, about 400 I think |
|
19:58
🔗
|
emijrp |
Nemo_bis: add this http://www.youtube.com/watch?v=TgR5xCep-fI to the top, and launche the video uplo0ader |
|
19:59
🔗
|
Nemo_bis |
emijrp, ok |
|
19:59
🔗
|
Nemo_bis |
emijrp, do i have to update the script? |
|
20:00
🔗
|
emijrp |
yes |
|
20:01
🔗
|
emijrp |
https://emijrp.googlecode.com/svn-history/r113/trunk/scrapers/youtube2internetarchive.py |
|
20:01
🔗
|
emijrp |
direct link to the last version https://code.google.com/p/emijrp/source/browse/trunk/scrapers/youtube2internetarchive.py |
|
20:02
🔗
|
Nemo_bis |
yay for the first time I managed to adjust the size preference *before* running it for the first time |
|
20:03
🔗
|
Nemo_bis |
usual mysterious 404 error |
|
20:04
🔗
|
Nemo_bis |
uh, will take a while, a weird wiki eating all down bandwidth |
|
20:07
🔗
|
Nemo_bis |
emijrp, btw what sense does it make to put such a tiny size limit? |
|
20:07
🔗
|
emijrp |
testing |
|
20:08
🔗
|
Nemo_bis |
hmpf |
|
20:08
🔗
|
Nemo_bis |
also emijrp, is there anything else I should be careful about in this test? |
|
20:09
🔗
|
emijrp |
this is not a test |
|
20:09
🔗
|
emijrp |
size limit is for debugging, my home connection has a tiny upload stream |
|
20:16
🔗
|
Nemo_bis |
emijrp, ok but can't you leave a sane default for the other users? :p |
|
20:29
🔗
|
Nemo_bis |
emijrp, it's uploading the second video now |
|
20:29
🔗
|
emijrp |
Nemo_bis: are you using the correct script? |
|
20:29
🔗
|
emijrp |
http://archive.org/details/spanishrevolution-15M_Barcelona_2011_-_Lectura_Manifiest_15M_-_Emisio_streaming_3g_en_di-fI |
|
20:29
🔗
|
emijrp |
the video id is truncated |
|
20:29
🔗
|
Nemo_bis |
hm |
|
20:29
🔗
|
Nemo_bis |
I did update it |
|
20:32
🔗
|
emijrp |
also, i dont know why your descriptions are truncated, but i uplaoded this video this afternoon and descrition is OK http://archive.org/details/spanishrevolution-Juan_Sanchez_en_huelga_de_hambre_en_la_Puerta_del_Sol_MOV-AUmPWwtBP9s |
|
20:32
🔗
|
Nemo_bis |
emijrp, do you get the error 404? |
|
20:32
🔗
|
emijrp |
yes |
|
20:33
🔗
|
Nemo_bis |
script stopped |
|
20:37
🔗
|
emijrp |
ok i found the bug for the title |
|
20:38
🔗
|
Nemo_bis |
oh, good |
|
20:43
🔗
|
emijrp |
update |
|
20:43
🔗
|
emijrp |
and run |
|
20:44
🔗
|
Nemo_bis |
ehm, computer overloaded, browser stuck; what's the direct URL to the raw text? :) |
|
20:45
🔗
|
Nemo_bis |
https://emijrp.googlecode.com/svn/trunk/scrapers/youtube2internetarchive.py |
|
20:46
🔗
|
Nemo_bis |
emijrp, http://archive.org/details/spanishrevolution-La_que_esta_cayendo_-_15M_Caceres-6Zl7sApWsRw |
|
20:48
🔗
|
emijrp |
look ok |
|
20:56
🔗
|
Nemo_bis |
emijrp, even description? |
|
20:58
🔗
|
emijrp |
that video has a short desc |
|
20:58
🔗
|
emijrp |
so it is ok |
|
21:00
🔗
|
Nemo_bis |
hm |