Time |
Nickname |
Message |
06:20
🔗
|
soultcer |
Isn't there cityofheroes? |
09:16
🔗
|
soultcer |
alard: How do I use the warrior data directory. It's a symbolic link to /data/data/data, a folder that doesn't exit |
09:17
🔗
|
soultcer |
Do I simply create it? |
09:21
🔗
|
alard |
soultcer: Which version of the warrior? (I'm looking through the code of warrior 2, but haven't find the symlink so far.) |
09:22
🔗
|
alard |
*found |
09:22
🔗
|
soultcer |
archiveteam-warrior-v2-20120813.ova |
09:23
🔗
|
soultcer |
It creates a symlink inside the project directory to /data/data/data |
09:23
🔗
|
alard |
https://github.com/ArchiveTeam/seesaw-kit/blob/master/seesaw/warrior.py#L335-345 |
09:24
🔗
|
alard |
Doesn't that create the directory? |
09:26
🔗
|
soultcer |
Hm, it should as far as I read from the code. Run-warrior gets called with data-dir=/data/data, then the code will first remove and recreate /data/data/data |
09:27
🔗
|
alard |
But it's not a problem to just create a relative data/ directory. |
09:28
🔗
|
alard |
Like here: https://github.com/ArchiveTeam/cityofheroes-grab/blob/master/pipeline.py#L15-30 |
09:28
🔗
|
alard |
The warrior will run your pipeline in the correct subdirectory, so ./data/ will point to the correct path. |
09:29
🔗
|
alard |
(And if you hardcode /data/data/data you'll have problems running the script outside the warrior, with ./run-pipeline.) |
09:29
🔗
|
soultcer |
Hm weird, now the directory is there |
09:29
🔗
|
soultcer |
I must have looked at the wrong time/too early |
09:30
🔗
|
soultcer |
At the moment I was just using the python TemporaryFile class to create temp files. Since I don't really need a lot of space, everything was working fine |
09:32
🔗
|
alard |
Ah, yes, creating the data directory is the very last step in the installation. |
09:34
🔗
|
alard |
(Just ask TemporaryFile to write things to the ./data/ directory.) |
09:35
🔗
|
alard |
Is this going to be a new large-scale warrior project? |
09:48
🔗
|
soultcer |
Nah, I'm just making sure the urlteam stuff runs on the warrior. |
09:48
🔗
|
soultcer |
It requires neither high storage capacity nor lots of bandwidth |
10:02
🔗
|
soultcer |
Is there a default username configured for the warrior? |
10:03
🔗
|
alard |
warrior |
10:03
🔗
|
soultcer |
Good |
10:03
🔗
|
soultcer |
So I will know which tasks were finished by warriors and which where run standalone |