| Time |
Nickname |
Message |
|
10:07
🔗
|
|
mls has joined #warrior |
|
10:15
🔗
|
mls |
Smiley: Which warrior version are you using? |
|
10:19
🔗
|
Smiley |
mls: erm ? how do I tell? |
|
10:19
🔗
|
Smiley |
Or do you mean, I'm using the ova |
|
10:19
🔗
|
Smiley |
in virtualbox |
|
10:19
🔗
|
mls |
Yes, the .ova file should have a version mentioned in its name v2 or v3? |
|
10:21
🔗
|
Smiley |
Oh, v2 |
|
10:21
🔗
|
Smiley |
I didn't even know there was a v3? |
|
10:21
🔗
|
Smiley |
(The wiki still links to v2 too) |
|
10:21
🔗
|
mls |
There's a beta dubbed v3 |
|
10:21
🔗
|
Smiley |
Ah right |
|
10:22
🔗
|
Smiley |
So should I try that? |
|
10:22
🔗
|
Smiley |
Also, how do we go about getting console access now, as there's only one active tty, and it autostarts hte warrior code so I can't get in to enable ssh? |
|
10:23
🔗
|
mls |
Stick with what you have, I'm not the person who created it and am not very familiar with the beta v3 |
|
10:23
🔗
|
mls |
Console access should be easy, importing instance now so I can talk you through |
|
10:24
🔗
|
Smiley |
Right now I'm running url team and that works, so it just seems to be newsgrabber which is broken, but i wanted to figure out exactly what it's doing |
|
10:24
🔗
|
Smiley |
k |
|
10:24
🔗
|
mls |
And I meant to say appliance, not instance.. gah, words. |
|
10:24
🔗
|
Smiley |
I understood, words are wind |
|
10:29
🔗
|
mls |
Right, lets try that again. Virtually allocated drives that aren't visible are hard to edit =P |
|
10:35
🔗
|
mls |
Smiley: So once you've started your warrior you should get a pretty screen with a logo telling where you should point your browser |
|
10:36
🔗
|
Smiley |
yup |
|
10:36
🔗
|
mls |
When you select that screen with your mouse you can press Alt+3 and see a login screen |
|
10:36
🔗
|
Smiley |
hmmm |
|
10:37
🔗
|
Smiley |
that's not working for me, weird |
|
10:37
🔗
|
mls |
But you have the Warrior logo with the guiding text? |
|
10:37
🔗
|
Smiley |
yup |
|
10:38
🔗
|
mls |
Try Left Ctrl+Alt+3 |
|
10:38
🔗
|
Smiley |
and if I do crt+alt+4 I get a console screen showing './boot-part-2.sh: line 6: 11251 Quit sleep 120' |
|
10:39
🔗
|
Smiley |
I wonder why the keyboard isn't working |
|
10:39
🔗
|
mls |
Oh right, try doing the same but instead of regular digits try the function keys |
|
10:39
🔗
|
Smiley |
only 4 seems to work |
|
10:39
🔗
|
Smiley |
yeha, that flips my actual tty |
|
10:39
🔗
|
mls |
So Alt+F3, Alt+F4 and so on |
|
10:39
🔗
|
Smiley |
from X |
|
10:39
🔗
|
Smiley |
Oh ffs, ty |
|
10:39
🔗
|
mls |
You're running VirtualBox on Linux? |
|
10:40
🔗
|
Smiley |
yup |
|
10:40
🔗
|
Smiley |
yeah so I'm logged in now at least |
|
10:40
🔗
|
Smiley |
not sure why I didn't try just alt+Function key before |
|
10:40
🔗
|
mls |
Good to know, clicking VirtualBox requires the mouse and keyboard getting captured or you'll end up switching your local ttys =D |
|
10:41
🔗
|
Smiley |
YUP |
|
10:41
🔗
|
Smiley |
yup, but i use ctrl+alt+function key to switch my local tty |
|
10:41
🔗
|
Smiley |
however didn't occur to me to try just alt+functionkey ;D |
|
10:41
🔗
|
mls |
I remember switching tty working without the function keys, but that was back the day I didn't use any GUI |
|
10:41
🔗
|
Smiley |
chtty ? |
|
10:41
🔗
|
mls |
No no, just alt+<digit> |
|
10:41
🔗
|
Smiley |
:O |
|
10:42
🔗
|
mls |
Or even alt+cursor-left, alt+cursor-right |
|
10:43
🔗
|
Smiley |
Oh yes I've used thaT TOO |
|
10:43
🔗
|
Smiley |
whoops, keep hitting caps lock -_- |
|
10:43
🔗
|
Smiley |
now it's based on debian right? |
|
10:43
🔗
|
Smiley |
why can't I install openssh server o_O |
|
10:43
🔗
|
mls |
That never happened to me ever, I swear ;-] |
|
10:44
🔗
|
mls |
So anyway, warrior usually outputs to tty2 |
|
10:44
🔗
|
mls |
Logs to /data/data/warrior.log |
|
10:45
🔗
|
Smiley |
'WARNING: Project newsgrabber did not install correctly and we're ignoring this problem' |
|
10:45
🔗
|
Smiley |
lol.... |
|
10:45
🔗
|
mls |
There's the cause |
|
10:46
🔗
|
Smiley |
this is a freshly downloaded and installed warrior. |
|
10:46
🔗
|
mls |
I'll be doing the same, run urlteam2 and switch to newsgrabber |
|
10:46
🔗
|
Smiley |
that's what I did |
|
10:46
🔗
|
Smiley |
i can't ssh in, so copying text is impossible right now :/ |
|
10:47
🔗
|
mls |
No need to ssh in, login on tty3 or whatever tty you get a login prompt |
|
10:48
🔗
|
mls |
From there you can copy the /data/data/warrior.log file, scp or rsync should work |
|
10:50
🔗
|
mls |
Or try a ftp server if you prefer that |
|
10:54
🔗
|
Smiley |
so..... the newsgrabber project is broken :/ |
|
10:55
🔗
|
mls |
It's running on my end, looking at it now |
|
10:58
🔗
|
Smiley |
hmm ok |
|
10:58
🔗
|
Smiley |
when it first 'failed' for me, is when it'd get to the dedupe step |
|
10:58
🔗
|
Smiley |
and then it never runs again |
|
10:58
🔗
|
mls |
I see that both jobs are on that step right now |
|
11:01
🔗
|
mls |
Have you run the Software Update (Python 3.5) from available projects? |
|
11:02
🔗
|
mls |
And I'm not saying you should, just trying to figure things out |
|
11:07
🔗
|
Smiley |
I haven't |
|
11:07
🔗
|
Smiley |
trying it, and it says that also didn't install properly |
|
11:08
🔗
|
Smiley |
is there some way to force the warrior to reinstall a project? |
|
11:08
🔗
|
mls |
By reinstalling the Warrior, or manually removing the project directory |
|
11:09
🔗
|
Smiley |
ok, newsgrabber isnt' there, at all |
|
11:09
🔗
|
mls |
Though running the Software Upgrade might've made things more unpredictable |
|
11:09
🔗
|
mls |
Where's there? |
|
11:09
🔗
|
Smiley |
/data/data/projects |
|
11:10
🔗
|
mls |
True, it's elsewhere :D |
|
11:10
🔗
|
Smiley |
oh ok, where? |
|
11:10
🔗
|
mls |
ls ~warrior/projects |
|
11:10
🔗
|
Smiley |
home is empty |
|
11:10
🔗
|
mls |
Erm, ok |
|
11:10
🔗
|
Smiley |
:D |
|
11:10
🔗
|
mls |
In that case |
|
11:11
🔗
|
mls |
If you please, cat /etc/issue |
|
11:11
🔗
|
Smiley |
Debian 6.0 |
|
11:12
🔗
|
mls |
Unless they've changed a whole lot, and by the looks of my fresh installation they haven't |
|
11:13
🔗
|
mls |
In that case I'm very curious how other projects were able to run |
|
11:13
🔗
|
Smiley |
they are in /data/data/projects |
|
11:13
🔗
|
Smiley |
I have flickr-7379806, urlteam2-f4db6c4 and yahooanswers-f3141cb |
|
11:14
🔗
|
Smiley |
looks like wikiteam project also broken |
|
11:14
🔗
|
Smiley |
infact, those 3 above, are the only 3 that DO work |
|
11:14
🔗
|
Smiley |
the rest refuse to install |
|
11:16
🔗
|
Smiley |
Has some one changed where proijects are meant to install to, and only updated 3 of them? |
|
11:16
🔗
|
mls |
Not that I'm aware of |
|
11:16
🔗
|
mls |
But then again I'm not involved with this project |
|
11:16
🔗
|
mls |
Does running, id warrior, give you anything? |
|
11:19
🔗
|
Smiley |
yeah, it's got uid 1000, gid 1000 |
|
11:19
🔗
|
Smiley |
Oh I'm logged in as root |
|
11:19
🔗
|
Smiley |
does it run as warrior user? |
|
11:19
🔗
|
mls |
Yes you are |
|
11:19
🔗
|
mls |
Yes it does |
|
11:19
🔗
|
mls |
ps axu|grep ^warrior |
|
11:19
🔗
|
Smiley |
k wtf |
|
11:19
🔗
|
mls |
Should give you about 5 processes |
|
11:20
🔗
|
Smiley |
so /home/warrior/projects has newsgrabber, wikis, yahooanswers, urlteam2 and flickr |
|
11:20
🔗
|
Smiley |
so not _all_ the projects, but some more |
|
11:20
🔗
|
Smiley |
nuked the newsgrabber folder, re-selected the project, still fails to install |
|
11:21
🔗
|
mls |
Anything useful in /data/data/warrior.log ? |
|
11:21
🔗
|
Smiley |
only the did not install correctly and we're ignoring this problem |
|
11:21
🔗
|
Smiley |
it didn't create a directory for it in /home/warrior |
|
11:22
🔗
|
Smiley |
can I try and manually gitclone it? |
|
11:22
🔗
|
Smiley |
to see what happens |
|
11:22
🔗
|
mls |
Should be in /home/warrior/projects |
|
11:23
🔗
|
Smiley |
yup, it's not there. |
|
11:24
🔗
|
mls |
The two jobs that got to the deduplication step are still not done |
|
11:25
🔗
|
Smiley |
on the left, where it shows the steps |
|
11:25
🔗
|
Smiley |
has it even highlighted the dedupe step as running for you? |
|
11:25
🔗
|
mls |
Nope |
|
11:25
🔗
|
Smiley |
or at the top, does it show dedupe: 2 |
|
11:25
🔗
|
Smiley |
? |
|
11:25
🔗
|
mls |
Not that either |
|
11:25
🔗
|
Smiley |
yeah that's what mine did, it's like it just quits |
|
11:25
🔗
|
mls |
DeduplicateWarcExtProc 1 |
|
11:26
🔗
|
mls |
~warrior/projects/newsgrabber/data/ is empty |
|
11:26
🔗
|
Smiley |
but hte fact I can't even run the project on this VM is weird. |
|
11:26
🔗
|
Smiley |
I'm going to wipe this, reload the appliance |
|
11:38
🔗
|
mls |
It's messy, projects being cloned in both /home/warrior/projects and /data/data/projects |
|
11:38
🔗
|
Smiley |
yup |
|
11:39
🔗
|
mls |
Job data is still present in /data/data/projects/newsgrabber-3ef5d42/data |
|
11:43
🔗
|
Smiley |
ok so clone of newsgrabber-3ef5d42 into /data/data/projects/ seems to have worked |
|
11:43
🔗
|
Smiley |
yup it's worked this time, but I'm betting it'll crash at the dedupe step |
|
11:43
🔗
|
Smiley |
and then if you reboot/restart it, it won't work ever again |
|
11:44
🔗
|
mls |
I suspect that's because run-warrior2, that's supposed to glue it all together monitors /home/warrior/projects while things are happening elsewhere. |
|
11:45
🔗
|
Smiley |
ah |
|
11:45
🔗
|
Smiley |
so it's calling the dedupe task in the wrong place. |
|
11:45
🔗
|
mls |
Possibly |
|
11:45
🔗
|
Smiley |
Oh oh, now it seems to be working correctly maybe |
|
11:46
🔗
|
Smiley |
HCross2: any changes with the newsgrabber warrior atm? it suddenly seems to be working |
|
11:46
🔗
|
Smiley |
Item newsbuddy:warrior_221_1515126348.62: Step 4 of 9 INFO Fetched \u2018https://cdn-ssl.vidible.tv/prod/player/js/17.16.1255/html5/video-recovery-success.gif\u2019: 403 Forbidden. Length: unspecified [application/xml]. |
|
11:46
🔗
|
Smiley |
that url, with the \u2018 on the start, is that _correct_ |
|
11:46
🔗
|
Smiley |
If it's just a rendering bug with the warrior, then meh |
|
11:47
🔗
|
mls |
And I also suspect that if one would create a symbolic link to /data/data/projects it wouldn't work either since run-warrior2 is expecting project names which are currently unproperly named |
|
11:47
🔗
|
mls |
Nah I have the same when I'm running it manually, makes things hard to read in the beginning, I barely notice it anymore |
|
11:49
🔗
|
mls |
I believe /data/data/projects came to existance eversince warrior v3 beta was made available |
|
11:49
🔗
|
mls |
Since stuff is running dockerized and all |
|
11:50
🔗
|
Smiley |
ah nope |
|
11:50
🔗
|
Smiley |
stuff getting stuck now at step 4 of 9 |
|
11:50
🔗
|
Smiley |
it's weird, some of the items at first succeeded |
|
11:51
🔗
|
mls |
Smiley: Actually it might not be |
|
11:53
🔗
|
mls |
The deduplication is ran by calling dedupe.py as an external process, it might be the one located at ~warrior/projects/newsgrabber, expecting something to be there in ~warrior/projects/newsgrabber/data and there's nothing. |
|
11:53
🔗
|
Smiley |
so it just waits forever? |
|
11:53
🔗
|
Smiley |
mls: so can you run it manually, against the correct directory? |
|
11:53
🔗
|
Smiley |
and if that works, patch time xD |
|
11:53
🔗
|
mls |
No, it exits, gracefully, but without any results so it erm, does nothing? |
|
11:54
🔗
|
mls |
Might be the whole process goes ¯\_(ツ)_/¯ |
|
11:54
🔗
|
Smiley |
:D |
|
11:55
🔗
|
mls |
How odd |
|
11:55
🔗
|
* |
mls sniggers |
|
11:56
🔗
|
Smiley |
so running dedup tells you it doesn't have warcio |
|
11:58
🔗
|
mls |
I might be wrong, but by looking at the main process, it doesn't check for anything, nor does it raise any alarm bells |
|
11:59
🔗
|
mls |
Well not entirely true, but for the dedupe and then continuing on it doesn't |
|
12:27
🔗
|
Smiley |
Nod |
|
12:27
🔗
|
Smiley |
I've not looked at hte dedupe code yet |
|
12:29
🔗
|
mls |
The dedupe code itself seems fine, just not how it's called from within the pipeline by the looks of it |
|
12:31
🔗
|
mls |
Not with how the entire thing is ran |
|
12:35
🔗
|
Smiley |
hmm so it needs to pass back a code to say it finished, or not, maybe |
|
13:30
🔗
|
Smiley |
where do you get the v3 warrior? |
|
13:32
🔗
|
mls |
https://www.archiveteam.org/index.php?title=ArchiveTeam_Warrior#Beta_version |
|
13:34
🔗
|
mls |
I'm curious what version of Warrior is being used for newsgrabber |
|
13:40
🔗
|
Smiley |
the warrior version is independant afaik |
|
13:40
🔗
|
Smiley |
ii.e. the warrior (no matter what version) grabs the github code for the current scripts |
|
13:41
🔗
|
mls |
It only lists project version and user agent on the tracker |
|
13:41
🔗
|
* |
Smiley fires up the v3 and waits |
|
13:41
🔗
|
mls |
You'll be fine =] |
|
13:41
🔗
|
Smiley |
nothign yet :P |
|
13:50
🔗
|
Smiley |
hmmm |
|
13:50
🔗
|
Smiley |
V3 warrior isn't working for me :D |
|
13:50
🔗
|
Smiley |
i have no web interface |
|
13:51
🔗
|
Smiley |
and no /data dir? |
|
13:59
🔗
|
Smiley |
hmmm |
|
14:00
🔗
|
Smiley |
oh yeah it's in docker, right |
|
14:00
🔗
|
Smiley |
so how do I interact with docker D: |
|
18:39
🔗
|
|
BnAboyZ has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
MrRadar2 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
BnARobin has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
hook54321 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
mls has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
Kaz has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
yuitimoth has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
svchfoo1 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
tsr has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
balrog has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
will has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
ivan has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
Odd0002 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
Jusque has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
chfoo has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
bwn has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
fennec has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:39
🔗
|
|
bsmith093 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
18:44
🔗
|
|
mls has joined #warrior |
|
18:44
🔗
|
|
balrog has joined #warrior |
|
18:44
🔗
|
|
BnAboyZ has joined #warrior |
|
18:44
🔗
|
|
will has joined #warrior |
|
18:44
🔗
|
|
Kaz has joined #warrior |
|
18:44
🔗
|
|
ivan has joined #warrior |
|
18:44
🔗
|
|
Odd0002 has joined #warrior |
|
18:44
🔗
|
|
Jusque has joined #warrior |
|
18:44
🔗
|
|
chfoo has joined #warrior |
|
18:44
🔗
|
|
yuitimoth has joined #warrior |
|
18:44
🔗
|
|
bwn has joined #warrior |
|
18:44
🔗
|
|
MrRadar2 has joined #warrior |
|
18:44
🔗
|
|
fennec has joined #warrior |
|
18:44
🔗
|
|
bsmith093 has joined #warrior |
|
18:44
🔗
|
|
BnARobin has joined #warrior |
|
18:44
🔗
|
|
hook54321 has joined #warrior |
|
18:44
🔗
|
|
svchfoo1 has joined #warrior |
|
18:44
🔗
|
|
tsr has joined #warrior |
|
18:44
🔗
|
|
ircd.choopa.net sets mode: +ooo balrog chfoo svchfoo1 |
|
18:44
🔗
|
|
swebb sets mode: +o balrog |
|
23:41
🔗
|
mls |
Might I suggest using a different identifier for v3 beta when reporting in (tracker, hq) |