[10:07] *** mls has joined #warrior [10:15] Smiley: Which warrior version are you using? [10:19] mls: erm ? how do I tell? [10:19] Or do you mean, I'm using the ova [10:19] in virtualbox [10:19] Yes, the .ova file should have a version mentioned in its name v2 or v3? [10:21] Oh, v2 [10:21] I didn't even know there was a v3? [10:21] (The wiki still links to v2 too) [10:21] There's a beta dubbed v3 [10:21] Ah right [10:22] So should I try that? [10:22] Also, how do we go about getting console access now, as there's only one active tty, and it autostarts hte warrior code so I can't get in to enable ssh? [10:23] Stick with what you have, I'm not the person who created it and am not very familiar with the beta v3 [10:23] Console access should be easy, importing instance now so I can talk you through [10:24] Right now I'm running url team and that works, so it just seems to be newsgrabber which is broken, but i wanted to figure out exactly what it's doing [10:24] k [10:24] And I meant to say appliance, not instance.. gah, words. [10:24] I understood, words are wind [10:29] Right, lets try that again. Virtually allocated drives that aren't visible are hard to edit =P [10:35] Smiley: So once you've started your warrior you should get a pretty screen with a logo telling where you should point your browser [10:36] yup [10:36] When you select that screen with your mouse you can press Alt+3 and see a login screen [10:36] hmmm [10:37] that's not working for me, weird [10:37] But you have the Warrior logo with the guiding text? [10:37] yup [10:38] Try Left Ctrl+Alt+3 [10:38] and if I do crt+alt+4 I get a console screen showing './boot-part-2.sh: line 6: 11251 Quit sleep 120' [10:39] I wonder why the keyboard isn't working [10:39] Oh right, try doing the same but instead of regular digits try the function keys [10:39] only 4 seems to work [10:39] yeha, that flips my actual tty [10:39] So Alt+F3, Alt+F4 and so on [10:39] from X [10:39] Oh ffs, ty [10:39] You're running VirtualBox on Linux? [10:40] yup [10:40] yeah so I'm logged in now at least [10:40] not sure why I didn't try just alt+Function key before [10:40] Good to know, clicking VirtualBox requires the mouse and keyboard getting captured or you'll end up switching your local ttys =D [10:41] YUP [10:41] yup, but i use ctrl+alt+function key to switch my local tty [10:41] however didn't occur to me to try just alt+functionkey ;D [10:41] I remember switching tty working without the function keys, but that was back the day I didn't use any GUI [10:41] chtty ? [10:41] No no, just alt+ [10:41] :O [10:42] Or even alt+cursor-left, alt+cursor-right [10:43] Oh yes I've used thaT TOO [10:43] whoops, keep hitting caps lock -_- [10:43] now it's based on debian right? [10:43] why can't I install openssh server o_O [10:43] That never happened to me ever, I swear ;-] [10:44] So anyway, warrior usually outputs to tty2 [10:44] Logs to /data/data/warrior.log [10:45] 'WARNING: Project newsgrabber did not install correctly and we're ignoring this problem' [10:45] lol.... [10:45] There's the cause [10:46] this is a freshly downloaded and installed warrior. [10:46] I'll be doing the same, run urlteam2 and switch to newsgrabber [10:46] that's what I did [10:46] i can't ssh in, so copying text is impossible right now :/ [10:47] No need to ssh in, login on tty3 or whatever tty you get a login prompt [10:48] From there you can copy the /data/data/warrior.log file, scp or rsync should work [10:50] Or try a ftp server if you prefer that [10:54] so..... the newsgrabber project is broken :/ [10:55] It's running on my end, looking at it now [10:58] hmm ok [10:58] when it first 'failed' for me, is when it'd get to the dedupe step [10:58] and then it never runs again [10:58] I see that both jobs are on that step right now [11:01] Have you run the Software Update (Python 3.5) from available projects? [11:02] And I'm not saying you should, just trying to figure things out [11:07] I haven't [11:07] trying it, and it says that also didn't install properly [11:08] is there some way to force the warrior to reinstall a project? [11:08] By reinstalling the Warrior, or manually removing the project directory [11:09] ok, newsgrabber isnt' there, at all [11:09] Though running the Software Upgrade might've made things more unpredictable [11:09] Where's there? [11:09] /data/data/projects [11:10] True, it's elsewhere :D [11:10] oh ok, where? [11:10] ls ~warrior/projects [11:10] home is empty [11:10] Erm, ok [11:10] :D [11:10] In that case [11:11] If you please, cat /etc/issue [11:11] Debian 6.0 [11:12] Unless they've changed a whole lot, and by the looks of my fresh installation they haven't [11:13] In that case I'm very curious how other projects were able to run [11:13] they are in /data/data/projects [11:13] I have flickr-7379806, urlteam2-f4db6c4 and yahooanswers-f3141cb [11:14] looks like wikiteam project also broken [11:14] infact, those 3 above, are the only 3 that DO work [11:14] the rest refuse to install [11:16] Has some one changed where proijects are meant to install to, and only updated 3 of them? [11:16] Not that I'm aware of [11:16] But then again I'm not involved with this project [11:16] Does running, id warrior, give you anything? [11:19] yeah, it's got uid 1000, gid 1000 [11:19] Oh I'm logged in as root [11:19] does it run as warrior user? [11:19] Yes you are [11:19] Yes it does [11:19] ps axu|grep ^warrior [11:19] k wtf [11:19] Should give you about 5 processes [11:20] so /home/warrior/projects has newsgrabber, wikis, yahooanswers, urlteam2 and flickr [11:20] so not _all_ the projects, but some more [11:20] nuked the newsgrabber folder, re-selected the project, still fails to install [11:21] Anything useful in /data/data/warrior.log ? [11:21] only the did not install correctly and we're ignoring this problem [11:21] it didn't create a directory for it in /home/warrior [11:22] can I try and manually gitclone it? [11:22] to see what happens [11:22] Should be in /home/warrior/projects [11:23] yup, it's not there. [11:24] The two jobs that got to the deduplication step are still not done [11:25] on the left, where it shows the steps [11:25] has it even highlighted the dedupe step as running for you? [11:25] Nope [11:25] or at the top, does it show dedupe: 2 [11:25] ? [11:25] Not that either [11:25] yeah that's what mine did, it's like it just quits [11:25] DeduplicateWarcExtProc 1 [11:26] ~warrior/projects/newsgrabber/data/ is empty [11:26] but hte fact I can't even run the project on this VM is weird. [11:26] I'm going to wipe this, reload the appliance [11:38] It's messy, projects being cloned in both /home/warrior/projects and /data/data/projects [11:38] yup [11:39] Job data is still present in /data/data/projects/newsgrabber-3ef5d42/data [11:43] ok so clone of newsgrabber-3ef5d42 into /data/data/projects/ seems to have worked [11:43] yup it's worked this time, but I'm betting it'll crash at the dedupe step [11:43] and then if you reboot/restart it, it won't work ever again [11:44] I suspect that's because run-warrior2, that's supposed to glue it all together monitors /home/warrior/projects while things are happening elsewhere. [11:45] ah [11:45] so it's calling the dedupe task in the wrong place. [11:45] Possibly [11:45] Oh oh, now it seems to be working correctly maybe [11:46] HCross2: any changes with the newsgrabber warrior atm? it suddenly seems to be working [11:46] Item newsbuddy:warrior_221_1515126348.62: Step 4 of 9 INFO Fetched \u2018https://cdn-ssl.vidible.tv/prod/player/js/17.16.1255/html5/video-recovery-success.gif\u2019: 403 Forbidden. Length: unspecified [application/xml]. [11:46] that url, with the \u2018 on the start, is that _correct_ [11:46] If it's just a rendering bug with the warrior, then meh [11:47] And I also suspect that if one would create a symbolic link to /data/data/projects it wouldn't work either since run-warrior2 is expecting project names which are currently unproperly named [11:47] Nah I have the same when I'm running it manually, makes things hard to read in the beginning, I barely notice it anymore [11:49] I believe /data/data/projects came to existance eversince warrior v3 beta was made available [11:49] Since stuff is running dockerized and all [11:50] ah nope [11:50] stuff getting stuck now at step 4 of 9 [11:50] it's weird, some of the items at first succeeded [11:51] Smiley: Actually it might not be [11:53] The deduplication is ran by calling dedupe.py as an external process, it might be the one located at ~warrior/projects/newsgrabber, expecting something to be there in ~warrior/projects/newsgrabber/data and there's nothing. [11:53] so it just waits forever? [11:53] mls: so can you run it manually, against the correct directory? [11:53] and if that works, patch time xD [11:53] No, it exits, gracefully, but without any results so it erm, does nothing? [11:54] Might be the whole process goes ¯\_(ツ)_/¯ [11:54] :D [11:55] How odd [11:55] * mls sniggers [11:56] so running dedup tells you it doesn't have warcio [11:58] I might be wrong, but by looking at the main process, it doesn't check for anything, nor does it raise any alarm bells [11:59] Well not entirely true, but for the dedupe and then continuing on it doesn't [12:27] Nod [12:27] I've not looked at hte dedupe code yet [12:29] The dedupe code itself seems fine, just not how it's called from within the pipeline by the looks of it [12:31] Not with how the entire thing is ran [12:35] hmm so it needs to pass back a code to say it finished, or not, maybe [13:30] where do you get the v3 warrior? [13:32] https://www.archiveteam.org/index.php?title=ArchiveTeam_Warrior#Beta_version [13:34] I'm curious what version of Warrior is being used for newsgrabber [13:40] the warrior version is independant afaik [13:40] ii.e. the warrior (no matter what version) grabs the github code for the current scripts [13:41] It only lists project version and user agent on the tracker [13:41] * Smiley fires up the v3 and waits [13:41] You'll be fine =] [13:41] nothign yet :P [13:50] hmmm [13:50] V3 warrior isn't working for me :D [13:50] i have no web interface [13:51] and no /data dir? [13:59] hmmm [14:00] oh yeah it's in docker, right [14:00] so how do I interact with docker D: [18:39] *** BnAboyZ has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** MrRadar2 has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** BnARobin has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** hook54321 has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** mls has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** Kaz has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** yuitimoth has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** svchfoo1 has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** tsr has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** balrog has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** will has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** ivan has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** Odd0002 has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** Jusque has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** chfoo has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** bwn has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** fennec has quit IRC (hub.efnet.us ircd.choopa.net) [18:39] *** bsmith093 has quit IRC (hub.efnet.us ircd.choopa.net) [18:44] *** mls has joined #warrior [18:44] *** balrog has joined #warrior [18:44] *** BnAboyZ has joined #warrior [18:44] *** will has joined #warrior [18:44] *** Kaz has joined #warrior [18:44] *** ivan has joined #warrior [18:44] *** Odd0002 has joined #warrior [18:44] *** Jusque has joined #warrior [18:44] *** chfoo has joined #warrior [18:44] *** yuitimoth has joined #warrior [18:44] *** bwn has joined #warrior [18:44] *** MrRadar2 has joined #warrior [18:44] *** fennec has joined #warrior [18:44] *** bsmith093 has joined #warrior [18:44] *** BnARobin has joined #warrior [18:44] *** hook54321 has joined #warrior [18:44] *** svchfoo1 has joined #warrior [18:44] *** tsr has joined #warrior [18:44] *** ircd.choopa.net sets mode: +ooo balrog chfoo svchfoo1 [18:44] *** swebb sets mode: +o balrog [23:41] Might I suggest using a different identifier for v3 beta when reporting in (tracker, hq)