#warrior 2019-12-13,Fri

↑back Search

Time Nickname Message
04:17 🔗 Craigle_ has joined #warrior
04:35 🔗 oshura has joined #warrior
04:39 🔗 DogsRNice has quit IRC (Read error: Connection reset by peer)
04:41 🔗 Craigle_ has quit IRC (Quit: The Lounge - https://thelounge.chat)
04:44 🔗 Craigle has quit IRC ()
04:46 🔗 Craigle has joined #warrior
05:26 🔗 kiska has quit IRC (Remote host closed the connection)
05:26 🔗 Flashfire has quit IRC (Remote host closed the connection)
05:27 🔗 Flashfire has joined #warrior
05:27 🔗 kiska has joined #warrior
06:21 🔗 Dallas has quit IRC (Quit: The Lounge - https://thelounge.chat)
06:27 🔗 coderobe has quit IRC (Read error: Connection reset by peer)
07:18 🔗 coderobe has joined #warrior
07:53 🔗 mtntmnky has quit IRC (Remote host closed the connection)
07:54 🔗 mtntmnky has joined #warrior
10:22 🔗 zhongfu has quit IRC (Ping timeout: 745 seconds)
11:25 🔗 vicarage has quit IRC (Ping timeout: 260 seconds)
12:28 🔗 vicarage has joined #warrior
13:02 🔗 balrog has quit IRC (Bye)
13:43 🔗 oshura_ has joined #warrior
13:44 🔗 oshura_ morning everyone. I was hoping to get some guidance from someone. I would like to run warrior on my raspberry pi but I am a little lost as to how to do it. The other day Wingy tried to assist me but it was late at night and they had to go to bed. Who here might be able to help point me in the right direction? I got stuck at the building the docker container on the RPi part of the process
13:44 🔗 oshura has quit IRC (Quit: Page closed)
13:52 🔗 Wingy oshura_: I'm up again :)
13:52 🔗 oshura_ Hey Wingy!
13:52 🔗 oshura_ Yeah man, I tried looking at that github but I'm afraid I don't know enough to make it work
13:53 🔗 oshura_ I tried to google my answers but was overwhelmed by information
13:54 🔗 oshura_ Also, I'm getting an error "Tracker returned status code 500. The tracker has probably malfunctioned." Anyone else getting that error?
13:57 🔗 Kaz Looking into it
14:00 🔗 Wingy oshura_: What is the error message?
14:00 🔗 Wingy Also, thanks for googling it first :)
14:18 🔗 oshura_ I never even made it far enough to the error message lol. I couldn't figure out where my docker-compose directory was (honestly, I had a hard time figuring out what docker-compose was)
14:20 🔗 oshura_ I looked for at least an hour but there was way too much information and I couldn't figure it out sadly
14:20 🔗 Wingy This guide helps. I'll walk you through it. https://dev.to/rohansawant/installing-docker-and-docker-compose-on-the-raspberry-pi-in-5-simple-steps-3mgl
14:22 🔗 oshura_ I think I made it that far on my own. Let me double check. My RPi is rebooting
14:28 🔗 jc86035 has joined #warrior
14:33 🔗 oshura_ I'm on the last step of that guide right now, the pi is doing it's thing installing via pip
14:35 🔗 oshura_ In the meanwhile (@Kaz), should I just leave my warrior instance running trying to access the tracker?
14:37 🔗 Kaz Yep
14:37 🔗 Kaz Tracker will be back in a sec
14:37 🔗 Wingy oshura_: which pi are you using?
14:37 🔗 oshura_ rpi4
14:37 🔗 oshura_ also, done
14:37 🔗 Wingy Okay, make a warrior directory in your home folder
14:38 🔗 oshura_ ok hold on, I need to figure out where to find that
14:38 🔗 oshura_ is that the folder that automatically opens when I ssh into the pi?
14:38 🔗 Wingy type cd and press enter to go to your home directory
14:38 🔗 Wingy yes
14:40 🔗 Wingy Hmm I think warrior doesn't support docker on pi. It might, we'll try.
14:40 🔗 oshura_ there was a way according to the instruction page where the docker image link is
14:43 🔗 Wingy There's a Pi image
14:43 🔗 oshura_ good? lol
14:43 🔗 Wingy It just isn't on docker hub lol
14:44 🔗 Wingy I'll build and upload
14:44 🔗 oshura_ oh ok, that's probably why I couldn't figure it out (well, it couldn't have helped, that's for sure)
14:46 🔗 Wingy Actually I'm going to change the dockerfile a bit to add env variable support
14:46 🔗 oshura_ I just couldn't figure out how to build it, I wish there was a how-to guide.
14:46 🔗 oshura_ Cool, I have no idea what that means haha
14:46 🔗 Wingy You have to clone their git repository and 'docker build' it
14:47 🔗 oshura_ @kaz, it's back up
14:49 🔗 oshura_ ooooooohhh that makes a little more sense
14:49 🔗 oshura_ do I just do that with the image you're building
14:50 🔗 Wingy I'll just give you a docker-compose file and walk you through what it does :)
14:50 🔗 oshura_ ok
14:58 🔗 Wingy Hmm
14:58 🔗 Wingy I don't have my pi plugged in rn
14:58 🔗 Wingy I'll go get it so I can build the image
14:58 🔗 Wingy Apparently you can't build arm images on x86
14:59 🔗 Wingy Or maybe I can use qemu
15:04 🔗 oshura_ gotcha. I'm going to be in and out for a bit taking care of some things but I'll keep checking the chat throughout the day for instructions
15:04 🔗 Wingy Okay, it'll hopefully be ready in 15 minutes or so
15:07 🔗 oshura-m has joined #warrior
15:08 🔗 Wingy Oh libvirt won't do arm lol
15:10 🔗 Wingy I'm getting the pi out
15:11 🔗 oshura-m I appreciate it. I know I can’t be the only one in the world who wants to do something like this but I may be the first who asked for help lol
15:11 🔗 Wingy Yeah having a pi warrior image will be good lol
15:12 🔗 oshura-m When I get some free time (yeah right 😂) I’m willing to help write up a how to guide on how to install it for those of us newbies
15:13 🔗 oshura_ based on your work of course Wingy
15:13 🔗 JAA lol free time, what's that?
15:13 🔗 Wingy I might be able to help too :)
15:13 🔗 Wingy Maybe even make an sd card image
15:14 🔗 Wingy Just etcher it on to an sd card, put it in the pi, and let it archive!
15:14 🔗 JAA > wc -l TODO
15:14 🔗 JAA 1461 TODO
15:14 🔗 JAA My todo list for AT. :-|
15:14 🔗 Wingy uhoh
15:14 🔗 Wingy hmm
15:17 🔗 oshura-m That sounds cool too. My goal with it is to add it alongside my BOINC client to let them work side by side hopefully on my 1g pi so that I can use them to their best potential. As such, do you think the etcher would work Wingy?
15:18 🔗 Wingy warrior + boinc? hmm might be a squeeze
15:18 🔗 Wingy Also with docker-compose you can --scale warrior=2 to get 2 warriors at once
15:19 🔗 oshura-m That sounds awesome. I would be willing at this point to give priority to Warrior over boinc until we get these two sites archived (plays.tv and yahoo groups) since I know we’re in a time crunch
15:20 🔗 Wingy Yeah maybe run 6 threads on plays.tv
15:20 🔗 Wingy I think #yahoosucks and #pythons-attack-y! have enough for now
15:22 🔗 oshura-m Right now I’m running 6 threads on my laptop but I have two other pis with external HDD that I could be using to run whatever is needed and help the process along. I just have to do it in the next hour or so before I go to work.
15:22 🔗 markedL there's room for more on #pythons-attack-y!
15:23 🔗 oshura-m If only I understood what that meant lol I just want to help put out the biggest fire for now
15:29 🔗 zhongfu has joined #warrior
15:32 🔗 oshura-m Where is all this stuff being h hosted? Will the public be able to access it? I’m curious
15:37 🔗 markedL virtually all grabs get hosted at Internet Archive in one way or another. Ideally in the WayBackMachine
15:50 🔗 xBorsti has joined #warrior
15:50 🔗 xBorsti has quit IRC (Client Quit)
15:59 🔗 kiskabak has quit IRC (Read error: Operation timed out)
16:03 🔗 Flashfire has quit IRC (Remote host closed the connection)
16:03 🔗 kiska has quit IRC (Remote host closed the connection)
16:04 🔗 Flashfire has joined #warrior
16:04 🔗 kiska has joined #warrior
16:15 🔗 DogsRNice has joined #warrior
17:04 🔗 pinkieval has quit IRC (Read error: Connection reset by peer)
17:06 🔗 mls_ has quit IRC (Ping timeout: 258 seconds)
17:07 🔗 mls has joined #warrior
17:26 🔗 markedL has quit IRC (Read error: Operation timed out)
17:27 🔗 asdf0101 has quit IRC (Read error: Operation timed out)
17:27 🔗 jc86035 has quit IRC (Quit: Connection closed for inactivity)
17:52 🔗 balrog has joined #warrior
17:53 🔗 asdf0101 has joined #warrior
17:54 🔗 markedL has joined #warrior
18:05 🔗 markedL has quit IRC (Read error: Operation timed out)
18:06 🔗 asdf0101 has quit IRC (Read error: Operation timed out)
18:13 🔗 asdf0101 has joined #warrior
18:13 🔗 markedL has joined #warrior
18:19 🔗 balrog has quit IRC (Read error: Operation timed out)
18:23 🔗 balrog has joined #warrior
18:26 🔗 balrog has quit IRC (Read error: Operation timed out)
18:32 🔗 balrog has joined #warrior
19:31 🔗 Wingy This. is. running. on. a pi. https://owo.whats-th.is/8gG1qvP.png
19:38 🔗 kiska has quit IRC (Remote host closed the connection)
19:38 🔗 Flashfire has quit IRC (Remote host closed the connection)
19:38 🔗 Flashfire has joined #warrior
19:39 🔗 kiska has joined #warrior
19:43 🔗 pinkieval has joined #warrior
20:02 🔗 astrid ssh gitorious.org
20:02 🔗 astrid er
20:02 🔗 astrid misfire
20:23 🔗 phillipsj I guess all that CPU usage is from VM overhead, not disk IO (play.tv tracker ran out of items, and I finished uploading my buffered files)
20:25 🔗 phillipsj ..I guess CPU usage went down a little bit. Maybe as much as 50%.
20:29 🔗 * phillipsj tries giving them the deafaul 1 CPU instead of 2.
20:30 🔗 oshura-m Nice Wingy! Now how do I get to do that?
20:31 🔗 Wingy I modified the Dockerfile.raspberry to use the env variables and built a docker image
20:46 🔗 phillipsj ..to be sure If that saved any CPU, I should have looked at the laod average before changing things.
20:47 🔗 phillipsj I guess I can bounce the VM that got stuck on the warrior download.
20:50 🔗 Wingy oshura_ oshura-m: are you available to get the pi working?
20:51 🔗 oshura-m If you can give me like 30 minutes, I should be able to try. It’s going to have to be remote, but I think we can do it. #CrossingFingers
20:51 🔗 Wingy Okay :)
20:52 🔗 TetryonB1 has joined #warrior
20:55 🔗 TetryonBe has quit IRC (Read error: Operation timed out)
21:17 🔗 d5f4a3622 has quit IRC (Read error: Connection reset by peer)
21:27 🔗 bsmith093 has quit IRC (Quit: Leaving.)
21:30 🔗 d5f4a3622 has joined #warrior
21:33 🔗 bsmith093 has joined #warrior
21:35 🔗 jc86035 has joined #warrior
21:57 🔗 TetryonBe has joined #warrior
21:59 🔗 TetryonB1 has quit IRC (Read error: Operation timed out)
22:03 🔗 RBecker has quit IRC (Read error: Operation timed out)
22:04 🔗 RBecker has joined #warrior
22:06 🔗 vicarage has quit IRC (Ping timeout: 260 seconds)
22:08 🔗 oshura_ Hey Wingy, took me longer than expected. I'm up for it if you are
22:08 🔗 Wingy I am :D
22:09 🔗 oshura_ How do you want to do this? Do you want to just explain it to me on this chat room?
22:09 🔗 Wingy Yeah :)
22:09 🔗 Wingy Do you have docker-compose installed yet?
22:09 🔗 oshura_ I sure do
22:10 🔗 Wingy This docker-composey.yml seems to work well on my pi: https://gist.githubusercontent.com/Wingysam/b4d3440c958d3487a0a634addf289f88/raw/79402b675a672d760f377f0bec4067034c633767/docker-compose.yml
22:11 🔗 Wingy docker-compose.yml*
22:11 🔗 Wingy The first line is the version of the docker-compose format that the file is
22:11 🔗 Wingy In this case, docker-compose 3.7
22:11 🔗 Wingy Then we define services
22:11 🔗 Wingy First, we define URLTeam
22:12 🔗 Wingy The image of it is my image that I made for you (and anyone else on a pi)
22:12 🔗 Wingy Then we set the environment variables
22:12 🔗 Wingy DOWNLOADER is what shows up on the tracker
22:12 🔗 Wingy SELECTED_PROJECT is which project this warrior uses, in this case urlteam
22:12 🔗 Wingy CONCURRENT_ITEMS is how many items to run from the tracker at once
22:12 🔗 Wingy Then we define ports
22:13 🔗 Wingy In this case, we just say that we want something on the pi to point to 8001
22:13 🔗 oshura_ ok, i'm tracking
22:13 🔗 Wingy And we always want it to restart when it shuts down
22:13 🔗 oshura_ yep
22:13 🔗 Wingy Then we have Auto
22:13 🔗 Wingy Which is basically the same as URLTeam but on auto not urlteam
22:14 🔗 Wingy So make a directory with `mkdir warrior`
22:14 🔗 Wingy then `cd warrior`
22:14 🔗 oshura_ where do I make the dir, where it boots up to?
22:14 🔗 Wingy In your home directory
22:14 🔗 Wingy So yes
22:14 🔗 Wingy Then `wget -O docker-compose.yml https://gist.githubusercontent.com/Wingysam/b4d3440c958d3487a0a634addf289f88/raw/79402b675a672d760f377f0bec4067034c633767/docker-compose.yml`
22:15 🔗 Wingy Then `nano docker-compose.yml` and use the text editor to replace both of the changethistoyourname things with Oshura or whatever you want to show up as on the tracker
22:15 🔗 Wingy Then control+o to write the file, then control+x to exit
22:16 🔗 Wingy then `docker-compose up`
22:16 🔗 Wingy Sorry if I'm overloading you lol
22:16 🔗 oshura_ no worries just bear with me
22:16 🔗 Wingy That was a massive text wall
22:17 🔗 Wingy Do you want one command to just make it work?
22:18 🔗 oshura_ I'm on it
22:18 🔗 oshura_ I'm just curious, if I wanted to choose a different project to work on, would I just change the URL2 thing to auto or groups or whatever?
22:19 🔗 Wingy Basically just copy Auto and replace auto with whatever you want
22:19 🔗 Wingy Actually replace auto if you want to run more
22:19 🔗 Wingy You probably don't want to run too much on a pi
22:20 🔗 oshura_ do you have a list of options for what the would be, i.e., auto=the project they are working on, URLteam=url shortener, etc
22:20 🔗 Wingy It changes frequently, go to one of the existing warriors and look at available projects for a list of available projects.
22:20 🔗 Wingy Then the ID is generally just the project name in lowercase with no spaces
22:21 🔗 Wingy Yahoo! Groups is yahoogroups
22:21 🔗 Wingy Plays.tv is playstv
22:21 🔗 oshura_ and again, just to verify, auto is the project they are prioritizing?
22:22 🔗 Wingy Yes
22:22 🔗 Wingy Currently plays.tv
22:22 🔗 Wingy But it usually defaults to urlteam
22:23 🔗 JAA urlteam2, not urlteam
22:23 🔗 Wingy Ah yes
22:23 🔗 Wingy Thanks
22:23 🔗 Wingy My docker-compose file has urlteam2
22:24 🔗 JAA Hmm, why does your file need to list the projects?
22:24 🔗 oshura_ Gotcha, and is the data being saved currently to the SD card? If so, is there an option that can be written into it that could be changed to save the data to an externally mounted HDD?
22:24 🔗 Wingy To determine which projects to work on
22:25 🔗 JAA Oh right, I think I see now what you're doing. Ignore me.
22:25 🔗 Wingy Maybe symlink /var/lib/docker/overlay2 to the usb drive?
22:26 🔗 oshura_ what would be the exact command that I would need to input for that if you don't mind please? I am still learning
22:27 🔗 Wingy Of course! Where is your external drive located?
22:27 🔗 Wingy Have you put it in the /etc/fstab yet?
22:27 🔗 oshura_ I don't think I've done that
22:28 🔗 oshura_ and also, how can I know that the docker installation process is completed?
22:29 🔗 Wingy If the warrior doesn't start we'll know :)
22:29 🔗 Wingy There are other ways to check but I think this is easiest :)
22:29 🔗 Wingy If you want to check now you can run `docker -v` and `docker-compose -v`
22:30 🔗 Wingy Is your external drive plugged in right now?
22:30 🔗 oshura_ I mean't how to know if the warrior thing is running. Also, yes it is
22:31 🔗 Wingy We'll make sure the web interface is running
22:31 🔗 oshura_ and after typing both those commands I got the versions for each so they're working
22:31 🔗 Wingy Yes
22:31 🔗 Wingy Can you go in the warrior folder with `cd warrior` then `docker-compose ps`?
22:31 🔗 TetryonBe has quit IRC (Quit: leaving)
22:33 🔗 TetryonBe has joined #warrior
22:33 🔗 oshura_ one moment, the connection just got real sluggish
22:34 🔗 Wingy Are you on a cellular network?
22:34 🔗 oshura_ I am. It's the only way to get into the network right now from outside my home (over vnc)
22:35 🔗 Wingy You might want to look into ssh :)
22:35 🔗 oshura_ It's what I was trying to do but right now the connection is not working for some reason
22:36 🔗 Wingy maybe even routing the ssh connection through a mosh server like tilde.team
22:36 🔗 Wingy Oh they don't have a mosh server sorry
22:36 🔗 oshura_ I have no idea what that means but I would love to learn later
22:37 🔗 Wingy Yeah ask me about it tomorrow or something :)
22:37 🔗 Wingy Once we get warrior working
22:37 🔗 Wingy Can you give me the result of `sudo blkid`?
22:37 🔗 oshura_ I'd love to but I can't secure a connection to the pi either through vnc or through ssh right now, one moment
22:38 🔗 Wingy Okay :) No problem
22:40 🔗 AlsoJAA has quit IRC (Quit: leaving)
22:41 🔗 oshura_ hmm... it looks like the rpi may have crashed. I'm getting an error from vnc viewer that the vnc server is not listening for cloud connections and I am having a hard time connecting to it via ssh
22:41 🔗 Wingy Okay :)
22:41 🔗 Wingy We'll try tomorrow
22:42 🔗 oshura_ yea sounds good. I'll give it a go when I get home tonight
22:42 🔗 oshura_ at least I have the instructions here. But let's say that it would have worked, how would I have known that warrior was running, would I have gotten a notice that the engine was up?
22:44 🔗 Wingy You can look for the name on the tracker but it moves so fast
22:44 🔗 AlsoJAA has joined #warrior
22:44 🔗 oshura_ hmmm... well, we'll try it later. Thanks for now Wingy
22:44 🔗 oshura_ I gotta go back to work
22:44 🔗 Wingy :)
22:44 🔗 JAA sets mode: +o AlsoJAA
22:48 🔗 pnJay possible to swap default to url team until the ingest servers stop burning?
22:51 🔗 Terbium has joined #warrior
23:00 🔗 Wingy pnJay: I think arkiver has to do that
23:14 🔗 Wingy has quit IRC (Read error: Operation timed out)
irclogger-viewer