| Time |
Nickname |
Message |
|
04:17
🔗
|
|
Craigle_ has joined #warrior |
|
04:35
🔗
|
|
oshura has joined #warrior |
|
04:39
🔗
|
|
DogsRNice has quit IRC (Read error: Connection reset by peer) |
|
04:41
🔗
|
|
Craigle_ has quit IRC (Quit: The Lounge - https://thelounge.chat) |
|
04:44
🔗
|
|
Craigle has quit IRC () |
|
04:46
🔗
|
|
Craigle has joined #warrior |
|
05:26
🔗
|
|
kiska has quit IRC (Remote host closed the connection) |
|
05:26
🔗
|
|
Flashfire has quit IRC (Remote host closed the connection) |
|
05:27
🔗
|
|
Flashfire has joined #warrior |
|
05:27
🔗
|
|
kiska has joined #warrior |
|
06:21
🔗
|
|
Dallas has quit IRC (Quit: The Lounge - https://thelounge.chat) |
|
06:27
🔗
|
|
coderobe has quit IRC (Read error: Connection reset by peer) |
|
07:18
🔗
|
|
coderobe has joined #warrior |
|
07:53
🔗
|
|
mtntmnky has quit IRC (Remote host closed the connection) |
|
07:54
🔗
|
|
mtntmnky has joined #warrior |
|
10:22
🔗
|
|
zhongfu has quit IRC (Ping timeout: 745 seconds) |
|
11:25
🔗
|
|
vicarage has quit IRC (Ping timeout: 260 seconds) |
|
12:28
🔗
|
|
vicarage has joined #warrior |
|
13:02
🔗
|
|
balrog has quit IRC (Bye) |
|
13:43
🔗
|
|
oshura_ has joined #warrior |
|
13:44
🔗
|
oshura_ |
morning everyone. I was hoping to get some guidance from someone. I would like to run warrior on my raspberry pi but I am a little lost as to how to do it. The other day Wingy tried to assist me but it was late at night and they had to go to bed. Who here might be able to help point me in the right direction? I got stuck at the building the docker container on the RPi part of the process |
|
13:44
🔗
|
|
oshura has quit IRC (Quit: Page closed) |
|
13:52
🔗
|
Wingy |
oshura_: I'm up again :) |
|
13:52
🔗
|
oshura_ |
Hey Wingy! |
|
13:52
🔗
|
oshura_ |
Yeah man, I tried looking at that github but I'm afraid I don't know enough to make it work |
|
13:53
🔗
|
oshura_ |
I tried to google my answers but was overwhelmed by information |
|
13:54
🔗
|
oshura_ |
Also, I'm getting an error "Tracker returned status code 500. The tracker has probably malfunctioned." Anyone else getting that error? |
|
13:57
🔗
|
Kaz |
Looking into it |
|
14:00
🔗
|
Wingy |
oshura_: What is the error message? |
|
14:00
🔗
|
Wingy |
Also, thanks for googling it first :) |
|
14:18
🔗
|
oshura_ |
I never even made it far enough to the error message lol. I couldn't figure out where my docker-compose directory was (honestly, I had a hard time figuring out what docker-compose was) |
|
14:20
🔗
|
oshura_ |
I looked for at least an hour but there was way too much information and I couldn't figure it out sadly |
|
14:20
🔗
|
Wingy |
This guide helps. I'll walk you through it. https://dev.to/rohansawant/installing-docker-and-docker-compose-on-the-raspberry-pi-in-5-simple-steps-3mgl |
|
14:22
🔗
|
oshura_ |
I think I made it that far on my own. Let me double check. My RPi is rebooting |
|
14:28
🔗
|
|
jc86035 has joined #warrior |
|
14:33
🔗
|
oshura_ |
I'm on the last step of that guide right now, the pi is doing it's thing installing via pip |
|
14:35
🔗
|
oshura_ |
In the meanwhile (@Kaz), should I just leave my warrior instance running trying to access the tracker? |
|
14:37
🔗
|
Kaz |
Yep |
|
14:37
🔗
|
Kaz |
Tracker will be back in a sec |
|
14:37
🔗
|
Wingy |
oshura_: which pi are you using? |
|
14:37
🔗
|
oshura_ |
rpi4 |
|
14:37
🔗
|
oshura_ |
also, done |
|
14:37
🔗
|
Wingy |
Okay, make a warrior directory in your home folder |
|
14:38
🔗
|
oshura_ |
ok hold on, I need to figure out where to find that |
|
14:38
🔗
|
oshura_ |
is that the folder that automatically opens when I ssh into the pi? |
|
14:38
🔗
|
Wingy |
type cd and press enter to go to your home directory |
|
14:38
🔗
|
Wingy |
yes |
|
14:40
🔗
|
Wingy |
Hmm I think warrior doesn't support docker on pi. It might, we'll try. |
|
14:40
🔗
|
oshura_ |
there was a way according to the instruction page where the docker image link is |
|
14:43
🔗
|
Wingy |
There's a Pi image |
|
14:43
🔗
|
oshura_ |
good? lol |
|
14:43
🔗
|
Wingy |
It just isn't on docker hub lol |
|
14:44
🔗
|
Wingy |
I'll build and upload |
|
14:44
🔗
|
oshura_ |
oh ok, that's probably why I couldn't figure it out (well, it couldn't have helped, that's for sure) |
|
14:46
🔗
|
Wingy |
Actually I'm going to change the dockerfile a bit to add env variable support |
|
14:46
🔗
|
oshura_ |
I just couldn't figure out how to build it, I wish there was a how-to guide. |
|
14:46
🔗
|
oshura_ |
Cool, I have no idea what that means haha |
|
14:46
🔗
|
Wingy |
You have to clone their git repository and 'docker build' it |
|
14:47
🔗
|
oshura_ |
@kaz, it's back up |
|
14:49
🔗
|
oshura_ |
ooooooohhh that makes a little more sense |
|
14:49
🔗
|
oshura_ |
do I just do that with the image you're building |
|
14:50
🔗
|
Wingy |
I'll just give you a docker-compose file and walk you through what it does :) |
|
14:50
🔗
|
oshura_ |
ok |
|
14:58
🔗
|
Wingy |
Hmm |
|
14:58
🔗
|
Wingy |
I don't have my pi plugged in rn |
|
14:58
🔗
|
Wingy |
I'll go get it so I can build the image |
|
14:58
🔗
|
Wingy |
Apparently you can't build arm images on x86 |
|
14:59
🔗
|
Wingy |
Or maybe I can use qemu |
|
15:04
🔗
|
oshura_ |
gotcha. I'm going to be in and out for a bit taking care of some things but I'll keep checking the chat throughout the day for instructions |
|
15:04
🔗
|
Wingy |
Okay, it'll hopefully be ready in 15 minutes or so |
|
15:07
🔗
|
|
oshura-m has joined #warrior |
|
15:08
🔗
|
Wingy |
Oh libvirt won't do arm lol |
|
15:10
🔗
|
Wingy |
I'm getting the pi out |
|
15:11
🔗
|
oshura-m |
I appreciate it. I know I can’t be the only one in the world who wants to do something like this but I may be the first who asked for help lol |
|
15:11
🔗
|
Wingy |
Yeah having a pi warrior image will be good lol |
|
15:12
🔗
|
oshura-m |
When I get some free time (yeah right 😂) I’m willing to help write up a how to guide on how to install it for those of us newbies |
|
15:13
🔗
|
oshura_ |
based on your work of course Wingy |
|
15:13
🔗
|
JAA |
lol free time, what's that? |
|
15:13
🔗
|
Wingy |
I might be able to help too :) |
|
15:13
🔗
|
Wingy |
Maybe even make an sd card image |
|
15:14
🔗
|
Wingy |
Just etcher it on to an sd card, put it in the pi, and let it archive! |
|
15:14
🔗
|
JAA |
> wc -l TODO |
|
15:14
🔗
|
JAA |
1461 TODO |
|
15:14
🔗
|
JAA |
My todo list for AT. :-| |
|
15:14
🔗
|
Wingy |
uhoh |
|
15:14
🔗
|
Wingy |
hmm |
|
15:17
🔗
|
oshura-m |
That sounds cool too. My goal with it is to add it alongside my BOINC client to let them work side by side hopefully on my 1g pi so that I can use them to their best potential. As such, do you think the etcher would work Wingy? |
|
15:18
🔗
|
Wingy |
warrior + boinc? hmm might be a squeeze |
|
15:18
🔗
|
Wingy |
Also with docker-compose you can --scale warrior=2 to get 2 warriors at once |
|
15:19
🔗
|
oshura-m |
That sounds awesome. I would be willing at this point to give priority to Warrior over boinc until we get these two sites archived (plays.tv and yahoo groups) since I know we’re in a time crunch |
|
15:20
🔗
|
Wingy |
Yeah maybe run 6 threads on plays.tv |
|
15:20
🔗
|
Wingy |
I think #yahoosucks and #pythons-attack-y! have enough for now |
|
15:22
🔗
|
oshura-m |
Right now I’m running 6 threads on my laptop but I have two other pis with external HDD that I could be using to run whatever is needed and help the process along. I just have to do it in the next hour or so before I go to work. |
|
15:22
🔗
|
markedL |
there's room for more on #pythons-attack-y! |
|
15:23
🔗
|
oshura-m |
If only I understood what that meant lol I just want to help put out the biggest fire for now |
|
15:29
🔗
|
|
zhongfu has joined #warrior |
|
15:32
🔗
|
oshura-m |
Where is all this stuff being h hosted? Will the public be able to access it? I’m curious |
|
15:37
🔗
|
markedL |
virtually all grabs get hosted at Internet Archive in one way or another. Ideally in the WayBackMachine |
|
15:50
🔗
|
|
xBorsti has joined #warrior |
|
15:50
🔗
|
|
xBorsti has quit IRC (Client Quit) |
|
15:59
🔗
|
|
kiskabak has quit IRC (Read error: Operation timed out) |
|
16:03
🔗
|
|
Flashfire has quit IRC (Remote host closed the connection) |
|
16:03
🔗
|
|
kiska has quit IRC (Remote host closed the connection) |
|
16:04
🔗
|
|
Flashfire has joined #warrior |
|
16:04
🔗
|
|
kiska has joined #warrior |
|
16:15
🔗
|
|
DogsRNice has joined #warrior |
|
17:04
🔗
|
|
pinkieval has quit IRC (Read error: Connection reset by peer) |
|
17:06
🔗
|
|
mls_ has quit IRC (Ping timeout: 258 seconds) |
|
17:07
🔗
|
|
mls has joined #warrior |
|
17:26
🔗
|
|
markedL has quit IRC (Read error: Operation timed out) |
|
17:27
🔗
|
|
asdf0101 has quit IRC (Read error: Operation timed out) |
|
17:27
🔗
|
|
jc86035 has quit IRC (Quit: Connection closed for inactivity) |
|
17:52
🔗
|
|
balrog has joined #warrior |
|
17:53
🔗
|
|
asdf0101 has joined #warrior |
|
17:54
🔗
|
|
markedL has joined #warrior |
|
18:05
🔗
|
|
markedL has quit IRC (Read error: Operation timed out) |
|
18:06
🔗
|
|
asdf0101 has quit IRC (Read error: Operation timed out) |
|
18:13
🔗
|
|
asdf0101 has joined #warrior |
|
18:13
🔗
|
|
markedL has joined #warrior |
|
18:19
🔗
|
|
balrog has quit IRC (Read error: Operation timed out) |
|
18:23
🔗
|
|
balrog has joined #warrior |
|
18:26
🔗
|
|
balrog has quit IRC (Read error: Operation timed out) |
|
18:32
🔗
|
|
balrog has joined #warrior |
|
19:31
🔗
|
Wingy |
This. is. running. on. a pi. https://owo.whats-th.is/8gG1qvP.png |
|
19:38
🔗
|
|
kiska has quit IRC (Remote host closed the connection) |
|
19:38
🔗
|
|
Flashfire has quit IRC (Remote host closed the connection) |
|
19:38
🔗
|
|
Flashfire has joined #warrior |
|
19:39
🔗
|
|
kiska has joined #warrior |
|
19:43
🔗
|
|
pinkieval has joined #warrior |
|
20:02
🔗
|
astrid |
ssh gitorious.org |
|
20:02
🔗
|
astrid |
er |
|
20:02
🔗
|
astrid |
misfire |
|
20:23
🔗
|
phillipsj |
I guess all that CPU usage is from VM overhead, not disk IO (play.tv tracker ran out of items, and I finished uploading my buffered files) |
|
20:25
🔗
|
phillipsj |
..I guess CPU usage went down a little bit. Maybe as much as 50%. |
|
20:29
🔗
|
* |
phillipsj tries giving them the deafaul 1 CPU instead of 2. |
|
20:30
🔗
|
oshura-m |
Nice Wingy! Now how do I get to do that? |
|
20:31
🔗
|
Wingy |
I modified the Dockerfile.raspberry to use the env variables and built a docker image |
|
20:46
🔗
|
phillipsj |
..to be sure If that saved any CPU, I should have looked at the laod average before changing things. |
|
20:47
🔗
|
phillipsj |
I guess I can bounce the VM that got stuck on the warrior download. |
|
20:50
🔗
|
Wingy |
oshura_ oshura-m: are you available to get the pi working? |
|
20:51
🔗
|
oshura-m |
If you can give me like 30 minutes, I should be able to try. It’s going to have to be remote, but I think we can do it. #CrossingFingers |
|
20:51
🔗
|
Wingy |
Okay :) |
|
20:52
🔗
|
|
TetryonB1 has joined #warrior |
|
20:55
🔗
|
|
TetryonBe has quit IRC (Read error: Operation timed out) |
|
21:17
🔗
|
|
d5f4a3622 has quit IRC (Read error: Connection reset by peer) |
|
21:27
🔗
|
|
bsmith093 has quit IRC (Quit: Leaving.) |
|
21:30
🔗
|
|
d5f4a3622 has joined #warrior |
|
21:33
🔗
|
|
bsmith093 has joined #warrior |
|
21:35
🔗
|
|
jc86035 has joined #warrior |
|
21:57
🔗
|
|
TetryonBe has joined #warrior |
|
21:59
🔗
|
|
TetryonB1 has quit IRC (Read error: Operation timed out) |
|
22:03
🔗
|
|
RBecker has quit IRC (Read error: Operation timed out) |
|
22:04
🔗
|
|
RBecker has joined #warrior |
|
22:06
🔗
|
|
vicarage has quit IRC (Ping timeout: 260 seconds) |
|
22:08
🔗
|
oshura_ |
Hey Wingy, took me longer than expected. I'm up for it if you are |
|
22:08
🔗
|
Wingy |
I am :D |
|
22:09
🔗
|
oshura_ |
How do you want to do this? Do you want to just explain it to me on this chat room? |
|
22:09
🔗
|
Wingy |
Yeah :) |
|
22:09
🔗
|
Wingy |
Do you have docker-compose installed yet? |
|
22:09
🔗
|
oshura_ |
I sure do |
|
22:10
🔗
|
Wingy |
This docker-composey.yml seems to work well on my pi: https://gist.githubusercontent.com/Wingysam/b4d3440c958d3487a0a634addf289f88/raw/79402b675a672d760f377f0bec4067034c633767/docker-compose.yml |
|
22:11
🔗
|
Wingy |
docker-compose.yml* |
|
22:11
🔗
|
Wingy |
The first line is the version of the docker-compose format that the file is |
|
22:11
🔗
|
Wingy |
In this case, docker-compose 3.7 |
|
22:11
🔗
|
Wingy |
Then we define services |
|
22:11
🔗
|
Wingy |
First, we define URLTeam |
|
22:12
🔗
|
Wingy |
The image of it is my image that I made for you (and anyone else on a pi) |
|
22:12
🔗
|
Wingy |
Then we set the environment variables |
|
22:12
🔗
|
Wingy |
DOWNLOADER is what shows up on the tracker |
|
22:12
🔗
|
Wingy |
SELECTED_PROJECT is which project this warrior uses, in this case urlteam |
|
22:12
🔗
|
Wingy |
CONCURRENT_ITEMS is how many items to run from the tracker at once |
|
22:12
🔗
|
Wingy |
Then we define ports |
|
22:13
🔗
|
Wingy |
In this case, we just say that we want something on the pi to point to 8001 |
|
22:13
🔗
|
oshura_ |
ok, i'm tracking |
|
22:13
🔗
|
Wingy |
And we always want it to restart when it shuts down |
|
22:13
🔗
|
oshura_ |
yep |
|
22:13
🔗
|
Wingy |
Then we have Auto |
|
22:13
🔗
|
Wingy |
Which is basically the same as URLTeam but on auto not urlteam |
|
22:14
🔗
|
Wingy |
So make a directory with `mkdir warrior` |
|
22:14
🔗
|
Wingy |
then `cd warrior` |
|
22:14
🔗
|
oshura_ |
where do I make the dir, where it boots up to? |
|
22:14
🔗
|
Wingy |
In your home directory |
|
22:14
🔗
|
Wingy |
So yes |
|
22:14
🔗
|
Wingy |
Then `wget -O docker-compose.yml https://gist.githubusercontent.com/Wingysam/b4d3440c958d3487a0a634addf289f88/raw/79402b675a672d760f377f0bec4067034c633767/docker-compose.yml` |
|
22:15
🔗
|
Wingy |
Then `nano docker-compose.yml` and use the text editor to replace both of the changethistoyourname things with Oshura or whatever you want to show up as on the tracker |
|
22:15
🔗
|
Wingy |
Then control+o to write the file, then control+x to exit |
|
22:16
🔗
|
Wingy |
then `docker-compose up` |
|
22:16
🔗
|
Wingy |
Sorry if I'm overloading you lol |
|
22:16
🔗
|
oshura_ |
no worries just bear with me |
|
22:16
🔗
|
Wingy |
That was a massive text wall |
|
22:17
🔗
|
Wingy |
Do you want one command to just make it work? |
|
22:18
🔗
|
oshura_ |
I'm on it |
|
22:18
🔗
|
oshura_ |
I'm just curious, if I wanted to choose a different project to work on, would I just change the URL2 thing to auto or groups or whatever? |
|
22:19
🔗
|
Wingy |
Basically just copy Auto and replace auto with whatever you want |
|
22:19
🔗
|
Wingy |
Actually replace auto if you want to run more |
|
22:19
🔗
|
Wingy |
You probably don't want to run too much on a pi |
|
22:20
🔗
|
oshura_ |
do you have a list of options for what the would be, i.e., auto=the project they are working on, URLteam=url shortener, etc |
|
22:20
🔗
|
Wingy |
It changes frequently, go to one of the existing warriors and look at available projects for a list of available projects. |
|
22:20
🔗
|
Wingy |
Then the ID is generally just the project name in lowercase with no spaces |
|
22:21
🔗
|
Wingy |
Yahoo! Groups is yahoogroups |
|
22:21
🔗
|
Wingy |
Plays.tv is playstv |
|
22:21
🔗
|
oshura_ |
and again, just to verify, auto is the project they are prioritizing? |
|
22:22
🔗
|
Wingy |
Yes |
|
22:22
🔗
|
Wingy |
Currently plays.tv |
|
22:22
🔗
|
Wingy |
But it usually defaults to urlteam |
|
22:23
🔗
|
JAA |
urlteam2, not urlteam |
|
22:23
🔗
|
Wingy |
Ah yes |
|
22:23
🔗
|
Wingy |
Thanks |
|
22:23
🔗
|
Wingy |
My docker-compose file has urlteam2 |
|
22:24
🔗
|
JAA |
Hmm, why does your file need to list the projects? |
|
22:24
🔗
|
oshura_ |
Gotcha, and is the data being saved currently to the SD card? If so, is there an option that can be written into it that could be changed to save the data to an externally mounted HDD? |
|
22:24
🔗
|
Wingy |
To determine which projects to work on |
|
22:25
🔗
|
JAA |
Oh right, I think I see now what you're doing. Ignore me. |
|
22:25
🔗
|
Wingy |
Maybe symlink /var/lib/docker/overlay2 to the usb drive? |
|
22:26
🔗
|
oshura_ |
what would be the exact command that I would need to input for that if you don't mind please? I am still learning |
|
22:27
🔗
|
Wingy |
Of course! Where is your external drive located? |
|
22:27
🔗
|
Wingy |
Have you put it in the /etc/fstab yet? |
|
22:27
🔗
|
oshura_ |
I don't think I've done that |
|
22:28
🔗
|
oshura_ |
and also, how can I know that the docker installation process is completed? |
|
22:29
🔗
|
Wingy |
If the warrior doesn't start we'll know :) |
|
22:29
🔗
|
Wingy |
There are other ways to check but I think this is easiest :) |
|
22:29
🔗
|
Wingy |
If you want to check now you can run `docker -v` and `docker-compose -v` |
|
22:30
🔗
|
Wingy |
Is your external drive plugged in right now? |
|
22:30
🔗
|
oshura_ |
I mean't how to know if the warrior thing is running. Also, yes it is |
|
22:31
🔗
|
Wingy |
We'll make sure the web interface is running |
|
22:31
🔗
|
oshura_ |
and after typing both those commands I got the versions for each so they're working |
|
22:31
🔗
|
Wingy |
Yes |
|
22:31
🔗
|
Wingy |
Can you go in the warrior folder with `cd warrior` then `docker-compose ps`? |
|
22:31
🔗
|
|
TetryonBe has quit IRC (Quit: leaving) |
|
22:33
🔗
|
|
TetryonBe has joined #warrior |
|
22:33
🔗
|
oshura_ |
one moment, the connection just got real sluggish |
|
22:34
🔗
|
Wingy |
Are you on a cellular network? |
|
22:34
🔗
|
oshura_ |
I am. It's the only way to get into the network right now from outside my home (over vnc) |
|
22:35
🔗
|
Wingy |
You might want to look into ssh :) |
|
22:35
🔗
|
oshura_ |
It's what I was trying to do but right now the connection is not working for some reason |
|
22:36
🔗
|
Wingy |
maybe even routing the ssh connection through a mosh server like tilde.team |
|
22:36
🔗
|
Wingy |
Oh they don't have a mosh server sorry |
|
22:36
🔗
|
oshura_ |
I have no idea what that means but I would love to learn later |
|
22:37
🔗
|
Wingy |
Yeah ask me about it tomorrow or something :) |
|
22:37
🔗
|
Wingy |
Once we get warrior working |
|
22:37
🔗
|
Wingy |
Can you give me the result of `sudo blkid`? |
|
22:37
🔗
|
oshura_ |
I'd love to but I can't secure a connection to the pi either through vnc or through ssh right now, one moment |
|
22:38
🔗
|
Wingy |
Okay :) No problem |
|
22:40
🔗
|
|
AlsoJAA has quit IRC (Quit: leaving) |
|
22:41
🔗
|
oshura_ |
hmm... it looks like the rpi may have crashed. I'm getting an error from vnc viewer that the vnc server is not listening for cloud connections and I am having a hard time connecting to it via ssh |
|
22:41
🔗
|
Wingy |
Okay :) |
|
22:41
🔗
|
Wingy |
We'll try tomorrow |
|
22:42
🔗
|
oshura_ |
yea sounds good. I'll give it a go when I get home tonight |
|
22:42
🔗
|
oshura_ |
at least I have the instructions here. But let's say that it would have worked, how would I have known that warrior was running, would I have gotten a notice that the engine was up? |
|
22:44
🔗
|
Wingy |
You can look for the name on the tracker but it moves so fast |
|
22:44
🔗
|
|
AlsoJAA has joined #warrior |
|
22:44
🔗
|
oshura_ |
hmmm... well, we'll try it later. Thanks for now Wingy |
|
22:44
🔗
|
oshura_ |
I gotta go back to work |
|
22:44
🔗
|
Wingy |
:) |
|
22:44
🔗
|
|
JAA sets mode: +o AlsoJAA |
|
22:48
🔗
|
pnJay |
possible to swap default to url team until the ingest servers stop burning? |
|
22:51
🔗
|
|
Terbium has joined #warrior |
|
23:00
🔗
|
Wingy |
pnJay: I think arkiver has to do that |
|
23:14
🔗
|
|
Wingy has quit IRC (Read error: Operation timed out) |