Time |
Nickname |
Message |
00:04
π
|
Wingy |
oshura: Definitely put warrior on the external hard drives. Don't use flash storage, please. Flash storage includes sd cards and usb sticks, and it will wear down those multi-hundred-dollar USB SSDs somewhat. |
00:04
π
|
Wingy |
Long > Short: use the usb hard drives |
01:04
π
|
oshura |
gotcha. Well, in that case I am using external hard drives. I still would need help getting the docker containers to run on the pis (I have three that I could use right now) |
01:37
π
|
|
britmob has quit IRC (Read error: Connection reset by peer) |
01:43
π
|
|
britmob has joined #warrior |
01:55
π
|
|
mls_ has quit IRC (Ping timeout: 258 seconds) |
01:56
π
|
|
mls_ has joined #warrior |
02:00
π
|
|
kiska has quit IRC (Remote host closed the connection) |
02:00
π
|
|
Flashfire has quit IRC (Remote host closed the connection) |
02:01
π
|
|
Flashfire has joined #warrior |
02:01
π
|
|
kiska has joined #warrior |
02:45
π
|
Wingy |
https://i.imgur.com/oiESEVB.png |
02:57
π
|
oshura |
I would love to know how to do that Wing |
02:57
π
|
Wingy |
oshura: I made it myself :) |
02:57
π
|
oshura |
Is that on a raspberry pi? |
02:57
π
|
Wingy |
It reads from docker-compose and checks the forwarded ports |
02:57
π
|
Wingy |
It's on an Ubuntu server |
02:57
π
|
Wingy |
But it'd work on a pi. |
02:57
π
|
Wingy |
Can a pi run multiple warriors? |
02:58
π
|
oshura |
I have no idea. I was struggling to run the docker with just one warrior |
02:58
π
|
oshura |
i know it can run multiple containers on docker but that's about all I know |
03:00
π
|
|
bsmith093 has quit IRC (Quit: Leaving.) |
03:01
π
|
oshura |
I'm just learning about linux now. I just know that this is time sensitive and would love to help before it's too late |
03:02
π
|
oshura |
I keep getting this error when it comes to uploading a video on plays.tv project though |
03:02
π
|
oshura |
Starting RsyncUpload for Item user:ea0dff7b640cdea30aefbb5e2982e11e @ERROR: max connections (100) reached -- try again later rsync error: error starting client-server protocol (code 5) at main.c(1653) [sender=3.1.1] Process RsyncUpload returned exit code 5 for Item user:ea0dff7b640cdea30aefbb5e2982e11e Failed RsyncUpload for Item user:ea0dff7b640cdea30aefbb5e2982e11e Retrying after 60 seconds... |
03:15
π
|
kiska |
Please wait for a upload slot :D |
03:15
π
|
kiska |
That is what that error is |
03:23
π
|
oshura |
Thank you for the explanation @kiska. Is there anything I can do while the upload slot opens up to help the process along? I just feel like sitting here with an idling computer is not the best use of time for this situation |
03:24
π
|
|
bsmith093 has joined #warrior |
03:24
π
|
Wingy |
oshura more threads? uses more disk space though |
03:25
π
|
Wingy |
and the pi might slow down if they open too quickly |
03:25
π
|
Wingy |
and I uploaded my code to github: https://github.com/Wingysam/warrior-manager |
03:26
π
|
|
bsmith093 has quit IRC (Client Quit) |
03:28
π
|
Wingy |
this should install nodejs if you don't have it: curl -sL https://deb.nodesource.com/setup_13.x | sudo bash - && sudo apt install nodejs |
03:29
π
|
oshura |
ok, hold on let me try that. I am a total newb when it comes to linux but I'll give it a whirl |
03:36
π
|
Wingy |
I have to go to bed :( |
03:36
π
|
Wingy |
Goodnight |
03:37
π
|
Wingy |
Lmk in the morning if it works/not π |
03:38
π
|
|
bsmith093 has joined #warrior |
03:39
π
|
|
bsmith093 has quit IRC (Client Quit) |
06:01
π
|
phillipsj |
kiska your rnsync target (hel1) is accepting -1 connections. |
06:06
π
|
|
britmob_ has joined #warrior |
06:08
π
|
|
britmob has quit IRC (Ping timeout: 248 seconds) |
06:13
π
|
|
britmob_ has quit IRC (Read error: Operation timed out) |
06:15
π
|
|
britmob has joined #warrior |
06:21
π
|
phillipsj |
it says 150 now, so thanks. |
06:24
π
|
phillipsj |
100 to 150 was proof of intervention. /topic says this is a little off-topic here. |
06:44
π
|
|
bsmith093 has joined #warrior |
06:50
π
|
kiska |
-1 connections is the targets way of saying I am almost out of disk space |
06:51
π
|
phillipsj |
I am aware :) |
06:51
π
|
kiska |
XD |
06:51
π
|
kiska |
Just saying if someone isn't aware |
07:01
π
|
phillipsj |
I told my warroir to get up tp 6 concurrent items. That will only make my machine buffer and extra 16-200MB though. |
07:02
π
|
* |
phillipsj does not feel like lauching multiple VMs for now. |
07:03
π
|
* |
kiska doesn't want to spend more money |
07:04
π
|
|
oshura has quit IRC (Quit: Page closed) |
07:06
π
|
phillipsj |
understandable. I removed 4GB of RAM from may machin for higher memory bandwdith. Would need to restart firefox to run more VMs. |
07:06
π
|
phillipsj |
I guess I can do that. |
07:08
π
|
phillipsj |
I found even with 20GB, I had to restart firefox after 30 days or so. |
07:14
π
|
* |
phillipsj now magically has 6GB of free ram: enough for 7 more warrior instances. |
07:19
π
|
bilboed |
use containers (i.e. docker) instead. warrior instances take about 200MB each (6 threads/yahoogroups) |
07:25
π
|
|
VADemon has quit IRC (Quit: left4dead) |
07:29
π
|
phillipsj |
docker won't work for me (freeBSD). When it was working, I apparently had to run Linux anyway, so won't save much. |
07:29
π
|
bilboed |
you would just have to run *one* linux vm and then containers within |
07:29
π
|
|
VADemon has joined #warrior |
07:30
π
|
phillipsj |
I do have a linux machine doing nothing but primality testing Maybe I can look into it tomorrow. |
08:19
π
|
* |
phillipsj estimates he will buffer 200-2400MB now. |
08:23
π
|
|
Medowar has joined #warrior |
08:23
π
|
|
step has quit IRC (Quit: ZNC 1.7.5 - https://znc.in) |
08:24
π
|
kiska |
Well I am still clearing space out *somewhere* |
08:24
π
|
|
step has joined #warrior |
08:29
π
|
phillipsj |
That may explain the disk IO on my end :) |
08:32
π
|
kiska |
XD |
08:34
π
|
|
yano has quit IRC (Read error: Connection reset by peer) |
08:35
π
|
|
yano has joined #warrior |
08:39
π
|
|
step has quit IRC (Quit: ZNC 1.7.5 - https://znc.in) |
08:40
π
|
|
step has joined #warrior |
09:07
π
|
|
phillipsj has quit IRC (Remote host closed the connection) |
09:09
π
|
|
nepeat has quit IRC (Quit: ZNC 1.7.5 - https://znc.in) |
09:10
π
|
|
jrayhawk has quit IRC (Ping timeout: 248 seconds) |
09:12
π
|
|
phillipsj has joined #warrior |
09:12
π
|
|
step_ has joined #warrior |
09:12
π
|
|
step has quit IRC (Quit: ZNC 1.7.5 - https://znc.in) |
09:13
π
|
|
step_ is now known as step |
09:16
π
|
|
jrayhawk has joined #warrior |
09:31
π
|
|
jrayhawk has quit IRC (Ping timeout: 248 seconds) |
09:32
π
|
|
jrayhawk has joined #warrior |
09:40
π
|
|
TetryonBe has joined #warrior |
10:06
π
|
|
sildur has joined #warrior |
10:07
π
|
sildur |
"Thanks for NOT asking about upload problems" |
10:07
π
|
sildur |
hah! |
10:07
π
|
sildur |
I see I'm not the first... |
10:12
π
|
kiska |
Which upload issues? |
10:12
π
|
sildur |
a lot of rsync errors |
10:12
π
|
sildur |
@ERROR: max connections (35) reached -- try again later rsync error: error starting client-server protocol (code 5) at main.c(1653) [sender=3.1.1] Process RsyncUpload returned exit code 5 for Item user:691c80a4fff1bfbea23d430aec974c5f Failed RsyncUpload for Item user:691c80a4fff1bfbea23d430aec974c5f |
10:13
π
|
kiska |
Yes that is cause the server doesn't have that much capacity |
10:15
π
|
kiska |
Be patient while I request a server upgrade |
10:15
π
|
sildur |
at least now there are not download errors. I had my share of them. yesterday yahoo groups was really slow. I though they were throttling me, but it was still really slow after connecting to my vpn and trying to access with a browser on private mode |
10:16
π
|
sildur |
oh, thanks! |
11:30
π
|
|
ShellyRol has quit IRC (Read error: Connection reset by peer) |
11:33
π
|
|
ShellyRol has joined #warrior |
11:43
π
|
|
sildur has quit IRC (Ping timeout: 260 seconds) |
13:13
π
|
|
vicarage has quit IRC (Ping timeout: 263 seconds) |
14:37
π
|
Wingy |
phillipsj linux vm + docker + docker-compose + my tool warrior-manager? It seems like itβd work well |
14:38
π
|
Wingy |
Can you access the vm as an ip? Or do you have to forward ports? |
15:18
π
|
|
sep332 has joined #warrior |
15:19
π
|
|
vicarage has joined #warrior |
16:14
π
|
Wingy |
With Docker how do I set ArchiveTeam's Choice in the env variables? |
16:15
π
|
|
DogsRNice has joined #warrior |
16:18
π
|
DogsRNice |
im having some troubble getting the vm to work. its just getting stuck on updating even though it should be able to connect to the internet |
16:18
π
|
DogsRNice |
https://cdn.discordapp.com/attachments/492827195853766668/654718104152047645/Capture.PNG |
16:22
π
|
markedL |
when did you dl that .ova file? |
16:23
π
|
markedL |
DogsRNice https://warriorhq.archiveteam.org/downloads/warrior3/ was it from here? |
16:24
π
|
DogsRNice |
some time in 2017. its been a while since ive run it |
16:24
π
|
DogsRNice |
it wouldnt boot for a while actually until i messed around with some settings |
16:32
π
|
markedL |
v2 is no longer working |
16:33
π
|
markedL |
no longer supported,IDK if that's your problem but it's a good first start |
16:34
π
|
DogsRNice |
well that would make sense |
16:34
π
|
DogsRNice |
it somehow started working though and now its saying its updating the code |
16:40
π
|
markedL |
hm, maybe v2 means something else, dunno |
16:45
π
|
jrwr |
DogsRNice: Def grab the new images |
16:46
π
|
jrwr |
from the warrior3 link above |
16:46
π
|
DogsRNice |
yeah i am |
16:47
π
|
markedL |
let me know if it still says warrior-2 in the title bar on the new one |
16:47
π
|
markedL |
we should put more version number messages in more places |
16:48
π
|
phillipsj |
Wingy, I have been forwarding ports. Each instance gets assigned 10.0.2.15 for some reason. |
16:51
π
|
phillipsj |
"system" CPU usage is around 30%: much of it is probably VM overhead. Anything hiting disk gets hashed and compressed for the in-memory cache as well (ZFS). |
16:54
π
|
* |
phillipsj has been thinking of deditcating a pair of SAS drives with UFS (less overhead than ZFS) for warroir use. |
16:57
π
|
phillipsj |
Oh, looks like I can spin down a few instance: get item from tracker limited now. |
17:56
π
|
* |
phillipsj spins extra VMs back up. |
18:11
π
|
|
Medowar has quit IRC (Quit: Connection closed for inactivity) |
18:20
π
|
Decobus |
Is there a channel for the plays.tv archiving? |
18:21
π
|
markedL |
#stops.tv irc.hackint.org |
18:21
π
|
Decobus |
thank you markedL |
20:57
π
|
|
d5f4a3622 has quit IRC (Read error: Connection reset by peer) |
20:59
π
|
|
d5f4a3622 has joined #warrior |
21:12
π
|
|
d5f4a3622 has quit IRC (Read error: Connection reset by peer) |
21:13
π
|
TetryonBe |
hi, any d/l problems related to yahoo workers should get asked over their channel, or here? |
21:14
π
|
Wingy |
In their channel :) |
21:15
π
|
TetryonBe |
thanks |
21:20
π
|
|
d5f4a3622 has joined #warrior |