#warrior 2019-12-12,Thu

↑back Search

Time Nickname Message
00:04 πŸ”— Wingy oshura: Definitely put warrior on the external hard drives. Don't use flash storage, please. Flash storage includes sd cards and usb sticks, and it will wear down those multi-hundred-dollar USB SSDs somewhat.
00:04 πŸ”— Wingy Long > Short: use the usb hard drives
01:04 πŸ”— oshura gotcha. Well, in that case I am using external hard drives. I still would need help getting the docker containers to run on the pis (I have three that I could use right now)
01:37 πŸ”— britmob has quit IRC (Read error: Connection reset by peer)
01:43 πŸ”— britmob has joined #warrior
01:55 πŸ”— mls_ has quit IRC (Ping timeout: 258 seconds)
01:56 πŸ”— mls_ has joined #warrior
02:00 πŸ”— kiska has quit IRC (Remote host closed the connection)
02:00 πŸ”— Flashfire has quit IRC (Remote host closed the connection)
02:01 πŸ”— Flashfire has joined #warrior
02:01 πŸ”— kiska has joined #warrior
02:45 πŸ”— Wingy https://i.imgur.com/oiESEVB.png
02:57 πŸ”— oshura I would love to know how to do that Wing
02:57 πŸ”— Wingy oshura: I made it myself :)
02:57 πŸ”— oshura Is that on a raspberry pi?
02:57 πŸ”— Wingy It reads from docker-compose and checks the forwarded ports
02:57 πŸ”— Wingy It's on an Ubuntu server
02:57 πŸ”— Wingy But it'd work on a pi.
02:57 πŸ”— Wingy Can a pi run multiple warriors?
02:58 πŸ”— oshura I have no idea. I was struggling to run the docker with just one warrior
02:58 πŸ”— oshura i know it can run multiple containers on docker but that's about all I know
03:00 πŸ”— bsmith093 has quit IRC (Quit: Leaving.)
03:01 πŸ”— oshura I'm just learning about linux now. I just know that this is time sensitive and would love to help before it's too late
03:02 πŸ”— oshura I keep getting this error when it comes to uploading a video on plays.tv project though
03:02 πŸ”— oshura Starting RsyncUpload for Item user:ea0dff7b640cdea30aefbb5e2982e11e @ERROR: max connections (100) reached -- try again later rsync error: error starting client-server protocol (code 5) at main.c(1653) [sender=3.1.1] Process RsyncUpload returned exit code 5 for Item user:ea0dff7b640cdea30aefbb5e2982e11e Failed RsyncUpload for Item user:ea0dff7b640cdea30aefbb5e2982e11e Retrying after 60 seconds...
03:15 πŸ”— kiska Please wait for a upload slot :D
03:15 πŸ”— kiska That is what that error is
03:23 πŸ”— oshura Thank you for the explanation @kiska. Is there anything I can do while the upload slot opens up to help the process along? I just feel like sitting here with an idling computer is not the best use of time for this situation
03:24 πŸ”— bsmith093 has joined #warrior
03:24 πŸ”— Wingy oshura more threads? uses more disk space though
03:25 πŸ”— Wingy and the pi might slow down if they open too quickly
03:25 πŸ”— Wingy and I uploaded my code to github: https://github.com/Wingysam/warrior-manager
03:26 πŸ”— bsmith093 has quit IRC (Client Quit)
03:28 πŸ”— Wingy this should install nodejs if you don't have it: curl -sL https://deb.nodesource.com/setup_13.x | sudo bash - && sudo apt install nodejs
03:29 πŸ”— oshura ok, hold on let me try that. I am a total newb when it comes to linux but I'll give it a whirl
03:36 πŸ”— Wingy I have to go to bed :(
03:36 πŸ”— Wingy Goodnight
03:37 πŸ”— Wingy Lmk in the morning if it works/not πŸ‘‹
03:38 πŸ”— bsmith093 has joined #warrior
03:39 πŸ”— bsmith093 has quit IRC (Client Quit)
06:01 πŸ”— phillipsj kiska your rnsync target (hel1) is accepting -1 connections.
06:06 πŸ”— britmob_ has joined #warrior
06:08 πŸ”— britmob has quit IRC (Ping timeout: 248 seconds)
06:13 πŸ”— britmob_ has quit IRC (Read error: Operation timed out)
06:15 πŸ”— britmob has joined #warrior
06:21 πŸ”— phillipsj it says 150 now, so thanks.
06:24 πŸ”— phillipsj 100 to 150 was proof of intervention. /topic says this is a little off-topic here.
06:44 πŸ”— bsmith093 has joined #warrior
06:50 πŸ”— kiska -1 connections is the targets way of saying I am almost out of disk space
06:51 πŸ”— phillipsj I am aware :)
06:51 πŸ”— kiska XD
06:51 πŸ”— kiska Just saying if someone isn't aware
07:01 πŸ”— phillipsj I told my warroir to get up tp 6 concurrent items. That will only make my machine buffer and extra 16-200MB though.
07:02 πŸ”— * phillipsj does not feel like lauching multiple VMs for now.
07:03 πŸ”— * kiska doesn't want to spend more money
07:04 πŸ”— oshura has quit IRC (Quit: Page closed)
07:06 πŸ”— phillipsj understandable. I removed 4GB of RAM from may machin for higher memory bandwdith. Would need to restart firefox to run more VMs.
07:06 πŸ”— phillipsj I guess I can do that.
07:08 πŸ”— phillipsj I found even with 20GB, I had to restart firefox after 30 days or so.
07:14 πŸ”— * phillipsj now magically has 6GB of free ram: enough for 7 more warrior instances.
07:19 πŸ”— bilboed use containers (i.e. docker) instead. warrior instances take about 200MB each (6 threads/yahoogroups)
07:25 πŸ”— VADemon has quit IRC (Quit: left4dead)
07:29 πŸ”— phillipsj docker won't work for me (freeBSD). When it was working, I apparently had to run Linux anyway, so won't save much.
07:29 πŸ”— bilboed you would just have to run *one* linux vm and then containers within
07:29 πŸ”— VADemon has joined #warrior
07:30 πŸ”— phillipsj I do have a linux machine doing nothing but primality testing Maybe I can look into it tomorrow.
08:19 πŸ”— * phillipsj estimates he will buffer 200-2400MB now.
08:23 πŸ”— Medowar has joined #warrior
08:23 πŸ”— step has quit IRC (Quit: ZNC 1.7.5 - https://znc.in)
08:24 πŸ”— kiska Well I am still clearing space out *somewhere*
08:24 πŸ”— step has joined #warrior
08:29 πŸ”— phillipsj That may explain the disk IO on my end :)
08:32 πŸ”— kiska XD
08:34 πŸ”— yano has quit IRC (Read error: Connection reset by peer)
08:35 πŸ”— yano has joined #warrior
08:39 πŸ”— step has quit IRC (Quit: ZNC 1.7.5 - https://znc.in)
08:40 πŸ”— step has joined #warrior
09:07 πŸ”— phillipsj has quit IRC (Remote host closed the connection)
09:09 πŸ”— nepeat has quit IRC (Quit: ZNC 1.7.5 - https://znc.in)
09:10 πŸ”— jrayhawk has quit IRC (Ping timeout: 248 seconds)
09:12 πŸ”— phillipsj has joined #warrior
09:12 πŸ”— step_ has joined #warrior
09:12 πŸ”— step has quit IRC (Quit: ZNC 1.7.5 - https://znc.in)
09:13 πŸ”— step_ is now known as step
09:16 πŸ”— jrayhawk has joined #warrior
09:31 πŸ”— jrayhawk has quit IRC (Ping timeout: 248 seconds)
09:32 πŸ”— jrayhawk has joined #warrior
09:40 πŸ”— TetryonBe has joined #warrior
10:06 πŸ”— sildur has joined #warrior
10:07 πŸ”— sildur "Thanks for NOT asking about upload problems"
10:07 πŸ”— sildur hah!
10:07 πŸ”— sildur I see I'm not the first...
10:12 πŸ”— kiska Which upload issues?
10:12 πŸ”— sildur a lot of rsync errors
10:12 πŸ”— sildur @ERROR: max connections (35) reached -- try again later rsync error: error starting client-server protocol (code 5) at main.c(1653) [sender=3.1.1] Process RsyncUpload returned exit code 5 for Item user:691c80a4fff1bfbea23d430aec974c5f Failed RsyncUpload for Item user:691c80a4fff1bfbea23d430aec974c5f
10:13 πŸ”— kiska Yes that is cause the server doesn't have that much capacity
10:15 πŸ”— kiska Be patient while I request a server upgrade
10:15 πŸ”— sildur at least now there are not download errors. I had my share of them. yesterday yahoo groups was really slow. I though they were throttling me, but it was still really slow after connecting to my vpn and trying to access with a browser on private mode
10:16 πŸ”— sildur oh, thanks!
11:30 πŸ”— ShellyRol has quit IRC (Read error: Connection reset by peer)
11:33 πŸ”— ShellyRol has joined #warrior
11:43 πŸ”— sildur has quit IRC (Ping timeout: 260 seconds)
13:13 πŸ”— vicarage has quit IRC (Ping timeout: 263 seconds)
14:37 πŸ”— Wingy phillipsj linux vm + docker + docker-compose + my tool warrior-manager? It seems like it’d work well
14:38 πŸ”— Wingy Can you access the vm as an ip? Or do you have to forward ports?
15:18 πŸ”— sep332 has joined #warrior
15:19 πŸ”— vicarage has joined #warrior
16:14 πŸ”— Wingy With Docker how do I set ArchiveTeam's Choice in the env variables?
16:15 πŸ”— DogsRNice has joined #warrior
16:18 πŸ”— DogsRNice im having some troubble getting the vm to work. its just getting stuck on updating even though it should be able to connect to the internet
16:18 πŸ”— DogsRNice https://cdn.discordapp.com/attachments/492827195853766668/654718104152047645/Capture.PNG
16:22 πŸ”— markedL when did you dl that .ova file?
16:23 πŸ”— markedL DogsRNice https://warriorhq.archiveteam.org/downloads/warrior3/ was it from here?
16:24 πŸ”— DogsRNice some time in 2017. its been a while since ive run it
16:24 πŸ”— DogsRNice it wouldnt boot for a while actually until i messed around with some settings
16:32 πŸ”— markedL v2 is no longer working
16:33 πŸ”— markedL no longer supported,IDK if that's your problem but it's a good first start
16:34 πŸ”— DogsRNice well that would make sense
16:34 πŸ”— DogsRNice it somehow started working though and now its saying its updating the code
16:40 πŸ”— markedL hm, maybe v2 means something else, dunno
16:45 πŸ”— jrwr DogsRNice: Def grab the new images
16:46 πŸ”— jrwr from the warrior3 link above
16:46 πŸ”— DogsRNice yeah i am
16:47 πŸ”— markedL let me know if it still says warrior-2 in the title bar on the new one
16:47 πŸ”— markedL we should put more version number messages in more places
16:48 πŸ”— phillipsj Wingy, I have been forwarding ports. Each instance gets assigned 10.0.2.15 for some reason.
16:51 πŸ”— phillipsj "system" CPU usage is around 30%: much of it is probably VM overhead. Anything hiting disk gets hashed and compressed for the in-memory cache as well (ZFS).
16:54 πŸ”— * phillipsj has been thinking of deditcating a pair of SAS drives with UFS (less overhead than ZFS) for warroir use.
16:57 πŸ”— phillipsj Oh, looks like I can spin down a few instance: get item from tracker limited now.
17:56 πŸ”— * phillipsj spins extra VMs back up.
18:11 πŸ”— Medowar has quit IRC (Quit: Connection closed for inactivity)
18:20 πŸ”— Decobus Is there a channel for the plays.tv archiving?
18:21 πŸ”— markedL #stops.tv irc.hackint.org
18:21 πŸ”— Decobus thank you markedL
20:57 πŸ”— d5f4a3622 has quit IRC (Read error: Connection reset by peer)
20:59 πŸ”— d5f4a3622 has joined #warrior
21:12 πŸ”— d5f4a3622 has quit IRC (Read error: Connection reset by peer)
21:13 πŸ”— TetryonBe hi, any d/l problems related to yahoo workers should get asked over their channel, or here?
21:14 πŸ”— Wingy In their channel :)
21:15 πŸ”— TetryonBe thanks
21:20 πŸ”— d5f4a3622 has joined #warrior

irclogger-viewer