#warrior 2019-10-17,Thu

↑back Search

Time Nickname Message
00:40 🔗 bitspill has joined #warrior
01:34 🔗 tonsofpcs has joined #warrior
01:36 🔗 tonsofpcs just learned about this - i have an esxi server, how many instances should i run? is there benefit to multiple? what space/ram/cpu restraints are there?
01:36 🔗 tonsofpcs s/rest/const/
01:38 🔗 Kaz spin up a debian VM, install docker and just use the container
01:39 🔗 Kaz as for constraints, it varies wildly depending on project
01:42 🔗 tonsofpcs so i shouldnt use the prebuilt image?
01:49 🔗 Kaz ova is only for if you're running it on a desktop or something like that
01:57 🔗 bsmith093 has quit IRC (Read error: Operation timed out)
02:37 🔗 Panda9 has joined #warrior
03:33 🔗 bsmith093 has joined #warrior
04:02 🔗 bsmith093 has quit IRC (Quit: Leaving.)
04:03 🔗 bsmith093 has joined #warrior
04:03 🔗 bsmith093 has quit IRC (Client Quit)
04:04 🔗 bsmith093 has joined #warrior
04:32 🔗 bsmith093 has quit IRC (Quit: Leaving.)
04:41 🔗 bsmith093 has joined #warrior
04:54 🔗 yano_ has joined #warrior
04:54 🔗 yano has quit IRC (Read error: Connection reset by peer)
04:56 🔗 datechnom has quit IRC (Ping timeout: 260 seconds)
05:46 🔗 d5f4a3622 has quit IRC (Read error: Operation timed out)
05:47 🔗 d5f4a3622 has joined #warrior
05:47 🔗 Zerote you can import the ova into esxi, but if you're going to be running multiple warriors per ip, its more efficient to run a linux vm and then running them in docker
06:12 🔗 tonsofpcs thanks
06:12 🔗 tonsofpcs built debian, trying to figure out docker install now (googling many things)
06:28 🔗 tonsofpcs installed.
06:36 🔗 Zerote there should be a template for a docker-compose file somewhere, i had that set to auto start with the vms back when i was running them in esxi
06:38 🔗 Panda9 Is it correct in saying that running multiple warrior clients under the same IP will not speed things up as the tracker limits the amount of scans by ip?
06:42 🔗 Zerote depends on the project, but i run multiple warriors per ip for both the current projects
06:43 🔗 Zerote Right now, yourshot/natgeo is being limited by their servers, they cant handle the traffic. Urlteam is limited by the amount of work the tracker sends out, so all the warriors on that project are competing with each other for work
06:45 🔗 Panda9 Yeah i saw it was slowing done a tonne for me over the last 24 hours
06:45 🔗 Panda9 Thats why i thought having another instance running wouldnt help
06:46 🔗 Panda9 Looks like the tracker might need to work a little harder to keep our agents more busy ;)
07:00 🔗 Zerote for natgeo, if you run more instances, you're just putting more load on their servers, you will get slightly better leaderboard stats, but the combined download rate of the project is whatever their servers can handle, we cant do much from our side afaik
07:02 🔗 Zerote for urlteam, the number of jobs can be increased by adding more shorteners, (the tracker rate limits per shortener, as to not bog them down to much), but that carries a management overhead
07:24 🔗 Panda9 Yeah thats fine. I will let the Archive Team Administrators work their magic and just keep providing bandwidth and compute
10:01 🔗 d5f4a3622 has quit IRC (Read error: Operation timed out)
10:04 🔗 Flashfire has quit IRC (Read error: Connection reset by peer)
10:04 🔗 kiska has quit IRC (Read error: Connection reset by peer)
10:04 🔗 Flashfire has joined #warrior
10:04 🔗 kiska has joined #warrior
10:04 🔗 Fusl sets mode: +o kiska
10:04 🔗 Fusl_ sets mode: +o kiska
10:20 🔗 mtntmnky_ has joined #warrior
10:24 🔗 d5f4a3622 has joined #warrior
10:32 🔗 mtntmnky has quit IRC (Remote host closed the connection)
13:34 🔗 Fusl /b 16
13:46 🔗 yano_ is now known as yano
16:55 🔗 tonsofpcs for dns should I use google, cloudflare, or something else? My ISP DNS is one of those ones that randomly injects search pages so I don't want to use that.
16:55 🔗 tonsofpcs (US based if it matters)
16:59 🔗 Kaz either is fine (as long as it's not your ISP)
17:04 🔗 yano i prefer quad9, but that's my preference
17:11 🔗 tonsofpcs cool. These don't seem to take much RAM or CPU either. I'll leave four instances running for now and see how it goes.
17:14 🔗 tonsofpcs is there a way to (maybe through the leaderboard?) confirm that my username is indeed participating. Watching the 'recent' cycle through about 10 on my screen every second with over 100 per second doesn't seem like a good way to tell
17:24 🔗 JAA yano: I hope you use the unfiltered one.
17:25 🔗 Kaz reminds me - the checks we make in the pipeline aren't 'good enough' imo.
17:25 🔗 Kaz we need one that we expect to fail, to see if something is hijacking nxdomain
17:25 🔗 Kaz but there's no central source for that list, so it's an ad-hoc thing when projects get created
17:26 🔗 JAA Yeah
17:26 🔗 JAA Template repo...
18:29 🔗 yano JAA: i do
18:29 🔗 yano JAA: i use the ipv6 unfiltered one on all my servers (plus the backup unfiltered one)
18:31 🔗 JAA yano: Good. Make sure to mention that when you recommend Quad9 since it's not immediately obvious until you dig into the FAQ I think.
18:32 🔗 JAA On another note, Quad9's unfiltered servers don't support DNSSEC.
18:36 🔗 yano JAA: good point
18:36 🔗 JAA By the way, since we're mentioning preferences, mine's to run a recursive resolver myself.
18:56 🔗 Zerote tonsofpcs: I'm assuming you're talking about urlteam. You can set the limit at the top of the leaderboard to 5000 or something. It's pretty slow when it's that big, but you can CTRL+F your nick and check that it's working.
18:57 🔗 Zerote Alternatively, I wrote a python script that grabs the websocket and displays a leaderboard centered around a specific user, given as a launch parameter. I can upload it to github or send it to you if you want
18:59 🔗 JAA Zerote: Please share. That question has been asked many times before.
19:01 🔗 PostDox has quit IRC (Quit: PostDox)
19:02 🔗 Zerote Alright, just a sec, I'll make a repo for it
19:15 🔗 markedL I agree with Kaz the Checks need additional checks ...
19:29 🔗 Zerote https://github.com/zerote000/UrlTeam-Leaderboard
19:30 🔗 Zerote It's been quite a while since I looked at the code, and only just worked on it until it worked pretty well, so there might be some sloppy code hidden in there, but there you go :)
19:31 🔗 JAA AT lives on sloppy code. :-)
19:44 🔗 Igloo Gaffa tape FTW
20:03 🔗 PostDox has joined #warrior
20:18 🔗 mtntmnky_ is now known as mtntmnky
21:07 🔗 Panda9 is now known as Datechnom
21:09 🔗 Datechnom Thanks for sharing the python tracker script zerote
21:09 🔗 d5f4a3622 has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4)
21:12 🔗 d5f4a3622 has joined #warrior
21:49 🔗 bitspill has quit IRC (Quit: Connection closed for inactivity)
22:50 🔗 Dallas has quit IRC (Read error: Operation timed out)
22:51 🔗 h3ndr1k has quit IRC (Read error: Operation timed out)
22:54 🔗 h3ndr1k has joined #warrior
22:55 🔗 MrRadar2 has quit IRC (Remote host closed the connection)
22:55 🔗 MrRadar2 has joined #warrior
22:55 🔗 BnAboyZ has quit IRC (Read error: Operation timed out)
23:00 🔗 MrRadar2 has quit IRC (Remote host closed the connection)
23:10 🔗 Igloo has quit IRC (Ping timeout: 1212 seconds)
23:12 🔗 Dallas has joined #warrior
23:21 🔗 BnAboyZ has joined #warrior
23:23 🔗 MrRadar2 has joined #warrior
23:23 🔗 Igloo has joined #warrior
23:42 🔗 kiskabak has quit IRC (Read error: Operation timed out)
23:44 🔗 kiskabak has joined #warrior
23:44 🔗 Fusl sets mode: +o kiskabak
23:44 🔗 Fusl_ sets mode: +o kiskabak

irclogger-viewer