| Time |
Nickname |
Message |
|
00:40
🔗
|
|
bitspill has joined #warrior |
|
01:34
🔗
|
|
tonsofpcs has joined #warrior |
|
01:36
🔗
|
tonsofpcs |
just learned about this - i have an esxi server, how many instances should i run? is there benefit to multiple? what space/ram/cpu restraints are there? |
|
01:36
🔗
|
tonsofpcs |
s/rest/const/ |
|
01:38
🔗
|
Kaz |
spin up a debian VM, install docker and just use the container |
|
01:39
🔗
|
Kaz |
as for constraints, it varies wildly depending on project |
|
01:42
🔗
|
tonsofpcs |
so i shouldnt use the prebuilt image? |
|
01:49
🔗
|
Kaz |
ova is only for if you're running it on a desktop or something like that |
|
01:57
🔗
|
|
bsmith093 has quit IRC (Read error: Operation timed out) |
|
02:37
🔗
|
|
Panda9 has joined #warrior |
|
03:33
🔗
|
|
bsmith093 has joined #warrior |
|
04:02
🔗
|
|
bsmith093 has quit IRC (Quit: Leaving.) |
|
04:03
🔗
|
|
bsmith093 has joined #warrior |
|
04:03
🔗
|
|
bsmith093 has quit IRC (Client Quit) |
|
04:04
🔗
|
|
bsmith093 has joined #warrior |
|
04:32
🔗
|
|
bsmith093 has quit IRC (Quit: Leaving.) |
|
04:41
🔗
|
|
bsmith093 has joined #warrior |
|
04:54
🔗
|
|
yano_ has joined #warrior |
|
04:54
🔗
|
|
yano has quit IRC (Read error: Connection reset by peer) |
|
04:56
🔗
|
|
datechnom has quit IRC (Ping timeout: 260 seconds) |
|
05:46
🔗
|
|
d5f4a3622 has quit IRC (Read error: Operation timed out) |
|
05:47
🔗
|
|
d5f4a3622 has joined #warrior |
|
05:47
🔗
|
Zerote |
you can import the ova into esxi, but if you're going to be running multiple warriors per ip, its more efficient to run a linux vm and then running them in docker |
|
06:12
🔗
|
tonsofpcs |
thanks |
|
06:12
🔗
|
tonsofpcs |
built debian, trying to figure out docker install now (googling many things) |
|
06:28
🔗
|
tonsofpcs |
installed. |
|
06:36
🔗
|
Zerote |
there should be a template for a docker-compose file somewhere, i had that set to auto start with the vms back when i was running them in esxi |
|
06:38
🔗
|
Panda9 |
Is it correct in saying that running multiple warrior clients under the same IP will not speed things up as the tracker limits the amount of scans by ip? |
|
06:42
🔗
|
Zerote |
depends on the project, but i run multiple warriors per ip for both the current projects |
|
06:43
🔗
|
Zerote |
Right now, yourshot/natgeo is being limited by their servers, they cant handle the traffic. Urlteam is limited by the amount of work the tracker sends out, so all the warriors on that project are competing with each other for work |
|
06:45
🔗
|
Panda9 |
Yeah i saw it was slowing done a tonne for me over the last 24 hours |
|
06:45
🔗
|
Panda9 |
Thats why i thought having another instance running wouldnt help |
|
06:46
🔗
|
Panda9 |
Looks like the tracker might need to work a little harder to keep our agents more busy ;) |
|
07:00
🔗
|
Zerote |
for natgeo, if you run more instances, you're just putting more load on their servers, you will get slightly better leaderboard stats, but the combined download rate of the project is whatever their servers can handle, we cant do much from our side afaik |
|
07:02
🔗
|
Zerote |
for urlteam, the number of jobs can be increased by adding more shorteners, (the tracker rate limits per shortener, as to not bog them down to much), but that carries a management overhead |
|
07:24
🔗
|
Panda9 |
Yeah thats fine. I will let the Archive Team Administrators work their magic and just keep providing bandwidth and compute |
|
10:01
🔗
|
|
d5f4a3622 has quit IRC (Read error: Operation timed out) |
|
10:04
🔗
|
|
Flashfire has quit IRC (Read error: Connection reset by peer) |
|
10:04
🔗
|
|
kiska has quit IRC (Read error: Connection reset by peer) |
|
10:04
🔗
|
|
Flashfire has joined #warrior |
|
10:04
🔗
|
|
kiska has joined #warrior |
|
10:04
🔗
|
|
Fusl sets mode: +o kiska |
|
10:04
🔗
|
|
Fusl_ sets mode: +o kiska |
|
10:20
🔗
|
|
mtntmnky_ has joined #warrior |
|
10:24
🔗
|
|
d5f4a3622 has joined #warrior |
|
10:32
🔗
|
|
mtntmnky has quit IRC (Remote host closed the connection) |
|
13:34
🔗
|
Fusl |
/b 16 |
|
13:46
🔗
|
|
yano_ is now known as yano |
|
16:55
🔗
|
tonsofpcs |
for dns should I use google, cloudflare, or something else? My ISP DNS is one of those ones that randomly injects search pages so I don't want to use that. |
|
16:55
🔗
|
tonsofpcs |
(US based if it matters) |
|
16:59
🔗
|
Kaz |
either is fine (as long as it's not your ISP) |
|
17:04
🔗
|
yano |
i prefer quad9, but that's my preference |
|
17:11
🔗
|
tonsofpcs |
cool. These don't seem to take much RAM or CPU either. I'll leave four instances running for now and see how it goes. |
|
17:14
🔗
|
tonsofpcs |
is there a way to (maybe through the leaderboard?) confirm that my username is indeed participating. Watching the 'recent' cycle through about 10 on my screen every second with over 100 per second doesn't seem like a good way to tell |
|
17:24
🔗
|
JAA |
yano: I hope you use the unfiltered one. |
|
17:25
🔗
|
Kaz |
reminds me - the checks we make in the pipeline aren't 'good enough' imo. |
|
17:25
🔗
|
Kaz |
we need one that we expect to fail, to see if something is hijacking nxdomain |
|
17:25
🔗
|
Kaz |
but there's no central source for that list, so it's an ad-hoc thing when projects get created |
|
17:26
🔗
|
JAA |
Yeah |
|
17:26
🔗
|
JAA |
Template repo... |
|
18:29
🔗
|
yano |
JAA: i do |
|
18:29
🔗
|
yano |
JAA: i use the ipv6 unfiltered one on all my servers (plus the backup unfiltered one) |
|
18:31
🔗
|
JAA |
yano: Good. Make sure to mention that when you recommend Quad9 since it's not immediately obvious until you dig into the FAQ I think. |
|
18:32
🔗
|
JAA |
On another note, Quad9's unfiltered servers don't support DNSSEC. |
|
18:36
🔗
|
yano |
JAA: good point |
|
18:36
🔗
|
JAA |
By the way, since we're mentioning preferences, mine's to run a recursive resolver myself. |
|
18:56
🔗
|
Zerote |
tonsofpcs: I'm assuming you're talking about urlteam. You can set the limit at the top of the leaderboard to 5000 or something. It's pretty slow when it's that big, but you can CTRL+F your nick and check that it's working. |
|
18:57
🔗
|
Zerote |
Alternatively, I wrote a python script that grabs the websocket and displays a leaderboard centered around a specific user, given as a launch parameter. I can upload it to github or send it to you if you want |
|
18:59
🔗
|
JAA |
Zerote: Please share. That question has been asked many times before. |
|
19:01
🔗
|
|
PostDox has quit IRC (Quit: PostDox) |
|
19:02
🔗
|
Zerote |
Alright, just a sec, I'll make a repo for it |
|
19:15
🔗
|
markedL |
I agree with Kaz the Checks need additional checks ... |
|
19:29
🔗
|
Zerote |
https://github.com/zerote000/UrlTeam-Leaderboard |
|
19:30
🔗
|
Zerote |
It's been quite a while since I looked at the code, and only just worked on it until it worked pretty well, so there might be some sloppy code hidden in there, but there you go :) |
|
19:31
🔗
|
JAA |
AT lives on sloppy code. :-) |
|
19:44
🔗
|
Igloo |
Gaffa tape FTW |
|
20:03
🔗
|
|
PostDox has joined #warrior |
|
20:18
🔗
|
|
mtntmnky_ is now known as mtntmnky |
|
21:07
🔗
|
|
Panda9 is now known as Datechnom |
|
21:09
🔗
|
Datechnom |
Thanks for sharing the python tracker script zerote |
|
21:09
🔗
|
|
d5f4a3622 has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4) |
|
21:12
🔗
|
|
d5f4a3622 has joined #warrior |
|
21:49
🔗
|
|
bitspill has quit IRC (Quit: Connection closed for inactivity) |
|
22:50
🔗
|
|
Dallas has quit IRC (Read error: Operation timed out) |
|
22:51
🔗
|
|
h3ndr1k has quit IRC (Read error: Operation timed out) |
|
22:54
🔗
|
|
h3ndr1k has joined #warrior |
|
22:55
🔗
|
|
MrRadar2 has quit IRC (Remote host closed the connection) |
|
22:55
🔗
|
|
MrRadar2 has joined #warrior |
|
22:55
🔗
|
|
BnAboyZ has quit IRC (Read error: Operation timed out) |
|
23:00
🔗
|
|
MrRadar2 has quit IRC (Remote host closed the connection) |
|
23:10
🔗
|
|
Igloo has quit IRC (Ping timeout: 1212 seconds) |
|
23:12
🔗
|
|
Dallas has joined #warrior |
|
23:21
🔗
|
|
BnAboyZ has joined #warrior |
|
23:23
🔗
|
|
MrRadar2 has joined #warrior |
|
23:23
🔗
|
|
Igloo has joined #warrior |
|
23:42
🔗
|
|
kiskabak has quit IRC (Read error: Operation timed out) |
|
23:44
🔗
|
|
kiskabak has joined #warrior |
|
23:44
🔗
|
|
Fusl sets mode: +o kiskabak |
|
23:44
🔗
|
|
Fusl_ sets mode: +o kiskabak |