| Time |
Nickname |
Message |
|
02:20
🔗
|
|
ShellyRol has quit IRC (Read error: Connection reset by peer) |
|
02:20
🔗
|
|
ShellyRol has joined #warrior |
|
04:34
🔗
|
|
Flashfire has quit IRC (Remote host closed the connection) |
|
04:34
🔗
|
|
kiska has quit IRC (Remote host closed the connection) |
|
04:35
🔗
|
|
Flashfire has joined #warrior |
|
04:35
🔗
|
|
kiska has joined #warrior |
|
04:35
🔗
|
|
Fusl sets mode: +o kiska |
|
04:35
🔗
|
|
Fusl_ sets mode: +o kiska |
|
06:25
🔗
|
|
zerkalo has quit IRC (west.us.hub irc.mzima.net) |
|
06:25
🔗
|
|
yano has quit IRC (west.us.hub irc.mzima.net) |
|
06:25
🔗
|
|
yuitimoth has quit IRC (west.us.hub irc.mzima.net) |
|
06:25
🔗
|
|
svchfoo3 has quit IRC (west.us.hub irc.mzima.net) |
|
06:25
🔗
|
|
nyany has quit IRC (west.us.hub irc.mzima.net) |
|
06:26
🔗
|
|
zerkalo has joined #warrior |
|
06:26
🔗
|
|
yano has joined #warrior |
|
06:26
🔗
|
|
yuitimoth has joined #warrior |
|
06:26
🔗
|
|
svchfoo3 has joined #warrior |
|
06:26
🔗
|
|
nyany has joined #warrior |
|
06:26
🔗
|
|
irc.mzima.net sets mode: +o svchfoo3 |
|
06:26
🔗
|
|
Fusl sets mode: +o svchfoo3 |
|
06:26
🔗
|
|
Fusl_ sets mode: +o svchfoo3 |
|
14:20
🔗
|
|
kiska1 has quit IRC (Remote host closed the connection) |
|
14:21
🔗
|
|
kiska1 has joined #warrior |
|
14:21
🔗
|
|
Fusl sets mode: +o kiska1 |
|
14:21
🔗
|
|
Fusl_ sets mode: +o kiska1 |
|
17:07
🔗
|
|
Dj-Wawa has joined #warrior |
|
17:17
🔗
|
|
Dragnog has joined #warrior |
|
18:19
🔗
|
|
kpcyrd has joined #warrior |
|
18:19
🔗
|
kpcyrd |
is there a list of valid values for SELECTED_PROJECT= ? |
|
18:23
🔗
|
Fusl |
kpcyrd: curl -sf --compressed https://warriorhq.archiveteam.org/projects.json | jq -r '.projects[].name' |
|
18:24
🔗
|
kpcyrd |
Fusl: thanks. do you also know at which path I should mount my storage? the root fs is rather small but I have another partition I can mount into the containers |
|
18:25
🔗
|
Fusl |
that depends on how much concurrency you plan to run. general rule of thumb i always use is 8gb per thread |
|
18:28
🔗
|
kpcyrd |
hmm.. I'm planning to run a swarm of really small instances |
|
18:28
🔗
|
kpcyrd |
they have 2gb each |
|
18:29
🔗
|
kpcyrd |
that should be enough for urlteam2? |
|
18:44
🔗
|
kpcyrd |
oh lol. 8gb storage, not ram |
|
18:44
🔗
|
kpcyrd |
that makes a lot more sense |
|
18:46
🔗
|
JAA |
URLTeam needs basically zero storage, only IPs and time. |
|
18:47
🔗
|
JAA |
Also very little RAM or any other resources really. |
|
18:48
🔗
|
astrid |
urlteam mostly needs ip addresses |
|
18:50
🔗
|
JAA |
Fusl should run it on rips. :-P |
|
18:50
🔗
|
|
ShellyRol has quit IRC (Read error: Operation timed out) |
|
18:51
🔗
|
kpcyrd |
ok, I've been following archivebot instructions to setup the machines, I'm going to extend my deployment for machines that are basically must a cpu with an ip and use that for urlteam like workers |
|
18:51
🔗
|
Fusl_ |
i did, it broke the master |
|
18:51
🔗
|
Fusl_ |
master cant take all the load :( |
|
18:52
🔗
|
JAA |
Ah right. |
|
18:52
🔗
|
kpcyrd |
the warriors I've deployed aren't doing anything most of the time, I'm using the default concurrency (2?) and both workers are stuck in "trying again in 90 seconds" most of the time |
|
18:52
🔗
|
JAA |
kpcyrd: ArchiveBot is a completely different thing. |
|
18:52
🔗
|
|
ShellyRol has joined #warrior |
|
18:53
🔗
|
kpcyrd |
yeah, figured that eventually |
|
18:54
🔗
|
kpcyrd |
is there a recommended concurrency for urlteam? there's no way I'm beating Fusl at the current rate :D |
|
18:55
🔗
|
Fusl_ |
around 5 per ip seems ok |
|
19:01
🔗
|
kpcyrd |
how does the urlteam task allocation work? with a namespace that large we shouldn't run out of free items any time soon? :) |
|
19:02
🔗
|
kpcyrd |
*search space |
|
19:03
🔗
|
Igloo |
I think it's the only project with anything "to do" right now |
|
19:12
🔗
|
kpcyrd |
do I need to take care of this manually or does the warrior restart automatically? https://github.com/ArchiveTeam/terroroftinytown/blob/develop/terroroftinytown/tracker/api.py#L89-L98 |
|
19:13
🔗
|
Igloo |
You'd have to do a git pull |
|
19:13
🔗
|
Igloo |
The warrior will do it if the project changes. |
|
19:13
🔗
|
Igloo |
If using docker you'd have to rebuild it. |
|
19:16
🔗
|
JAA |
Any concurrency is fine on URLTeam. The tracker limits items to one per shortener and IP at a time. |
|
19:16
🔗
|
kpcyrd |
Igloo: I've deployed https://hub.docker.com/r/archiveteam/warrior-dockerfile, is it sufficient to monitor for new images on docker hub (and pull+restart when found)? |
|
19:18
🔗
|
Igloo |
I've missed the conversation for this; but I should say so yes. |
|
19:19
🔗
|
Igloo |
I believe Fusl_ has built that setup |
|
19:24
🔗
|
kpcyrd |
is there a way to monitor my status on https://tracker.archiveteam.org:1338/ ? |
|
19:25
🔗
|
Fusl |
https://hub.docker.com/r/archiveteam/ isn't my territory |
|
19:25
🔗
|
Fusl |
https://hub.docker.com/u/warcforceone is mine |
|
19:35
🔗
|
|
Cameron_D has quit IRC (Ping timeout: 1212 seconds) |
|
19:53
🔗
|
|
Cameron_D has joined #warrior |
|
20:03
🔗
|
|
Cameron_D has quit IRC (Remote host closed the connection) |
|
20:15
🔗
|
|
Cameron_D has joined #warrior |
|
22:06
🔗
|
|
ShellyRol has quit IRC (Read error: Operation timed out) |
|
22:07
🔗
|
|
ShellyRol has joined #warrior |
|
22:26
🔗
|
|
JAA has quit IRC (Read error: Operation timed out) |
|
22:27
🔗
|
|
kiskabak has quit IRC (Ping timeout (120 seconds)) |
|
22:29
🔗
|
|
kiskabak has joined #warrior |
|
22:29
🔗
|
|
Fusl sets mode: +o kiskabak |
|
22:29
🔗
|
|
Fusl_ sets mode: +o kiskabak |
|
22:30
🔗
|
|
JAA has joined #warrior |
|
22:30
🔗
|
|
Fusl sets mode: +o JAA |
|
22:30
🔗
|
|
Fusl_ sets mode: +o JAA |
|
22:31
🔗
|
|
AlsoJAA sets mode: +o JAA |