#warrior 2019-08-01,Thu

↑back Search

Time Nickname Message
02:20 🔗 ShellyRol has quit IRC (Read error: Connection reset by peer)
02:20 🔗 ShellyRol has joined #warrior
04:34 🔗 Flashfire has quit IRC (Remote host closed the connection)
04:34 🔗 kiska has quit IRC (Remote host closed the connection)
04:35 🔗 Flashfire has joined #warrior
04:35 🔗 kiska has joined #warrior
04:35 🔗 Fusl sets mode: +o kiska
04:35 🔗 Fusl_ sets mode: +o kiska
06:25 🔗 zerkalo has quit IRC (west.us.hub irc.mzima.net)
06:25 🔗 yano has quit IRC (west.us.hub irc.mzima.net)
06:25 🔗 yuitimoth has quit IRC (west.us.hub irc.mzima.net)
06:25 🔗 svchfoo3 has quit IRC (west.us.hub irc.mzima.net)
06:25 🔗 nyany has quit IRC (west.us.hub irc.mzima.net)
06:26 🔗 zerkalo has joined #warrior
06:26 🔗 yano has joined #warrior
06:26 🔗 yuitimoth has joined #warrior
06:26 🔗 svchfoo3 has joined #warrior
06:26 🔗 nyany has joined #warrior
06:26 🔗 irc.mzima.net sets mode: +o svchfoo3
06:26 🔗 Fusl sets mode: +o svchfoo3
06:26 🔗 Fusl_ sets mode: +o svchfoo3
14:20 🔗 kiska1 has quit IRC (Remote host closed the connection)
14:21 🔗 kiska1 has joined #warrior
14:21 🔗 Fusl sets mode: +o kiska1
14:21 🔗 Fusl_ sets mode: +o kiska1
17:07 🔗 Dj-Wawa has joined #warrior
17:17 🔗 Dragnog has joined #warrior
18:19 🔗 kpcyrd has joined #warrior
18:19 🔗 kpcyrd is there a list of valid values for SELECTED_PROJECT= ?
18:23 🔗 Fusl kpcyrd: curl -sf --compressed https://warriorhq.archiveteam.org/projects.json | jq -r '.projects[].name'
18:24 🔗 kpcyrd Fusl: thanks. do you also know at which path I should mount my storage? the root fs is rather small but I have another partition I can mount into the containers
18:25 🔗 Fusl that depends on how much concurrency you plan to run. general rule of thumb i always use is 8gb per thread
18:28 🔗 kpcyrd hmm.. I'm planning to run a swarm of really small instances
18:28 🔗 kpcyrd they have 2gb each
18:29 🔗 kpcyrd that should be enough for urlteam2?
18:44 🔗 kpcyrd oh lol. 8gb storage, not ram
18:44 🔗 kpcyrd that makes a lot more sense
18:46 🔗 JAA URLTeam needs basically zero storage, only IPs and time.
18:47 🔗 JAA Also very little RAM or any other resources really.
18:48 🔗 astrid urlteam mostly needs ip addresses
18:50 🔗 JAA Fusl should run it on rips. :-P
18:50 🔗 ShellyRol has quit IRC (Read error: Operation timed out)
18:51 🔗 kpcyrd ok, I've been following archivebot instructions to setup the machines, I'm going to extend my deployment for machines that are basically must a cpu with an ip and use that for urlteam like workers
18:51 🔗 Fusl_ i did, it broke the master
18:51 🔗 Fusl_ master cant take all the load :(
18:52 🔗 JAA Ah right.
18:52 🔗 kpcyrd the warriors I've deployed aren't doing anything most of the time, I'm using the default concurrency (2?) and both workers are stuck in "trying again in 90 seconds" most of the time
18:52 🔗 JAA kpcyrd: ArchiveBot is a completely different thing.
18:52 🔗 ShellyRol has joined #warrior
18:53 🔗 kpcyrd yeah, figured that eventually
18:54 🔗 kpcyrd is there a recommended concurrency for urlteam? there's no way I'm beating Fusl at the current rate :D
18:55 🔗 Fusl_ around 5 per ip seems ok
19:01 🔗 kpcyrd how does the urlteam task allocation work? with a namespace that large we shouldn't run out of free items any time soon? :)
19:02 🔗 kpcyrd *search space
19:03 🔗 Igloo I think it's the only project with anything "to do" right now
19:12 🔗 kpcyrd do I need to take care of this manually or does the warrior restart automatically? https://github.com/ArchiveTeam/terroroftinytown/blob/develop/terroroftinytown/tracker/api.py#L89-L98
19:13 🔗 Igloo You'd have to do a git pull
19:13 🔗 Igloo The warrior will do it if the project changes.
19:13 🔗 Igloo If using docker you'd have to rebuild it.
19:16 🔗 JAA Any concurrency is fine on URLTeam. The tracker limits items to one per shortener and IP at a time.
19:16 🔗 kpcyrd Igloo: I've deployed https://hub.docker.com/r/archiveteam/warrior-dockerfile, is it sufficient to monitor for new images on docker hub (and pull+restart when found)?
19:18 🔗 Igloo I've missed the conversation for this; but I should say so yes.
19:19 🔗 Igloo I believe Fusl_ has built that setup
19:24 🔗 kpcyrd is there a way to monitor my status on https://tracker.archiveteam.org:1338/ ?
19:25 🔗 Fusl https://hub.docker.com/r/archiveteam/ isn't my territory
19:25 🔗 Fusl https://hub.docker.com/u/warcforceone is mine
19:35 🔗 Cameron_D has quit IRC (Ping timeout: 1212 seconds)
19:53 🔗 Cameron_D has joined #warrior
20:03 🔗 Cameron_D has quit IRC (Remote host closed the connection)
20:15 🔗 Cameron_D has joined #warrior
22:06 🔗 ShellyRol has quit IRC (Read error: Operation timed out)
22:07 🔗 ShellyRol has joined #warrior
22:26 🔗 JAA has quit IRC (Read error: Operation timed out)
22:27 🔗 kiskabak has quit IRC (Ping timeout (120 seconds))
22:29 🔗 kiskabak has joined #warrior
22:29 🔗 Fusl sets mode: +o kiskabak
22:29 🔗 Fusl_ sets mode: +o kiskabak
22:30 🔗 JAA has joined #warrior
22:30 🔗 Fusl sets mode: +o JAA
22:30 🔗 Fusl_ sets mode: +o JAA
22:31 🔗 AlsoJAA sets mode: +o JAA

irclogger-viewer