[00:47] *** Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) [00:54] *** Fusl has quit IRC (Quit: K-Lined) [01:14] *** Fusl has joined #urlteam [01:14] *** svchfoo1 sets mode: +o Fusl [01:15] *** svchfoo3 sets mode: +o Fusl [01:15] *** Fusl_ sets mode: +o Fusl [03:10] hmm, I've scaled my workers up and I'm making better progress now but it seems the individual nodes are still lightly used. With a limitation of 1job/shortener/ip I should rarely, if ever, run into a situation with no active job [03:13] also I would expect an FullClaim error instead of NoItemAvailable [03:40] I don't understand this line: https://github.com/ArchiveTeam/terroroftinytown/blob/1f5e121f85e734b71b06ebd69cf5131b8b8f51d3/terroroftinytown/tracker/model.py#L685 [03:40] and the Budget.is_claims_full call seems redundant with Budget.get_available_project [03:43] or, get_available_project is checking all conditions and if it didn't return a result then is_claims_full is checking for a specific condition again to generate the correct error [03:43] I will be honest I dont understand it either I barely understand what I am doing when adding new urls [03:50] after looking into this for about an hour I think there's a tiny issue somewhere in the scheduling, but I can't figure it out [03:53] this line seems odd: https://github.com/ArchiveTeam/terroroftinytown/blob/1f5e121f85e734b71b06ebd69cf5131b8b8f51d3/terroroftinytown/tracker/model.py#L590 [03:55] claims is the number of jobs that are currently checked out and items is the number of allocated jobs. they are both incremented. I couldn't find the code about the working dying yet, but in that case the item would be read from the table and claims is incremented, while items is not [04:50] *** Cameron_D has quit IRC (Read error: Operation timed out) [05:00] *** Cameron_D has joined #urlteam [05:32] *** Cameron_D has quit IRC (Read error: Operation timed out) [05:32] *** Cameron_D has joined #urlteam [05:33] fyi, the password hashes in terroroftinytown are salted md5 [05:34] i'm surprised they are hashed at all [05:39] I've started setting up a development environment and had to figure out how to log in [05:40] I've finished one patch that's scratching another itch about being able to export my submission rate into my monitoring without writing a websocket client [05:41] now I need to make sure it actually works [05:47] Oh for fucks sake MD5 [05:47] Dont tell me the salts are stored next to the passwords [05:50] that's always the case for salts [05:53] filed my first pr \o/ https://github.com/ArchiveTeam/terroroftinytown/pull/71 [06:35] *** asdf0101 has quit IRC (The Lounge - https://thelounge.chat) [06:38] *** asdf0101 has joined #urlteam [06:42] *** asdf0101 has quit IRC (Client Quit) [06:55] *** asdf0101 has joined #urlteam [09:16] *** kiska1 has quit IRC (Read error: Operation timed out) [09:16] *** systwi_ has joined #urlteam [09:16] *** kiska1 has joined #urlteam [09:16] *** Fusl sets mode: +o kiska1 [09:16] *** Fusl_ sets mode: +o kiska1 [09:23] *** systwi has quit IRC (Read error: Operation timed out) [10:24] kpcyrd: There's that limit of one job per shortener and IP, but there's also a global limit of jobs for each shortener, and we usually have way more capacity here than items available on the tracker. It's why we need to add more shorteners to the tracker. [10:53] *** eythian has quit IRC (Quit: No Ping reply in 180 seconds.) [10:56] *** eythian has joined #urlteam [12:45] *** jornane has quit IRC (Ping timeout: 252 seconds) [12:48] *** jornane has joined #urlteam [14:05] *** systwi_ is now known as systwi [15:59] i wish the tracker for this would be multi threaded so i can throw all my ips at it :( [16:31] it seems there are already too many ips for the global limit :/ [17:53] *** odemg has joined #urlteam [21:40] *** Flashfloo has quit IRC (Remote host closed the connection) [21:40] *** Flashfire has quit IRC (Remote host closed the connection) [21:40] *** kiska has quit IRC (Remote host closed the connection) [21:40] *** Flashfloo has joined #urlteam [21:40] *** Flashfire has joined #urlteam [21:41] *** kiska has joined #urlteam [21:41] *** Fusl sets mode: +o kiska [21:41] *** Fusl_ sets mode: +o kiska [21:41] *** svchfoo1 sets mode: +o Flashfire [21:41] *** svchfoo3 sets mode: +o Flashfire [23:36] *** lunik1498 has joined #urlteam [23:36] *** lunik1498 is now known as lunik1