[00:48] *** Boppen has quit IRC (Ping timeout: 194 seconds) [01:17] *** Boppen has joined #urlteam [01:25] *** JesseW has joined #urlteam [01:55] *** Boppen has quit IRC (Ping timeout: 194 seconds) [02:10] *** JesseW has quit IRC (Ping timeout: 370 seconds) [02:24] *** Boppen has joined #urlteam [02:52] *** dashcloud has quit IRC (Remote host closed the connection) [02:54] *** dashcloud has joined #urlteam [02:55] *** svchfoo1 sets mode: +o dashcloud [03:01] *** Boppen has quit IRC (Read error: Connection reset by peer) [03:31] *** dashcloud has quit IRC (Read error: Operation timed out) [03:31] *** Boppen has joined #urlteam [03:31] *** dashcloud has joined #urlteam [03:31] *** svchfoo1 sets mode: +o dashcloud [03:48] *** JesseW has joined #urlteam [04:07] *** Boppen has quit IRC (Read error: Connection reset by peer) [04:37] *** Boppen has joined #urlteam [05:16] *** Boppen has quit IRC (Ping timeout: 194 seconds) [05:44] *** Boppen has joined #urlteam [06:05] *** BnA-Rob1n has quit IRC (Ping timeout: 244 seconds) [06:07] *** BnA-Rob1n has joined #urlteam [06:12] *** BnA-Rob1n has quit IRC (Ping timeout: 244 seconds) [06:19] *** BnA-Rob1n has joined #urlteam [06:22] *** Boppen has quit IRC (Ping timeout: 194 seconds) [06:50] *** JesseW has quit IRC (Ping timeout: 370 seconds) [06:51] *** Boppen has joined #urlteam [07:28] *** Boppen has quit IRC (Read error: Connection reset by peer) [07:58] *** Boppen has joined #urlteam [09:00] *** WinterFox has joined #urlteam [10:15] *** Boppen has quit IRC (Read error: Connection reset by peer) [10:45] *** Boppen has joined #urlteam [12:13] *** dashcloud has quit IRC (Read error: Operation timed out) [12:17] *** dashcloud has joined #urlteam [12:17] *** svchfoo1 sets mode: +o dashcloud [13:02] *** WinterFox has quit IRC (Remote host closed the connection) [14:08] *** Start has quit IRC (Quit: Disconnected.) [14:43] *** Boppen has quit IRC (Read error: Connection reset by peer) [14:46] *** Rotab has joined #urlteam [15:04] *** Start has joined #urlteam [15:12] *** Boppen has joined #urlteam [15:51] *** Boppen has quit IRC (Ping timeout: 194 seconds) [16:07] *** Start has quit IRC (Quit: Disconnected.) [16:13] *** Start has joined #urlteam [16:19] *** Start has quit IRC (Quit: Disconnected.) [16:20] *** Boppen has joined #urlteam [17:31] *** Boppen has quit IRC (Ping timeout: 194 seconds) [18:00] *** Boppen has joined #urlteam [18:15] *** jornane has quit IRC (Ping timeout: 260 seconds) [18:27] *** Start has joined #urlteam [18:36] not sure why i overlooked it for over a year, but adding the missing "pragma synchronous=normal" seems to restored the tracker's performance to what i was originally expecting [18:36] did you do that about 20 hours ago? [18:36] no, just now [18:37] hm ok [18:37] *** Boppen has quit IRC (Read error: Connection reset by peer) [18:37] i think someone just started up more scrapers and it just caused it to die [18:38] hm ok [18:38] * xmc keeps an eye on munin [18:38] there's been some work done on the physical host lately too [18:40] yeah, it seems like a few hours ago nginx was unable to service any request to the tracker [18:41] yea [18:41] some of the disks got swapped out [18:42] and so the ceph cluster is rebuilding or whatever [18:42] i'm not very good at computer [18:42] should have done that sooner to make me double check why the tracker was dying :P [18:42] lol [18:43] huh [18:43] zloty accounts for a good portion of the write load in the cluster [18:43] so, uh, if you can figure out how to batch better, that reduces our opex to replace drives that wear out :) [18:44] the tracker should behave much better now though [18:44] cool [18:44] what'd you change exactly? [18:44] just changed the fsync setting for sqlite [18:44] o ... [18:45] instead of fsync every commit that happened hundreds of time per second to only when the WAL is synced to the database [18:46] i honestly don't know why i didn't look at the code to make sure it was set instead of continuously trying to debug the sql queries [19:06] *** Boppen has joined #urlteam [19:09] *** jornane has joined #urlteam [19:44] *** Boppen has quit IRC (Read error: Connection reset by peer) [19:45] *** Start has quit IRC (Quit: Disconnected.) [20:05] *** Start has joined #urlteam [20:13] *** Boppen has joined #urlteam [20:20] *** bwn has quit IRC (Read error: Operation timed out) [20:31] *** Smiley has quit IRC (Remote host closed the connection) [20:33] *** BnA-Rob1n has quit IRC (Ping timeout: 244 seconds) [20:34] *** Fletcher has quit IRC (Ping timeout: 244 seconds) [20:49] *** bwn has joined #urlteam [20:54] *** Smiley has joined #urlteam [20:56] *** Fletcher has joined #urlteam [20:56] *** BnA-Rob1n has joined #urlteam [21:10] *** Start has quit IRC (Quit: Disconnected.) [22:31] *** Boppen has quit IRC (Read error: Connection reset by peer) [22:43] *** Start has joined #urlteam [22:58] *** Boppen has joined #urlteam [23:19] *** trs80 has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** GLaDOS has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** ranma has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** swebb has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** Frogging has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** chazchaz has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** atlogbot has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** JW_work has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** Fusl has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** svchfoo1 has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** svchfoo3 has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** Cameron_D has quit IRC (ircd.choopa.net hub.efnet.us) [23:19] *** arkiver has quit IRC (ircd.choopa.net hub.efnet.us) [23:20] *** Arkiver2 has joined #urlteam [23:27] *** GLaDOS has joined #urlteam [23:27] *** ranma has joined #urlteam [23:27] *** swebb has joined #urlteam [23:27] *** Frogging has joined #urlteam [23:27] *** atlogbot has joined #urlteam [23:27] *** JW_work has joined #urlteam [23:27] *** trs80 has joined #urlteam [23:27] *** svchfoo1 has joined #urlteam [23:27] *** svchfoo3 has joined #urlteam [23:27] *** Cameron_D has joined #urlteam [23:27] *** hub.efnet.us sets mode: +ooo swebb svchfoo1 svchfoo3 [23:28] *** Fusl_ has joined #urlteam [23:29] *** Frogging_ has joined #urlteam [23:29] *** swebb sets mode: +o xmc [23:30] *** svchfoo1 has quit IRC (Ping timeout: 370 seconds) [23:30] *** Cameron_D has quit IRC (Ping timeout: 370 seconds) [23:30] *** chazchaz_ has joined #urlteam [23:32] *** Frogging has quit IRC (Ping timeout: 1208 seconds) [23:32] *** Frogging_ is now known as Frogging [23:32] *** svchfoo1 has joined #urlteam [23:32] *** svchfoo3 sets mode: +o svchfoo1 [23:34] *** Cameron_D has joined #urlteam [23:34] *** Fusl_ is now known as Fusl