[01:39] this is the tracker's sql queries made per request: http://pastebin.com/iCytRTc4 [01:41] so there's a bit of a noticeable performance problem [01:44] fortunately it seems like the time it spends in sqlite code is negligible and majority of the time is in sqlalchemy [10:47] http://blog.feedly.com/2014/10/28/feedly-url-shortener-retired/ [10:48] it'll be around for the forseeable future, but worth scraping sooner rather than later [10:58] I guess they're, fed.. up. [19:36] chfoo: You don't have to give out every job twice. You just need to check one or two codes from each job and see if they are correct. So for say each 10 jobs, you hand out 1 verification job that includes 20 shortcodes [19:38] But so far I have never detected any problems. The only times I had different results was when the owner of a url shortener decided that he needed a specific shortcode and just deleted the old URL (is.gd), or with tinyurl which displays advertisements when an URL returns a 404 and sometimes has encoding issues. [23:05] i need to pause tracker. the database is filling up and i need to get the export scripts working correctly. [23:13] 13terroroftinytown/06develop 143085e68 15Christopher Foo: WIP Fix up release supervisor script args. [23:13] [13terroroftinytown] 15chfoo pushed 1 new commit to 06develop: 02https://github.com/ArchiveTeam/terroroftinytown/commit/3085e686b74b12f41f945b92df1df010a94583d1 [23:46] chfoo: ic [23:47] chfoo: any ETA when the tracker will be back online again? (minutes, hours, days?) [23:58] hopefully in a few days