#urlteam 2014-09-18,Thu

↑back Search

Time Nickname Message
00:58 🔗 GitHub114 13terroroftinytown/06master 140865e89 15Christopher Foo: Bump client min version to 4...
00:58 🔗 GitHub114 13terroroftinytown/06master 14dc7feb8 15Christopher Foo: Use unicode-escape encoding for JSON on the done API...
00:58 🔗 GitHub114 13terroroftinytown/06master 14ff2c42e 15Christopher Foo: services: Results must return body encoding or None....
00:58 🔗 GitHub114 [13terroroftinytown] 15chfoo pushed 3 new commits to 06master: 02https://github.com/ArchiveTeam/terroroftinytown/compare/a6cc2d550efa...0865e891f512
01:02 🔗 GitHub114 [13terroroftinytown-client-grab] 15chfoo pushed 1 new commit to 06master: 02https://github.com/ArchiveTeam/terroroftinytown-client-grab/commit/1adc311feb9b30c4cac6173ecdbe31f4d0571a45
01:02 🔗 GitHub114 13terroroftinytown-client-grab/06master 141adc311 15Christopher Foo: Bump submodule.
01:06 🔗 chfoo i reenabled the 3 shortener queues
01:12 🔗 aaaaaaaaa I have a suggestion, can you increase the time out on updatesubmodule for the tasks that aren't doing it from 10 seconds?
01:12 🔗 aaaaaaaaa It looks like it is erroring out when new items pop up every 10 seconds.
01:13 🔗 chfoo it's supposed to only error every hour
01:15 🔗 aaaaaaaaa I mean when I click on "work on this project" it pops up two items. The one does the updatesubmodule and the other dies and then sleeps for 10 seconds. Then a new item pops up and does the same until the other item finishes updating.
01:15 🔗 chfoo oh, ok
01:15 🔗 aaaaaaaaa looks too much like it is erroring out and broken
01:16 🔗 chfoo the problem is that the version of git in the warrior vm is really old so it doesn't support updating to the latest
01:17 🔗 chfoo so i'm trying the new command, and then trying the old command
01:17 🔗 aaaaaaaaa could you make the other item sleep longer?
01:18 🔗 aaaaaaaaa that way there isn't a build up of red "FAILED"
01:18 🔗 chfoo i'm not sure how. seesaw wasn't really meant for updating submodules though
01:19 🔗 aaaaaaaaa Thats ok, just a suggestion.
01:20 🔗 chfoo it's something that needs to be fix though
01:21 🔗 chfoo i realized that i forgot to change the nickname in my warrior
01:22 🔗 aaaaaaaaa easy to spot
01:27 🔗 chfoo i keep confusing which warrior vm is being used for dev or for real :)
01:28 🔗 aaaaaaaaa I organized mine into groups. The blue border around it helps.
01:33 🔗 aaaaaaaaa https://github.com/ArchiveTeam/terroroftinytown-client-grab/blob/master/pipeline.py line 83
01:34 🔗 aaaaaaaaa module is spelled "moule"
01:39 🔗 chfoo thanks, will fix
01:40 🔗 chfoo oh, there's a retry delay. that should reduce the time it errors
01:44 🔗 GitHub169 13terroroftinytown-client-grab/06master 1419d9e71 15Christopher Foo: UpdateSubmodule: Fix typo, decrease retry delay, increase max tries. Bump ver.
01:44 🔗 GitHub169 [13terroroftinytown-client-grab] 15chfoo pushed 1 new commit to 06master: 02https://github.com/ArchiveTeam/terroroftinytown-client-grab/commit/19d9e71c814c9de0d666be9a09c7d6c57ecc17c7
01:46 🔗 chfoo the tracker isn't assigning shorteners randomly. anyone know of a good way?
01:49 🔗 aaaaaaaaa much better
01:49 🔗 aaaaaaaaa is the tracker terror of tinytown without the -grab?
01:50 🔗 chfoo yes, https://github.com/ArchiveTeam/terroroftinytown
01:56 🔗 chfoo maybe order by random since i don't envision having thousands of shorteners in the tracker
02:04 🔗 GitHub115 13terroroftinytown/06master 14eff0f9e 15Christopher Foo: tracker: Security: Add @authenticated to delete project.
02:04 🔗 GitHub115 [13terroroftinytown] 15chfoo pushed 1 new commit to 06master: 02https://github.com/ArchiveTeam/terroroftinytown/commit/eff0f9e9e1ded2e6f112ab767af44a75bf96aa4c
02:10 🔗 GitHub26 13terroroftinytown/06master 1469353fa 15Christopher Foo: tracker: Use order_by random() to assign random projects....
02:10 🔗 GitHub26 [13terroroftinytown] 15chfoo pushed 1 new commit to 06master: 02https://github.com/ArchiveTeam/terroroftinytown/commit/69353fa7a3c02e142ea75e40c09ab3d9c1ccc080
15:24 🔗 aaaaaaaaa I see vantec found this project.
16:35 🔗 vantec shhhhh aaaaaaaaa
16:36 🔗 vantec sweet, looks like I can do 1M urls a day
17:13 🔗 chfoo anyone know a good algorithm to turn a number into a randomly looking shortcode? it has to be one-to-one mapping. it seems like using using bytes from md5 digest doesn't seem idea because we'll never know when it cycles.
17:18 🔗 aaaaaaaaa base 36 conversion or not random looking enough?
17:19 🔗 aaaaaaaaa or heck a different, less used, base would look odder.
17:23 🔗 aaaaaaaaa A coworker suggested using some simple cipher.
17:42 🔗 aaaaaaaaa heck, maybe just xor it with a big enough key
17:45 🔗 Smiley rot13 ?
18:21 🔗 chfoo a combination of those might work. the reason is that the auto queue works only by incrementing a integer and it doesn't work well for those shorteners with random, fixed-length shortcodes
18:23 🔗 chfoo so i figured if there was a function that converted the auto queue integer into a random number, it would give a better distribution of random chance of hitting a url
18:23 🔗 chfoo rather than starting from 000000 and slowly going to ZZZZZ for example
18:24 🔗 xmc gray code

irclogger-viewer