[00:57] *** JesseW has joined #urlteam [01:22] *** JesseW has quit IRC (Ping timeout: 370 seconds) [03:35] *** will has quit IRC (Ping timeout: 244 seconds) [03:35] *** will has joined #urlteam [03:45] *** JesseW has joined #urlteam [05:49] *** Rotab has joined #urlteam [06:10] dammit, we've got an estimate of 2,624 error reports [06:10] Looking into it. [06:11] Ah, isgd_6 has one that hasn't been resolved for over 10 hours -- that's why. [06:11] shuffling all the claims around, to see if that helps [06:19] *** Start has quit IRC (Ping timeout: 260 seconds) [06:27] *** Start has joined #urlteam [06:27] disabled autoqueue for isgd_6 -- try letting it empty out [06:32] *** WinterFox has joined #urlteam [06:56] switch to 25 URL items in isgd_6, reset the lower seq number to the earliest failing one, and clear out the failing items [06:57] *** Start has quit IRC (Ping timeout: 260 seconds) [06:59] ok, the number of error reports is improved (because we threw out all the ones for the old items) [06:59] and I have a new crop of 30 to see whether they will finish [07:00] I turned off autoqueue -- phuzion (or other admins) if you notice isgd_6 has an empty queue, feel free to turn autoqueue back on [07:00] but I'm curious whether some items will get stuck again [07:00] so I'd like to leave it off for now [07:00] and I'm going to sleep [07:06] *** Start has joined #urlteam [07:11] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:20] 6M scanned by me since I joined yesterday :D [07:21] nIce [10:42] *** bwn has quit IRC (Read error: Operation timed out) [10:52] *** bwn has joined #urlteam [11:22] ಠ_ಠ [12:14] voltagex: thats's OMG :P How much concurrency do you have? :P [12:15] 32x4 grabs at the moment [12:16] 128 concurrency? GG [12:18] More earlier before I got worried about the cost [12:19] yeah lol [12:20] It's all AWS credit and spot instances right now [12:22] everyone loves free stuff :) [12:22] anyways [12:22] can i propose an url shortner? [12:22] well it's not really a shotner [12:22] but it's embedded in the website [12:23] it's https://www.hive.co/l/huvf [12:24] the url codes seems to bee only 4 characters [12:24] lovercase [12:24] and numbers [12:24] i haven't seen special characters as of yet [12:26] found a 3 long one www.hive.co/l/6tb [12:27] they probably add a new position when they run out of the 4 characters one [12:56] I'll go to bed when I hit 7M [13:19] *** WinterFox has quit IRC (Remote host closed the connection) [13:31] night! [13:56] *** Start has quit IRC (Quit: Disconnected.) [15:03] night [15:25] *** Start has joined #urlteam [15:27] *** JesseW has joined #urlteam [15:38] luckcolor: please do add your suggested shortener to the wiki page! [15:38] ok [15:38] And investigate the info listed there. If it's straightforward, I'm glad to add it. If it's not, I'm glad to look over possible custom code to handle it. [15:39] isgd_6 is still semi-borked [15:40] i mean Jessew i'm currently scripting a permutation gen to get the url list [15:40] it's not a lot of urls to backup i think [15:41] 4 ^ 26? [15:41] nice, although if you want it integrated with urlteam, I need the info listed on the wiki page [15:41] sure [15:41] i need then the password of the wiki [15:41] :P [15:41] If you just want grab them yourself, and put the results up on IA, that's fine too (and may be easier). [15:41] yeah [15:41] luckcolor: the secret word is yahoosucks [15:41] :O [15:41] thx [15:42] sure [15:42] I'll let you know my progress [15:42] great! [15:42] So, isgd_6 has done *9* of it's 30 claims in the last 8 hours -- and all the other ones have failed multiple times. :-( [15:43] chfoo, any guesses? [15:48] Jessew: would you do me a favor? [15:48] if you have time [15:48] what is it? [15:49] so after i gte this url list i need to check the urls right, so have you got some script which can walk over them and save the result? [15:49] that would be a good task for urlteam, yes. :-) [15:50] Ok good :P [15:50] otherwise, you can use curl and a bash for loop, something like this: [15:51] for foo in $(cat file_with_list); do curl -i http://whatever.it.is/$foo ; done > output_file [15:52] ok thanks [15:52] well i still have to figure out my permutations gen [15:52] * luckcolor is a beginner coder [15:53] you don't have to do that part, either [15:53] if you can list the possible characters, urlteam can handle it from there [15:53] i already have the list [15:53] and the way to distinguish a successful result from an unsuccessful onee [15:53] I'll edit the wiki [15:54] and a way to extract the pointed-to URL [15:55] wat fo you mean with the pointed url? [15:55] *what do [15:57] the long URL that the short URL points to [15:58] I'm going AFK for a bit; feel free to ask more questions, I read the logs [16:00] it's probably failing since it's not using upgraded Python yet [16:04] *** JesseW has quit IRC (Ping timeout: 370 seconds) [16:06] *** Start has quit IRC (Quit: Disconnected.) [16:33] *** Start has joined #urlteam [17:02] *** JW_work has quit IRC (Read error: Operation timed out) [17:10] *** JW_work has joined #urlteam [17:38] *** Start has quit IRC (Quit: Disconnected.) [19:40] *** Start has joined #urlteam [19:44] *** Start has quit IRC (Client Quit) [22:13] *** Start has joined #urlteam [22:35] *** VADemon has joined #urlteam [22:47] *** dashcloud has quit IRC (Read error: Operation timed out) [22:51] *** dashcloud has joined #urlteam [22:52] *** svchfoo1 sets mode: +o dashcloud