#urlteam 2016-05-26,Thu

↑back Search

Time Nickname Message
00:57 🔗 JesseW has joined #urlteam
01:22 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
03:35 🔗 will has quit IRC (Ping timeout: 244 seconds)
03:35 🔗 will has joined #urlteam
03:45 🔗 JesseW has joined #urlteam
05:49 🔗 Rotab has joined #urlteam
06:10 🔗 JesseW dammit, we've got an estimate of 2,624 error reports
06:10 🔗 JesseW Looking into it.
06:11 🔗 JesseW Ah, isgd_6 has one that hasn't been resolved for over 10 hours -- that's why.
06:11 🔗 JesseW shuffling all the claims around, to see if that helps
06:19 🔗 Start has quit IRC (Ping timeout: 260 seconds)
06:27 🔗 Start has joined #urlteam
06:27 🔗 JesseW disabled autoqueue for isgd_6 -- try letting it empty out
06:32 🔗 WinterFox has joined #urlteam
06:56 🔗 JesseW switch to 25 URL items in isgd_6, reset the lower seq number to the earliest failing one, and clear out the failing items
06:57 🔗 Start has quit IRC (Ping timeout: 260 seconds)
06:59 🔗 JesseW ok, the number of error reports is improved (because we threw out all the ones for the old items)
06:59 🔗 JesseW and I have a new crop of 30 to see whether they will finish
07:00 🔗 JesseW I turned off autoqueue -- phuzion (or other admins) if you notice isgd_6 has an empty queue, feel free to turn autoqueue back on
07:00 🔗 JesseW but I'm curious whether some items will get stuck again
07:00 🔗 JesseW so I'd like to leave it off for now
07:00 🔗 JesseW and I'm going to sleep
07:06 🔗 Start has joined #urlteam
07:11 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
07:20 🔗 voltagex 6M scanned by me since I joined yesterday :D
07:21 🔗 xmc nIce
10:42 🔗 bwn has quit IRC (Read error: Operation timed out)
10:52 🔗 bwn has joined #urlteam
11:22 🔗 ranma ಠ_ಠ
12:14 🔗 luckcolor voltagex: thats's OMG :P How much concurrency do you have? :P
12:15 🔗 voltagex 32x4 grabs at the moment
12:16 🔗 luckcolor 128 concurrency? GG
12:18 🔗 voltagex More earlier before I got worried about the cost
12:19 🔗 luckcolor yeah lol
12:20 🔗 voltagex It's all AWS credit and spot instances right now
12:22 🔗 luckcolor everyone loves free stuff :)
12:22 🔗 luckcolor anyways
12:22 🔗 luckcolor can i propose an url shortner?
12:22 🔗 luckcolor well it's not really a shotner
12:22 🔗 luckcolor but it's embedded in the website
12:23 🔗 luckcolor it's https://www.hive.co/l/huvf
12:24 🔗 luckcolor the url codes seems to bee only 4 characters
12:24 🔗 luckcolor lovercase
12:24 🔗 luckcolor and numbers
12:24 🔗 luckcolor i haven't seen special characters as of yet
12:26 🔗 luckcolor found a 3 long one www.hive.co/l/6tb
12:27 🔗 luckcolor they probably add a new position when they run out of the 4 characters one
12:56 🔗 voltagex I'll go to bed when I hit 7M
13:19 🔗 WinterFox has quit IRC (Remote host closed the connection)
13:31 🔗 voltagex night!
13:56 🔗 Start has quit IRC (Quit: Disconnected.)
15:03 🔗 luckcolor night
15:25 🔗 Start has joined #urlteam
15:27 🔗 JesseW has joined #urlteam
15:38 🔗 JesseW luckcolor: please do add your suggested shortener to the wiki page!
15:38 🔗 luckcolor ok
15:38 🔗 JesseW And investigate the info listed there. If it's straightforward, I'm glad to add it. If it's not, I'm glad to look over possible custom code to handle it.
15:39 🔗 JesseW isgd_6 is still semi-borked
15:40 🔗 luckcolor i mean Jessew i'm currently scripting a permutation gen to get the url list
15:40 🔗 luckcolor it's not a lot of urls to backup i think
15:41 🔗 luckcolor 4 ^ 26?
15:41 🔗 JesseW nice, although if you want it integrated with urlteam, I need the info listed on the wiki page
15:41 🔗 luckcolor sure
15:41 🔗 luckcolor i need then the password of the wiki
15:41 🔗 luckcolor :P
15:41 🔗 JesseW If you just want grab them yourself, and put the results up on IA, that's fine too (and may be easier).
15:41 🔗 luckcolor yeah
15:41 🔗 JesseW luckcolor: the secret word is yahoosucks
15:41 🔗 luckcolor :O
15:41 🔗 luckcolor thx
15:42 🔗 JesseW sure
15:42 🔗 luckcolor I'll let you know my progress
15:42 🔗 JesseW great!
15:42 🔗 JesseW So, isgd_6 has done *9* of it's 30 claims in the last 8 hours -- and all the other ones have failed multiple times. :-(
15:43 🔗 JesseW chfoo, any guesses?
15:48 🔗 luckcolor Jessew: would you do me a favor?
15:48 🔗 luckcolor if you have time
15:48 🔗 JesseW what is it?
15:49 🔗 luckcolor so after i gte this url list i need to check the urls right, so have you got some script which can walk over them and save the result?
15:49 🔗 JesseW that would be a good task for urlteam, yes. :-)
15:50 🔗 luckcolor Ok good :P
15:50 🔗 JesseW otherwise, you can use curl and a bash for loop, something like this:
15:51 🔗 JesseW for foo in $(cat file_with_list); do curl -i http://whatever.it.is/$foo ; done > output_file
15:52 🔗 luckcolor ok thanks
15:52 🔗 luckcolor well i still have to figure out my permutations gen
15:52 🔗 * luckcolor is a beginner coder
15:53 🔗 JesseW you don't have to do that part, either
15:53 🔗 JesseW if you can list the possible characters, urlteam can handle it from there
15:53 🔗 luckcolor i already have the list
15:53 🔗 JesseW and the way to distinguish a successful result from an unsuccessful onee
15:53 🔗 luckcolor I'll edit the wiki
15:54 🔗 JesseW and a way to extract the pointed-to URL
15:55 🔗 luckcolor wat fo you mean with the pointed url?
15:55 🔗 luckcolor *what do
15:57 🔗 JesseW the long URL that the short URL points to
15:58 🔗 JesseW I'm going AFK for a bit; feel free to ask more questions, I read the logs
16:00 🔗 chfoo it's probably failing since it's not using upgraded Python yet
16:04 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
16:06 🔗 Start has quit IRC (Quit: Disconnected.)
16:33 🔗 Start has joined #urlteam
17:02 🔗 JW_work has quit IRC (Read error: Operation timed out)
17:10 🔗 JW_work has joined #urlteam
17:38 🔗 Start has quit IRC (Quit: Disconnected.)
19:40 🔗 Start has joined #urlteam
19:44 🔗 Start has quit IRC (Client Quit)
22:13 🔗 Start has joined #urlteam
22:35 🔗 VADemon has joined #urlteam
22:47 🔗 dashcloud has quit IRC (Read error: Operation timed out)
22:51 🔗 dashcloud has joined #urlteam
22:52 🔗 svchfoo1 sets mode: +o dashcloud

irclogger-viewer