#urlteam 2017-09-30,Sat

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
Somebody2Soulflare: thanks for adding the shortener to the wiki page. [05:15]
Soulflarenp!
noticed it on @steamgames' twitter and disected it a bit
[05:15]
Somebody2Nice, help is always appreciated.
Soulflare: looks feasible to start scraping; I'll set it up
I presume the alphabet is just A-Za-z0-9?
zpr-io started
JAA, other people interested in fixing up the wiki page: One *lovely* feature would be a way to auto-generate the warrior table from the server data.
You'd need to figure out how to sync it with the comments (which are only in the wiki page, and should probably stay there)
And the initially and last scraped date aren't on the tracker -- but they could be derived from searches at IA, which would be nice.
[05:16]
SoulflareI believe it's just alphanumeric yes [05:24]
Somebody2Example URL could in theory be extracted from the results, too
zpr-io has results
and no errors
[05:24]
Soulflare\o/ [05:25]
Somebody2boosting queue to 40 [05:25]
Soulflareis that including that it either gives a 302 or 200? or is 200 considered the error in that sense
since it just returns a json error
in other words, were the "no errors" all 302 found instead of 200 ok?
[05:25]
Somebody2302 or 200 are not errors; errors are something unexpected [05:27]
Soulflareoh so like server errors or worse [05:28]
Somebody2yep [05:28]
Soulflaregotcha [05:28]
Somebody2You can see the settings here: https://tracker.archiveteam.org:1338/api/project_settings?name=zpr-io
it will only show up as errors if it returns an HTTP code not listed there
or if it times out
[05:28]
Soulflarethat's pretty cool to see
having only seen the warrior and tracker so far
[05:29]
Somebody2If zpr-io is incremental, and the alphabet is 0-9a-zA-Z, and the current max is around nnids, there are about 300 million shortcodes.
Which we should be able to grab in a few days, probably.
Yeah, terroroftinytown (the current URLTeam software) is pretty cool
I've hacked on it a bit, but I arrived after it had pretty much been written. I'm just a custodian.
We've found about 15,000 shortcodes (out of 22,000 tried) on zpr-io, in just the few minutes since I started it.
boosting queue to 70
Soulflare: if you'd like, investigating dlvr.it would be very welcome.
Nobody seeems to have checked into it since 2015.
You can sort the list of Alive (but not yet in the Warrior) shorteners by date-of-last-checked -- and work your way down the list, adding info.
[05:29]
Soulflarealright, I'm gonna head off to bed shortly but I will gladly pick it apart when I get up
thanks for the info
[05:34]
Somebody2Awesome, thanks. Sleep sufficiently! [05:35]
Soulflareo/ [05:36]
Somebody278,000 found out of 107,000 checked on zpr-io [05:45]
poeurl-com started [05:53]
poeurl-com has no 1 or 2 character ones, but we've started getting results now in the 3-character range
I'm going to sleep soon, and it will probably be done before I wake up; other admins, feel free to turn it off.
Paused vgd_6 until we can get it working again.
[06:02]
.................................. (idle for 2h45mn)
***mls has quit IRC (Quit: leaving) [08:49]
.... (idle for 19mn)
JAAWasn't vgd paused already? [09:08]
............................... (idle for 2h31mn)
***dan- has quit IRC (Ping timeout: 633 seconds) [11:39]
dan- has joined #urlteam [11:45]
..................................................... (idle for 4h20mn)
Smiley has quit IRC (Read error: Connection reset by peer)
Smiley has joined #urlteam
[16:05]
............ (idle for 57mn)
astrid has quit IRC (Read error: Operation timed out)
astrid has joined #urlteam
swebb sets mode: +o astrid
[17:06]
......... (idle for 43mn)
Somebody2JAA: vgd_6 had autoqueue turned off, but it was still enabled.
I'm not entirely clear what the "enabled" switch *does* exactly...
turned off autoqueue for zpr-io, because it was throwing 503 errors
but is still returning results, so... hm
poeurl-com seems to be still going fine
hm, zpr-io just seems to return 503's for some shortcodes. Odd
I've added 503 as an acceptable response, so it should clear out the errors now
[17:49]
.................. (idle for 1h25mn)
***SilSte has joined #urlteam [19:20]
........ (idle for 36mn)
JAASomebody2: My guess would be that "enabled" means "does the tracker hand out new jobs or not?" while "autoqueue" is "does the tracker generate new jobs?".
I.e. with "enabled" checked but autoqueue off, clients would still process whatever items are in the queue (remaining ones from before the autoqueue was turned off or ones added manually).
But no idea whether that's correct.
s/hand out new jobs/hand out jobs/
[19:56]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)