***: CoolCanuk has joined #urlteam
CoolCanuk has quit IRC (Quit: Connection closed for inactivity)
bwn has quit IRC (Read error: Connection reset by peer)
bwn has joined #urlteam
mr_archiv has quit IRC (Quit: WeeChat 1.6)
MrDignity has quit IRC (Remote host closed the connection)
MrDignity has joined #urlteam
JAA sets mode: +bb BestPrize!*@* *!pointspri@*
MrDignity has quit IRC (Remote host closed the connection)
MrDignity has joined #urlteam
dashcloud has quit IRC (No Ping reply in 180 seconds.)
dashcloud has joined #urlteam
dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #urlteam
Uzerus_ has joined #urlteam
Uzerus_: ok
Somebody2: So, I'm not following what you are asking yet...
Uzerus_: warrior is asking the tracker every 10-400 sec for file, what contain list of urls to check
Somebody2: The warrior requests a group of (generally 50) short URLs from the tracker. Then the warrior requests each short URL from the shortening service...
Uzerus_: but tracker usually returns 404
Somebody2: AH, I se what you mean now!
OK, yes, I can explain that.
We limit each Warrior to only working on one batch of URLs from each shortening service at once, and we limit the total number ...
Uzerus_: ah, to not overload service
Somebody2: ... of warriors that can work on a particular shortening service (to avoid overwhelming it)
Uzerus_: cos it'll be ddos :D
Somebody2: Yep!
And we don't have enough people investigating new services to soak up the amount of warrior power available.
Uzerus_: ew, i can search for some services
Somebody2: We have a big list of services that we could add, if someone took the time to investigate them.
Great, thank you!
The basic info we need is documented on the wiki page.
It's basically -- what alphabet of characters is used in the short code, what HTTP status code is returned.
Uzerus_: you mean that service.com/somerandom[a-A,0-9]buthowmany?
Somebody2: Yeah, bascially.
Uzerus_: it can be different than random?
f.e. every 3rd and 10 letter is big... ?
Somebody2: It can, but we don't generally care.
Uzerus_: ah, so you expect converting the /randomthings
Somebody2: What we care about is if it doesn't include digits, or is case-insenstive, or something like that.
Uzerus_: ok, but it probably is not for today
Somebody2: Sounds good -- no hurry.
Let's head back to #effteepee
***: dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.)
dashcloud has joined #urlteam
dashcloud has quit IRC (Read error: Connection reset by peer)
dashcloud has joined #urlteam
dashcloud has quit IRC (Read error: Operation timed out)
dashcloud has joined #urlteam
Uzerus has joined #urlteam