Time |
Nickname |
Message |
00:56
🔗
|
Flashfire |
https://gph.is/ |
02:29
🔗
|
Somebody2 |
teej_: Oh, my idea? Good suggestion; but I'm lazy. Feel free to add it yourself, though, with my thanks! |
02:29
🔗
|
Somebody2 |
Flashfire: is it researched on the wiki page? If not, please add it first. |
02:30
🔗
|
Somebody2 |
I see that it's on the wiki page, but not researched yet |
02:34
🔗
|
Flashfire |
ok working on it |
02:34
🔗
|
Flashfire |
should I add it to the warrior project section? |
02:36
🔗
|
Flashfire |
gph.is - giphy.com gives 301 on Successful Redirect to Gif. Gives 302 on Bad short url and redirects to Giphy.com |
02:36
🔗
|
Flashfire |
somebody2 is this enough? |
02:38
🔗
|
Flashfire |
Added a bit more on top of that |
03:11
🔗
|
|
Mayonaise has quit IRC (Read error: Connection reset by peer) |
03:18
🔗
|
|
Mayonaise has joined #urlteam |
04:07
🔗
|
JAA |
If gph.is is simply a bit.ly alias, we probably don't want to crawl it actually since we already grab bit.ly. |
04:15
🔗
|
|
odemg has quit IRC (Ping timeout: 265 seconds) |
04:15
🔗
|
Flashfire |
I dont know how we can tell if its a bitly alias though |
04:24
🔗
|
teej_ |
Flashfire: Type is https://gph.is/1sNZMwL |
04:25
🔗
|
teej_ |
I guess you can just type a random string and check. |
04:25
🔗
|
teej_ |
Type in* |
04:25
🔗
|
teej_ |
But it works for https://bit.ly/1sNZMwL |
04:26
🔗
|
teej_ |
Nevermind. |
04:26
🔗
|
teej_ |
Wait... Why is it forbidden? |
04:27
🔗
|
|
odemg has joined #urlteam |
04:30
🔗
|
teej_ |
When I load that url, it says Forbidden "Uh oh, Bitly can't show you the page you are trying to access." |
04:31
🔗
|
teej_ |
For https://bit.ly/1sNZMwL |
04:31
🔗
|
teej_ |
When I use tor, it works. |
04:31
🔗
|
teej_ |
Does that mean Bitly blocked my IP because of the URLTeam grabber? |
04:33
🔗
|
teej_ |
If so, that's going to mess up a lot of people. I only ran `--concurrent` 6 at most. |
04:39
🔗
|
Flashfire |
It could be |
04:39
🔗
|
Flashfire |
it works for me teej_ |
04:46
🔗
|
teej_ |
So Bitly blocked my IP. |
04:46
🔗
|
Flashfire |
Unlikely but possible |
04:46
🔗
|
Flashfire |
We may want to get a tracker admin |
04:46
🔗
|
Flashfire |
JAA ivan Hcross Somebody2 swebb |
04:47
🔗
|
Flashfire |
sorry to ping you all but we may have a problem |
04:52
🔗
|
teej_ |
Flashfire: Give me another bit.ly link. |
04:53
🔗
|
teej_ |
Make sure it works for you. |
04:54
🔗
|
teej_ |
The main bit.ly site still works. |
04:54
🔗
|
Flashfire |
http://bit.ly/yvqi8u |
04:54
🔗
|
Flashfire |
links to some ali express thing |
04:55
🔗
|
teej_ |
That one is blocked by my adblocker. |
04:55
🔗
|
teej_ |
So it still works... Hmm... |
04:56
🔗
|
teej_ |
Hey, now my previous link works, since I probably stopped the URLTeam code. |
04:57
🔗
|
teej_ |
Maybe it's hitting a threshold limit. |
04:57
🔗
|
teej_ |
I should probably turn it to `--concurrent 1`. |
04:59
🔗
|
Somebody2 |
Yeah, temporary blocks are pretty common |
04:59
🔗
|
Somebody2 |
let me look at what you wrote up about gph.is |
05:02
🔗
|
teej_ |
I'm going to test http://gph.is/2aQa9xQ |
05:03
🔗
|
teej_ |
So if you type http://bit.ly/2aQa9xQ it will go to the same site. |
05:04
🔗
|
Somebody2 |
yep, I confirmed it's a bitly alias using https://gph.is/2EQsQk1 , too. |
05:04
🔗
|
teej_ |
All ghp.is links work on bit.ly, but not all bit.ly links works on gph.is. |
05:04
🔗
|
Somebody2 |
So please move the details about it up to the list of bitly aliases. |
05:05
🔗
|
Somebody2 |
and there's no need to actually scrape it. |
05:07
🔗
|
teej_ |
Somebody2: If temporary bans are common, wouldn't it mess up the URLTeam results? |
05:09
🔗
|
Somebody2 |
teej_: Nope -- we handle that and retry from a different IP |
05:09
🔗
|
Somebody2 |
(I think) |
05:10
🔗
|
teej_ |
Somebody2: Double check. |
05:11
🔗
|
Somebody2 |
heh, not certain how to. Feel free to do so if you wish! |
05:13
🔗
|
Flashfire |
Adjix could use a recrawl last one was 2 years ago |
05:17
🔗
|
Flashfire |
Somebody2 |
05:18
🔗
|
Somebody2 |
Nice, will look into it! |
05:21
🔗
|
Somebody2 |
Flashfire: I think it may be discontinued. Please search for the (multiple) mentions of it on the wiki page, combine them, and verify that it's still working. |
05:21
🔗
|
Somebody2 |
after that, I'm glad to start it up again |
05:23
🔗
|
Flashfire |
Ok its dead |
05:27
🔗
|
Somebody2 |
tahks, Flashfire! |
05:28
🔗
|
Somebody2 |
I really appreciate both of your additional energy for this project. There's plenty to do. |
05:30
🔗
|
Flashfire |
can someone verify qr.cm is a bitly alias? |
05:30
🔗
|
Flashfire |
it gives me the same thing for qr.cm/1 and bit.ly/1 |
05:31
🔗
|
Flashfire |
Im putting it in there for the moment if i am wrong correct me later |
05:37
🔗
|
teej_ |
Okay. |
05:37
🔗
|
Flashfire |
http://vqr.mx/ |
05:38
🔗
|
teej_ |
I found this: https://www.techmaish.com/list-of-230-free-url-shorteners-services/ |
05:47
🔗
|
Flashfire |
somebody2 I did a bit of research into some of the ones I had in my old list and kaywa.me looks like a good project |
05:47
🔗
|
Flashfire |
throws 302 when success and 200 when error |
05:47
🔗
|
Flashfire |
Oh what fun |
05:47
🔗
|
Flashfire |
Incremental at a guess from single character |
05:47
🔗
|
Flashfire |
created via dynamic qr codes |
05:49
🔗
|
Flashfire |
also getting a 512 error from the tracker....... |
05:49
🔗
|
Flashfire |
does that mean you are adding my suggestions? |
06:05
🔗
|
Flashfire |
http://ftp.gg.gg/ |
06:06
🔗
|
Flashfire |
http://gg.gg/co9i9 |
06:06
🔗
|
Flashfire |
FTP.gg.gg is an alias of gg.gg |
07:19
🔗
|
|
Jusque has quit IRC (Quit: ZNC - http://znc.in) |
07:20
🔗
|
|
Jusque has joined #urlteam |
12:10
🔗
|
|
caff has quit IRC (Read error: Connection reset by peer) |
13:51
🔗
|
JAA |
Flashfire, teej_: The best way to check whether something is a bit.ly alias is to see what IP it resolves to. IPs between 67.199.248.10 and .13 are bit.ly. |
16:09
🔗
|
Somebody2 |
JAA: please dump that advice about bit.ly aliases on the wiki page if it isn't already |
16:09
🔗
|
Somebody2 |
Flashfire: saw your suggestions, can't get to them right now; ping me again in a few days |
16:10
🔗
|
Somebody2 |
buff.ly is screaming a bit too loud at a queue of 35 -- dropping it back down to 25 |
16:10
🔗
|
JAA |
I think it should be on the wiki already. |
16:10
🔗
|
Somebody2 |
OK, cool |
16:42
🔗
|
|
Boppen has quit IRC (Quit: Nettalk6 - www.ntalk.de) |
19:21
🔗
|
|
caff has joined #urlteam |
19:31
🔗
|
phuzion |
buff-ly is spamming error reports and has shut the tracker down, should I clear them? |
19:31
🔗
|
phuzion |
and disable the project for the time being |
19:31
🔗
|
phuzion |
Somebody2: did you clear the error reports for buff.ly? |