[16:50] soultcer: did you grab my file? https://www.dropbox.com/s/yvh0yel4vj3nzjb/2012-twitter-unrolled-urls-20120101-20121217.txt.bz2 [18:23] swebb: Yes, got it [18:23] Excellent. [18:23] I'll leave it up there for a while just in case. [18:23] I'll import it into the db and will add it to the db so that everyone can use it even for shorteners that I have not imported [18:24] I seriously underestimated just how many different URL shorteners are being used by Twitter users. [18:25] Yea, it's got everything recursively un-wound, so it t.co/xxx -> bit.ly/xxx -> amzn.com/xxx -> etc … It's got them all until the non-redirected url is hit. [18:25] There are a buttload of shorteners out there. [18:26] instagram has one, flicker, facebook, amazon, … Most major sites that have some sort of twitter integration have their own shortener. [18:31] The Amazon one is just a Bitly Pro thing actually [18:32] When you go to bitly and shorten and amazon.com link, you won't get a bit.ly/XXX link, but an amzn.to/XXX link [18:56] Ahh [18:56] It's possible that many shorteners are using the bit.ly DNS trick. [18:57] Does amzn.to/xxx = bit.ly/xxx ? [19:16] Yes [19:16] But not bit.ly/XXX = amzn.to/XXX [19:17] It's not a DNS trick, they are paying for Bitly Pro (or Enterprise or whatever they call it) [19:17] http://www.enterprise.bitly.com/products/ [19:57] It looks like anyone can make a custom domain under their bit.ly account. I made one and it works: http://www.evernote.com/shard/s41/sh/f5d00bd0-7bdd-45b4-a000-119ba00ce74a/28e0d7aef6ceb1dbc07a97ee64c7f0c6 [19:58] Where custom_domain/xxx = bit.ly/xxx [19:58] You don't have to sign up for the enterprise account. [19:58] Just make a cname in DNS and you're up and running. [20:21] But the difference is that when someone shortens an amazon.com on bitly, it will become an amzn.to url. [20:21] *an amazon.com URL [20:41] Ahh. [20:41] Understood.