#urlteam 2013-03-25,Mon

↑back Search

Time Nickname Message
22:50 🔗 chfoo i want to scrape a url shortener. should i do this myself or would it be best to get it working with the warrior infrastructure?
23:02 🔗 ersi Preferebly extending the current urlteam tinyback project
23:02 🔗 ersi but you could go and scrape it yourself if it's a small one I guess. We'd love to get the data do. :)
23:02 🔗 ersi preferebly in the same format as we currently utilise. shortcode|link like Dg4fsd|http://archiveteam.org
23:11 🔗 chfoo i'll try extending tinyback
23:13 🔗 ersi Feel free to check in on some of my commits (I've mainly only added shortener sites ("services")
23:14 🔗 ersi and ask if there's anything
23:21 🔗 chfoo how should i deal with double redirects? it redirects to a personal share url like username.shortener.com/share/xxxxxx and then to the final url?
23:22 🔗 chfoo oh wait, hold on
23:23 🔗 ersi currently we just iterate through all the short codes that we've generated a pattern for (like sequential or if it's some other way)'
23:23 🔗 ersi I've never seen a user.shortener.tld/share/cake
23:23 🔗 ersi what are you digging into? delicious or something?
23:23 🔗 chfoo its sharedby.co formerly visibli.com
23:24 🔗 chfoo i realized the shortcode is the same during the double redirect
23:25 🔗 ersi indeed

irclogger-viewer