#urlteam 2012-12-13,Thu

↑back Search

Time Nickname Message
18:26 🔗 deathy so if I'm a "researcher" .. any way to quickly convert between a short url and full url? without download a huge torrent/file or part of it ... (silly question)
19:48 🔗 chronomex is the shortener still online?
19:57 🔗 deathy well...was more of a theoretical question :)
19:57 🔗 deathy let's say it isn't
20:41 🔗 soultcer Well then you have to download the torrent
20:55 🔗 underscor We don't have an online resolver right now
20:55 🔗 underscor I was thinking about it
20:59 🔗 soultcer 500 GB diskspace if you use b-tree indexes
21:00 🔗 soultcer Better 750 gb to 1000 gb so we can expand
21:45 🔗 soultcer There are some unshorteners out there, though I don't think they keep a permanent archive
22:17 🔗 chronomex hmm
22:17 🔗 chronomex right, http://is.gd.urlte.am/RSta7r
22:18 🔗 chronomex or http://urlte.am/is.gd/RSta7r
22:18 🔗 chronomex probably could make all of these acceptable
22:41 🔗 soultcer But how do we handle spam?
22:46 🔗 chronomex what do you mean?
22:49 🔗 soultcer Well, assuming is.gd blocked a website for spam, tinyback will still return the original URL.
22:50 🔗 soultcer e.g. http://is.gd/mBAh
22:50 🔗 soultcer So urlte.am/is.gd/mBAh will link to a spam site
22:58 🔗 chronomex ah
22:58 🔗 chronomex well, ok
22:59 🔗 soultcer But a nice server for urlteam data would be awesome
23:00 🔗 soultcer The db currently lives on an 3 year old external usb drive :D
23:03 🔗 chronomex how big is our dataset?
23:03 🔗 soultcer 426GB as of this moment with indexes
23:03 🔗 chronomex hmm
23:03 🔗 chronomex stored in what?
23:04 🔗 soultcer BerkeleyDB with b-trees
23:04 🔗 chronomex that def wouldn't fit on a vps, but I could host it from my house or something
23:04 🔗 * chronomex investigates storage array systems
23:05 🔗 chronomex I intend to start a drive-of-the-month program, which means I'll need to have a drive cage
23:05 🔗 soultcer drive-of-the-month?
23:05 🔗 chronomex yeah you buy the cheapest 2T+ drive on newegg or whatever
23:05 🔗 chronomex every month
23:06 🔗 soultcer But why?
23:06 🔗 chronomex thus ensuring that you mix batches well, and you have a continuous sustained space increase
23:06 🔗 chronomex I like to save things
23:07 🔗 chronomex don't we all?
23:07 🔗 soultcer I try to only store things I need
23:08 🔗 chronomex well ok
23:11 🔗 soultcer Will you buy a second drive each month for backup?
23:28 🔗 chronomex no, more of a M-copies type of filesystem thing and just keep adding drives

irclogger-viewer