| Time |
Nickname |
Message |
|
18:26
🔗
|
deathy |
so if I'm a "researcher" .. any way to quickly convert between a short url and full url? without download a huge torrent/file or part of it ... (silly question) |
|
19:48
🔗
|
chronomex |
is the shortener still online? |
|
19:57
🔗
|
deathy |
well...was more of a theoretical question :) |
|
19:57
🔗
|
deathy |
let's say it isn't |
|
20:41
🔗
|
soultcer |
Well then you have to download the torrent |
|
20:55
🔗
|
underscor |
We don't have an online resolver right now |
|
20:55
🔗
|
underscor |
I was thinking about it |
|
20:59
🔗
|
soultcer |
500 GB diskspace if you use b-tree indexes |
|
21:00
🔗
|
soultcer |
Better 750 gb to 1000 gb so we can expand |
|
21:45
🔗
|
soultcer |
There are some unshorteners out there, though I don't think they keep a permanent archive |
|
22:17
🔗
|
chronomex |
hmm |
|
22:17
🔗
|
chronomex |
right, http://is.gd.urlte.am/RSta7r |
|
22:18
🔗
|
chronomex |
or http://urlte.am/is.gd/RSta7r |
|
22:18
🔗
|
chronomex |
probably could make all of these acceptable |
|
22:41
🔗
|
soultcer |
But how do we handle spam? |
|
22:46
🔗
|
chronomex |
what do you mean? |
|
22:49
🔗
|
soultcer |
Well, assuming is.gd blocked a website for spam, tinyback will still return the original URL. |
|
22:50
🔗
|
soultcer |
e.g. http://is.gd/mBAh |
|
22:50
🔗
|
soultcer |
So urlte.am/is.gd/mBAh will link to a spam site |
|
22:58
🔗
|
chronomex |
ah |
|
22:58
🔗
|
chronomex |
well, ok |
|
22:59
🔗
|
soultcer |
But a nice server for urlteam data would be awesome |
|
23:00
🔗
|
soultcer |
The db currently lives on an 3 year old external usb drive :D |
|
23:03
🔗
|
chronomex |
how big is our dataset? |
|
23:03
🔗
|
soultcer |
426GB as of this moment with indexes |
|
23:03
🔗
|
chronomex |
hmm |
|
23:03
🔗
|
chronomex |
stored in what? |
|
23:04
🔗
|
soultcer |
BerkeleyDB with b-trees |
|
23:04
🔗
|
chronomex |
that def wouldn't fit on a vps, but I could host it from my house or something |
|
23:04
🔗
|
* |
chronomex investigates storage array systems |
|
23:05
🔗
|
chronomex |
I intend to start a drive-of-the-month program, which means I'll need to have a drive cage |
|
23:05
🔗
|
soultcer |
drive-of-the-month? |
|
23:05
🔗
|
chronomex |
yeah you buy the cheapest 2T+ drive on newegg or whatever |
|
23:05
🔗
|
chronomex |
every month |
|
23:06
🔗
|
soultcer |
But why? |
|
23:06
🔗
|
chronomex |
thus ensuring that you mix batches well, and you have a continuous sustained space increase |
|
23:06
🔗
|
chronomex |
I like to save things |
|
23:07
🔗
|
chronomex |
don't we all? |
|
23:07
🔗
|
soultcer |
I try to only store things I need |
|
23:08
🔗
|
chronomex |
well ok |
|
23:11
🔗
|
soultcer |
Will you buy a second drive each month for backup? |
|
23:28
🔗
|
chronomex |
no, more of a M-copies type of filesystem thing and just keep adding drives |