#urlteam 2016-06-17,Fri

↑back Search

Time Nickname Message
00:26 🔗 JesseW has joined #urlteam
01:01 🔗 VADemon has quit IRC (Quit: left4dead)
01:22 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
01:33 🔗 Start has quit IRC (Quit: Disconnected.)
01:33 🔗 Start has joined #urlteam
02:24 🔗 marvinw is now known as ivan`
02:58 🔗 JesseW has joined #urlteam
03:31 🔗 JesseW ur1-ca seems to be freaking out. looking into it
03:32 🔗 JesseW ur1-ca hasn't returned results since yesterday -- so I'm just going to turn it off
03:34 🔗 JesseW the server seems *very* speedy -- did you do something to improve it, xmc (or chfoo)?
03:36 🔗 JesseW We have now finished scanning all of the 5 character entries for da-gd . Stopping it for now until phuzion clarifies if it includes 6 character ones (we haven't found any so far)
04:30 🔗 chfoo oh, yeah. fixed an overlooked sqlite setting
04:49 🔗 JesseW today?
04:49 🔗 JesseW I know you did so a little while ago, but it seemed noticablely faster than yesterday for me
05:09 🔗 chfoo oh, nope, i didn't touch anything today
05:09 🔗 phuzion has quit IRC (Read error: Operation timed out)
05:10 🔗 JesseW Hm, IDK then.
05:25 🔗 DoomTay has joined #urlteam
05:28 🔗 DoomTay So if I understand the project has a collection of shortened urls and their unshortened counterparts
05:28 🔗 JesseW yep, many GBs worth
05:28 🔗 DoomTay Do you think that data could be compiled into something machine-accessible so, say, a browser extension could be made to make use of it?
05:29 🔗 JesseW it's already machine-accessible, but not efficiently random-accessible (due to compression)
05:29 🔗 DoomTay Dang
05:29 🔗 JesseW look over http://archiveteam.org/index.php?title=URLTeam#Archives to see how it is currently stored
05:30 🔗 JesseW it would be pretty straightforward to convert it into other formats -- just takes someone bothering to do it
05:31 🔗 phuzion has joined #urlteam
05:32 🔗 JesseW If I were to make a service to use the data, I'd lean towards excluding data from still-existing shortening services, to avoid unnecessarily irritating them (thereby maybe making it harder to scrape more from them).
05:32 🔗 JesseW But we do have data from a number of dead shortening services, and I see *no* reason not to create a service that will translate those shortcodes on demand.
05:33 🔗 DoomTay Agreed on both counts
05:36 🔗 JesseW It would require someone willing to pay for the (probably limited) hosting costs
05:37 🔗 DoomTay Hmm
05:41 🔗 DoomTay I was about to suggest whoever's hosting urlte.am then I saw that that's actually a tracker under archive.org
05:41 🔗 DoomTay Er, archiveteam.org
05:42 🔗 DoomTay Speaking of which, what's up with http://tracker.archiveteam.org:1337/calculator ?
05:42 🔗 JesseW xmc currently hosts the box that the tracker runs on (thanks xmc!)
05:43 🔗 JesseW DoomTay: it's not particularly useful to random users, but it's very helpful for tracker admins, as it lets us convert shortcodes (like a4nG) into sequence numbers (which various places in the admin interface expect).
05:44 🔗 DoomTay Ah
05:44 🔗 JesseW it doesn't really need to be made public, but it's harmless for it to be, so it is
05:50 🔗 DoomTay has quit IRC (Quit: Page closed)
06:59 🔗 dashcloud has quit IRC (Ping timeout: 250 seconds)
07:05 🔗 dashcloud has joined #urlteam
07:06 🔗 svchfoo1 sets mode: +o dashcloud
07:06 🔗 svchfoo3 sets mode: +o dashcloud
07:19 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
07:39 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
07:39 🔗 dashcloud has joined #urlteam
07:40 🔗 svchfoo1 sets mode: +o dashcloud
07:40 🔗 svchfoo3 sets mode: +o dashcloud
08:18 🔗 dashcloud has quit IRC (Read error: Operation timed out)
08:21 🔗 dashcloud has joined #urlteam
08:21 🔗 svchfoo1 sets mode: +o dashcloud
08:21 🔗 svchfoo3 sets mode: +o dashcloud
08:33 🔗 hawc145 has joined #urlteam
08:35 🔗 zhongfu has quit IRC (Quit: No Ping reply in 180 seconds.)
08:37 🔗 chfoo has quit IRC (Read error: Operation timed out)
08:39 🔗 HCross has quit IRC (Ping timeout: 370 seconds)
08:40 🔗 luckcolor has quit IRC (Read error: Operation timed out)
08:42 🔗 svchfoo1 has quit IRC (Ping timeout: 370 seconds)
08:44 🔗 chfoo has joined #urlteam
08:45 🔗 zhongfu has joined #urlteam
08:45 🔗 svchfoo3 sets mode: +o chfoo
08:46 🔗 luckcolor has joined #urlteam
08:47 🔗 svchfoo1 has joined #urlteam
08:47 🔗 svchfoo3 sets mode: +o svchfoo1
09:42 🔗 WinterFox has joined #urlteam
10:22 🔗 hawc145 is now known as HCross
11:38 🔗 VADemon has joined #urlteam
12:34 🔗 dashcloud has quit IRC (Read error: Operation timed out)
12:38 🔗 dashcloud has joined #urlteam
12:38 🔗 svchfoo1 sets mode: +o dashcloud
13:12 🔗 VADemon has quit IRC (Quit: left4dead)
13:45 🔗 VADemon has joined #urlteam
15:08 🔗 JesseW has joined #urlteam
15:29 🔗 JesseW has quit IRC (Read error: Operation timed out)
15:42 🔗 JW_work has joined #urlteam
15:57 🔗 WinterFox has quit IRC (Remote host closed the connection)
17:12 🔗 xmc JesseW: the other admins did some serious speedups on the disk, so ... yes
17:13 🔗 xmc & i would love to see e.g. tr.im.urlte.am/aw3at redirect to the right place
17:15 🔗 xmc i would probably have done it but i don't really have the storage budget for ten grillion shortlinks to be on hot storage
17:19 🔗 JW_work ah, cool — good to know
17:23 🔗 JW_work OK, well, I think a good next step would be to identify which of the shorteners we have data for are now dead, and how much (uncompressed) data that comes to. I'll see about doing that.
17:24 🔗 DoomTay has joined #urlteam
18:18 🔗 DoomTay has left
23:35 🔗 WinterFox has joined #urlteam

irclogger-viewer