[00:09] *** ivan` has quit IRC (Leaving)
[00:09] *** marvinw has joined #urlteam
[00:16] *** botpie91 has quit IRC (Read error: Operation timed out)
[00:20] *** botpie91 has joined #urlteam
[00:23] *** phuzion has quit IRC (Read error: Operation timed out)
[05:32] *** JesseW has joined #urlteam
[05:37] <JesseW> thanks for your wiki updates -- I'll look, probably on Tuesday
[06:11] <bwn> sure
[06:12] <bwn> my plan is to work through the ones with no dates, then oldest
[06:12] <JesseW> that sounds great
[06:13] <JesseW> as I've said, I've focused on ingesting new lists -- but rechecking/investigating the alive (and dead) lists is very useful too
[06:38] *** JesseW has quit IRC (Ping timeout: 370 seconds)
[07:15] *** WinterFox has joined #urlteam
[07:58] *** dashcloud has quit IRC (Ping timeout: 250 seconds)
[08:03] *** Smiley has quit IRC (Read error: Connection reset by peer)
[08:03] *** dashcloud has joined #urlteam
[08:04] *** svchfoo1 sets mode: +o dashcloud
[08:10] *** Smiley has joined #urlteam
[08:11] *** dashcloud has quit IRC (Ping timeout: 250 seconds)
[08:12] *** dashcloud has joined #urlteam
[08:12] *** svchfoo1 sets mode: +o dashcloud
[12:39] *** VADemon has joined #urlteam
[13:13] *** WinterFox has quit IRC (Remote host closed the connection)
[13:16] *** VADemon has quit IRC (Read error: Connection reset by peer)
[13:17] *** VADemon has joined #urlteam
[13:45] <luckcolor> hey guys
[13:46] <luckcolor> anybody perhaps has the urlteam database output?
[13:46] <luckcolor> or like some sèpecifications documentation
[13:46] <luckcolor> or just a file which i can take as a model
[14:16] *** GLaDOS has joined #urlteam
[14:54] *** dashcloud has quit IRC (Read error: Operation timed out)
[14:58] *** dashcloud has joined #urlteam
[14:59] *** svchfoo1 sets mode: +o dashcloud
[15:39] *** JesseW has joined #urlteam
[15:50] <JesseW> luckcolor: see http://archiveteam.org/index.php?title=URLTeam#Archives 
[15:51] <JesseW> If that doesn't answer all your questions then it needs to be expanded -- please let me know and I'll see about adding to it.
[16:19] <luckcolor> JesseW: i was going to archive a part of a url shorner before adding it on the wiki
[16:20] <luckcolor> JesseW: we have talked about this the other day
[16:20] <luckcolor> so well i suppose i can use your curl loop
[16:21] <luckcolor> and then to do some text parsing 
[16:21] <luckcolor> as i have finally finished my Combinations generator
[16:22] <Medowar> JesseW: Zapt.In, in the wiki listed as discontinued, appears to be under the controll of IA. It uses the IA DNS Servers and points at archive.org. http://www.tcpiputils.com/browse/domain/zapt.in
[16:30] <luckcolor> Jessew: it's going hope i don't get banned :P
[16:31] <luckcolor> So after i create a beacon compliant file would you mind injecting it in the urlteam archives?
[16:31] <JesseW> Medowar: good to know, please update the wiki
[16:32] <luckcolor> wait JesseW it's saving the files the like resolve to
[16:32] <luckcolor> not the resolved url
[16:32] <JesseW> luckcolor: hm
[16:32] <luckcolor> want a pastebin?
[16:32] <Medowar> done
[16:32] <luckcolor> of the file?
[16:36] <JesseW> luckcolor: sure
[16:36] <luckcolor> coming right up in a second
[16:37] <JesseW> luckcolor: what's the reason not to scrape this shortener directly via normal urlteam methods?
[16:37] <JesseW> and have you added it to the wiki page yet? (If not, please do)
[16:38] <luckcolor> i was manually scraping the smallest positions
[16:39] <luckcolor> i mean
[16:39] <luckcolor> the 1 2 and 3 long chracters urls
[16:39] <luckcolor> for the 4 long one si was ofc going to use urlteam
[16:39] <luckcolor> :P
[16:39] <JesseW> Medowar: your wiki update looks good, and thanks for the more useful description of ZPE
[16:40] <Medowar> currently working my way through the list of bitly aliases. some seem to be gone
[16:40] <JesseW> luckcolor: unless you are worried it will go down before I get a chance to set up the project, it's probably better to just do the whole thing through normal urlteam methods (i.e. terroroftinytown)
[16:41] <JesseW> Medowar: great, thank you!
[16:41] <luckcolor> I mean the website is new
[16:41] <luckcolor> but they have this insite urlshortner
[16:41] <luckcolor> which gets generated for the user uploaded tracks
[16:42] <luckcolor> GG crashed HCross paste server
[16:43] <JesseW> luckcolor: add it to the wiki
[16:43] <luckcolor> here's a piece of the ouput
[16:43] <luckcolor> http://paste.harrycross.me/view/2998c918
[16:43] <luckcolor> adding it do the wiki now
[16:44] <JesseW> yay!
[16:45] <JesseW> luckcolor: that looks like a 404ing one -- do you have an example of one that works?
[16:46] <luckcolor> yeah sure
[16:47] <luckcolor> http://hive.co/l/aaaa
[16:47] <JesseW> checking
[16:48] <luckcolor> http://hive.co/a
[16:48] <luckcolor> works too :P
[16:49] <JesseW> Medowar: the zapt.in one is odd. A random shortcode (ag4) 302's to http://archive.org/rewrite/index.php?ag4 which then just returns an *empty* 200.
[16:49] <JesseW> luckcolor: hm
[16:49] <luckcolor> so about the possible characters
[16:49] <luckcolor> i only have seen
[16:49] <luckcolor> lovercase letters
[16:49] <luckcolor> and numbers
[16:50] <JesseW> http://hive.co/a redirects to https://hive.co/a which refuses to connect (on my machine at least)
[16:50] <luckcolor> let it go
[16:50] <luckcolor> after a while it reduirected me to facebook
[16:50] <Medowar> http://archive.org/rewrite/301.zaptin.html
[16:50] <luckcolor> *redirected
[16:50] <JesseW> hm, facinating
[16:51] <Medowar> this is what you get, when you go to zapt.in/verylongnonshortcode
[16:51] <Medowar> or any other non-shortcode
[16:51] <luckcolor> Jessew for some reason it takes ages
[16:52] <luckcolor> probably dns
[16:52] <luckcolor> that's also why i wanted to manually do the 1 2 3 charqacters ones
[16:52] <luckcolor> *characters
[16:52] <JesseW> I get connect to 50.63.202.8 port 443 failed: Connection refused
[16:53] <Medowar> same
[16:53] <luckcolor> dunno lol
[16:55] <luckcolor> Jessew: which date should i put on the table
[16:55] <luckcolor> todays?
[16:55] <JesseW> the "alive" table? yeah, today is fine
[16:57] <luckcolor> ok
[16:57] <luckcolor> it's there
[16:57] <JesseW> thanks, that looks good
[16:58] <luckcolor> Should i specify pattern data too?
[16:58] <JesseW> Yes please -- add answers to as many of the questions in http://archiveteam.org/index.php?title=URLTeam#Researching_URL_Shorteners as you can
[16:58] <JesseW> to the entry
[16:59] <luckcolor> https://www.hive.co/a i tried it again it gave 404
[16:59] <luckcolor> well it redirecte on the homepage
[16:59] <luckcolor> so i don't know what happened before lol
[16:59] <JesseW> ha
[17:00] <luckcolor> also your script didn't work becaus eof a typo
[17:00] <luckcolor> -i should be -I
[17:00] <JesseW> :-)
[17:00] <luckcolor> trying to hammer it again to get soem test data
[17:02] <JesseW> no, I meant lowercase eye. Lowercase eye returns the headers *and* the body, while uppercase eye makes a HEAD request and (therefore) the response generally doesn't *contain* a body
[17:02] <luckcolor> well that's what was on the wiki
[17:02] <JesseW> but as I said, what I sent you was just a general suggestion of pieces to fit together
[17:02] <luckcolor> yeah
[17:03] <JesseW> yep, because the command on the wiki is for a slightly different purpose :-)
[17:03] <luckcolor> so in which table  shoudl i add the dioscoveries i make :P?
[17:03] <luckcolor> *discoveries
[17:03] <JesseW> just add them to the Alive entry, in text form, after the text you already wrote there
[17:04] * luckcolor types on the keyboard way too fast
[17:04] <luckcolor> ok
[17:04] * JesseW is finding it amazingly hard to come up with even *one* existing zapt.in shorcode
[17:04] <luckcolor> lel
[17:05] <luckcolor> need help? :D
[17:05] <JesseW> sure!
[17:05] <luckcolor> so what do i have to do :P
[17:06] <luckcolor> status update: i found on url with lenght 2 characters which resolved
[17:06] <luckcolor> *an
[17:06] <JesseW> magically figure out good search terms that will bring up an example of a zapy.in short url. :-) If I knew what they were, I could use them myself. :-)
[17:06] <JesseW> luckcolor: what's the one you found?
[17:06] <luckcolor> i can't say
[17:06] <JesseW> as you like
[17:07] <luckcolor> no i mean XD
[17:07] <luckcolor> i have to pair the input list with the outputs to dind that out
[17:07] <luckcolor> *find
[17:07] <JesseW> I see.
[17:07] <JesseW> OK, well I'm going AFK for now. I'll read the logs.
[17:07] <luckcolor> ok cya
[17:07] <luckcolor> thx for you time
[17:07] *** JesseW has quit IRC (Quit: Leaving.)
[17:08] <luckcolor> *your
[17:09] *** JesseW has joined #urlteam
[17:09] <JesseW> found what is probably a working zapy.in (by just randomly trying examples): 999
[17:11] <luckcolor> http://zapy.in/
[17:11] <luckcolor> it's dead
[17:11] <JesseW> yeah, that was a typo
[17:11] <JesseW> zapt.in
[17:11] <JesseW> not zapy.in
[17:11] <luckcolor> ah ok :)
[17:11] <luckcolor> dem typos
[17:12] *** JesseW has quit IRC (Client Quit)
[17:18] <Medowar> finishd bitly cleaup
[17:18] <Medowar> http://archiveteam.org/index.php?title=URLTeam&type=revision&diff=25701&oldid=25700
[17:18] <Medowar> quiet a lot
[17:31] <Medowar> disclaimer: i went on a pure dns basis. so many urls are actually using shorteners, only different ones.
[17:47] *** VADemon has quit IRC (Quit: left4dead)
[17:54] *** Frogging has quit IRC (Read error: Operation timed out)
[17:54] *** Frogging has joined #urlteam
[17:54] *** swebb has quit IRC (Read error: Operation timed out)
[17:55] *** ranma has quit IRC (Read error: Operation timed out)
[17:56] *** marvinw has quit IRC (Ping timeout: 246 seconds)
[18:01] *** marvinw has joined #urlteam
[18:04] *** swebb has joined #urlteam
[18:05] *** svchfoo1 sets mode: +o swebb
[18:07] *** ranma has joined #urlteam
[19:29] *** Mayonaise has quit IRC (Read error: Operation timed out)
[19:31] *** logchfoo4 starts logging #urlteam at Mon May 30 19:31:46 2016
[19:31] *** logchfoo4 has joined #urlteam
[19:33] *** twrist has joined #urlteam
[19:35] *** GLaDOS has quit IRC (Read error: Operation timed out)
[19:35] *** twrist is now known as GLaDOS
[20:27] *** botpie91 has joined #urlteam
[20:30] *** marvinw has joined #urlteam
[20:33] *** Silvan has quit IRC (Read error: Connection reset by peer)
[20:48] *** xmc has quit IRC (Read error: Operation timed out)
[20:50] *** Mayonaise has joined #urlteam
[20:51] *** xmc has joined #urlteam
[20:51] *** swebb sets mode: +o xmc
[20:53] *** marvinw has quit IRC (Read error: Operation timed out)
[20:54] *** botpie91 has quit IRC (Write error: Broken pipe)
[20:55] *** marvinw has joined #urlteam
[20:55] *** botpie91 has joined #urlteam
[21:01] *** SilSte has joined #urlteam