#urlteam 2016-05-30,Mon

↑back Search

Time Nickname Message
00:09 🔗 ivan` has quit IRC (Leaving)
00:09 🔗 marvinw has joined #urlteam
00:16 🔗 botpie91 has quit IRC (Read error: Operation timed out)
00:20 🔗 botpie91 has joined #urlteam
00:23 🔗 phuzion has quit IRC (Read error: Operation timed out)
05:32 🔗 JesseW has joined #urlteam
05:37 🔗 JesseW thanks for your wiki updates -- I'll look, probably on Tuesday
06:11 🔗 bwn sure
06:12 🔗 bwn my plan is to work through the ones with no dates, then oldest
06:12 🔗 JesseW that sounds great
06:13 🔗 JesseW as I've said, I've focused on ingesting new lists -- but rechecking/investigating the alive (and dead) lists is very useful too
06:38 🔗 JesseW has quit IRC (Ping timeout: 370 seconds)
07:15 🔗 WinterFox has joined #urlteam
07:58 🔗 dashcloud has quit IRC (Ping timeout: 250 seconds)
08:03 🔗 Smiley has quit IRC (Read error: Connection reset by peer)
08:03 🔗 dashcloud has joined #urlteam
08:04 🔗 svchfoo1 sets mode: +o dashcloud
08:10 🔗 Smiley has joined #urlteam
08:11 🔗 dashcloud has quit IRC (Ping timeout: 250 seconds)
08:12 🔗 dashcloud has joined #urlteam
08:12 🔗 svchfoo1 sets mode: +o dashcloud
12:39 🔗 VADemon has joined #urlteam
13:13 🔗 WinterFox has quit IRC (Remote host closed the connection)
13:16 🔗 VADemon has quit IRC (Read error: Connection reset by peer)
13:17 🔗 VADemon has joined #urlteam
13:45 🔗 luckcolor hey guys
13:46 🔗 luckcolor anybody perhaps has the urlteam database output?
13:46 🔗 luckcolor or like some sèpecifications documentation
13:46 🔗 luckcolor or just a file which i can take as a model
14:16 🔗 GLaDOS has joined #urlteam
14:54 🔗 dashcloud has quit IRC (Read error: Operation timed out)
14:58 🔗 dashcloud has joined #urlteam
14:59 🔗 svchfoo1 sets mode: +o dashcloud
15:39 🔗 JesseW has joined #urlteam
15:50 🔗 JesseW luckcolor: see http://archiveteam.org/index.php?title=URLTeam#Archives
15:51 🔗 JesseW If that doesn't answer all your questions then it needs to be expanded -- please let me know and I'll see about adding to it.
16:19 🔗 luckcolor JesseW: i was going to archive a part of a url shorner before adding it on the wiki
16:20 🔗 luckcolor JesseW: we have talked about this the other day
16:20 🔗 luckcolor so well i suppose i can use your curl loop
16:21 🔗 luckcolor and then to do some text parsing
16:21 🔗 luckcolor as i have finally finished my Combinations generator
16:22 🔗 Medowar JesseW: Zapt.In, in the wiki listed as discontinued, appears to be under the controll of IA. It uses the IA DNS Servers and points at archive.org. http://www.tcpiputils.com/browse/domain/zapt.in
16:30 🔗 luckcolor Jessew: it's going hope i don't get banned :P
16:31 🔗 luckcolor So after i create a beacon compliant file would you mind injecting it in the urlteam archives?
16:31 🔗 JesseW Medowar: good to know, please update the wiki
16:32 🔗 luckcolor wait JesseW it's saving the files the like resolve to
16:32 🔗 luckcolor not the resolved url
16:32 🔗 JesseW luckcolor: hm
16:32 🔗 luckcolor want a pastebin?
16:32 🔗 Medowar done
16:32 🔗 luckcolor of the file?
16:36 🔗 JesseW luckcolor: sure
16:36 🔗 luckcolor coming right up in a second
16:37 🔗 JesseW luckcolor: what's the reason not to scrape this shortener directly via normal urlteam methods?
16:37 🔗 JesseW and have you added it to the wiki page yet? (If not, please do)
16:38 🔗 luckcolor i was manually scraping the smallest positions
16:39 🔗 luckcolor i mean
16:39 🔗 luckcolor the 1 2 and 3 long chracters urls
16:39 🔗 luckcolor for the 4 long one si was ofc going to use urlteam
16:39 🔗 luckcolor :P
16:39 🔗 JesseW Medowar: your wiki update looks good, and thanks for the more useful description of ZPE
16:40 🔗 Medowar currently working my way through the list of bitly aliases. some seem to be gone
16:40 🔗 JesseW luckcolor: unless you are worried it will go down before I get a chance to set up the project, it's probably better to just do the whole thing through normal urlteam methods (i.e. terroroftinytown)
16:41 🔗 JesseW Medowar: great, thank you!
16:41 🔗 luckcolor I mean the website is new
16:41 🔗 luckcolor but they have this insite urlshortner
16:41 🔗 luckcolor which gets generated for the user uploaded tracks
16:42 🔗 luckcolor GG crashed HCross paste server
16:43 🔗 JesseW luckcolor: add it to the wiki
16:43 🔗 luckcolor here's a piece of the ouput
16:43 🔗 luckcolor http://paste.harrycross.me/view/2998c918
16:43 🔗 luckcolor adding it do the wiki now
16:44 🔗 JesseW yay!
16:45 🔗 JesseW luckcolor: that looks like a 404ing one -- do you have an example of one that works?
16:46 🔗 luckcolor yeah sure
16:47 🔗 luckcolor http://hive.co/l/aaaa
16:47 🔗 JesseW checking
16:48 🔗 luckcolor http://hive.co/a
16:48 🔗 luckcolor works too :P
16:49 🔗 JesseW Medowar: the zapt.in one is odd. A random shortcode (ag4) 302's to http://archive.org/rewrite/index.php?ag4 which then just returns an *empty* 200.
16:49 🔗 JesseW luckcolor: hm
16:49 🔗 luckcolor so about the possible characters
16:49 🔗 luckcolor i only have seen
16:49 🔗 luckcolor lovercase letters
16:49 🔗 luckcolor and numbers
16:50 🔗 JesseW http://hive.co/a redirects to https://hive.co/a which refuses to connect (on my machine at least)
16:50 🔗 luckcolor let it go
16:50 🔗 luckcolor after a while it reduirected me to facebook
16:50 🔗 Medowar http://archive.org/rewrite/301.zaptin.html
16:50 🔗 luckcolor *redirected
16:50 🔗 JesseW hm, facinating
16:51 🔗 Medowar this is what you get, when you go to zapt.in/verylongnonshortcode
16:51 🔗 Medowar or any other non-shortcode
16:51 🔗 luckcolor Jessew for some reason it takes ages
16:52 🔗 luckcolor probably dns
16:52 🔗 luckcolor that's also why i wanted to manually do the 1 2 3 charqacters ones
16:52 🔗 luckcolor *characters
16:52 🔗 JesseW I get connect to 50.63.202.8 port 443 failed: Connection refused
16:53 🔗 Medowar same
16:53 🔗 luckcolor dunno lol
16:55 🔗 luckcolor Jessew: which date should i put on the table
16:55 🔗 luckcolor todays?
16:55 🔗 JesseW the "alive" table? yeah, today is fine
16:57 🔗 luckcolor ok
16:57 🔗 luckcolor it's there
16:57 🔗 JesseW thanks, that looks good
16:58 🔗 luckcolor Should i specify pattern data too?
16:58 🔗 JesseW Yes please -- add answers to as many of the questions in http://archiveteam.org/index.php?title=URLTeam#Researching_URL_Shorteners as you can
16:58 🔗 JesseW to the entry
16:59 🔗 luckcolor https://www.hive.co/a i tried it again it gave 404
16:59 🔗 luckcolor well it redirecte on the homepage
16:59 🔗 luckcolor so i don't know what happened before lol
16:59 🔗 JesseW ha
17:00 🔗 luckcolor also your script didn't work becaus eof a typo
17:00 🔗 luckcolor -i should be -I
17:00 🔗 JesseW :-)
17:00 🔗 luckcolor trying to hammer it again to get soem test data
17:02 🔗 JesseW no, I meant lowercase eye. Lowercase eye returns the headers *and* the body, while uppercase eye makes a HEAD request and (therefore) the response generally doesn't *contain* a body
17:02 🔗 luckcolor well that's what was on the wiki
17:02 🔗 JesseW but as I said, what I sent you was just a general suggestion of pieces to fit together
17:02 🔗 luckcolor yeah
17:03 🔗 JesseW yep, because the command on the wiki is for a slightly different purpose :-)
17:03 🔗 luckcolor so in which table shoudl i add the dioscoveries i make :P?
17:03 🔗 luckcolor *discoveries
17:03 🔗 JesseW just add them to the Alive entry, in text form, after the text you already wrote there
17:04 🔗 * luckcolor types on the keyboard way too fast
17:04 🔗 luckcolor ok
17:04 🔗 * JesseW is finding it amazingly hard to come up with even *one* existing zapt.in shorcode
17:04 🔗 luckcolor lel
17:05 🔗 luckcolor need help? :D
17:05 🔗 JesseW sure!
17:05 🔗 luckcolor so what do i have to do :P
17:06 🔗 luckcolor status update: i found on url with lenght 2 characters which resolved
17:06 🔗 luckcolor *an
17:06 🔗 JesseW magically figure out good search terms that will bring up an example of a zapy.in short url. :-) If I knew what they were, I could use them myself. :-)
17:06 🔗 JesseW luckcolor: what's the one you found?
17:06 🔗 luckcolor i can't say
17:06 🔗 JesseW as you like
17:07 🔗 luckcolor no i mean XD
17:07 🔗 luckcolor i have to pair the input list with the outputs to dind that out
17:07 🔗 luckcolor *find
17:07 🔗 JesseW I see.
17:07 🔗 JesseW OK, well I'm going AFK for now. I'll read the logs.
17:07 🔗 luckcolor ok cya
17:07 🔗 luckcolor thx for you time
17:07 🔗 JesseW has quit IRC (Quit: Leaving.)
17:08 🔗 luckcolor *your
17:09 🔗 JesseW has joined #urlteam
17:09 🔗 JesseW found what is probably a working zapy.in (by just randomly trying examples): 999
17:11 🔗 luckcolor http://zapy.in/
17:11 🔗 luckcolor it's dead
17:11 🔗 JesseW yeah, that was a typo
17:11 🔗 JesseW zapt.in
17:11 🔗 JesseW not zapy.in
17:11 🔗 luckcolor ah ok :)
17:11 🔗 luckcolor dem typos
17:12 🔗 JesseW has quit IRC (Client Quit)
17:18 🔗 Medowar finishd bitly cleaup
17:18 🔗 Medowar http://archiveteam.org/index.php?title=URLTeam&type=revision&diff=25701&oldid=25700
17:18 🔗 Medowar quiet a lot
17:31 🔗 Medowar disclaimer: i went on a pure dns basis. so many urls are actually using shorteners, only different ones.
17:47 🔗 VADemon has quit IRC (Quit: left4dead)
17:54 🔗 Frogging has quit IRC (Read error: Operation timed out)
17:54 🔗 Frogging has joined #urlteam
17:54 🔗 swebb has quit IRC (Read error: Operation timed out)
17:55 🔗 ranma has quit IRC (Read error: Operation timed out)
17:56 🔗 marvinw has quit IRC (Ping timeout: 246 seconds)
18:01 🔗 marvinw has joined #urlteam
18:04 🔗 swebb has joined #urlteam
18:05 🔗 svchfoo1 sets mode: +o swebb
18:07 🔗 ranma has joined #urlteam
19:29 🔗 Mayonaise has quit IRC (Read error: Operation timed out)
19:31 🔗 logchfoo4 starts logging #urlteam at Mon May 30 19:31:46 2016
19:31 🔗 logchfoo4 has joined #urlteam
19:33 🔗 twrist has joined #urlteam
19:35 🔗 GLaDOS has quit IRC (Read error: Operation timed out)
19:35 🔗 twrist is now known as GLaDOS
20:27 🔗 botpie91 has joined #urlteam
20:30 🔗 marvinw has joined #urlteam
20:33 🔗 Silvan has quit IRC (Read error: Connection reset by peer)
20:48 🔗 xmc has quit IRC (Read error: Operation timed out)
20:50 🔗 Mayonaise has joined #urlteam
20:51 🔗 xmc has joined #urlteam
20:51 🔗 swebb sets mode: +o xmc
20:53 🔗 marvinw has quit IRC (Read error: Operation timed out)
20:54 🔗 botpie91 has quit IRC (Write error: Broken pipe)
20:55 🔗 marvinw has joined #urlteam
20:55 🔗 botpie91 has joined #urlteam
21:01 🔗 SilSte has joined #urlteam
irclogger-viewer