[00:09] *** ivan` has quit IRC (Leaving) [00:09] *** marvinw has joined #urlteam [00:16] *** botpie91 has quit IRC (Read error: Operation timed out) [00:20] *** botpie91 has joined #urlteam [00:23] *** phuzion has quit IRC (Read error: Operation timed out) [05:32] *** JesseW has joined #urlteam [05:37] thanks for your wiki updates -- I'll look, probably on Tuesday [06:11] sure [06:12] my plan is to work through the ones with no dates, then oldest [06:12] that sounds great [06:13] as I've said, I've focused on ingesting new lists -- but rechecking/investigating the alive (and dead) lists is very useful too [06:38] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:15] *** WinterFox has joined #urlteam [07:58] *** dashcloud has quit IRC (Ping timeout: 250 seconds) [08:03] *** Smiley has quit IRC (Read error: Connection reset by peer) [08:03] *** dashcloud has joined #urlteam [08:04] *** svchfoo1 sets mode: +o dashcloud [08:10] *** Smiley has joined #urlteam [08:11] *** dashcloud has quit IRC (Ping timeout: 250 seconds) [08:12] *** dashcloud has joined #urlteam [08:12] *** svchfoo1 sets mode: +o dashcloud [12:39] *** VADemon has joined #urlteam [13:13] *** WinterFox has quit IRC (Remote host closed the connection) [13:16] *** VADemon has quit IRC (Read error: Connection reset by peer) [13:17] *** VADemon has joined #urlteam [13:45] hey guys [13:46] anybody perhaps has the urlteam database output? [13:46] or like some sèpecifications documentation [13:46] or just a file which i can take as a model [14:16] *** GLaDOS has joined #urlteam [14:54] *** dashcloud has quit IRC (Read error: Operation timed out) [14:58] *** dashcloud has joined #urlteam [14:59] *** svchfoo1 sets mode: +o dashcloud [15:39] *** JesseW has joined #urlteam [15:50] luckcolor: see http://archiveteam.org/index.php?title=URLTeam#Archives [15:51] If that doesn't answer all your questions then it needs to be expanded -- please let me know and I'll see about adding to it. [16:19] JesseW: i was going to archive a part of a url shorner before adding it on the wiki [16:20] JesseW: we have talked about this the other day [16:20] so well i suppose i can use your curl loop [16:21] and then to do some text parsing [16:21] as i have finally finished my Combinations generator [16:22] JesseW: Zapt.In, in the wiki listed as discontinued, appears to be under the controll of IA. It uses the IA DNS Servers and points at archive.org. http://www.tcpiputils.com/browse/domain/zapt.in [16:30] Jessew: it's going hope i don't get banned :P [16:31] So after i create a beacon compliant file would you mind injecting it in the urlteam archives? [16:31] Medowar: good to know, please update the wiki [16:32] wait JesseW it's saving the files the like resolve to [16:32] not the resolved url [16:32] luckcolor: hm [16:32] want a pastebin? [16:32] done [16:32] of the file? [16:36] luckcolor: sure [16:36] coming right up in a second [16:37] luckcolor: what's the reason not to scrape this shortener directly via normal urlteam methods? [16:37] and have you added it to the wiki page yet? (If not, please do) [16:38] i was manually scraping the smallest positions [16:39] i mean [16:39] the 1 2 and 3 long chracters urls [16:39] for the 4 long one si was ofc going to use urlteam [16:39] :P [16:39] Medowar: your wiki update looks good, and thanks for the more useful description of ZPE [16:40] currently working my way through the list of bitly aliases. some seem to be gone [16:40] luckcolor: unless you are worried it will go down before I get a chance to set up the project, it's probably better to just do the whole thing through normal urlteam methods (i.e. terroroftinytown) [16:41] Medowar: great, thank you! [16:41] I mean the website is new [16:41] but they have this insite urlshortner [16:41] which gets generated for the user uploaded tracks [16:42] GG crashed HCross paste server [16:43] luckcolor: add it to the wiki [16:43] here's a piece of the ouput [16:43] http://paste.harrycross.me/view/2998c918 [16:43] adding it do the wiki now [16:44] yay! [16:45] luckcolor: that looks like a 404ing one -- do you have an example of one that works? [16:46] yeah sure [16:47] http://hive.co/l/aaaa [16:47] checking [16:48] http://hive.co/a [16:48] works too :P [16:49] Medowar: the zapt.in one is odd. A random shortcode (ag4) 302's to http://archive.org/rewrite/index.php?ag4 which then just returns an *empty* 200. [16:49] luckcolor: hm [16:49] so about the possible characters [16:49] i only have seen [16:49] lovercase letters [16:49] and numbers [16:50] http://hive.co/a redirects to https://hive.co/a which refuses to connect (on my machine at least) [16:50] let it go [16:50] after a while it reduirected me to facebook [16:50] http://archive.org/rewrite/301.zaptin.html [16:50] *redirected [16:50] hm, facinating [16:51] this is what you get, when you go to zapt.in/verylongnonshortcode [16:51] or any other non-shortcode [16:51] Jessew for some reason it takes ages [16:52] probably dns [16:52] that's also why i wanted to manually do the 1 2 3 charqacters ones [16:52] *characters [16:52] I get connect to 50.63.202.8 port 443 failed: Connection refused [16:53] same [16:53] dunno lol [16:55] Jessew: which date should i put on the table [16:55] todays? [16:55] the "alive" table? yeah, today is fine [16:57] ok [16:57] it's there [16:57] thanks, that looks good [16:58] Should i specify pattern data too? [16:58] Yes please -- add answers to as many of the questions in http://archiveteam.org/index.php?title=URLTeam#Researching_URL_Shorteners as you can [16:58] to the entry [16:59] https://www.hive.co/a i tried it again it gave 404 [16:59] well it redirecte on the homepage [16:59] so i don't know what happened before lol [16:59] ha [17:00] also your script didn't work becaus eof a typo [17:00] -i should be -I [17:00] :-) [17:00] trying to hammer it again to get soem test data [17:02] no, I meant lowercase eye. Lowercase eye returns the headers *and* the body, while uppercase eye makes a HEAD request and (therefore) the response generally doesn't *contain* a body [17:02] well that's what was on the wiki [17:02] but as I said, what I sent you was just a general suggestion of pieces to fit together [17:02] yeah [17:03] yep, because the command on the wiki is for a slightly different purpose :-) [17:03] so in which table shoudl i add the dioscoveries i make :P? [17:03] *discoveries [17:03] just add them to the Alive entry, in text form, after the text you already wrote there [17:04] * luckcolor types on the keyboard way too fast [17:04] ok [17:04] * JesseW is finding it amazingly hard to come up with even *one* existing zapt.in shorcode [17:04] lel [17:05] need help? :D [17:05] sure! [17:05] so what do i have to do :P [17:06] status update: i found on url with lenght 2 characters which resolved [17:06] *an [17:06] magically figure out good search terms that will bring up an example of a zapy.in short url. :-) If I knew what they were, I could use them myself. :-) [17:06] luckcolor: what's the one you found? [17:06] i can't say [17:06] as you like [17:07] no i mean XD [17:07] i have to pair the input list with the outputs to dind that out [17:07] *find [17:07] I see. [17:07] OK, well I'm going AFK for now. I'll read the logs. [17:07] ok cya [17:07] thx for you time [17:07] *** JesseW has quit IRC (Quit: Leaving.) [17:08] *your [17:09] *** JesseW has joined #urlteam [17:09] found what is probably a working zapy.in (by just randomly trying examples): 999 [17:11] http://zapy.in/ [17:11] it's dead [17:11] yeah, that was a typo [17:11] zapt.in [17:11] not zapy.in [17:11] ah ok :) [17:11] dem typos [17:12] *** JesseW has quit IRC (Client Quit) [17:18] finishd bitly cleaup [17:18] http://archiveteam.org/index.php?title=URLTeam&type=revision&diff=25701&oldid=25700 [17:18] quiet a lot [17:31] disclaimer: i went on a pure dns basis. so many urls are actually using shorteners, only different ones. [17:47] *** VADemon has quit IRC (Quit: left4dead) [17:54] *** Frogging has quit IRC (Read error: Operation timed out) [17:54] *** Frogging has joined #urlteam [17:54] *** swebb has quit IRC (Read error: Operation timed out) [17:55] *** ranma has quit IRC (Read error: Operation timed out) [17:56] *** marvinw has quit IRC (Ping timeout: 246 seconds) [18:01] *** marvinw has joined #urlteam [18:04] *** swebb has joined #urlteam [18:05] *** svchfoo1 sets mode: +o swebb [18:07] *** ranma has joined #urlteam [19:29] *** Mayonaise has quit IRC (Read error: Operation timed out) [19:31] *** logchfoo4 starts logging #urlteam at Mon May 30 19:31:46 2016 [19:31] *** logchfoo4 has joined #urlteam [19:33] *** twrist has joined #urlteam [19:35] *** GLaDOS has quit IRC (Read error: Operation timed out) [19:35] *** twrist is now known as GLaDOS [20:27] *** botpie91 has joined #urlteam [20:30] *** marvinw has joined #urlteam [20:33] *** Silvan has quit IRC (Read error: Connection reset by peer) [20:48] *** xmc has quit IRC (Read error: Operation timed out) [20:50] *** Mayonaise has joined #urlteam [20:51] *** xmc has joined #urlteam [20:51] *** swebb sets mode: +o xmc [20:53] *** marvinw has quit IRC (Read error: Operation timed out) [20:54] *** botpie91 has quit IRC (Write error: Broken pipe) [20:55] *** marvinw has joined #urlteam [20:55] *** botpie91 has joined #urlteam [21:01] *** SilSte has joined #urlteam