[00:30] *** z00nx has joined #urlteam
[05:43] *** dashcloud has quit IRC (Read error: Operation timed out)
[05:46] *** dashcloud has joined #urlteam
[05:46] *** svchfoo1 sets mode: +o dashcloud
[06:00] *** dashcloud has quit IRC (Read error: Operation timed out)
[06:03] *** dashcloud has joined #urlteam
[06:04] *** svchfoo3 sets mode: +o dashcloud
[06:45] *** JesseW has quit IRC (Ping timeout: 370 seconds)
[07:41] *** WinterFox has joined #urlteam
[09:18] *** SilSte has quit IRC (Ping timeout: 194 seconds)
[09:18] *** SilSte has joined #urlteam
[11:31] <Medowar> JW_work: I may suggest two new shorteners, that are pretty big. buff.ly, buffer.com and hubs.ly, hubspot. Both have results in the millions, buff.ly is already researched and in the wiki. 3,5 mio urls. hubs.ly not yet, but I expect a similar size.
[11:33] <Medowar> ok, forget hubs.ly, that one is pretty new and only at 50k results(according to google), hubspot previously used bitly(hub.am)
[12:15] <arkiver> So
[12:15] <arkiver> We really need these all saved by WARCs
[12:16] <arkiver> I want to update to the scripts of urlteam to also create WARCs
[12:16] <arkiver> The previously discovered items need to be processed and grabbed again for the WARCs
[12:17] <arkiver> JW_work: what do you think of that?
[12:41] <Medowar> but only save redirects as warc, right? saving all tested links as warcs would create way too much data, I think.
[13:28] <arkiver> Yes
[13:28] <arkiver> Only he redirects and other pages regarding the reidrect
[13:28] <arkiver> not the pages the site redirects to
[14:03] *** Start has quit IRC (Quit: Disconnected.)
[14:08] *** WinterFox has quit IRC (Read error: Operation timed out)
[14:45] *** dashcloud has quit IRC (Read error: Operation timed out)
[14:49] *** dashcloud has joined #urlteam
[14:49] *** svchfoo1 sets mode: +o dashcloud
[15:33] *** zhongfu has quit IRC (Remote host closed the connection)
[15:42] *** VADemon has joined #urlteam
[17:07] *** JesseW has joined #urlteam
[18:38] *** zhongfu has joined #urlteam
[18:44] *** zhongfu has quit IRC (Remote host closed the connection)
[18:59] *** zhongfu has joined #urlteam
[20:24] *** JesseW has quit IRC (Ping timeout: 370 seconds)
[20:48] *** dashcloud has quit IRC (Remote host closed the connection)
[20:49] *** dashcloud has joined #urlteam
[20:49] *** svchfoo3 sets mode: +o dashcloud
[21:19] *** JesseW has joined #urlteam
[21:38] *** SilSte has quit IRC (Ping timeout: 194 seconds)
[21:38] *** SilSte has joined #urlteam
[21:42] *** Start has joined #urlteam
[22:57] *** dashcloud has quit IRC (Read error: Operation timed out)
[23:00] *** dashcloud has joined #urlteam
[23:01] *** svchfoo3 sets mode: +o dashcloud
[23:51] *** dashcloud has quit IRC (Read error: Operation timed out)
[23:55] *** dashcloud has joined #urlteam
[23:55] *** svchfoo3 sets mode: +o dashcloud