[00:01] *** chfoo has quit IRC (chfoo) [00:07] *** chfoo has joined #archiveteam-bs [00:25] *** kyan has quit IRC (Ping timeout: 258 seconds) [00:37] *** Start has joined #archiveteam-bs [00:51] *** mistym has quit IRC (Remote host closed the connection) [00:55] *** primus104 has quit IRC (Leaving.) [01:20] *** RedType has quit IRC (Quit: leaving) [01:20] *** RedType has joined #archiveteam-bs [01:32] *** username1 has joined #archiveteam-bs [01:34] *** schbirid2 has quit IRC (Read error: Operation timed out) [01:38] *** RedType has quit IRC (Quit: womp) [01:38] *** RedType has joined #archiveteam-bs [01:42] *** mistym has joined #archiveteam-bs [02:08] *** kyan has joined #archiveteam-bs [03:15] *** dcmorton has quit IRC (Quit: ZNC - http://znc.in) [03:18] *** dcmorton has joined #archiveteam-bs [04:19] *** antomatic has joined #archiveteam-bs [04:20] *** antomati_ has quit IRC (Read error: Operation timed out) [04:20] *** Sk1d has quit IRC (Read error: Operation timed out) [04:21] *** Sk1d has joined #archiveteam-bs [04:22] *** brayden has quit IRC (Read error: Operation timed out) [04:22] *** aaaaaaaaa has quit IRC (Leaving) [04:34] *** mistym has quit IRC (Remote host closed the connection) [04:42] *** brayden has joined #archiveteam-bs [04:52] *** useretail has quit IRC (Dreaming in digital. Living in real-time. Thinking in binary. Talking in IP.) [05:02] *** mistym has joined #archiveteam-bs [05:11] *** kyan has quit IRC (Quit: Leaving) [05:43] *** wp494 has quit IRC (Ping timeout: 740 seconds) [06:04] *** wp494 has joined #archiveteam-bs [06:40] *** mistym has quit IRC (Remote host closed the connection) [07:37] *** primus104 has joined #archiveteam-bs [07:41] *** mistym has joined #archiveteam-bs [07:51] *** mistym has quit IRC (Ping timeout: 483 seconds) [07:53] *** wp494 has quit IRC (LOUD UNNECESSARY QUIT MESSAGES) [07:54] *** wp494 has joined #archiveteam-bs [08:28] looks like twit is under Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International license now [08:28] http://blog.twitpic.com/2014/10/twitpics-future/ this is better [08:30] but i figure that could be fixed some day on the back end [08:32] any ways i'm uploading more episodes of tech news today [08:33] i'm way behind on that one [08:57] *** marvinw has quit IRC (Ping timeout: 252 seconds) [09:09] *** marvinw has joined #archiveteam-bs [09:49] *** primus104 has quit IRC (Leaving.) [10:33] *** Rotab has quit IRC (Ping timeout: 198 seconds) [10:35] *** Rotab has joined #archiveteam-bs [11:20] *** mistym has joined #archiveteam-bs [11:24] *** mistym has quit IRC (Ping timeout: 252 seconds) [12:02] joepie91_, where do I get my hug [12:22] you gotta love how firefox does not come with documentation [12:22] but everything is online [12:24] i need a new cheap usenet provider that accepts paypal. any recommendations or referral codes? ( joepie91_ ) [12:24] *** username1 is now known as schbirid [12:26] block account, nothing recurring [12:29] *** wp494 has quit IRC (Ping timeout: 740 seconds) [12:42] *** sankin has joined #archiveteam-bs [12:47] *** BlueMaxim has quit IRC (Quit: Leaving) [13:12] *** primus104 has joined #archiveteam-bs [13:57] *** useretail has joined #archiveteam-bs [14:09] *** mistym has joined #archiveteam-bs [14:22] *** mistym has quit IRC (Read error: Operation timed out) [14:31] *** mistym has joined #archiveteam-bs [14:48] *** primus has joined #archiveteam-bs [15:07] *** primus104 has quit IRC (Leaving.) [15:40] *** mistym has quit IRC (Remote host closed the connection) [15:55] *** aaaaaaaaa has joined #archiveteam-bs [16:28] *** mistym has joined #archiveteam-bs [16:54] *** SimpBrain has joined #archiveteam-bs [17:14] *** edsu_ is now known as edsu [17:28] SketchCow: You got quoted in LWN :) [17:31] where at [17:32] http://lwn.net/Articles/644345/ [17:32] " Let’s bring the DOS prompt back! And let a thousand programs bloom! " — Jason Scott [http://blog.archive.org/2015/05/08/making-your-dos-programs-live-again-at-the-internet-archive/], announcing the debut of the Internet Archive's in-browser DOS simulator. [17:34] In what [17:34] Oh [17:36] SketchCow: in that blog entry, i would suggest changing <> to say <> [17:36] Everyone's got notes [17:36] some people would be unsure about whether to include file extensions [17:36] That thing is already a tech support nightmare [17:36] heh, ok [17:37] i can imagine [17:37] *** primus104 has joined #archiveteam-bs [17:45] *** t4nk391 has joined #archiveteam-bs [17:47] t4nk391: you're already here so it's fine [17:47] yup [17:47] so, yeah, usually WARC is best for storing Web archives; it avoids the URL-to-filename mapping mess and preserves request/response info as well [17:47] wget-warc and wpull have support for that output [17:48] I'm using curl [17:48] replay and extraction can be done with tools like https://pypi.python.org/pypi/Warcat/ [17:48] why curl [17:48] first thing i found xD [17:49] curl is a pretty good hammer [17:49] its a hammer taht got me past https + logging in (post) + cookies [17:50] yeah, it's pretty good :) [17:50] it works ok but there's higher-level tools that do more of the crawling process for you [17:51] I like to learn, higher level tools are not fun [17:51] I guess it depends on your goals [17:51] are you looking for an archive that others can use [17:52] if so then the merit of using existing tools is that they codify shared standards [17:52] this is why we push WARC tools [17:52] (or at least why I push it) [17:53] i'm only taking parts of the website [17:53] if this is an archive for your personal use then I guess any pipeline will work [17:54] its a torrent website, so i would like to take the torrent files and metadata. other stuff like the forums + comments will take more time then im willing to spend [18:11] currently running at 2 pages each second, might need to run multiple concurrent. [18:17] Well im off to bed (6:19am here), have a good day/night all :D [18:19] cheerio [18:20] *** t4nk391 has quit IRC (Quit: Page closed) [18:24] *** primus104 has quit IRC (Leaving.) [18:33] http://arstechnica.com/gaming/2015/05/humanity-weeps-as-candy-crush-saga-comes-pre-installed-with-windows-10/ [18:33] oh god why [18:34] beginning of the end, this is fine [18:40] it's not really that surprising, microsoft has a history of bundling third party games [18:56] s/third party games/crap/ [18:56] *** Zebranky has quit IRC (Remote host closed the connection) [18:58] chips challenge was really good [19:00] *** Nertsy has quit IRC (Read error: Operation timed out) [19:27] *** Nertsy has joined #archiveteam-bs [19:27] *** primus104 has joined #archiveteam-bs [19:34] *** Zebranky has joined #archiveteam-bs [19:50] *** lytv has quit IRC (Max SendQ exceeded) [19:50] *** Fusl has quit IRC (Max SendQ exceeded) [19:53] *** lytv has joined #archiveteam-bs [19:55] *** SN4T14_ has joined #archiveteam-bs [19:55] *** Fusl has joined #archiveteam-bs [20:00] *** SN4T14__ has quit IRC (Ping timeout: 369 seconds) [20:03] *** SimpBrain has quit IRC (Quit: Leaving) [20:44] *** sankin has quit IRC (Leaving.) [20:44] *** mistym has quit IRC (Remote host closed the connection) [20:50] *** SimpBrain has joined #archiveteam-bs [21:25] *** Rotab has quit IRC (Read error: Connection reset by peer) [21:40] *** SimpBrain has quit IRC (Quit: Leaving) [21:47] *** mistym has joined #archiveteam-bs [21:49] *** Rotab has joined #archiveteam-bs [21:51] *** pwnsrv has quit IRC (Ping timeout: 265 seconds) [22:05] *** pwnsrv has joined #archiveteam-bs [22:38] *** mistym_ has joined #archiveteam-bs [22:44] RedType: 'cept their previous bundling wasn't from publishers that were known for putting out shitty intentionally exploitative games [22:44] and looks like micropayments will be intact in this version, so fuck that [22:44] *** mistym has quit IRC (Read error: Operation timed out) [22:46] but joepie91_ but but but THE FUTURE [22:46] to be honest im surprised they didnt bundle one of their own smaller titles, like that halo top down shooter or something [22:50] it is amazing to me how many people still don't seem to understand the power of defaults [22:50] "meh, who cares, you can delete it" [22:55] *** wp494 has joined #archiveteam-bs [23:11] *** Mayonaise has quit IRC (Ping timeout: 362 seconds) [23:13] *** RedType has quit IRC (Quit: leaving) [23:14] *** RedType has joined #archiveteam-bs [23:16] *** RedType has quit IRC (Client Quit) [23:26] *** lysobit has quit IRC (Ping timeout: 512 seconds) [23:27] *** BlueMaxim has joined #archiveteam-bs [23:27] *** RedType has joined #archiveteam-bs [23:28] *** lysobit has joined #archiveteam-bs [23:36] *** Mayonaise has joined #archiveteam-bs