[00:00] *** dashcloud has quit IRC (Read error: Operation timed out) [00:03] *** dashcloud has joined #archiveteam-bs [00:05] *** cvb has quit IRC (Read error: Operation timed out) [00:18] *** BlueMaxim has joined #archiveteam-bs [00:54] *** RedType_ has quit IRC (Read error: Connection reset by peer) [00:56] *** RedType has joined #archiveteam-bs [01:01] *** Ravenloft has quit IRC (Remote host closed the connection) [01:02] *** RedType has quit IRC (Read error: Operation timed out) [01:14] http://forum.wareznet.net/wareznet-will-shut-down-permanently-on-january-1st-2016-t332334.html [01:14] wareznet shuts down on january 1st [01:15] you can get around logging in and access content by using the Googlebot user agent [01:16] *** RedType has joined #archiveteam-bs [01:22] *** toad1 has joined #archiveteam-bs [01:30] Start: what's wareznet? [01:46] *** JesseW1 has joined #archiveteam-bs [01:46] *** JesseW has quit IRC (Read error: Connection reset by peer) [01:57] *** bwn has quit IRC (Read error: Operation timed out) [02:04] JesseW: a warez forum, found out about it while using google to look for sites that are shutting down [02:04] honestly i've never heard of it until today [02:05] Ah, makes sense. [02:06] What search queries do you use to look for sites that are shutting down? (presumably, "shut down", but, what else if anything?) [02:07] *** primus104 has quit IRC (Leaving.) [02:08] +"(shutting|shut|closing|close) down on (january|february|march|april|may|june|july|august|september|october|november|december)" [02:09] and [02:09] +"(shutting|shut|closing|close) down on (january|february|march|april|may|june|july|august|september|october|november|december) * YEAR" (replace YEAR with 2015, 2016, etc.) [02:39] *** Boppen has quit IRC (hub.dk irc.du.se) [02:39] *** Rotab has quit IRC (hub.dk irc.du.se) [02:40] *** Sk1d has joined #archiveteam-bs [02:50] nice [03:09] *** JesseW1 has quit IRC (Leaving.) [03:21] *** aaaaaaaaa has quit IRC (Leaving) [03:22] *** JesseW has joined #archiveteam-bs [03:48] *** Sk1d has quit IRC (Ping timeout: 252 seconds) [04:26] *** remsen2 has joined #archiveteam-bs [04:26] *** remsen2 has quit IRC (Client Quit) [04:30] *** remsen has quit IRC (Read error: Operation timed out) [05:38] *** bwn has joined #archiveteam-bs [05:48] *** dashcloud has quit IRC (Read error: Operation timed out) [05:48] *** asdf has joined #archiveteam-bs [05:51] *** dashcloud has joined #archiveteam-bs [06:04] Start: maybe also do something like +"(shutting|shut|closing|close) down (on|at) 1..31 (january|february|march|april|may|june|july|august|september|october|november|december)" [06:43] *** dashcloud has quit IRC (Read error: Operation timed out) [06:46] *** dashcloud has joined #archiveteam-bs [07:15] *** JesseW has quit IRC (Leaving.) [08:13] *** cvb has joined #archiveteam-bs [08:20] *** arkiver2 has joined #archiveteam-bs [08:27] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [08:27] *** primus104 has joined #archiveteam-bs [08:30] *** Sk1d has joined #archiveteam-bs [08:33] so i think the 031xxx files of dtic archive was close to 15 to 20gb [08:35] *** arkiver2 has joined #archiveteam-bs [08:39] *** RedType has quit IRC (Read error: Operation timed out) [08:41] *** RedType has joined #archiveteam-bs [08:41] *** arkiver2 has quit IRC (Quit: Nettalk6 - www.ntalk.de) [08:44] *** arkiver2 has joined #archiveteam-bs [09:34] *** schbirid has joined #archiveteam-bs [09:55] http://www.telegraph.co.uk/news/worldnews/europe/france/11997976/Paris-attacks-Terrorists-could-have-used-PlayStation4-to-plot.html [10:12] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [10:12] or two Call of Duty players could write messages to each other on a wall in a disappearing spray of bullets. [10:12] I don't even know where to begin with that [10:12] BAN DECALS! [10:13] pretty sure this kind of stuff is ancient [10:13] weren't there groups using WoW or everquest before? [10:14] or use signs in minecraft [10:14] those sign posts. [10:54] *** bwn has quit IRC (Read error: Operation timed out) [11:18] *** FAMAS has joined #archiveteam-bs [11:27] *** bwn has joined #archiveteam-bs [12:26] *** FAMAS has quit IRC (Ping timeout: 252 seconds) [12:37] *** antomatic has quit IRC (Ping timeout: 252 seconds) [12:41] *** antomatic has joined #archiveteam-bs [13:17] *** BlueMaxim has quit IRC (Quit: Leaving) [13:41] *** mr-b has joined #archiveteam-bs [13:50] *** vtyl has joined #archiveteam-bs [13:51] *** lytv has quit IRC (Read error: Operation timed out) [13:56] *** vitzli has joined #archiveteam-bs [14:37] *** logan2 has quit IRC () [15:14] *** JesseW has joined #archiveteam-bs [15:14] *** Start has quit IRC (Quit: Disconnected.) [15:31] *** JesseW has quit IRC (Leaving.) [15:43] *** Start has joined #archiveteam-bs [16:17] *** wednesday has quit IRC (Read error: Operation timed out) [16:36] *** wednesday has joined #archiveteam-bs [16:39] Has anyone tried scraping Tableau embeds before? [16:39] I'm specifically trying to scrape the one on this page: http://www.twincities.com/localnews/ci_29113668# [16:39] It seems to be intentionally highly obfuscated, down to doing custom rendering into a element [16:40] And their PDF export function is hilariously broken (it basically just takes a screenshot of the current view) [16:40] Document attempts on the wiki [16:46] *** Boppen has joined #archiveteam-bs [16:50] *** vitzli has quit IRC (Quit: Leaving) [17:03] *** Start has quit IRC (Quit: Disconnected.) [17:13] *** Start has joined #archiveteam-bs [17:20] *** logan has joined #archiveteam-bs [17:34] *** pwnsrv has joined #archiveteam-bs [17:41] MrRadar: I don't think it's broken [17:41] I think it just never was a PDF to begin with [17:41] but a custom authoring thing [17:50] MrRadar: yeah, 99% sure that it's not obfuscation, just custom authoring tools [17:50] Eh, even if it's not intentional it still ends up making it hard to scrape [17:50] sure [17:51] MrRadar: but all the data is in a single request [17:51] so :P [17:51] Oh, URL? I hadn't looked too hard into the network requests it makes [17:52] MrRadar: varies by 'session' [17:52] that is, pageload [17:52] I got http://public.tableau.com/vizql/w/Police_Shootings/v/Database/bootstrapSession/sessions/70503C190554460B81141F66438564D2-0:0 [17:52] see devtools ;) [17:53] Right, I'll have to dig into that a bit when I can [17:53] even base64-inlines the images... sigh [17:53] Well, that makes it easy to save [17:53] MrRadar: http://jsbeautifier.org/ is useful [17:53] :P [18:37] *** Start has quit IRC (Quit: Disconnected.) [19:06] *** asdf has quit IRC (Quit: Leaving) [19:42] *** bwn_ has joined #archiveteam-bs [19:42] *** mr-b has quit IRC (Read error: Operation timed out) [19:43] *** marvinw has quit IRC (Read error: Operation timed out) [19:43] *** sep332 has quit IRC (Read error: Operation timed out) [19:43] *** jspiros has quit IRC (Read error: Operation timed out) [19:43] *** yakfish has quit IRC (Read error: Operation timed out) [19:43] *** lrkj has quit IRC (Read error: Operation timed out) [19:43] *** pwnsrv has quit IRC (Read error: Operation timed out) [19:43] *** myself has quit IRC (Write error: Broken pipe) [19:43] *** Jordan has quit IRC (Write error: Broken pipe) [19:43] HCross: what freenode chnnel? [19:43] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [19:43] *** dxrt has quit IRC (Read error: Operation timed out) [19:43] *** botpie91 has quit IRC (Read error: Operation timed out) [19:43] *** dxrt has joined #archiveteam-bs [19:43] #freenode [19:43] *** antonizoo has quit IRC (Read error: Operation timed out) [19:44] lol [19:44] *** Lord_Nigh has joined #archiveteam-bs [19:44] http://harrycross.me/23f.png [19:44] ah, i can imagine who it might be [19:44] *** mr-b has joined #archiveteam-bs [19:44] *** Kenshin has quit IRC (Read error: Operation timed out) [19:45] *** Kenshin has joined #archiveteam-bs [19:45] *** Baljem has quit IRC (Read error: Operation timed out) [19:45] *** Baljem has joined #archiveteam-bs [19:46] *** beardicus has quit IRC (Read error: Operation timed out) [19:46] *** toad1 has quit IRC (Read error: Operation timed out) [19:48] *** bwn has quit IRC (Read error: Operation timed out) [19:48] nah, that seems unrelated or did he ask for me there for some reason? [19:53] *** marvinw has joined #archiveteam-bs [19:57] *** jspiros has joined #archiveteam-bs [20:28] *** aaaaaaaaa has joined #archiveteam-bs [20:39] *** pgoetz has joined #archiveteam-bs [20:50] *** Start has joined #archiveteam-bs [20:55] *** schbirid has quit IRC (Quit: Leaving) [20:58] *** Start has quit IRC (Quit: Disconnected.) [21:07] *** botpie91 has joined #archiveteam-bs [21:07] *** sep332 has joined #archiveteam-bs [21:07] *** beardicus has joined #archiveteam-bs [21:07] *** yakfish has joined #archiveteam-bs [21:08] *** myself has joined #archiveteam-bs [21:09] *** lrkj has joined #archiveteam-bs [21:14] *** toad1 has joined #archiveteam-bs [21:15] *** Jordan has joined #archiveteam-bs [21:40] *** bwn_ has quit IRC (Read error: Operation timed out) [21:48] *** aaaaaaaaa has quit IRC (Quit: Leaving) [22:03] *** bwn_ has joined #archiveteam-bs [22:13] *** pgoetz has quit IRC (Remote host closed the connection) [23:16] *** jspiros has quit IRC (Ping timeout: 252 seconds) [23:16] *** jspiros has joined #archiveteam-bs [23:17] *** cvb has quit IRC (Read error: Operation timed out) [23:20] *** vtyl has quit IRC (Ping timeout: 252 seconds) [23:22] *** bwn_ has quit IRC (Ping timeout: 252 seconds) [23:23] *** bwn has joined #archiveteam-bs [23:24] *** vtyl has joined #archiveteam-bs [23:25] *** dashcloud has quit IRC (Read error: Operation timed out) [23:26] *** dashcloud has joined #archiveteam-bs [23:28] *** Rye has quit IRC (Ping timeout: 252 seconds) [23:55] *** Rye has joined #archiveteam-bs [23:59] *** Rye has quit IRC (Ping timeout: 252 seconds)