[00:08] *** Aranje has joined #archiveteam-bs [00:11] *** Stiletto has quit IRC (Read error: Operation timed out) [00:19] *** Aranje has quit IRC (Read error: Connection reset by peer) [00:19] *** Aranje has joined #archiveteam-bs [00:23] *** mistym has quit IRC (Remote host closed the connection) [00:37] *** mistym has joined #archiveteam-bs [00:52] *** Stiletto has joined #archiveteam-bs [01:09] *** ohhdemgir has quit IRC (Read error: Operation timed out) [01:18] *** ete_ has quit IRC (Read error: Connection reset by peer) [01:30] *** schbirid2 has joined #archiveteam-bs [01:31] *** schbirid has quit IRC (Read error: Operation timed out) [01:32] *** ohhdemgir has joined #archiveteam-bs [01:35] *** Asparagir has joined #archiveteam-bs [02:13] *** mistym has quit IRC (Remote host closed the connection) [02:43] *** mistym has joined #archiveteam-bs [02:53] *** Stilett0 has joined #archiveteam-bs [02:55] *** Stiletto has quit IRC (Read error: Operation timed out) [02:57] .tw https://twitter.com/CityNews/status/611262873428471808 [02:57] Sorry, couldn't get a tweet from https://twitter.com/CityNews/status/611262873428471808 (@CityNews) [02:57] *** lytv has quit IRC (Ping timeout: 370 seconds) [02:58] *** lytv has joined #archiveteam-bs [03:02] *** Asparagir has quit IRC (Asparagir) [03:02] heh ^"Federal Government websites back up after a cyber-attack, supposedly carried out by the terrorist group anonymous ow.ly/OskyF" [03:08] *** Asparagir has joined #archiveteam-bs [03:12] *** primus104 has quit IRC (Leaving.) [03:17] SketchCow: i think you need to talk to this guy to scan magazines that are hard to find: http://www.theatlantic.com/video/index/394451/most-magazines-in-the-world/ [03:18] *** Asparagir has quit IRC (Asparagir) [04:43] *** aaaaaaaaa has quit IRC (Leaving) [04:52] *** JesseW has joined #archiveteam-bs [04:53] * JesseW is FINALLY back up running the warrior -- my (underlying) server crashed, and I had to reinstall (because I didn't know how to more efficiently fix it). [04:54] But I saved the warrior hd images, so after re-downloading the ovf file (because I forgot to save the virtual machine details, sigh) I was able to pick up right where I left off. [05:09] *** RichardG has quit IRC (Ping timeout: 370 seconds) [05:20] *** bzc6p_ has joined #archiveteam-bs [05:20] *** swebb sets mode: +o bzc6p_ [05:24] *** bzc6p has quit IRC (Ping timeout: 600 seconds) [05:52] *** RichardG has joined #archiveteam-bs [06:36] *** mistym has quit IRC (Remote host closed the connection) [06:38] *** dashcloud has quit IRC (Read error: Operation timed out) [06:41] *** dashcloud has joined #archiveteam-bs [07:14] *** dashcloud has quit IRC (Read error: Operation timed out) [07:17] *** primus104 has joined #archiveteam-bs [07:19] *** dashcloud has joined #archiveteam-bs [07:19] *** xtr-201 has joined #archiveteam-bs [07:22] *** wp494 has quit IRC (Ping timeout: 740 seconds) [07:24] *** wp494 has joined #archiveteam-bs [07:28] *** JesseW has quit IRC (Quit: Leaving.) [07:30] *** bzc6p_ is now known as bzc6p [07:37] *** mistym has joined #archiveteam-bs [07:49] *** mistym has quit IRC (Ping timeout: 606 seconds) [09:20] so i'm up to 435k items on IA [09:40] *** mistym has joined #archiveteam-bs [09:51] *** mistym has quit IRC (Ping timeout: 606 seconds) [10:02] *** Aranje has quit IRC (Ping timeout: 240 seconds) [11:34] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [11:36] *** zenguy_pc has joined #archiveteam-bs [13:01] *** BlueMaxim has quit IRC (Quit: Leaving) [13:08] *** sankin has joined #archiveteam-bs [13:23] *** zenguy_pc has quit IRC (Ping timeout: 306 seconds) [13:28] *** Stilett0 has quit IRC (Read error: Operation timed out) [13:28] *** Stiletto has joined #archiveteam-bs [13:36] *** zenguy_pc has joined #archiveteam-bs [13:49] *** Aranje has joined #archiveteam-bs [14:32] *** mistym has joined #archiveteam-bs [14:38] *** SmileyG has joined #archiveteam-bs [14:39] *** Start has quit IRC (Quit: Disconnected.) [14:41] *** mistym has quit IRC (Remote host closed the connection) [14:41] *** Rickster has quit IRC (Ping timeout: 512 seconds) [14:42] *** Rickster has joined #archiveteam-bs [14:44] *** Smiley has quit IRC (Ping timeout: 512 seconds) [14:44] *** Famicoman has quit IRC (Ping timeout: 512 seconds) [14:59] *** mistym has joined #archiveteam-bs [15:03] *** JesseW has joined #archiveteam-bs [15:19] *** Famicoman has joined #archiveteam-bs [15:36] *** JesseW has quit IRC (Quit: Leaving.) [15:39] *** primus104 has quit IRC (Leaving.) [15:53] *** mistym has quit IRC (Remote host closed the connection) [15:59] *** dashcloud has quit IRC (Read error: Operation timed out) [16:00] *** Start has joined #archiveteam-bs [16:02] *** dashcloud has joined #archiveteam-bs [16:02] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [16:07] .t http://gizmodo.com/1712247516 [16:07] Start: Sorry, I don't know about the 'http://gizmodo.com/1712247516' timezone. [16:07] .title http://gizmodo.com/1712247516 [16:07] Start: Gizmodo [16:07] -_- [16:08] heh [16:11] *** mistym has joined #archiveteam-bs [16:20] *** zenguy_pc has joined #archiveteam-bs [16:23] *** McGEE has joined #archiveteam-bs [16:45] *** Start has quit IRC (Disconnected.) [16:47] *** aaaaaaaaa has joined #archiveteam-bs [16:47] *** swebb sets mode: +o aaaaaaaaa [16:49] *** Start has joined #archiveteam-bs [17:09] *** bzc6p has quit IRC (Read error: Operation timed out) [17:09] *** bzc6p has joined #archiveteam-bs [17:09] *** swebb sets mode: +o bzc6p [17:42] *** Start has quit IRC (Disconnected.) [17:51] *** McGEE has quit IRC () [18:07] *** Start-mob has joined #archiveteam-bs [18:15] *** chazchaz has quit IRC (Ping timeout: 369 seconds) [18:16] *** Start-mob has quit IRC (Ping timeout: 370 seconds) [18:20] *** chazchaz has joined #archiveteam-bs [18:26] aren't JS-only sites great [18:38] So I'll make some changes to the proposed new projects pages layout (wiki), upon yesterday's suggestions, but only tomorrow, as tonight I'm too tired. [18:55] *** Start has joined #archiveteam-bs [18:57] *** primus104 has joined #archiveteam-bs [18:59] *** mistym has quit IRC (Remote host closed the connection) [19:00] *** mistym has joined #archiveteam-bs [19:04] somehow this is relevant to archiveteam but i am not yet sure how https://i.imgur.com/apFt7pa.gif [19:12] *** trill_ has joined #archiveteam-bs [19:26] *** Start has quit IRC (Disconnected.) [19:27] *** ripvanwin has quit IRC (Leaving) [19:32] *** Start has joined #archiveteam-bs [19:36] *** primus104 has quit IRC (Leaving.) [19:41] *** Start has quit IRC (Disconnected.) [19:44] *** Start has joined #archiveteam-bs [19:48] *** ripvanwin has joined #archiveteam-bs [19:50] *** Start has quit IRC (Ping timeout: 370 seconds) [20:08] *** mistym has quit IRC (Remote host closed the connection) [20:18] *** bzc6p_ has joined #archiveteam-bs [20:18] *** swebb sets mode: +o bzc6p_ [20:19] *** primus104 has joined #archiveteam-bs [20:25] *** bzc6p has quit IRC (Read error: Operation timed out) [20:35] *** ivan` has joined #archiveteam-bs [20:37] Sanqui: Google crawls the web with Chrome these days. In many cases doing a crawl with a real browser will be *faster* than wget/wpull because all of the page resources are fetched in parallel without inappropriately high request delays (also, you get the benefits of SPDY) [20:38] Sanqui: using a bare-bones browser instead of a real browser will just result in a lot of site breakage [20:38] I knew GoogleBot does some JS, but I didn't think it was a full Chrome stack, that still seems exceedingly heavy [20:39] I'd hope that wget/wpull does support parallel download eventually. And SPDY is http2! [20:39] how do you know it's heavy? Chrome is pretty optimized, it even caches compiled JavaScript [20:40] still, I was thinking of an ArchiveBot solution - as far as I know, phantomjs is quite heavy. [20:40] ArchiveBot runs wpull with 3 concurrent workers [20:40] you can change it with !con [20:40] I know. [20:40] But should it run Chrome? [20:41] sounds absurd to me [20:41] imho yes but I haven't written much of the code to do it because I've been writing code to hoard data in google drive [20:41] it's not absurd [20:41] seems almost required anymore [20:47] *** mistym has joined #archiveteam-bs [20:52] *** bzc6p_ is now known as bzc6p [20:58] *** sankin has quit IRC (Leaving.) [21:19] *** mistym has quit IRC (Remote host closed the connection) [21:24] *** landshark has joined #archiveteam-bs [21:39] *** mistym has joined #archiveteam-bs [21:49] *** Muad-Dib has quit IRC (Ping timeout: 252 seconds) [21:51] *** Rickster has quit IRC (Ping timeout: 252 seconds) [21:53] *** dashcloud has quit IRC (Read error: Operation timed out) [21:56] *** dashcloud has joined #archiveteam-bs [21:57] *** trill_ has quit IRC (Ping timeout: 240 seconds) [21:58] *** landshark has quit IRC (Ping timeout: 306 seconds) [22:01] *** landshark has joined #archiveteam-bs [22:05] *** Rickster has joined #archiveteam-bs [22:08] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [22:24] *** zenguy_pc has joined #archiveteam-bs [22:44] *** Boltsie has quit IRC (Read error: Connection reset by peer) [22:46] *** Boltsie has joined #archiveteam-bs [22:47] *** closure has quit IRC (Ping timeout: 306 seconds) [22:53] *** BlueMaxim has joined #archiveteam-bs [22:58] *** closure has joined #archiveteam-bs