[00:14] * JesseW nodnodnodnod [00:14] I think there are efforts to do that -- I'm not sure what they are. [00:17] We got all external links from wikia [00:18] We'll also get the wikis themselves as WARCs [00:18] *** Joins: Ravenloft (~identd@[redacted]) [00:22] Has wikiteam gotten wikia wikis as xml dumps already? [00:23] Does wikia even *make* xml dumps available? [00:23] Glad to hear about the external links and plans to get WARCs, though [00:23] Also, many wikia wikis are still active, so there will be new content added after we grab them. [00:24] So we should also think about a schedule for re-grabbing them. [00:24] (I expect most of this is already been thought of, but it's probably worth blathering about it here, just in case) [00:24] *** Quits: Ghost_of_ (~kristian@[redacted]) (Remote host closed the connection) [00:44] *** Quits: robink (quasselcor@[redacted]) (Ping timeout: 190 seconds) [00:48] *** Joins: robink (quasselcor@[redacted]) [00:50] *** Joins: Ghost_of_ (~kristian@[redacted]) [00:54] *** Quits: Ravenloft (~identd@[redacted]) (Read error: Connection reset by peer) [01:17] *** Joins: Ravenloft (~identd@[redacted]) [01:39] *** Quits: Ghost_of_ (~kristian@[redacted]) (Quit: Leaving) [01:53] *** wp494_ is now known as wp494 [01:59] *** Quits: philpem (~philpem@[redacted]) (Ping timeout: 260 seconds) [02:00] *** Quits: kyan (~kyan@[redacted]) (Quit: Leaving) [02:11] *** Quits: schbirid (~schbirid4@[redacted]) (Ping timeout: 258 seconds) [02:23] *** Joins: schbirid (~schbirid4@[redacted]) [02:29] *** Quits: megaminxw (~tamara@[redacted]) (Quit: Leaving.) [02:52] *** Joins: W1nterFox (~winterfox@[redacted]) [02:57] *** Quits: JesseW (~jesse@[redacted]) (Leaving.) [02:58] *** Quits: WinterFox (~winterfox@[redacted]) (Read error: Operation timed out) [03:17] *** Quits: bwn (~bwn@[redacted]) (Read error: Operation timed out) [03:34] *** Joins: JesseW (~jesse@[redacted]) [03:43] *** Quits: BubuAnabe (8adb059a@[redacted]) (http://www.kiwiirc.com/ - A hand crafted IRC client) [03:44] *** Joins: BubuAnabe (b3335ec1@[redacted]) [03:44] *** Quits: JesseW (~jesse@[redacted]) (Leaving.) [03:45] *** Joins: JesseW (~jesse@[redacted]) [03:48] chfoo -- your archiving bot has not updated since 14:01 on all the channels... [03:49] *** logchfoo starts logging #archiveteam at Sun Jan 10 03:49:34 2016 [03:49] *** logchfoo has joined #archiveteam [03:50] thanks, i'll patch in the missing later [03:50] cool. [03:55] *** megaminxw has joined #archiveteam [04:01] *** bwn has joined #archiveteam [04:08] *** brayden has left [04:08] *** brayden has joined #archiveteam [04:54] *** JetBalsa has quit IRC (- nbs-irc 2.39 - www.nbs-irc.net -) [05:21] *** SketchCow has quit IRC (Read error: Connection reset by peer) [05:21] *** SketchCow has joined #archiveteam [05:25] *** Stilett0 is now known as Stiletto [05:29] *** BubuAnabe has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [05:33] *** bentpins has joined #archiveteam [05:44] *** VADemon has quit IRC (left4dead) [06:18] *** jonimus has joined #archiveteam [06:48] *** JesseW has quit IRC (Leaving.) [07:04] *** sniliohol has joined #archiveteam [07:05] hello. i noticed the `google books` page is empty http://www.archiveteam.org/index.php?title=Google_Books does anyone know of a scraper for gbooks? [07:28] sniliohol: for public domain books, or for books that you only get a preview for? [07:34] either [07:36] sniliohol: so I don't know of any scrapers that still work (or whether they exist), but to get the non-public-domain books, you can usually get around the page limitations by searching for common words [07:36] it will selectively show you pages that contain those words [07:36] get enough of them and you have a book [07:38] so there's not a scraper that does that programmatically? [07:38] are the public domain books easily downloaded? [07:41] *** Ghost_of_ has joined #archiveteam [07:45] *** MMovie1 has joined #archiveteam [07:46] *** MMovie has quit IRC (Read error: Operation timed out) [07:52] *** JesseW has joined #archiveteam [07:53] yes there's a download pdf link on the gear button in the upper right for public domain books [07:55] various people have been reuploading them to the archive.org books collection, not sure the current status of that [07:55] *** Stiletto has quit IRC (Ping timeout: 246 seconds) [07:56] looks like it's still ongoing https://archive.org/details/googlebooks?sort=-publicdate [07:56] https://tools.wmflabs.org/bub/ [08:18] *** JesseW has quit IRC (Leaving.) [08:37] *** bentpins has quit IRC (Read error: Connection reset by peer) [09:00] *** mutoso has quit IRC (Read error: Connection reset by peer) [09:01] *** mutoso has joined #archiveteam [09:06] *** sniliohol has quit IRC (Ping timeout: 241 seconds) [09:11] *** MMovie1 has quit IRC (Read error: Connection reset by peer) [09:11] *** Froggypwn has quit IRC (Read error: Operation timed out) [09:12] *** Sanky has quit IRC (Read error: Operation timed out) [09:12] *** Froggypwn has joined #archiveteam [09:13] *** MMovie has joined #archiveteam [09:14] *** Sanqui has joined #archiveteam [09:26] *** bentpins has joined #archiveteam [09:45] *** philpem has joined #archiveteam [09:46] *** bwn has quit IRC (Read error: Operation timed out) [10:16] *** BlueMaxim has quit IRC (Quit: Leaving) [10:24] *** bwn has joined #archiveteam [10:39] *** Ghost_of_ has quit IRC (Quit: Leaving) [11:51] *** jut has joined #archiveteam [12:33] *** vitzli has joined #archiveteam [12:51] *** SN4T14 has quit IRC (Quit: Leaving) [13:03] *** hcf_ has joined #archiveteam [13:19] *** hcf_ has quit IRC (Quit: Page closed) [13:22] *** vitzli has quit IRC (Leaving) [13:36] *** khaoohs_ has quit IRC (Read error: Operation timed out) [13:55] *** zer0rest has joined #archiveteam [13:57] *** khaoohs has joined #archiveteam [14:06] *** zer0rest has quit IRC (Read error: Connection reset by peer) [14:10] *** khaoohs has quit IRC (Read error: Operation timed out) [14:15] *** philpem has quit IRC (Ping timeout: 260 seconds) [14:20] *** W1nterFox has quit IRC (Remote host closed the connection) [14:21] *** jut has quit IRC (Ping timeout: 240 seconds) [14:22] *** VADemon has joined #archiveteam [14:27] *** atomotic has joined #archiveteam [14:30] *** khaoohs has joined #archiveteam [14:41] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:50] *** philpem has joined #archiveteam [15:03] *** zer0rest has joined #archiveteam [15:07] *** khaoohs has quit IRC (Read error: Operation timed out) [15:29] *** megaminxw has quit IRC (Quit: Leaving.) [15:36] *** Ravenloft has quit IRC (Ping timeout: 260 seconds) [15:37] *** bwn has quit IRC (Read error: Operation timed out) [15:42] *** bentpins has quit IRC (Quit: Leaving) [15:43] *** arkiver2 has joined #archiveteam [15:46] *** Swizzle has joined #archiveteam [16:16] *** Ravenloft has joined #archiveteam [16:25] *** zer0rest has quit IRC (Read error: Connection reset by peer) [16:32] *** sbet has joined #archiveteam [16:33] *** Swizzle has quit IRC (Quit: Leaving) [16:33] *** wyatt8750 has quit IRC (Read error: Operation timed out) [16:38] *** Froggypwn has quit IRC (Read error: Operation timed out) [16:38] *** Froggypwn has joined #archiveteam [16:40] *** wyatt8740 has joined #archiveteam [17:32] *** Elegance has quit IRC (Read error: Operation timed out) [17:36] *** mutoso has quit IRC (Read error: Connection reset by peer) [17:36] *** mutoso has joined #archiveteam [17:37] *** Jogie has joined #archiveteam [17:39] *** Elegance has joined #archiveteam [17:39] *** Elegance has quit IRC (Connection closed) [17:40] *** Elegance has joined #archiveteam [17:51] *** mutoso has quit IRC (Read error: Connection reset by peer) [17:59] *** mutoso has joined #archiveteam [18:01] *** arkiver2 has quit IRC (Ping timeout: 260 seconds) [18:03] *** sbet has quit IRC (Ping timeout: 240 seconds) [18:08] *** JesseW has joined #archiveteam [18:39] *** khaoohs has joined #archiveteam [18:40] *** Ghost_of_ has joined #archiveteam [18:43] *** JesseW has quit IRC (Leaving.) [18:48] *** arkiver2 has joined #archiveteam [18:51] *** Stiletto has joined #archiveteam [19:06] *** BubuAnabe has joined #archiveteam [19:09] *** Emcy has joined #archiveteam [19:22] *** BubuAnabe has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [19:22] *** BubuAnabe has joined #archiveteam [19:30] *** BubuAnabe has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [19:46] *** zer0rest has joined #archiveteam [19:53] *** SN4T14 has joined #archiveteam [20:07] *** JesseW has joined #archiveteam [20:14] *** zer0rest has quit IRC (Read error: Connection reset by peer) [20:30] *** zer0rest has joined #archiveteam [20:38] *** chfoo has quit IRC (Quit: chfoo) [20:51] *** VADemon has quit IRC (Quit: left4dead) [21:14] *** JetBalsa has joined #archiveteam [21:20] *** schbirid has quit IRC (Quit: Leaving) [21:24] *** bwn has joined #archiveteam [21:27] *** Emcy has quit IRC (Ping timeout: 252 seconds) [21:29] *** Emcy has joined #archiveteam [21:31] *** chfoo has joined #archiveteam [21:44] *** mutoso has quit IRC (Read error: Connection reset by peer) [21:45] *** W1nterFox has joined #archiveteam [21:49] *** mutoso has joined #archiveteam [21:52] *** JesseW has quit IRC (Leaving.) [21:58] *** nwf has joined #archiveteam [22:05] *** zer0rest has quit IRC (Ping timeout: 260 seconds) [22:12] *** Ghost_of_ has quit IRC (Quit: Leaving) [22:16] *** marvinw is now known as ivan` [22:22] Windows Secrets is going paid-only soon: http://windowssecrets.com/introduction/coming-changes-to-the-windows-secrets-newsletter/ [22:22] some stuff you've always had to pay for, but now that's going to apply to everything too [22:25] *** arkiver2 has quit IRC (Ping timeout: 260 seconds) [22:55] *** BlueMaxim has joined #archiveteam [23:06] *** JesseW has joined #archiveteam [23:27] *** GLaDOS has quit IRC (Ping timeout: 260 seconds) [23:36] *** GLaDOS has joined #archiveteam [23:45] *** megaminxw has joined #archiveteam [23:57] wp494: being archived