[00:01] Hello. SFFnet, which is an index of science fiction and fantasy authors and books and includes personal webpages of many important authors (some of whom are dead), is closing down as of March 31st per https://www.sff.net/closingnotice.asp [00:01] They have a robots.txt so they're not already in the Wayback Machine [00:03] I'm not affiliated with Archive Team yet but I'd be willing to have a go at snarfing the pages over my home connections; I don't have much idea how big the corpus is [00:04] *** i336 has joined #archiveteam [00:07] or should I just try #archivebot? sorry, not familiar with any of this infrastructure [00:07] archivebot is good, but if it's fiddly then you might want to run it on your own [00:08] check out the archiveteam wiki, the various pages that show up when you search for 'warc' [00:08] (you want to download into warc format) [00:08] archivebot will wind up directly browseable in archive.org, which is a good thing [00:08] other things have to be blessed by an IA admin [00:11] OK, thanks [00:11] (it's not impossible to be so blessed, but it means the admin is placing some amount of trust in your methods) [00:44] *** maelstrom has quit IRC (Ping timeout: 250 seconds) [00:48] *** cadbury_ has quit IRC (Ping timeout: 260 seconds) [00:48] *** cadbury_ has joined #archiveteam [00:51] *** maelstrom has joined #archiveteam [00:52] *** pizzaiolo has quit IRC (Remote host closed the connection) [01:00] *** cadbury_ has quit IRC (Ping timeout: 260 seconds) [01:11] *** cadbury_ has joined #archiveteam [01:32] *** maelstrom has quit IRC (Quit: Leaving) [01:50] *** hhallam has quit IRC (Quit: Page closed) [02:16] *** maelstrom has joined #archiveteam [03:01] *** Amigatari has quit IRC (Leaving) [03:20] *** QBcrusher has quit IRC (Ping timeout: 506 seconds) [03:20] *** QBcrusher has joined #archiveteam [04:05] *** ats has quit IRC (Ping timeout: 250 seconds) [04:06] *** ats has joined #archiveteam [04:27] *** ndiddy has quit IRC (Read error: Connection reset by peer) [04:52] *** nertzy has quit IRC (Quit: Leaving) [04:56] *** nertzy has joined #archiveteam [05:40] *** Feld0 has quit IRC (Quit: Pixel Wavelength is best pony.) [05:46] *** Feld0 has joined #archiveteam [05:50] *** Aranje has joined #archiveteam [05:51] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [05:57] *** Sk1d has joined #archiveteam [06:07] *** maelstrom has quit IRC (Quit: Leaving) [06:30] *** Honno has joined #archiveteam [06:53] *** SmileyG has joined #archiveteam [06:54] *** Sneakyimp has quit IRC (Read error: Operation timed out) [06:54] *** passerby_ has joined #archiveteam [06:55] *** tfgbd_znc has quit IRC (Ping timeout: 600 seconds) [06:57] *** i336 has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** Froggypwn has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** SadDM has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** yakfish has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** ranma has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** kyounko has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** rocode has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** Smiley has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** passerby has quit IRC (hub.efnet.us irc.colosolutions.net) [06:57] *** jspiros has quit IRC (hub.efnet.us irc.colosolutions.net) [07:01] *** Sneakyimp has joined #archiveteam [07:05] *** i336___ has joined #archiveteam [07:05] *** tfgbd_znc has joined #archiveteam [07:06] *** schbirid has joined #archiveteam [07:08] *** ranma has joined #archiveteam [07:09] *** jspiros has joined #archiveteam [07:19] *** jspiros has quit IRC (hub.efnet.us irc.colosolutions.net) [07:19] *** ranma has quit IRC (hub.efnet.us irc.colosolutions.net) [07:26] *** ranma_ has joined #archiveteam [07:26] *** jspiros has joined #archiveteam [07:28] *** ravetcofx has quit IRC (Read error: Operation timed out) [07:34] *** ravetcofx has joined #archiveteam [07:35] *** ranma_ is now known as ranma [09:05] *** Honno has quit IRC (Ping timeout: 370 seconds) [09:06] *** ravetcofx has quit IRC (Read error: Operation timed out) [09:21] *** no2pencil has quit IRC (Ping timeout: 600 seconds) [09:21] *** atomotic has joined #archiveteam [09:52] *** Honno has joined #archiveteam [09:57] *** atomotic has quit IRC (Remote host closed the connection) [10:02] *** BlueMaxim has quit IRC (Read error: Operation timed out) [10:03] *** Honno_ has joined #archiveteam [10:03] *** BlueMaxim has joined #archiveteam [10:06] *** Honno has quit IRC (Ping timeout: 370 seconds) [10:52] *** QBcrusher has quit IRC (Ping timeout: 250 seconds) [10:53] *** QBcrusher has joined #archiveteam [11:27] *** beardicus has joined #archiveteam [11:27] *** swebb sets mode: +o beardicus [12:21] *** balrog has quit IRC (Read error: Operation timed out) [12:30] *** balrog has joined #archiveteam [12:30] *** swebb sets mode: +o balrog [12:54] *** pizzaiolo has joined #archiveteam [13:45] *** kristian_ has joined #archiveteam [13:53] *** kristian_ has quit IRC (Quit: Leaving) [14:16] *** joepie91 has quit IRC (Excess Flood) [14:17] *** joepie91 has joined #archiveteam [14:17] *** swebb sets mode: +o joepie91 [14:19] *** nertzy has quit IRC (Quit: Leaving) [14:27] *** nertzy has joined #archiveteam [14:28] *** i336___ has quit IRC (Ping timeout: 260 seconds) [15:36] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [16:18] *** atomotic has joined #archiveteam [16:27] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [18:43] *** nicolas17 has joined #archiveteam [19:11] *** Simpbrain has quit IRC (Ping timeout: 250 seconds) [19:13] *** ravetcofx has joined #archiveteam [19:24] *** Simpbrain has joined #archiveteam [19:25] *** Sneakyimp has quit IRC (Ping timeout: 250 seconds) [19:41] *** Sneakyimp has joined #archiveteam [19:45] *** ravetcofx has quit IRC (Read error: Operation timed out) [19:47] *** bRick5772 has joined #archiveteam [19:48] *** ravetcofx has joined #archiveteam [20:22] *** observer has quit IRC (Quit: Page closed) [20:26] *** kristian_ has joined #archiveteam [20:27] *** ravetcofx has quit IRC (Read error: Operation timed out) [20:28] *** ravetcofx has joined #archiveteam [20:57] *** atomotic has joined #archiveteam [21:00] *** atomotic has quit IRC (Remote host closed the connection) [21:15] *** texting12 has joined #archiveteam [21:16] *** texting12 has quit IRC (Client Quit) [21:19] *** atomotic has joined #archiveteam [21:32] *** Asparagir has joined #archiveteam [21:41] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [21:49] *** pizzaiolo has quit IRC (Ping timeout: 246 seconds) [22:00] *** Honno_ has quit IRC (Ping timeout: 245 seconds) [22:15] *** Asparagir has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** beardicus has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** QBcrusher has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** tfgbd_znc has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** SmileyG has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** SirCmpwn has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** _Zialus_ has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Petri152 has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Mayonaise has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** marvinw has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** REiN^ has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** sep332 has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** nwf has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** phuzion has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** bwn has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** midas1 has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** kremlin has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** XPEric has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** mhazinsk has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** aMunster has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** remsen has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** nertzy has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** robink has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** RedType has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Igloo has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Rondom has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** kcaj has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Selavi has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** kanzure_ has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Blackout has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** tdannecy has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** midas has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** patricko- has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** luckcolor has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** computerf has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** macker has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Darkstar has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** randomdes has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** Jordan has quit IRC (hub.efnet.us ircd.choopa.net) [22:15] *** tapedrive has quit IRC (hub.efnet.us ircd.choopa.net) [22:18] *** beardicus has joined #archiveteam [22:18] *** SmileyG has joined #archiveteam [22:18] *** SirCmpwn has joined #archiveteam [22:18] *** _Zialus_ has joined #archiveteam [22:18] *** remsen has joined #archiveteam [22:18] *** marvinw has joined #archiveteam [22:18] *** REiN^ has joined #archiveteam [22:18] *** nwf has joined #archiveteam [22:18] *** bwn has joined #archiveteam [22:18] *** midas1 has joined #archiveteam [22:18] *** kremlin has joined #archiveteam [22:18] *** aMunster has joined #archiveteam [22:18] *** XPEric has joined #archiveteam [22:18] *** mhazinsk has joined #archiveteam [22:18] *** ircd.choopa.net sets mode: +oo beardicus midas1 [22:18] *** swebb sets mode: +o beardicus [22:18] *** swebb sets mode: +o midas1 [22:18] *** tfgbd_znc has joined #archiveteam [22:18] *** Petri152 has joined #archiveteam [22:19] *** pizzaiolo has joined #archiveteam [22:19] *** sep332_ has joined #archiveteam [22:19] *** nertzy has joined #archiveteam [22:19] *** robink has joined #archiveteam [22:19] *** RedType has joined #archiveteam [22:19] *** Igloo has joined #archiveteam [22:19] *** Rondom has joined #archiveteam [22:19] *** kcaj has joined #archiveteam [22:19] *** Selavi has joined #archiveteam [22:19] *** kanzure_ has joined #archiveteam [22:19] *** Blackout has joined #archiveteam [22:19] *** tdannecy has joined #archiveteam [22:19] *** midas has joined #archiveteam [22:19] *** patricko- has joined #archiveteam [22:19] *** luckcolor has joined #archiveteam [22:19] *** computerf has joined #archiveteam [22:19] *** macker has joined #archiveteam [22:19] *** Darkstar has joined #archiveteam [22:19] *** randomdes has joined #archiveteam [22:19] *** Jordan has joined #archiveteam [22:19] *** tapedrive has joined #archiveteam [22:19] *** irc.mzima.net sets mode: +o midas [22:19] *** swebb sets mode: +o midas [22:20] *** ndiddy has joined #archiveteam [22:20] *** pizzaiol1 has joined #archiveteam [22:23] *** pizzaiolo has quit IRC (Ping timeout: 246 seconds) [22:24] *** ndiddy has quit IRC (Read error: Connection reset by peer) [22:24] *** ndiddy has joined #archiveteam [22:36] *** bRick5772 has quit IRC (Quit: Leaving.) [22:40] *** pizzaiol1 has quit IRC (Ping timeout: 245 seconds) [22:44] *** Asparagir has joined #archiveteam [22:47] *** pizzaiolo has joined #archiveteam [23:01] *** pikhq has quit IRC (Ping timeout: 260 seconds) [23:03] *** BlueMaxim has joined #archiveteam [23:07] *** schbirid has quit IRC (Quit: Leaving) [23:08] *** Mayonaise has joined #archiveteam [23:13] *** pikhq has joined #archiveteam [23:38] *** Asparagir has quit IRC (Asparagir) [23:57] *** Stil3tt0 has joined #archiveteam [23:57] *** Stiletto has quit IRC (Ping timeout: 250 seconds)