[00:01] *** iguana has joined #archiveteam [00:17] *** anhedonis has quit IRC (Remote host closed the connection) [00:24] *** Stilett0 has quit IRC (Ping timeout: 246 seconds) [00:28] *** Coderjo_ is now known as Coderjo [00:30] *** iguana has quit IRC (Read error: Connection reset by peer) [00:45] SketchCow: you are no longer in the topic or as the one that set the topic. [01:18] *** valesi has quit IRC (Remote host closed the connection) [01:24] *** Selavi has joined #archiveteam [01:45] *** pizzaiolo has quit IRC (Remote host closed the connection) [02:09] *** Stilett0 has joined #archiveteam [02:11] *** Dark_Star has quit IRC (Ping timeout: 633 seconds) [02:15] *** Dark_Star has joined #archiveteam [03:14] *** Guest has joined #archiveteam [03:32] *** topdownji has quit IRC (Quit: Bye!) [04:00] *** BlueMaxim has quit IRC (Read error: Operation timed out) [04:22] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:23] *** kris33 has joined #archiveteam [04:28] *** Sk1d has joined #archiveteam [06:11] *** LordNigh2 has joined #archiveteam [06:13] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [06:13] *** LordNigh2 is now known as Lord_Nigh [07:49] *** atomotic has joined #archiveteam [08:05] *** godane has quit IRC (Leaving.) [08:40] *** JAA has joined #archiveteam [08:40] *** JAA has quit IRC (Client Quit) [09:19] *** RoanKatto has joined #archiveteam [09:19] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [09:21] *** Morbus has quit IRC (Read error: Operation timed out) [09:48] *** Honno has joined #archiveteam [10:24] *** neue has quit IRC (Textual IRC Client: www.textualapp.com) [10:25] *** atomotic has joined #archiveteam [10:26] *** btfo has quit IRC (Ping timeout: 600 seconds) [10:34] *** anhedonis has joined #archiveteam [10:35] *** btfo has joined #archiveteam [11:03] *** RoanKatto is now known as Morbus [11:12] *** atomotic has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…) [11:14] *** Yoshimura has joined #archiveteam [11:40] *** pizzaiolo has joined #archiveteam [12:06] *** raphidae has joined #archiveteam [12:14] *** odemg has joined #archiveteam [12:16] *** redlob has quit IRC (Read error: Operation timed out) [12:19] *** redlob has joined #archiveteam [12:26] *** ZexaronS has quit IRC (Leaving) [12:35] *** pizzaiolo has quit IRC (Ping timeout: 245 seconds) [12:38] *** atomotic has joined #archiveteam [12:40] *** JAA has joined #archiveteam [12:49] I'm grabbing every forum post on epicski. Specifically, I'm retrieving http://www.epicski.com/forum/post/$postid for all post IDs (1 to 2080000; last existing ID as of writing this is 2077464), but not following the redirect as that would mean archiving everything multiple times. In a second step, I'll then retrieve the thread pages containing the actual posts. [12:50] I expect the first part to take about 2 days at the current rate, assuming my IP doesn't get banned or throttled. The second part should be on the order of 100k pages (3M posts at 30 posts per page). [12:56] NB, I'm not grabbing anything else from the site (including non-forum stuff like product reviews but also the forum/thread listings, user profile pages, etc.). [12:57] ... or external links. ArchiveBot is on that though; let's see how far it gets until 12 May. [13:39] *** JAA has quit IRC (Quit: Page closed) [13:46] *** Yoshimura has quit IRC (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client) [14:08] *** brayden_ has joined #archiveteam [14:08] *** swebb sets mode: +o brayden_ [14:14] *** brayden has quit IRC (Read error: Operation timed out) [14:32] *** brayden__ has joined #archiveteam [14:32] *** swebb sets mode: +o brayden__ [14:34] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:37] *** brayden_ has quit IRC (Read error: Operation timed out) [14:40] *** JensRex has quit IRC (Remote host closed the connection) [14:41] *** JensRex has joined #archiveteam [15:21] *** Honno_ has joined #archiveteam [15:22] *** odemg has quit IRC (Remote host closed the connection) [15:24] *** nemo_ has joined #archiveteam [15:27] *** Honno has quit IRC (Ping timeout: 370 seconds) [15:30] *** brayden__ is now known as brayden [15:34] *** odemg has joined #archiveteam [15:48] *** pizzaiolo has joined #archiveteam [15:59] *** anhedonis has quit IRC (Remote host closed the connection) [15:59] *** anhedonis has joined #archiveteam [16:03] *** bithippo has quit IRC (Quit: Page closed) [16:21] *** Guest has quit IRC (Read error: Operation timed out) [16:23] *** nemo_ has quit IRC (Quit: Page closed) [16:48] *** dan_ has joined #archiveteam [17:09] *** brayden_ has joined #archiveteam [17:09] *** swebb sets mode: +o brayden_ [17:13] *** brayden has quit IRC (Read error: Operation timed out) [17:14] *** brayden_ is now known as brayden [17:24] *** dan_ has quit IRC (Quit: Page closed) [17:27] *** odemg has quit IRC (Remote host closed the connection) [17:30] *** Honno_ has quit IRC (Ping timeout: 370 seconds) [17:38] *** odemg has joined #archiveteam [17:38] *** odemg has quit IRC (Connection closed) [18:00] *** pizzaiolo has quit IRC (Read error: Connection reset by peer) [18:00] *** odemg has joined #archiveteam [18:02] *** icedice has joined #archiveteam [18:02] *** pizzaiolo has joined #archiveteam [18:16] *** Aranje has quit IRC (Ping timeout: 245 seconds) [18:40] *** godane has joined #archiveteam [18:52] *** odemg has quit IRC (Remote host closed the connection) [19:02] *** Aranje has joined #archiveteam [19:14] *** anhedonis has quit IRC (Ping timeout: 244 seconds) [19:16] *** anhedonis has joined #archiveteam [19:30] *** anhedonis has quit IRC (Quit: anhedonis) [19:54] *** odemg has joined #archiveteam [20:07] *** antomati_ has joined #archiveteam [20:07] *** swebb sets mode: +o antomati_ [20:09] *** antomatic has quit IRC (Ping timeout: 250 seconds) [20:11] *** antomati_ is now known as antomatic [20:14] *** antomati_ has joined #archiveteam [20:14] *** swebb sets mode: +o antomati_ [20:16] *** antomatic has quit IRC (Read error: Operation timed out) [20:17] *** antomati_ is now known as antomatic [20:27] *** JAA has joined #archiveteam [20:33] I just realised that EpicSki said they're closing because their hoster is shutting down the entire Huddler platform (see http://www.epicski.com/t/150694/rip-epicski-1999-2017#post_2075283 ). This could mean that these additional websites (from http://huddlerhub.wikia.com/wiki/Huddler_Hub ) may also be in danger: [20:33] https://www.head-fi.org/ http://www.overclock.net/ http://www.cheftalk.com/ http://www.backyardchickens.com/ https://thecatsite.com/ https://www.styleforum.net/ http://niketalk.com/ http://www.smokingmeatforums.com/ [20:33] (Putting them here for searchability) [20:33] Interestingly, none of them (as far as I can see) have any such announcement. [20:36] It might not be a too bad idea to grab those as well, just in case. [21:16] *** JAA has quit IRC (Quit: Good night) [21:19] *** Honno_ has joined #archiveteam [21:26] *** anjacks0n has joined #archiveteam [21:28] *** anjacks0n has quit IRC (Client Quit) [21:28] *** arbin_ has joined #archiveteam [21:33] *** arbin has quit IRC (Read error: Operation timed out) [21:41] *** JensRex has quit IRC (Remote host closed the connection) [21:41] *** JensRex has joined #archiveteam [21:46] *** Honno_ has quit IRC (Ping timeout: 370 seconds) [22:22] *** odemg has quit IRC (Remote host closed the connection) [22:45] *** kris33 has quit IRC (Read error: Connection reset by peer) [22:45] *** kris33_ has joined #archiveteam [22:55] *** box41 has joined #archiveteam [23:01] The arkOS project is being discontinued. It is hosted at https://arkos.io/ . The discontinuation notice is found at https://arkos.io/2017/04/sunset/ . [23:07] *** kris33_ has quit IRC (Textual IRC Client: www.textualapp.com) [23:28] *** odemg has joined #archiveteam [23:29] *** BlueMaxim has joined #archiveteam [23:58] *** box41 has quit IRC (Ping timeout: 268 seconds)