[01:36] *** Stilett0 has quit IRC (Ping timeout: 264 seconds) [01:40] *** zhongfu has quit IRC (Remote host closed the connection) [01:42] *** BlueMax has joined #archiveteam [01:43] *** zhongfu has joined #archiveteam [01:48] *** RichardG has quit IRC (Read error: Connection reset by peer) [01:51] *** RichardG has joined #archiveteam [02:23] *** BlueMaxim has joined #archiveteam [02:29] *** BlueMax has quit IRC (Read error: Operation timed out) [02:33] *** Mateon1 has quit IRC (Read error: Operation timed out) [02:33] *** Mateon1 has joined #archiveteam [02:40] *** arkiver2 has joined #archiveteam [03:11] *** arkiver2 has quit IRC (Quit: AndroIRC - Android IRC Client ( http://www.androirc.com )) [03:13] *** WubTheCap has joined #archiveteam [04:04] *** octothorp has joined #archiveteam [04:33] *** qw3rty114 has joined #archiveteam [04:37] *** qw3rty113 has quit IRC (Read error: Operation timed out) [05:02] *** Ctrl has quit IRC (Ping timeout: 250 seconds) [05:19] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:21] *** Sk1d has joined #archiveteam [05:32] *** dashcloud has quit IRC (Read error: Operation timed out) [05:32] *** dashcloud has joined #archiveteam [06:17] *** octothorp has quit IRC (Remote host closed the connection) [06:17] *** octothorp has joined #archiveteam [06:26] *** tuluu has quit IRC (Read error: Operation timed out) [06:30] *** tuluu has joined #archiveteam [07:26] *** Mayonaise has quit IRC (Read error: Operation timed out) [07:33] *** klondike has quit IRC (Ping timeout: 244 seconds) [07:49] *** schbirid has joined #archiveteam [07:54] *** Mayonaise has joined #archiveteam [08:03] *** tuluu has quit IRC (Read error: Operation timed out) [08:04] *** tuluu has joined #archiveteam [08:29] *** underscor has joined #archiveteam [08:39] *** kitties has quit IRC (Quit: Connection closed for inactivity) [09:02] *** octothorp has quit IRC (Remote host closed the connection) [09:03] *** atomotic has joined #archiveteam [09:07] *** rsznik has quit IRC (Read error: Connection reset by peer) [09:34] *** tuluu has quit IRC (Remote host closed the connection) [09:38] *** tuluu has joined #archiveteam [09:38] *** Stilett0 has joined #archiveteam [09:49] *** atomotic has quit IRC (Quit: atomotic) [09:54] *** BlueMaxim has quit IRC (Leaving) [10:20] *** klondike has joined #archiveteam [10:27] *** atomotic has joined #archiveteam [10:43] *** plue has quit IRC (Ping timeout: 260 seconds) [10:43] *** Stilett0 has quit IRC () [10:43] *** plue has joined #archiveteam [10:44] *** zhongfu has quit IRC (Remote host closed the connection) [10:44] *** echarlie has quit IRC (Ping timeout: 260 seconds) [10:44] *** echarlie has joined #archiveteam [10:45] *** zhongfu has joined #archiveteam [10:45] *** inzom has quit IRC (Ping timeout: 260 seconds) [10:49] *** Muad-Dib has quit IRC (Ping timeout: 260 seconds) [10:50] *** Meroje has quit IRC (Ping timeout: 260 seconds) [10:51] *** Hecatz has quit IRC (Ping timeout: 260 seconds) [10:51] *** zhongfu has quit IRC (Ping timeout: 260 seconds) [10:52] *** Rondom has quit IRC (Ping timeout: 260 seconds) [10:52] *** inzom has joined #archiveteam [10:52] *** midas2 has quit IRC (Ping timeout: 260 seconds) [10:53] *** Meroje has joined #archiveteam [10:53] *** Igloo has quit IRC (Ping timeout: 260 seconds) [10:53] *** Igloo has joined #archiveteam [10:55] *** Muad-Dib has joined #archiveteam [10:55] *** ItsYoda has quit IRC (Ping timeout: 260 seconds) [10:56] *** Rondom has joined #archiveteam [10:56] *** tyng has quit IRC (Ping timeout: 260 seconds) [10:56] *** jsa has quit IRC (Ping timeout: 260 seconds) [10:56] *** ItsYoda has joined #archiveteam [10:56] *** echarlie has quit IRC (Ping timeout: 260 seconds) [10:58] *** deetwelve has quit IRC (Ping timeout: 260 seconds) [10:59] *** tyng has joined #archiveteam [10:59] *** trvz has quit IRC (Ping timeout: 260 seconds) [11:00] *** inzom has quit IRC (Ping timeout: 260 seconds) [11:01] *** Meroje has quit IRC (Ping timeout: 260 seconds) [11:02] *** Hecatz has joined #archiveteam [11:02] *** jsa has joined #archiveteam [11:03] *** deetwelve has joined #archiveteam [11:03] *** Meroje has joined #archiveteam [11:04] *** trvz has joined #archiveteam [11:06] *** Muad-Dib has quit IRC (Ping timeout: 260 seconds) [11:08] *** zhongfu has joined #archiveteam [11:10] *** inzom has joined #archiveteam [11:15] *** inzom has quit IRC (Ping timeout: 260 seconds) [11:17] *** inzom has joined #archiveteam [11:19] *** Meroje has quit IRC (Ping timeout: 260 seconds) [11:19] *** zhongfu has quit IRC (Remote host closed the connection) [11:19] *** Meroje has joined #archiveteam [11:19] *** midas2 has joined #archiveteam [11:20] *** deetwelve has quit IRC (Ping timeout: 260 seconds) [11:20] *** zhongfu has joined #archiveteam [11:20] *** Muad-Dib has joined #archiveteam [11:21] *** deetwelve has joined #archiveteam [11:23] *** echarlie has joined #archiveteam [11:23] *** dan- has quit IRC (Ping timeout: 260 seconds) [11:38] *** atomotic has quit IRC (Read error: Connection reset by peer) [11:42] *** tyng has quit IRC (Ping timeout: 260 seconds) [11:45] *** inzom has quit IRC (Ping timeout: 260 seconds) [11:45] *** Hecatz has quit IRC (Ping timeout: 260 seconds) [11:45] *** ItsYoda has quit IRC (Ping timeout: 260 seconds) [11:46] *** ItsYoda has joined #archiveteam [11:46] *** Hecatz has joined #archiveteam [11:47] *** echarlie has quit IRC (Ping timeout: 260 seconds) [11:47] *** echarlie has joined #archiveteam [11:49] *** inzom has joined #archiveteam [11:58] *** dan- has joined #archiveteam [12:00] *** tyng has joined #archiveteam [13:15] *** atomotic has joined #archiveteam [15:14] *** sudofox has joined #archiveteam [15:14] what triggers your bot to spider my site? because it's not down or anything, it's just under maintenance mode... [15:15] don't want to pollute your archives with my maint mode [15:16] sudofox: What site is that? [15:16] https://www.sudomemo.net [15:17] i'm issuing a HTTP 503 and p much everything I can to indicate that it's temporarily unavailable per spec [15:17] I'm a fan of Archive Team so I was just a bit surprised [15:17] Hmm, I don't see that appearing anywhere at the moment. [15:17] Let's take this to #archivebot. [15:18] Sure :> [15:28] *** Morbus has joined #archiveteam [15:31] *** atomotic has quit IRC (Quit: atomotic) [15:42] *** Stilett0 has joined #archiveteam [15:55] *** ranavalon has joined #archiveteam [15:57] *** ranav has quit IRC (Read error: Operation timed out) [16:05] *** Soulflar- has joined #archiveteam [16:05] *** Soulflare has quit IRC (Read error: Connection reset by peer) [16:05] *** Soulflar- is now known as Soulflare [16:09] --------------- GOOD MORNING MANIACS [16:10] I'm happy to report that the Archivebot pipeline is basically flowing perfectly, no issues [16:10] Also, we've not had any insane grabs recently, so the FOS machine has been mostly happy [16:11] I've got a bunch of my own projects on the machine but about 9tb of emergency buffer exists if we need it [16:11] ------- THAT IS ALL - I HAVE SOME OTHER IDEAS I'LL DROP in #-BS [16:20] *** rsznik has joined #archiveteam [16:32] *** ranav has joined #archiveteam [16:34] *** ranavalon has quit IRC (Ping timeout: 252 seconds) [17:02] *** atomotic has joined #archiveteam [17:09] *** Morbus has quit IRC (Read error: Operation timed out) [17:09] *** Morbus has joined #archiveteam [18:30] *** atomotic has quit IRC (Quit: atomotic) [19:25] *** sudofox has quit IRC () [19:28] *** turtlepow has joined #archiveteam [19:28] Hiii people of Archive Team [19:30] hey what [19:30] I'm currently trying out this method of backup, however I'm not having 100% success with dA https://www.archiveteam.org/index.php?title=DeviantART [19:30] particularly with inputting the "/?catpath=/" part of the URL. It's only giving the first 12-24 links [19:32] Is there an adjustment I need to make? I tried checking out the git, and I think I pulled down the dev version as well [19:32] same results [19:33] Assist would be appreciated. [19:52] again any help would be appreciated. [20:03] Comparing the actual page URLs I'm seeing a pattern like this at the end "/?catpath=%2F&offset=24" is there something I need to adjust in my syntax? [20:11] *** RichardG has quit IRC (Read error: Connection reset by peer) [20:13] *** RichardG has joined #archiveteam [20:14] More likely that DA have updated it [20:32] Prob so, they do like to meddle with their code frequently [20:32] anyway, thanks for the response. I'll check back and see what I can squeeze out [20:35] *** BlueMax has joined #archiveteam [20:37] *** turtlepow has quit IRC (Ping timeout: 260 seconds) [20:47] *** tuluu has quit IRC (Read error: Operation timed out) [20:47] *** tuluu has joined #archiveteam [20:58] *** RichardG has quit IRC (Read error: Connection reset by peer) [20:59] *** RichardG has joined #archiveteam [21:16] *** dashcloud has quit IRC (Read error: Operation timed out) [21:21] *** dashcloud has joined #archiveteam [22:13] *** ats has quit IRC (Quit: new kernel, again) [22:14] *** schbirid has quit IRC (Quit: Leaving) [22:19] *** ats has joined #archiveteam [22:56] *** jschwart has quit IRC (Konversation terminated!) [23:04] *** tapedrive has joined #archiveteam [23:11] *** tuluu has quit IRC (Read error: Operation timed out) [23:11] *** tuluu has joined #archiveteam [23:12] *** BlueMaxim has joined #archiveteam [23:15] *** fie has quit IRC (Ping timeout: 506 seconds) [23:18] *** BlueMax has quit IRC (Read error: Operation timed out) [23:19] Are people here aware of the looming possibility of the UK shop Maplin going into administration? Maplin's is the UK's version of Radioshack and might go into administration within 48 hours (https://news.sky.com/story/amp/maplin-in-48-hour-race-to-secure-rescue-deal-with-jaeger-owner-11268634). They have their entire catalogue online, with reviews and information about thousands of products and components. [23:19] Initial look suggests that pages can be loaded fine without js, but reviews and additional info needs js to load. Google search shows possibility of 20,000+ product pages. [23:22] *** fie has joined #archiveteam [23:39] *** Mayonaise has quit IRC (WeeChat 0.3.8) [23:46] *** fie has quit IRC (Ping timeout: 246 seconds) [23:59] It's a big site, but maybe someone could shove it in archivebot?