[01:19] *** DopefishJ has joined #internetarchive [01:20] *** DFJustin has quit IRC (Ping timeout: 242 seconds) [02:03] *** Stiletto has joined #internetarchive [02:30] *** Fletcher has quit IRC (Ping timeout: 244 seconds) [02:40] *** Fletcher has joined #internetarchive [02:58] *** yipdw has quit IRC (Ping timeout: 260 seconds) [02:59] *** yipdw has joined #internetarchive [04:21] *** kyan has quit IRC (Read error: Operation timed out) [04:45] *** Stiletto has quit IRC (Read error: Connection reset by peer) [07:21] *** atomotic has joined #internetarchive [10:31] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [12:06] *** atomotic has joined #internetarchive [12:45] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:04] *** atomotic has joined #internetarchive [14:19] *** DopefishJ is now known as DFJustin [14:25] *** REiN^ has quit IRC (Ping timeout: 272 seconds) [15:03] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:50] *** kyounko|2 has joined #internetarchive [15:56] *** Stiletto has joined #internetarchive [15:58] *** BaKFat has joined #internetarchive [17:13] *** Stiletto has quit IRC (Read error: Operation timed out) [17:13] *** Stiletto has joined #internetarchive [17:38] *** Stiletto has quit IRC (Read error: Operation timed out) [17:38] *** Stiletto has joined #internetarchive [18:04] *** Stiletto has quit IRC (Read error: Operation timed out) [18:05] *** Stiletto has joined #internetarchive [19:42] *** kyan has joined #internetarchive [19:56] bay12games.com's robots.txt blocks IA. I asked the owner (Tarn Adams) about it, and he says that the concern is whether or not the site can handle the additional load, given that it can't handle much more than it has already [19:56] Does IA's crawler generate much load? Maybe I can suggest crawl-delay or such? [20:03] he seems open to the idea of changing it. in his words, he just doesn't know anything about how any of this works [20:04] *** matieu has quit IRC (Ping timeout: 366 seconds) [20:51] *** kyounko|2 has quit IRC (Read error: Operation timed out) [20:51] *** kyan has quit IRC (Read error: Operation timed out) [20:53] *** kyan has joined #internetarchive [21:49] *** kyan has quit IRC (Remote host closed the connection) [22:58] *** matieu has joined #internetarchive