[00:09] *** Kitaru has quit IRC (Quit: This computer has gone to sleep) [00:24] *** Lune has quit IRC (Quit: Page closed) [00:41] *** JesseW has joined #archiveteam [00:47] *** RichardG has quit IRC (Read error: Operation timed out) [01:09] *** DoomTay has joined #archiveteam [01:38] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [02:05] *** Aranje has joined #archiveteam [02:35] *** ravetcofx has quit IRC (Ping timeout: 506 seconds) [04:03] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:10] *** Sk1d has joined #archiveteam [04:13] *** WinterFox has joined #archiveteam [04:38] *** ravetcofx has joined #archiveteam [05:00] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [05:08] *** Sk1d has joined #archiveteam [05:08] *** Sk1d has quit IRC (Connection closed) [05:10] *** Sk1d has joined #archiveteam [05:17] *** DiscantX has joined #archiveteam [05:31] *** VADemon has joined #archiveteam [05:40] *** DiscantX has quit IRC (Ping timeout: 244 seconds) [05:43] *** Emcy has quit IRC (Read error: Operation timed out) [05:48] *** Ymgve has quit IRC () [05:49] *** Ymgve has joined #archiveteam [06:09] *** vtyl has joined #archiveteam [06:18] *** lytv has quit IRC (Read error: Operation timed out) [06:38] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:08] *** Arcai has joined #archiveteam [07:10] *** DoomTay has quit IRC (Quit: Page closed) [08:14] *** BlueMaxim has joined #archiveteam [08:38] *** Emcy has joined #archiveteam [08:42] Let's say that a website that's closing up shop wants to aid an effort to archive itself. Has Archive Team been involved in such a situation before? [08:49] *** atomotic has joined #archiveteam [08:50] Arcai: i believe so, but you'll want to speak with someone other than me [08:57] How big is the site, Arcai ? [08:59] On the order of single-digit terabytes. [09:00] So, probably a millions of pages? [09:00] Yeah. [09:01] #archivebot won’t work then, I guess. [09:02] It's purely hypothetical at this point but I'm making a last-ditch contingency plan for an organization that hosts a lot of content that I'd hate to have vanish in the event that it cannot continue its own operations in any way. [09:02] might it be worth a "just in case" download then? [09:05] It kind of depends on the site. If you have enumerable objects (images, videos, …) we usually make a Warrior project (distributed crawling). [09:05] It's in no danger at this point. My question was more directed at whether there's something I can include in the plan to make ArchiveTeam's job easier should it ever come to that. [09:06] Early shutdown notification in this channel. [09:07] Disable Cloudflare DDoS protection (the captcha thing). [09:07] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [09:08] Dont be a dickhole when our crawl causes higher than normal load [09:08] If you’re very forthcoming: A URL/item list and or complete sitemap. [09:09] I was thinking of things like some form of database dumps and access to domains. [09:12] You’re free to upload a database dump to archive.org if you want to. [09:19] *** BartoCH has joined #archiveteam [09:20] bzc6p: if you want a rsync target for rsyncing the lists to my server let me know [09:26] All right. Thanks. :) [09:27] I'll make sure that advance notice is part of the plan. [09:40] *** Emcy has quit IRC (Read error: Operation timed out) [10:06] *** Arcai has quit IRC (Ping timeout: 268 seconds) [10:22] *** dxrt- sets mode: +o dxrt [10:29] *** VADemon has quit IRC (Quit: left4dead) [10:31] *** RichardG has joined #archiveteam [11:06] *** Emcy has joined #archiveteam [11:06] *** fie has quit IRC (Ping timeout: 370 seconds) [11:22] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:33] *** zhongfu has quit IRC (Ping timeout: 260 seconds) [11:38] *** zhongfu has joined #archiveteam [11:44] *** zhongfu has quit IRC (Remote host closed the connection) [11:58] *** zhongfu has joined #archiveteam [12:03] *** zhongfu has quit IRC (Remote host closed the connection) [12:15] *** zhongfu has joined #archiveteam [12:45] *** RichardG_ has joined #archiveteam [12:45] *** RichardG has quit IRC (Read error: Connection reset by peer) [12:54] *** zhongfu has quit IRC (Remote host closed the connection) [12:56] *** zhongfu has joined #archiveteam [12:56] *** mutoso has quit IRC (Read error: Operation timed out) [12:57] *** mutoso has joined #archiveteam [13:09] *** vitzli has joined #archiveteam [13:21] *** BlueMaxim has quit IRC (Quit: Leaving) [13:25] *** WinterFox has quit IRC (Read error: Operation timed out) [13:54] *** RichardG_ has quit IRC (Read error: Operation timed out) [13:55] *** RichardG has joined #archiveteam [14:16] *** nwf__ has joined #archiveteam [14:19] *** nwf_ has quit IRC (Read error: Operation timed out) [14:56] *** metalcamp has joined #archiveteam [15:07] *** DoomTay has joined #archiveteam [15:50] *** Aranje has quit IRC (Quit: Three sheets to the wind) [15:50] *** JesseW has joined #archiveteam [16:09] *** JesseW has quit IRC (Ping timeout: 370 seconds) [16:14] *** SN4T14 has quit IRC (Ping timeout: 370 seconds) [16:52] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [16:53] *** RichardG has joined #archiveteam [16:58] *** mutoso has quit IRC (Read error: Operation timed out) [17:04] *** DiscantX has joined #archiveteam [17:06] *** mutoso has joined #archiveteam [17:18] *** atomotic has joined #archiveteam [17:25] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [17:55] *** Sue_ has quit IRC (Read error: Operation timed out) [18:08] *** Sue_ has joined #archiveteam [18:09] *** tomwsmf-a has joined #archiveteam [18:36] *** JesseW has joined #archiveteam [18:37] *** RedType has quit IRC (Ping timeout: 260 seconds) [18:47] *** DiscantX has quit IRC (Ping timeout: 244 seconds) [18:48] *** RedType has joined #archiveteam [19:18] *** DiscantX has joined #archiveteam [19:18] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [19:26] *** vitzli has quit IRC (Leaving) [20:09] *** anjacks0n has joined #archiveteam [20:27] *** Start has quit IRC (Quit: Disconnected.) [20:30] *** Start has joined #archiveteam [20:57] *** DiscantX has quit IRC (Ping timeout: 244 seconds) [20:57] *** metal_cam has joined #archiveteam [21:00] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [21:05] *** anjacks0n has quit IRC (anjacks0n) [21:07] *** metal_cam has quit IRC (Ping timeout: 244 seconds) [21:37] *** anjacks0n has joined #archiveteam [21:47] *** godane has quit IRC (Leaving.) [22:16] *** ndiddy has joined #archiveteam [22:18] *** DoomTay has quit IRC (Quit: Page closed) [22:22] *** Jeroen52 has joined #archiveteam [23:22] *** godane has joined #archiveteam [23:24] *** anjacks0n has quit IRC (anjacks0n) [23:33] *** anjacks0n has joined #archiveteam [23:47] *** anjacks0n has quit IRC (anjacks0n)