[00:12] *** JesseW has joined #archiveteam-bs [00:24] kyan: all of the users with private API privileges, and those who pay for VT Intelligence have access to everything, and likely have copies of everything from when they signed up till now [00:24] Cool! Would be nice to get it into IA [00:26] *** dashcloud has quit IRC (Read error: Operation timed out) [00:39] *** dashcloud has joined #archiveteam-bs [00:50] *** Famicoman has quit IRC (Read error: Operation timed out) [00:52] *** primus104 has quit IRC (Leaving.) [00:52] *** VADemon has quit IRC (Read error: Connection reset by peer) [00:56] *** Fletcher has quit IRC (Read error: Operation timed out) [00:58] *** vtyl has joined #archiveteam-bs [00:59] *** lytv has quit IRC (Ping timeout: 606 seconds) [00:59] *** Fletcher has joined #archiveteam-bs [01:55] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [02:11] *** zenguy_pc has joined #archiveteam-bs [02:11] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [02:21] *** zhongfu has quit IRC (Read error: Operation timed out) [02:22] *** zhongfu has joined #archiveteam-bs [02:28] *** zenguy_pc has joined #archiveteam-bs [02:52] *** Stiletto has quit IRC (Read error: Connection reset by peer) [02:52] *** Stiletto has joined #archiveteam-bs [03:21] *** chfoo has joined #archiveteam-bs [03:30] *** Famicoman has joined #archiveteam-bs [03:59] *** Stilett0 has joined #archiveteam-bs [04:02] *** Stiletto has quit IRC (Read error: Connection reset by peer) [04:28] *** aaaaaaaaa has quit IRC (Read error: Operation timed out) [05:11] *** Sk1d has quit IRC (Read error: Operation timed out) [05:17] *** remsen has joined #archiveteam-bs [05:29] *** remsen has quit IRC (Leaving) [06:16] *** Sk1d has joined #archiveteam-bs [06:36] *** remsen has joined #archiveteam-bs [06:56] *** arkiver2 has joined #archiveteam-bs [07:00] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [07:20] *** remsen has quit IRC (Leaving) [07:24] *** JesseW has quit IRC (Leaving.) [07:42] *** remsen has joined #archiveteam-bs [07:43] *** primus104 has joined #archiveteam-bs [08:04] *** remsen2 has joined #archiveteam-bs [08:07] *** godane has left [08:08] *** remsen has quit IRC (Read error: Operation timed out) [08:19] *** R5M has joined #archiveteam-bs [08:22] *** R5M has quit IRC (Client Quit) [08:25] *** remsen2 has quit IRC (Read error: Operation timed out) [08:30] *** arkiver2 has joined #archiveteam-bs [09:15] *** godane has joined #archiveteam-bs [09:28] *** schbirid has joined #archiveteam-bs [09:51] *** remsen has joined #archiveteam-bs [10:45] *** primus104 has quit IRC (Leaving.) [11:15] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [11:45] *** kyan has quit IRC (Remote host closed the connection) [11:46] *** kyan has joined #archiveteam-bs [11:53] *** kyan is now known as kyna [11:53] *** kyna is now known as kyan [11:54] *** arkiver2 has joined #archiveteam-bs [12:01] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [12:13] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [12:22] *** is-_ has joined #archiveteam-bs [12:55] *** arkiver2 has joined #archiveteam-bs [13:10] *** toad1 has quit IRC (Read error: Operation timed out) [13:30] *** arkiver2 has quit IRC (Quit: Nettalk6 - www.ntalk.de) [13:35] *** vtyl has quit IRC (Read error: Operation timed out) [13:38] *** lytv has joined #archiveteam-bs [14:00] *** primus104 has joined #archiveteam-bs [14:04] *** toad1 has joined #archiveteam-bs [14:47] *** primus104 has quit IRC (Leaving.) [15:17] https://archive.org/download/archiveteam_archivebot_go_20151018060001/www.cameronsworld.net-inf-20151017-191612-daeph-00000.warc.gz.png [15:21] *** ersi has joined #archiveteam-bs [15:21] *** midas sets mode: +o ersi [16:06] *** Fletcher has quit IRC (Ping timeout: 252 seconds) [16:06] *** diacope has quit IRC (Ping timeout: 252 seconds) [16:20] *** JesseW has joined #archiveteam-bs [16:42] *** primus104 has joined #archiveteam-bs [16:45] *** primus105 has joined #archiveteam-bs [16:49] *** primus104 has quit IRC (Read error: Operation timed out) [16:49] *** kyan_ has joined #archiveteam-bs [16:54] *** kyan_ has quit IRC (Leaving) [16:54] *** kyan has quit IRC (Ping timeout: 615 seconds) [16:55] *** JesseW has quit IRC (Leaving.) [17:10] *** kyan has joined #archiveteam-bs [17:40] *** MrRadar has quit IRC (Read error: Operation timed out) [17:42] Ha HA infocom thing breaks wide [17:51] I like how every time archivebot gets publicized, anime gets super double covered [17:56] haha [17:56] also, archivebot got coverage? [17:56] just some textfiles tweets [17:56] ah :P [18:04] I am going to take several runs at expanding our contribution pool. [18:04] It'll take a bit, since we're assholes [18:04] But that's like any relationship [18:06] *** MrRadar has joined #archiveteam-bs [18:07] we're also running right up against our current pipeline limits in terms of number of jobs so we might need to solicit more volunteers on the supply side [18:08] Can I get a phrasing (here or elsewhere) of what makes a good pipeline machine? [18:12] http://archiveteam.org/index.php?title=ArchiveBot#Volunteer_a_Node [18:12] I think the disk space requirement is more relaxed now though since jobs upload off every 5gb [18:17] so you need around 5gb * number of jobs * slop factor for slow upload / fos down [18:18] 100gb? [18:19] sounds reasonable [18:19] makes it easier for people to run vps's then [18:19] real numbers can be computed from http://dashboard.at.ninjawedding.org/pipelines but I'm too lazy [18:21] over half the pipelines are not over 250gb [18:22] some of them are ao-only [18:23] it can filter single links to only run on them pipelines? [18:25] yes [18:27] think the pipelines need to be split in 3 sections [18:28] SketchCow: the big one is continued availability. [18:28] <100gb for ao only, 100-500gb for general websites, 500gb+ should be newly tagged for big sites and longer jobs [18:28] Hi, Can anyone get https://web.archive.org/web/20151121091555/https://www.youtube.com/watch?v=WdkLJrz4jJY to play? [18:29] error [18:29] hmm, is there any way that that and https://web.archive.org/web/20151117045619/https://www.youtube.com/watch?v=E6HqZgWPTT0 can be seen. Both videos are now private [18:38] +1 SimpBrai1 [18:40] hmm. Anyone can think of a way to get to the backend video? [18:53] *** primus105 has quit IRC (Leaving.) [19:24] *** RedType_ has quit IRC (leaving) [19:27] We got mentioned by @HNTitles :) https://twitter.com/HNTitles/status/668872113655296000 [19:28] (It's a markov chain twitter bot to generate HackerNews article titles, nothing significant) [19:31] *** primus104 has joined #archiveteam-bs [19:32] lol [19:35] *** RedType has joined #archiveteam-bs [19:42] *** Start has quit IRC (Read error: Connection reset by peer) [19:43] *** Start has joined #archiveteam-bs [19:53] *** SimpBrai1 has quit IRC (Leaving) [19:54] *** SimpBrain has joined #archiveteam-bs [20:11] *** diacope has joined #archiveteam-bs [20:11] *** Fletcher has joined #archiveteam-bs [20:34] *** RedType has quit IRC (Changing server) [20:35] *** RedType has joined #archiveteam-bs [20:36] *** RedType has quit IRC (Remote host closed the connection) [20:41] *** schbirid has quit IRC (Quit: Leaving) [21:15] *** Zebranky_ is now known as Zebranky [21:59] *** BlueMaxim has joined #archiveteam-bs [22:09] *** RedType has joined #archiveteam-bs [22:23] *** SilSte has quit IRC (Read error: Connection reset by peer) [22:44] *** remsen has quit IRC (Read error: Operation timed out) [23:08] *** bwn has joined #archiveteam-bs [23:27] *** remsen has joined #archiveteam-bs [23:29] *** Stilett0 is now known as Stiletto [23:47] *** aaaaaaaaa has joined #archiveteam-bs