[00:14] *** w0rp has joined #archiveteam-bs [00:21] *** aaaaaaaa_ has joined #archiveteam-bs [00:27] *** aaaaaaaaa has quit IRC (Read error: Operation timed out) [00:37] so the dailymail.co.uk daily sitemap daily dumps are really getting big [00:38] some are bigger then 200mb after 2012-04 [00:39] *** aaaaaaaa_ is now known as aaaaaaaaa [00:41] *** superkuh has joined #archiveteam-bs [00:58] *** bwn has quit IRC (Ping timeout: 252 seconds) [01:00] *** Microguru has joined #archiveteam-bs [01:24] *** bwn has joined #archiveteam-bs [01:39] *** JesseW has joined #archiveteam-bs [02:02] *** primus104 has quit IRC (Leaving.) [02:04] so the first 6 months of dailymail.co.uk 2011 was 16gb [02:05] the last 6 months of 2011 was 21gb [02:05] first 6 months of 2012 is close to 30gb [02:06] THE MORE YOU KNOW [02:10] :-) [02:44] *** JesseW has quit IRC (Leaving.) [03:14] *** remsen has quit IRC (Read error: Operation timed out) [03:28] *** JesseW has joined #archiveteam-bs [03:31] *** bwn has quit IRC (Ping timeout: 606 seconds) [03:39] *** remsen has joined #archiveteam-bs [03:39] *** Sk1d has quit IRC (Ping timeout: 252 seconds) [04:30] *** kyan_ has joined #archiveteam-bs [04:35] *** kyan has quit IRC (Read error: Operation timed out) [04:52] *** aaaaaaaaa has quit IRC (Leaving) [05:06] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [05:06] *** GLaDOS has joined #archiveteam-bs [05:06] *** midas sets mode: +o GLaDOS [05:14] *** Apathy has quit IRC (Read error: Operation timed out) [05:14] *** afics has quit IRC (Read error: Operation timed out) [05:14] *** limebyte has quit IRC (hub.dk irc.homelien.no) [05:14] *** altlabel has quit IRC (hub.dk irc.homelien.no) [05:14] *** PurpleSym has quit IRC (hub.dk irc.homelien.no) [05:14] *** i0npulse has quit IRC (hub.dk irc.homelien.no) [05:14] *** yipdw has quit IRC (hub.dk irc.homelien.no) [05:14] *** chfoo- has quit IRC (hub.dk irc.homelien.no) [05:14] *** PotcFdk has quit IRC (hub.dk irc.homelien.no) [05:15] *** xmc has quit IRC (Read error: Operation timed out) [05:15] *** afics has joined #archiveteam-bs [05:16] *** xmc has joined #archiveteam-bs [05:17] *** Apathy has joined #archiveteam-bs [05:29] *** GLaDOS has quit IRC (Read error: Operation timed out) [05:29] *** GLaDOS has joined #archiveteam-bs [05:29] *** midas sets mode: +o GLaDOS [05:35] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [05:42] *** GLaDOS has joined #archiveteam-bs [05:42] *** midas sets mode: +o GLaDOS [05:48] *** GLaDOS has quit IRC (Read error: Operation timed out) [05:53] *** GLaDOS has joined #archiveteam-bs [05:53] *** midas sets mode: +o GLaDOS [05:55] *** Coderjoe has quit IRC (Read error: Connection reset by peer) [06:00] *** Coderjoe has joined #archiveteam-bs [06:04] *** Microguru has quit IRC (Quit: Microguru) [06:05] *** remsen has quit IRC (Read error: Connection reset by peer) [06:10] *** PotcFdk has joined #archiveteam-bs [06:10] *** limebyte has joined #archiveteam-bs [06:10] *** altlabel has joined #archiveteam-bs [06:10] *** PurpleSym has joined #archiveteam-bs [06:10] *** i0npulse has joined #archiveteam-bs [06:10] *** yipdw has joined #archiveteam-bs [06:10] *** chfoo- has joined #archiveteam-bs [06:10] *** irc.homelien.no sets mode: +oo yipdw chfoo- [07:14] kyan_: regarding broken links on the archiveteam wiki -- it'd be good to contact some skilled mediawiki bot writer and ask if they'd be willing to set up a bot to regularly go through the whole wiki and make sure all external links use the {{url}} template (which adds links to Wayback, WebCite & archive.today) and that at least one (or better, all three) have at least one copy of the link. [07:15] (Also, it'd be good to stuff more separate archiving services into {{url}} -- There's freezepage, one that someone mentioned a few days ago as being used heavily in japan, I think) [07:15] Yeah! that's a good idea. [07:16] * JesseW goes off to https://en.wikipedia.org/wiki/Wikipedia:Bot_requests [07:29] OK, request added: https://en.wikipedia.org/wiki/Wikipedia:Bot_requests#Offsite:_Linkrot_avoiding_bot [07:37] *** bwn has joined #archiveteam-bs [07:39] *** GLaDOS has quit IRC (Read error: Operation timed out) [07:50] *** primus104 has joined #archiveteam-bs [07:53] *** GLaDOS has joined #archiveteam-bs [07:53] *** midas sets mode: +o GLaDOS [08:20] *** remsen has joined #archiveteam-bs [08:21] *** JesseW has quit IRC (Leaving.) [08:40] *** primus104 has quit IRC (Leaving.) [08:48] *** Sk1d has joined #archiveteam-bs [09:00] *** kyan_ has quit IRC (Leaving) [09:03] *** PotcFdk has quit IRC (Ping timeout: 506 seconds) [09:08] *** bwn has quit IRC (Read error: Operation timed out) [09:09] *** PotcFdk has joined #archiveteam-bs [09:10] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [09:12] *** GLaDOS has joined #archiveteam-bs [09:12] *** midas sets mode: +o GLaDOS [09:30] *** PotcFdk has quit IRC (Ping timeout: 506 seconds) [09:39] *** bwn has joined #archiveteam-bs [09:56] *** PotcFdk has joined #archiveteam-bs [10:00] *** primus104 has joined #archiveteam-bs [10:01] *** xmc has quit IRC (Read error: Operation timed out) [10:02] *** remsen has quit IRC (Read error: Operation timed out) [10:03] *** schbirid has joined #archiveteam-bs [10:04] *** xmc has joined #archiveteam-bs [10:05] *** PotcFdk has quit IRC (Ping timeout: 506 seconds) [10:05] *** BlueMaxim has quit IRC (Quit: Leaving) [10:11] *** PotcFdk has joined #archiveteam-bs [10:46] A russia warplane is shot down by Turkey [10:49] America taking Thanksgiving a step too far? [11:11] *** HCross has quit IRC (Read error: Connection reset by peer) [11:13] *** SilSte has joined #archiveteam-bs [11:20] *** HCross has joined #archiveteam-bs [11:20] welp, that was a BSOD [12:31] *** remsen has joined #archiveteam-bs [13:31] *** remsen2 has joined #archiveteam-bs [13:33] *** primus104 has quit IRC (Leaving.) [13:34] *** remsen has quit IRC (Read error: Operation timed out) [13:41] *** remsen has joined #archiveteam-bs [13:43] *** remsen2 has quit IRC (Read error: Operation timed out) [14:07] *** primus104 has joined #archiveteam-bs [14:21] *** vitzli has joined #archiveteam-bs [14:58] *** primus104 has quit IRC (Leaving.) [15:07] *** cvb has joined #archiveteam-bs [15:10] so i'm grabbing the joe pags show [15:11] the good news is maybe able to get all of 2014 [15:11] the bad news is 2013 and 2015 are going be incomplete most likely [16:12] *** superkuh has quit IRC (Read error: Operation timed out) [16:30] *** Start has quit IRC (Quit: Disconnected.) [16:55] *** remsen has quit IRC (Read error: Operation timed out) [17:04] *** JesseW has joined #archiveteam-bs [17:06] *** luckcolor has joined #archiveteam-bs [17:06] i already seeen that trhead [17:07] Those are basically the solid recommendations for a windows client. [17:07] mmh what are you using? [17:08] I use a system called Quassel (http://quassel-irc.org/) but that requires a bit more setup, because I access IRC from multiple locations throughout the day. [17:09] i guess i coul try to fire it up. [17:09] Unless you've got a machine that's constantly online, it's probably not worth it, tbqh. [17:11] Quassel is a two-part system. One side is a core, which actually handles the connections to the IRC servers themselves, and speaks the IRC protocol to those servers. Then you have the clients, which connect to the core, and act as the user interface. So, my computer isn't directly connected to any of the IRC servers that I'm on right now. [17:11] Ok i understand. [17:11] So i8 there a public quassel node for achiveteam? [17:12] No. [17:12] I run my quasselcore myself. [17:12] Ok [17:12] I have a hosted server i will fire one there. [17:13] Thank you! I'll see how it goes from there [17:14] *** vitzli has quit IRC (Leaving) [17:24] *** JesseW has quit IRC (Leaving.) [17:43] *** Start has joined #archiveteam-bs [18:02] *** luckcolor has quit IRC (Quit: Page closed) [18:03] arkiver, im working on a image for Scaleway servers that has all the pre-requisites setup for archiving [18:03] Nice! [18:03] so you will be able to deploy that, then download whatever script you want on it for the project, then off it goes [18:04] pre-built warrior? nice [18:04] Initally, there will be some manual work setting each one going [18:05] once I get my head around their docker setup [18:05] probably a shell script for initial config like username and how many concurrent etc [18:07] HCross: awesome you're working on that! [18:08] yeah, it will take some time to polish [18:08] €3 plus VAT for 20/40 workers depending on the task, heck yeah [18:09] matrix.org is a great irc successor imo [18:09] arkiver, I cant do anything on it atm. There are no servers and IPs left [18:10] *** primus104 has joined #archiveteam-bs [18:11] HCross: that's ok [18:17] slack.com i use for an online irc, free version is ok and has a irc bridge/gateway [18:18] slack is proprietary [18:19] yes [18:31] *** SN4T14 has joined #archiveteam-bs [18:33] ha ha [18:33] OH NO PROPRIETARY [18:35] *** Start has quit IRC (Quit: Disconnected.) [18:44] HCross: Have you looked at my ansible deployment script? [18:44] I havent [18:45] HCross: https://clbin.com/H1WWC [18:46] It's currently designed to work on CentOS 6.7 systems, but with a few conditionals, I could make it work on Debian, Fedora, Ubuntu, etc. [18:47] phuzion, can I borrow from that for Scaleway? I need to change it to call the network internal Ip and bind to that [18:47] Go for it. Want me to put it up on a github repo so people can contribute to ot? [18:47] it* [18:48] Yes please. [18:48] I've also got a couple additions for log streaming I was going to add [18:48] Can we have a github, so we can sort it together [18:50] https://github.com/phuzion/archiveteam-deploy [18:50] Feel free to make pull requests and whatnot. [18:53] ive just forked it [18:54] Cool. [18:59] might fire up another vps later this week [18:59] hoping for a good black friday deal [19:03] *** primus104 has quit IRC (Leaving.) [19:11] *** aaaaaaaaa has joined #archiveteam-bs [19:18] *** bwn has quit IRC (Read error: Operation timed out) [19:33] Hostage situation in Roubaix [19:33] :o [19:34] Sky news: "Its a bank director and his family" [19:40] *** bwn has joined #archiveteam-bs [19:53] *** primus104 has joined #archiveteam-bs [19:58] *** Stiletto has quit IRC (Ping timeout: 255 seconds) [20:02] hey, does anyone know why i'm getting this error: requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine("''",)) [20:02] just upgraded ia to 0.9.8 [20:05] complete log: http://pastebin.com/UqpgfCPy [20:09] hmm.. now 'ia configure' worked, but 'ia tasks' still fails [20:22] *** Stiletto has joined #archiveteam-bs [21:02] *** Start has joined #archiveteam-bs [21:19] *** schbirid has quit IRC (Quit: Leaving) [21:37] *** aaaaaaaaa has quit IRC (Ping timeout: 615 seconds) [21:43] *** superkuh has joined #archiveteam-bs [21:46] woohoo prgmr just doubled my VPS' RAM for $0 [21:46] *** bwn has quit IRC (Quit: Leaving) [21:48] more concurrent jobs! :P [21:48] nah, all that VPS runs is, like, quasselcore [21:48] *** aaaaaaaaa has joined #archiveteam-bs [21:49] and bitlbee and ejabberd and other things that now use a laughably small amount of RAM [21:49] *** yipdw has quit IRC (Read error: Connection reset by peer) [21:50] *** yipdw has joined #archiveteam-bs [22:05] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [22:05] *** aaaaaaaaa has joined #archiveteam-bs [22:10] *** remsen has joined #archiveteam-bs [22:17] *** Start has quit IRC (Quit: Disconnected.) [22:23] *** aaaaaaaaa has quit IRC (Read error: Operation timed out) [22:29] *** godane has quit IRC (Read error: Operation timed out) [22:40] *** Kenshin has quit IRC (Ping timeout: 252 seconds) [22:40] *** Kenshin has joined #archiveteam-bs [22:52] *** bwn has joined #archiveteam-bs [23:12] *** BlueMaxim has joined #archiveteam-bs [23:34] *** aaaaaaaaa has joined #archiveteam-bs [23:37] *** antomati_ is now known as antomatic [23:48] *** Start has joined #archiveteam-bs [23:57] *** cvb has quit IRC (Read error: Operation timed out)