#archiveteam-bs 2015-11-24,Tue

↑back Search

Time Nickname Message
00:14 🔗 w0rp has joined #archiveteam-bs
00:21 🔗 aaaaaaaa_ has joined #archiveteam-bs
00:27 🔗 aaaaaaaaa has quit IRC (Read error: Operation timed out)
00:37 🔗 godane so the dailymail.co.uk daily sitemap daily dumps are really getting big
00:38 🔗 godane some are bigger then 200mb after 2012-04
00:39 🔗 aaaaaaaa_ is now known as aaaaaaaaa
00:41 🔗 superkuh has joined #archiveteam-bs
00:58 🔗 bwn has quit IRC (Ping timeout: 252 seconds)
01:00 🔗 Microguru has joined #archiveteam-bs
01:24 🔗 bwn has joined #archiveteam-bs
01:39 🔗 JesseW has joined #archiveteam-bs
02:02 🔗 primus104 has quit IRC (Leaving.)
02:04 🔗 godane so the first 6 months of dailymail.co.uk 2011 was 16gb
02:05 🔗 godane the last 6 months of 2011 was 21gb
02:05 🔗 godane first 6 months of 2012 is close to 30gb
02:06 🔗 godane THE MORE YOU KNOW
02:10 🔗 JesseW :-)
02:44 🔗 JesseW has quit IRC (Leaving.)
03:14 🔗 remsen has quit IRC (Read error: Operation timed out)
03:28 🔗 JesseW has joined #archiveteam-bs
03:31 🔗 bwn has quit IRC (Ping timeout: 606 seconds)
03:39 🔗 remsen has joined #archiveteam-bs
03:39 🔗 Sk1d has quit IRC (Ping timeout: 252 seconds)
04:30 🔗 kyan_ has joined #archiveteam-bs
04:35 🔗 kyan has quit IRC (Read error: Operation timed out)
04:52 🔗 aaaaaaaaa has quit IRC (Leaving)
05:06 🔗 GLaDOS has quit IRC (Ping timeout: 252 seconds)
05:06 🔗 GLaDOS has joined #archiveteam-bs
05:06 🔗 midas sets mode: +o GLaDOS
05:14 🔗 Apathy has quit IRC (Read error: Operation timed out)
05:14 🔗 afics has quit IRC (Read error: Operation timed out)
05:14 🔗 limebyte has quit IRC (hub.dk irc.homelien.no)
05:14 🔗 altlabel has quit IRC (hub.dk irc.homelien.no)
05:14 🔗 PurpleSym has quit IRC (hub.dk irc.homelien.no)
05:14 🔗 i0npulse has quit IRC (hub.dk irc.homelien.no)
05:14 🔗 yipdw has quit IRC (hub.dk irc.homelien.no)
05:14 🔗 chfoo- has quit IRC (hub.dk irc.homelien.no)
05:14 🔗 PotcFdk has quit IRC (hub.dk irc.homelien.no)
05:15 🔗 xmc has quit IRC (Read error: Operation timed out)
05:15 🔗 afics has joined #archiveteam-bs
05:16 🔗 xmc has joined #archiveteam-bs
05:17 🔗 Apathy has joined #archiveteam-bs
05:29 🔗 GLaDOS has quit IRC (Read error: Operation timed out)
05:29 🔗 GLaDOS has joined #archiveteam-bs
05:29 🔗 midas sets mode: +o GLaDOS
05:35 🔗 GLaDOS has quit IRC (Ping timeout: 252 seconds)
05:42 🔗 GLaDOS has joined #archiveteam-bs
05:42 🔗 midas sets mode: +o GLaDOS
05:48 🔗 GLaDOS has quit IRC (Read error: Operation timed out)
05:53 🔗 GLaDOS has joined #archiveteam-bs
05:53 🔗 midas sets mode: +o GLaDOS
05:55 🔗 Coderjoe has quit IRC (Read error: Connection reset by peer)
06:00 🔗 Coderjoe has joined #archiveteam-bs
06:04 🔗 Microguru has quit IRC (Quit: Microguru)
06:05 🔗 remsen has quit IRC (Read error: Connection reset by peer)
06:10 🔗 PotcFdk has joined #archiveteam-bs
06:10 🔗 limebyte has joined #archiveteam-bs
06:10 🔗 altlabel has joined #archiveteam-bs
06:10 🔗 PurpleSym has joined #archiveteam-bs
06:10 🔗 i0npulse has joined #archiveteam-bs
06:10 🔗 yipdw has joined #archiveteam-bs
06:10 🔗 chfoo- has joined #archiveteam-bs
06:10 🔗 irc.homelien.no sets mode: +oo yipdw chfoo-
07:14 🔗 JesseW kyan_: regarding broken links on the archiveteam wiki -- it'd be good to contact some skilled mediawiki bot writer and ask if they'd be willing to set up a bot to regularly go through the whole wiki and make sure all external links use the {{url}} template (which adds links to Wayback, WebCite & archive.today) and that at least one (or better, all three) have at least one copy of the link.
07:15 🔗 JesseW (Also, it'd be good to stuff more separate archiving services into {{url}} -- There's freezepage, one that someone mentioned a few days ago as being used heavily in japan, I think)
07:15 🔗 kyan_ Yeah! that's a good idea.
07:16 🔗 * JesseW goes off to https://en.wikipedia.org/wiki/Wikipedia:Bot_requests
07:29 🔗 JesseW OK, request added: https://en.wikipedia.org/wiki/Wikipedia:Bot_requests#Offsite:_Linkrot_avoiding_bot
07:37 🔗 bwn has joined #archiveteam-bs
07:39 🔗 GLaDOS has quit IRC (Read error: Operation timed out)
07:50 🔗 primus104 has joined #archiveteam-bs
07:53 🔗 GLaDOS has joined #archiveteam-bs
07:53 🔗 midas sets mode: +o GLaDOS
08:20 🔗 remsen has joined #archiveteam-bs
08:21 🔗 JesseW has quit IRC (Leaving.)
08:40 🔗 primus104 has quit IRC (Leaving.)
08:48 🔗 Sk1d has joined #archiveteam-bs
09:00 🔗 kyan_ has quit IRC (Leaving)
09:03 🔗 PotcFdk has quit IRC (Ping timeout: 506 seconds)
09:08 🔗 bwn has quit IRC (Read error: Operation timed out)
09:09 🔗 PotcFdk has joined #archiveteam-bs
09:10 🔗 GLaDOS has quit IRC (Ping timeout: 252 seconds)
09:12 🔗 GLaDOS has joined #archiveteam-bs
09:12 🔗 midas sets mode: +o GLaDOS
09:30 🔗 PotcFdk has quit IRC (Ping timeout: 506 seconds)
09:39 🔗 bwn has joined #archiveteam-bs
09:56 🔗 PotcFdk has joined #archiveteam-bs
10:00 🔗 primus104 has joined #archiveteam-bs
10:01 🔗 xmc has quit IRC (Read error: Operation timed out)
10:02 🔗 remsen has quit IRC (Read error: Operation timed out)
10:03 🔗 schbirid has joined #archiveteam-bs
10:04 🔗 xmc has joined #archiveteam-bs
10:05 🔗 PotcFdk has quit IRC (Ping timeout: 506 seconds)
10:05 🔗 BlueMaxim has quit IRC (Quit: Leaving)
10:11 🔗 PotcFdk has joined #archiveteam-bs
10:46 🔗 arkiver A russia warplane is shot down by Turkey
10:49 🔗 schbirid America taking Thanksgiving a step too far?
11:11 🔗 HCross has quit IRC (Read error: Connection reset by peer)
11:13 🔗 SilSte has joined #archiveteam-bs
11:20 🔗 HCross has joined #archiveteam-bs
11:20 🔗 HCross welp, that was a BSOD
12:31 🔗 remsen has joined #archiveteam-bs
13:31 🔗 remsen2 has joined #archiveteam-bs
13:33 🔗 primus104 has quit IRC (Leaving.)
13:34 🔗 remsen has quit IRC (Read error: Operation timed out)
13:41 🔗 remsen has joined #archiveteam-bs
13:43 🔗 remsen2 has quit IRC (Read error: Operation timed out)
14:07 🔗 primus104 has joined #archiveteam-bs
14:21 🔗 vitzli has joined #archiveteam-bs
14:58 🔗 primus104 has quit IRC (Leaving.)
15:07 🔗 cvb has joined #archiveteam-bs
15:10 🔗 godane so i'm grabbing the joe pags show
15:11 🔗 godane the good news is maybe able to get all of 2014
15:11 🔗 godane the bad news is 2013 and 2015 are going be incomplete most likely
16:12 🔗 superkuh has quit IRC (Read error: Operation timed out)
16:30 🔗 Start has quit IRC (Quit: Disconnected.)
16:55 🔗 remsen has quit IRC (Read error: Operation timed out)
17:04 🔗 JesseW has joined #archiveteam-bs
17:06 🔗 luckcolor has joined #archiveteam-bs
17:06 🔗 luckcolor i already seeen that trhead
17:07 🔗 phuzion Those are basically the solid recommendations for a windows client.
17:07 🔗 luckcolor mmh what are you using?
17:08 🔗 phuzion I use a system called Quassel (http://quassel-irc.org/) but that requires a bit more setup, because I access IRC from multiple locations throughout the day.
17:09 🔗 luckcolor i guess i coul try to fire it up.
17:09 🔗 phuzion Unless you've got a machine that's constantly online, it's probably not worth it, tbqh.
17:11 🔗 phuzion Quassel is a two-part system. One side is a core, which actually handles the connections to the IRC servers themselves, and speaks the IRC protocol to those servers. Then you have the clients, which connect to the core, and act as the user interface. So, my computer isn't directly connected to any of the IRC servers that I'm on right now.
17:11 🔗 luckcolor Ok i understand.
17:11 🔗 luckcolor So i8 there a public quassel node for achiveteam?
17:12 🔗 phuzion No.
17:12 🔗 phuzion I run my quasselcore myself.
17:12 🔗 luckcolor Ok
17:12 🔗 luckcolor I have a hosted server i will fire one there.
17:13 🔗 luckcolor Thank you! I'll see how it goes from there
17:14 🔗 vitzli has quit IRC (Leaving)
17:24 🔗 JesseW has quit IRC (Leaving.)
17:43 🔗 Start has joined #archiveteam-bs
18:02 🔗 luckcolor has quit IRC (Quit: Page closed)
18:03 🔗 HCross arkiver, im working on a image for Scaleway servers that has all the pre-requisites setup for archiving
18:03 🔗 arkiver Nice!
18:03 🔗 HCross so you will be able to deploy that, then download whatever script you want on it for the project, then off it goes
18:04 🔗 SimpBrain pre-built warrior? nice
18:04 🔗 HCross Initally, there will be some manual work setting each one going
18:05 🔗 HCross once I get my head around their docker setup
18:05 🔗 SimpBrain probably a shell script for initial config like username and how many concurrent etc
18:07 🔗 arkiver HCross: awesome you're working on that!
18:08 🔗 HCross yeah, it will take some time to polish
18:08 🔗 HCross �3 plus VAT for 20/40 workers depending on the task, heck yeah
18:09 🔗 schbirid matrix.org is a great irc successor imo
18:09 🔗 HCross arkiver, I cant do anything on it atm. There are no servers and IPs left
18:10 🔗 primus104 has joined #archiveteam-bs
18:11 🔗 arkiver HCross: that's ok
18:17 🔗 SimpBrain slack.com i use for an online irc, free version is ok and has a irc bridge/gateway
18:18 🔗 schbirid slack is proprietary
18:19 🔗 xmc yes
18:31 🔗 SN4T14 has joined #archiveteam-bs
18:33 🔗 SketchCow ha ha
18:33 🔗 SketchCow OH NO PROPRIETARY
18:35 🔗 Start has quit IRC (Quit: Disconnected.)
18:44 🔗 phuzion HCross: Have you looked at my ansible deployment script?
18:44 🔗 HCross I havent
18:45 🔗 phuzion HCross: https://clbin.com/H1WWC
18:46 🔗 phuzion It's currently designed to work on CentOS 6.7 systems, but with a few conditionals, I could make it work on Debian, Fedora, Ubuntu, etc.
18:47 🔗 HCross phuzion, can I borrow from that for Scaleway? I need to change it to call the network internal Ip and bind to that
18:47 🔗 phuzion Go for it. Want me to put it up on a github repo so people can contribute to ot?
18:47 🔗 phuzion it*
18:48 🔗 HCross Yes please.
18:48 🔗 achip I've also got a couple additions for log streaming I was going to add
18:48 🔗 HCross Can we have a github, so we can sort it together
18:50 🔗 phuzion https://github.com/phuzion/archiveteam-deploy
18:50 🔗 phuzion Feel free to make pull requests and whatnot.
18:53 🔗 HCross ive just forked it
18:54 🔗 phuzion Cool.
18:59 🔗 SimpBrain might fire up another vps later this week
18:59 🔗 SimpBrain hoping for a good black friday deal
19:03 🔗 primus104 has quit IRC (Leaving.)
19:11 🔗 aaaaaaaaa has joined #archiveteam-bs
19:18 🔗 bwn has quit IRC (Read error: Operation timed out)
19:33 🔗 HCross Hostage situation in Roubaix
19:33 🔗 SimpBrain :o
19:34 🔗 HCross Sky news: "Its a bank director and his family"
19:40 🔗 bwn has joined #archiveteam-bs
19:53 🔗 primus104 has joined #archiveteam-bs
19:58 🔗 Stiletto has quit IRC (Ping timeout: 255 seconds)
20:02 🔗 useretail hey, does anyone know why i'm getting this error: requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine("''",))
20:02 🔗 useretail just upgraded ia to 0.9.8
20:05 🔗 useretail complete log: http://pastebin.com/UqpgfCPy
20:09 🔗 useretail hmm.. now 'ia configure' worked, but 'ia tasks' still fails
20:22 🔗 Stiletto has joined #archiveteam-bs
21:02 🔗 Start has joined #archiveteam-bs
21:19 🔗 schbirid has quit IRC (Quit: Leaving)
21:37 🔗 aaaaaaaaa has quit IRC (Ping timeout: 615 seconds)
21:43 🔗 superkuh has joined #archiveteam-bs
21:46 🔗 yipdw woohoo prgmr just doubled my VPS' RAM for $0
21:46 🔗 bwn has quit IRC (Quit: Leaving)
21:48 🔗 SimpBrain more concurrent jobs! :P
21:48 🔗 yipdw nah, all that VPS runs is, like, quasselcore
21:48 🔗 aaaaaaaaa has joined #archiveteam-bs
21:49 🔗 yipdw and bitlbee and ejabberd and other things that now use a laughably small amount of RAM
21:49 🔗 yipdw has quit IRC (Read error: Connection reset by peer)
21:50 🔗 yipdw has joined #archiveteam-bs
22:05 🔗 aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
22:05 🔗 aaaaaaaaa has joined #archiveteam-bs
22:10 🔗 remsen has joined #archiveteam-bs
22:17 🔗 Start has quit IRC (Quit: Disconnected.)
22:23 🔗 aaaaaaaaa has quit IRC (Read error: Operation timed out)
22:29 🔗 godane has quit IRC (Read error: Operation timed out)
22:40 🔗 Kenshin has quit IRC (Ping timeout: 252 seconds)
22:40 🔗 Kenshin has joined #archiveteam-bs
22:52 🔗 bwn has joined #archiveteam-bs
23:12 🔗 BlueMaxim has joined #archiveteam-bs
23:34 🔗 aaaaaaaaa has joined #archiveteam-bs
23:37 🔗 antomati_ is now known as antomatic
23:48 🔗 Start has joined #archiveteam-bs
23:57 🔗 cvb has quit IRC (Read error: Operation timed out)

irclogger-viewer