[00:36] *** fredgido has quit IRC (Read error: Operation timed out) [01:18] *** luckcolor has joined #internetarchive [03:03] Hi, folks. [03:04] So, copying over what I said elsewhere: [03:04] We had a fiber cut 1.1km from the data center, at a junction box, in Richmond CA (which is different than the Richmond District of SF, which is where HQ is). [03:04] The fiber people took a fucking nap and spent 12 hours before they got someone to fly in and fix it and do the splicing, I expect yelling [03:04] Once they actually showed, they fixed it in about 2 hours. [03:04] Both datacenters (SF and Richmond) stayed up during all this, so some functions stayed going, because they used minor connections. [03:04] We TRIED to shift things to our smaller connections, but as you can imagine, The Archive bandwidth is no small fuckin' potatoes. So TV worked, the rest didn't. [03:05] There you go. Ideally, we will shore up some way of producing an "Archive Lite" version that comes up when part of the system is down. [03:05] We'll see how that goes. Our disaster recovery is variant levels. [03:38] *** odemg has quit IRC (Ping timeout: 265 seconds) [03:41] *** qw3rty118 has joined #internetarchive [03:48] *** qw3rty117 has quit IRC (Read error: Operation timed out) [03:50] *** odemg has joined #internetarchive [06:11] *** Fusl has quit IRC (Read error: Operation timed out) [06:13] *** balrog has quit IRC (Read error: Operation timed out) [06:13] *** balrog has joined #internetarchive [06:13] *** Fusl has joined #internetarchive [06:13] *** Fusl_ sets mode: +o Fusl [06:14] *** dxrt_ has quit IRC (Read error: Operation timed out) [06:15] *** kiska1 has quit IRC (Read error: Operation timed out) [06:17] *** qw3rty118 has quit IRC (Read error: Operation timed out) [06:18] *** ats_ has joined #internetarchive [06:21] *** ats has quit IRC (Read error: Operation timed out) [06:21] *** agfa has quit IRC (Ping timeout: 600 seconds) [06:36] *** Fusl2 has joined #internetarchive [06:36] *** agfa has joined #internetarchive [06:37] *** jrwr has quit IRC (Ping timeout: 264 seconds) [06:40] *** astrid has quit IRC (Read error: Operation timed out) [06:44] *** dxrt_ has joined #internetarchive [06:44] *** dxrt sets mode: +o dxrt_ [06:44] *** Fusl sets mode: +o dxrt_ [07:28] *** jrwr has joined #internetarchive [07:28] *** Fusl sets mode: +o jrwr [07:48] *** astrid has joined #internetarchive [07:48] *** Fusl sets mode: +o astrid [08:27] *** deevious has joined #internetarchive [13:28] jrwr: Where's this graph from? https://twitter.com/jrwr/status/1143618302826164224 [13:28] https://archive.org/stats/ [13:29] I got yelled at by SketchCow last time I linked that page on reddit, so I stuck to a screenshot [13:29] Cool, thanks. [13:30] Moar graphs. [13:30] if you dig deeper you can find their public graphing system [13:32] its surprisingly easy to get yelled at by SketchCow, i feel like its sometimes enough to just highlight him on irc to get things rolling [13:32] oh crap [13:34] lol [13:34] I've met him in person, hes a great guy [13:34] That beard of his is epic [13:39] Lots of interesting stuff in those graph. I wonder what causes the daily peak in WBM requests around 16:00 local time. [13:39] graphs* [13:40] Also, some of the graphs are broken when switching to UTC. :-( [13:41] who needs UTC, right? [13:42] Yeah, let's specify everything in "Pacific time" because everyone always knows whether that's PST or PDT. [13:42] Or better yet, specify it in some time zone but don't tell which it is (Twitter). [14:21] pacific time is great [14:21] very convenient for me [17:04] *** Dj-Wawa has joined #internetarchive [19:35] *** atbrdg has joined #internetarchive [19:48] *** atbrdg has quit IRC (Remote host closed the connection) [19:54] *** atbrdg has joined #internetarchive [19:54] *** atbrdg has quit IRC (Remote host closed the connection) [20:01] *** atbrdg has joined #internetarchive [20:06] *** atbrdg has quit IRC (Remote host closed the connection) [20:08] *** atbrdg has joined #internetarchive [20:11] *** atbrdg has quit IRC (Remote host closed the connection) [20:21] *** atbrdg has joined #internetarchive [20:21] smoke test @here @everyone [20:23] jrwr: stop highlighting me over at irc [20:24] *** atbrdg has quit IRC (Remote host closed the connection) [20:27] *** atbrdg has joined #internetarchive [20:27] *** atbrdg has quit IRC (Remote host closed the connection) [20:28] *** atbrdg has joined #internetarchive [20:29] *** atbrdg has quit IRC (Remote host closed the connection) [23:06] *** Arkiver2 is now known as arkiver