[00:07] *** BlueMax has quit IRC (Quit: Leaving) [00:08] *** mal_ has quit IRC (Read error: Connection reset by peer) [00:08] *** mal__ has joined #archiveteam [00:17] *** VerifiedJ has quit IRC (Quit: Leaving) [00:21] *** jesse-s has quit IRC (Ping timeout: 1230 seconds) [00:22] *** jesse-s has joined #archiveteam [00:22] *** sudoscrip has joined #archiveteam [00:29] *** atbk_ has quit IRC (Ping timeout: 745 seconds) [00:35] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [00:50] *** BlueMax has joined #archiveteam [01:23] *** sudoscrip has joined #archiveteam [01:25] *** britmob has quit IRC (Read error: Connection reset by peer) [01:36] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [01:45] ------------------------------------ [01:46] Hi, secret and not secret yahoo projects [01:46] Could you report where we are on shutdown eve [01:46] I intend to do some sort of tweetstorm tonight [01:46] ------------------------------------ [01:50] someone suggested about 71% retrieval (1 out of 1.4 mil) [01:53] Being a super rough estimate, I'd say "two-thirds" [01:56] that tracker is not fully loaded [01:57] or it's 1 out of 5.6 million for 17% [01:58] yeah something like that. betamax I think is the most on top of both groups numbers [01:58] and also knows how much was in IA before started here again [01:59] Or PurpleSym arkiver [01:59] How many were public. [02:01] #yahoosucks [17:47] what % of Yahoo Groups has been archived? | #archiveteam [18:45] <@SketchCow> Could you report where we are on shutdown eve [02:01] *** Myself has joined #archiveteam [02:05] joined group/python tracker showing 3642GB rsynced. public group/lua tracker shows 2724GB rsynced. [02:07] joined group should finish just under 50k groups, so below the 66k? groups before deletion [02:07] difficult to tell exactly how many were public [02:09] a discovery was done that yielded a total of 2.75 million groups [02:09] of those, 1.74 million are public [02:09] > we know of at least 5.6 million groups, yahoo claims more than ten million [02:10] current project status: public groups grab is being throttled due to yahoo's slow servers [02:11] while the joined-groups grab is being throttled by not enough new joins to groups being done [02:12] it'd be amused to learn that it's the same Windows Server 2008, a single PC sitting in a closet, since Y! Groups was founded. [02:14] Given when groups started, it'd be 2k running IIS5 or something [02:14] it was aquired, wasn't it? then merged with some Yahoo product [02:14] *** Wingy has joined #archiveteam [02:15] egroups from 1997 to 2000, then Y! bought it [02:15] Please keep the chat in here to a minimum. [02:15] I JUST now checked what groups I'm in [02:17] * Raccoon (maybe someone can find some last minute unpatched exploit to mirror their database overnight) [02:18] *** Wingy4 has joined #archiveteam [02:19] *** Wingy has quit IRC (Read error: Operation timed out) [02:19] *** Wingy4 is now known as Wingy [02:23] *** Wingy9 has joined #archiveteam [02:24] *** sudoscrip has joined #archiveteam [02:24] *** Wingy has quit IRC (Read error: Operation timed out) [02:24] *** Wingy9 is now known as Wingy [02:27] *** Wingy has quit IRC (Read error: Operation timed out) [02:28] SketchCow: if your tweetstorm could get the shutdown for the entire site (rather than just 'Get My Data' requests) extended to Jan 31st, it would be a real help [02:34] *** o_h_e[m] has joined #archiveteam [02:36] That will not be happening. [02:36] JAA: I specifically asked for the chat in here just because there are multiple channels, some I don't know about, and I'm about to drop some numbers in tweetstorm and want to avoid too much inaccuracy. [02:37] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [02:37] But you know, chatty chatty chatty. [02:37] SketchCow: Yeah, I was referring to the "how did Yahoo! Groups evolve" discussion. [02:41] SketchCow: just so you're aware, @FeatheredLeader has been leading a campaign to try and extend the deadline [02:42] (@FeatheredLeader on twitter that is, she's not on IRC) [02:43] *** d5f4a3622 has quit IRC (Ping timeout: 248 seconds) [02:45] Hello all. I am new and was tring to help. I am being constantly rate limited when using the warrior. [02:46] I know what is that for, but was just wondering if there anything I can do. (Have few hours on my hand) [02:48] we're behind on yahoo group joins, join #pythons-attack-y! [02:51] You mean (https://github.com/davidferguson/yahoogroups-joiner) ??? [02:51] isn't the 'archiver' similar to the one run by the warrior? [02:52] i see you're in that channel, so carry the conversation there [03:10] *** Wingy has joined #archiveteam [03:13] *** cerca has quit IRC (Remote host closed the connection) [03:21] *** o_h_e[m] has quit IRC (Read error: Operation timed out) [03:23] *** o_h_e[m] has joined #archiveteam [03:24] *** sudoscrip has joined #archiveteam [03:33] *** d5f4a3622 has joined #archiveteam [03:37] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [04:04] *** m007a83 has joined #archiveteam [04:06] *** oohee has joined #archiveteam [04:07] *** o_h_e[m] has quit IRC (Read error: Operation timed out) [04:08] *** oohee is now known as o_h_e[m] [04:10] *** DogsRNice has quit IRC (Read error: Connection reset by peer) [04:15] *** m007a83 has quit IRC (Fuck you Comcast) [04:16] *** Wingy has quit IRC (Read error: Operation timed out) [04:17] *** odemgi_ has joined #archiveteam [04:20] *** odemgi has quit IRC (Read error: Operation timed out) [04:25] *** sudoscrip has joined #archiveteam [04:38] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [04:55] *** qw3rty2 has joined #archiveteam [05:01] *** qw3rty has quit IRC (Ping timeout: 745 seconds) [05:05] *** lunik18 has joined #archiveteam [05:05] *** lunik1 has quit IRC (Read error: Operation timed out) [05:05] *** lunik18 is now known as lunik1 [05:26] *** sudoscrip has joined #archiveteam [05:26] *** benjins has joined #archiveteam [05:36] *** atbk has joined #archiveteam [05:39] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [06:01] *** odemgi has joined #archiveteam [06:04] *** Raccoon` has joined #archiveteam [06:06] *** odemgi_ has quit IRC (Read error: Operation timed out) [06:07] *** Raccoon has quit IRC (Ping timeout: 258 seconds) [06:07] *** Raccoon` is now known as Raccoon [06:08] *** Raccoon has quit IRC (Remote host closed the connection) [06:27] *** sudoscrip has joined #archiveteam [06:33] *** tech234a has quit IRC (Quit: Connection closed for inactivity) [06:39] *** Raccoon has joined #archiveteam [06:39] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [07:27] *** sudoscrip has joined #archiveteam [07:28] *** Jopik has joined #archiveteam [07:40] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [08:16] *** RichardG has quit IRC (Read error: Connection reset by peer) [08:19] *** Kyoon has joined #archiveteam [08:23] *** Diabeetus has joined #archiveteam [08:23] *** Diabeetus has quit IRC (Client Quit) [08:28] *** sudoscrip has joined #archiveteam [08:36] *** sudoscrip has quit IRC (Ping timeout: 492 seconds) [09:29] *** sudoscrip has joined #archiveteam [09:35] *** mls has quit IRC (Ping timeout: 258 seconds) [09:42] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [09:44] *** mls has joined #archiveteam [09:47] *** BlueMaxim has joined #archiveteam [10:00] *** BlueMax has quit IRC (Ping timeout: 745 seconds) [10:01] *** BlueMaxim has quit IRC (Ping timeout: 745 seconds) [10:01] *** BlueMax has joined #archiveteam [10:24] *** bluefoo has quit IRC (Ping timeout: 745 seconds) [10:24] *** o_h_e[m] has quit IRC (Read error: Connection reset by peer) [10:24] *** o_h_e[m] has joined #archiveteam [10:30] *** sudoscrip has joined #archiveteam [10:36] *** bluefoo has joined #archiveteam [10:42] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [11:14] *** dewdropaw has joined #archiveteam [11:17] *** dewdrop has quit IRC (Ping timeout: 360 seconds) [11:20] *** dewdropaw is now known as dewdrop [11:25] *** satoshi has quit IRC (Ping timeout: 258 seconds) [11:26] *** dewdropaw has joined #archiveteam [11:30] *** dewdrop has quit IRC (Read error: Operation timed out) [11:30] *** sudoscrip has joined #archiveteam [11:32] *** dewdropaw has quit IRC (Read error: Operation timed out) [11:43] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [11:48] *** dewdrop has joined #archiveteam [11:49] *** BlueMax has quit IRC (Read error: Connection reset by peer) [11:57] *** bluefoo has quit IRC (Ping timeout: 255 seconds) [12:01] *** dewdrop has quit IRC (Ping timeout: 745 seconds) [12:09] *** bluefoo has joined #archiveteam [12:17] *** Flashfire has quit IRC (Remote host closed the connection) [12:17] *** kiska has quit IRC (Remote host closed the connection) [12:17] *** Flashfire has joined #archiveteam [12:17] *** kiska has joined #archiveteam [12:31] *** sudoscrip has joined #archiveteam [12:44] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [13:34] *** Wingy has joined #archiveteam [13:38] *** Wingy has quit IRC (Read error: Operation timed out) [13:54] *** RichardG has joined #archiveteam [14:04] *** jc86035 has quit IRC (Quit: Connection closed for inactivity) [14:30] *** Wingy has joined #archiveteam [14:33] *** sudoscrip has joined #archiveteam [14:34] *** Wingy7 has joined #archiveteam [14:34] *** Wingy has quit IRC (Read error: Operation timed out) [14:34] *** Wingy7 is now known as Wingy [14:36] *** Wingy has quit IRC (Read error: Operation timed out) [14:37] *** Wingy has joined #archiveteam [14:39] *** Wingy has quit IRC (Read error: Operation timed out) [14:45] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [15:09] *** godane has quit IRC (Quit: Leaving.) [15:21] when I tell my warriors "archiveteam's choice", they invariably get plays.tv jobs, which run for one cycle and then block on rsync because the staging server is bottlenecked. I'm manually forcing a few onto other projects, but I wonder, should the "archiveteam's choice" decision engine take this into account, and hand out work that's more likely to keep a warrior busy? [15:24] the 'decision engine' is one of us manually changing the default [15:25] context switching between different projects is (usually) a bad idea [15:25] but lets move this into #archiveteam-bs if you want to discuss further [15:33] *** sudoscrip has joined #archiveteam [15:36] *** mback2k has quit IRC (Remote host closed the connection) [15:37] *** Wingy has joined #archiveteam [15:40] *** mback2k has joined #archiveteam [15:41] *** Wingy has quit IRC (Read error: Operation timed out) [15:46] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [15:50] *** godane has joined #archiveteam [15:59] *** bluefoo_ has joined #archiveteam [15:59] *** bluefoo has quit IRC (Ping timeout: 258 seconds) [16:34] *** sudoscrip has joined #archiveteam [16:46] *** wessel151 has joined #archiveteam [16:47] igloo can you help on plays.tv we need a new target [16:47] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [16:48] handle the load [16:48] @igloo [16:48] Stop. [16:58] *** jc86035 has joined #archiveteam [17:12] *** schbirid has joined #archiveteam [17:13] I'm fairly sure the Decision Engine is powered by Jack Daniels [17:16] SketchCow, I've sent you an email requesting to whitelist account to upload to s3 archiveteam_inbox , would that be possible? [17:16] *** i0npulse has quit IRC (Ping timeout: 248 seconds) [17:17] i've been running an rsync target for Youtube Liked Lists [17:17] *** superkuh_ has quit IRC (Quit: the neuronal action potential is an electrical manipulation of reversible abrupt phase changes in the lipid bilaye) [17:17] You'll get an e-mail shortly. I'm considering when, not if, to go to the hospital. [17:19] Ok, thanks. Wish you the best of health. [17:28] *** tech234a has joined #archiveteam [17:32] *** i0npulse has joined #archiveteam [17:35] *** sudoscrip has joined #archiveteam [17:39] *** SoraUta has quit IRC (Read error: Operation timed out) [17:39] *** superkuh_ has joined #archiveteam [17:48] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [17:55] *** superkuh_ has quit IRC (Quit: the neuronal action potential is an electrical manipulation of reversible abrupt phase changes in the lipid bilaye) [17:57] *** Mateon1 has quit IRC (Remote host closed the connection) [17:57] *** Mateon1 has joined #archiveteam [17:58] *** Myself_ has joined #archiveteam [17:58] *** Myself has quit IRC (Remote host closed the connection) [17:58] *** Myself_ is now known as Myself [17:58] *** Raccoon is now known as GetLost [17:58] *** GetLost is now known as Raccoon [17:58] *** Tenebrae has quit IRC (Read error: Operation timed out) [17:59] *** sivoais has quit IRC (Read error: Connection reset by peer) [17:59] *** sivoais has joined #archiveteam [18:00] *** anarcat has quit IRC (Read error: Connection reset by peer) [18:00] *** MrRadar2 has quit IRC (Read error: Operation timed out) [18:01] *** Tenebrae has joined #archiveteam [18:01] *** nataraj has joined #archiveteam [18:02] *** RichardG_ has joined #archiveteam [18:02] *** noirscape has quit IRC (Read error: Operation timed out) [18:05] *** anarcat has joined #archiveteam [18:06] *** RichardG has quit IRC (Read error: Operation timed out) [18:06] *** nataraj has quit IRC (Remote host closed the connection) [18:07] *** nataraj has joined #archiveteam [18:08] *** InkArchiv has joined #archiveteam [18:08] *** brayden has quit IRC (Read error: Connection reset by peer) [18:09] *** brayden has joined #archiveteam [18:09] *** InkArchiv has left [18:10] *** dhyan_nat has quit IRC (Ping timeout: 864 seconds) [18:10] *** InkArchiv has joined #archiveteam [18:11] *** not-joepi has quit IRC (Read error: Operation timed out) [18:12] *** dhyan_nat has joined #archiveteam [18:13] *** h3ndr1k_ has joined #archiveteam [18:13] *** h3ndr1k has quit IRC (Read error: Operation timed out) [18:16] *** cerca has joined #archiveteam [18:18] *** MrRadar2 has joined #archiveteam [18:21] *** noirscape has joined #archiveteam [18:21] *** nataraj has quit IRC (Ping timeout: 864 seconds) [18:22] *** synm0nger has joined #archiveteam [18:23] *** MrRadar2 has quit IRC (Read error: Connection reset by peer) [18:24] *** SynMonger has quit IRC (Read error: Connection reset by peer) [18:26] *** treora has quit IRC (Ping timeout: 864 seconds) [18:26] *** treora has joined #archiveteam [18:30] *** MrRadar2 has joined #archiveteam [18:36] *** sudoscrip has joined #archiveteam [18:38] *** Pixi has quit IRC (Quit: Pixi) [18:38] *** DigiDigi has quit IRC (Quit: Leaving) [18:44] *** sudoscrip has quit IRC (Ping timeout: 492 seconds) [18:45] *** Pixi has joined #archiveteam [19:00] *** DigiDigi has joined #archiveteam [19:20] *** killsushi has joined #archiveteam [19:28] *** DogsRNice has joined #archiveteam [19:31] *** britmob has joined #archiveteam [19:36] *** sudoscrip has joined #archiveteam [19:37] *** atbk has quit IRC (Quit: ZNC - https://znc.in) [19:37] *** atbk has joined #archiveteam [19:49] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [20:14] *** jc86035 has quit IRC (Quit: Connection closed for inactivity) [20:15] *** schbirid has quit IRC (Read error: Operation timed out) [20:17] *** schbirid has joined #archiveteam [20:21] *** satoshi has joined #archiveteam [20:28] *** X-Scale` has joined #archiveteam [20:35] *** X-Scale has quit IRC (Ping timeout: 610 seconds) [20:35] *** X-Scale` is now known as X-Scale [20:37] *** sudoscrip has joined #archiveteam [20:50] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [20:52] *** JAke_ has joined #archiveteam [20:53] *** JAke_ has quit IRC (Client Quit) [20:54] *** X-Scale` has joined #archiveteam [20:55] *** X-Scale has quit IRC (Read error: Operation timed out) [20:55] *** X-Scale` is now known as X-Scale [21:31] *** Chappie-s has left [21:38] *** sudoscrip has joined #archiveteam [21:43] *** Wingy has joined #archiveteam [21:45] *** schbirid has quit IRC (Quit: Leaving) [21:50] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [21:55] *** Wingy has quit IRC (Read error: Operation timed out) [21:57] *** Wingy has joined #archiveteam [22:02] *** Wingy4 has joined #archiveteam [22:03] *** Wingy has quit IRC (Read error: Operation timed out) [22:03] *** Wingy4 is now known as Wingy [22:06] *** o_h_e[m] has quit IRC (Read error: Operation timed out) [22:10] *** Wingy has quit IRC (Read error: Operation timed out) [22:11] *** Wingy has joined #archiveteam [22:12] *** Wingy has quit IRC (Read error: Operation timed out) [22:14] *** Wingy has joined #archiveteam [22:21] *** Wingy5 has joined #archiveteam [22:21] *** Wingy has quit IRC (Read error: Operation timed out) [22:21] *** Wingy5 is now known as Wingy [22:21] *** VADemon has quit IRC (Read error: Connection reset by peer) [22:21] *** VADemon has joined #archiveteam [22:22] *** Wingy has quit IRC (Client Quit) [22:23] *** Wingy has joined #archiveteam [22:39] *** sudoscrip has joined #archiveteam [22:52] *** sudoscrip has quit IRC (Ping timeout: 745 seconds) [23:09] *** BlueMax has joined #archiveteam [23:39] *** sudoscrip has joined #archiveteam [23:52] I'm archiving strawpoll.me! If you want to help, join #brokenpoll and open https://saw.home.wingysam.xyz/?5 in your browser :) [23:52] *** sudoscrip has quit IRC (Ping timeout: 745 seconds)