[00:02] *** mistym__ has quit IRC (Read error: Operation timed out) [00:26] *** mistym has quit IRC (Remote host closed the connection) [00:39] Anyone familiar with the state of reddit archival? A number of larger subreddits (r/AskReddit, r/IAmA) have gone private for the forseeable future. [00:47] they will be back in a day or two [00:49] but it would be nice to archive reddit, once things go beyond the 1000 item limit they get really hard to find [00:50] and it would be nice to know what the front page looked like every 5min [00:50] unlikely that this will be permanent [00:51] with 5/10 of the top subscribed subs being private the admins are going to have to do something about it that satisfies the respective moderators [00:51] Just made me realize that reddit archival is *probably* something that should happen. [00:51] not an acceptable state of affairs from a business standpoint even [00:51] yeah, it's a mod strike [00:51] Not that it needs to happen Right Now. Especially given that it'd miss the respective subreddits. :) [00:52] because reddit really sucks at mod --> admin comunication [00:52] so yeah not permanent no reason to fret yet [00:52] its a very large job though [00:52] the other direction (admin --> mod) is generally ok [00:52] No kidding. Reddit is a pretty large site. [00:53] a few years ago, I did work out how to abuse the search system to get links to all (undeleted) posts out of it [00:54] search feature was recently revamped [00:54] not sure if that would affect it [00:55] apparently the search is worse than it was before [00:55] and that is saying something [00:55] with custom systax you could as for all posts after a timestamp, grab the 1000 posts then look at the timestamp of the last post [00:55] the old search method is still avaliable [00:55] through a special link [00:57] I wrote a post about the method [00:57] oh god the reddit shitstorm at /u/chooter being fired from reddit, possibly in response to the 'jesse jackson ama gone horribly wrong' [00:58] but finding it would require a good reddit search [00:58] I found my old post regarding not finding it https://www.reddit.com/r/redditdev/comments/1c209w/reddit_has_now_made_it_impossible_to_get_old/c9cfi65?context=2 [00:59] I both have no comments and no *knowledge* of the shit storm. [01:00] It just made me realize that there's a *lot* of data there. [01:00] here: https://www.reddit.com/search?sort=top&q=timestamp%3A1372982400..1373068800&restrict_sr=on&syntax=cloudsearch [01:00] &syntax=cloudsearch at the end is the key [01:01] That's also kinda at the whims of a single company. [01:01] yeah, it should be archived [01:01] #deaddit [01:01] Maybe more appropriate for -bs though. [01:01] I mean, it's a problem but it's not literally dying as we speak. I don't think? [01:02] as far as I know it's still on an upwards trend [01:02] well the default subreddits (and several other major ones) are all currently going private [01:02] but remember how fast digg died [01:03] *nod* Not massive archive brigade time yet, but worth thinking about. [01:12] *** waddlespl has joined #archiveteam [01:12] uh guys [01:12] reddit is going down [01:13] lots of subreddits are going private (voluntarily) [01:13] oh, nvm. #archivebot is on it [01:14] *** schbirid has quit IRC (Read error: Operation timed out) [01:14] reddit has life in it yet [01:14] gsent [01:14] misfire [01:17] *** filippo__ has quit IRC (Ping timeout: 265 seconds) [01:19] *** filippo__ has joined #archiveteam [01:20] *** WinterFox has quit IRC (Read error: Operation timed out) [01:27] *** godane has joined #archiveteam [01:28] *** waddlespl has left [01:29] *** schbirid has joined #archiveteam [01:33] *** Aranje has quit IRC (Read error: Connection reset by peer) [01:34] *** Aranje has joined #archiveteam [01:39] *** ersi has quit IRC (Ping timeout: 265 seconds) [01:46] *** ersi has joined #archiveteam [01:48] *** mistym has joined #archiveteam [02:07] *** primus104 has quit IRC (Leaving.) [02:13] *** Aranje has quit IRC (Read error: Connection reset by peer) [02:14] *** Aranje has joined #archiveteam [02:27] *** Aranje has quit IRC (Read error: Connection reset by peer) [02:28] *** Aranje has joined #archiveteam [02:31] *** Aranje has quit IRC (Client Quit) [02:32] *** Emcy_ has joined #archiveteam [02:36] *** Emcy has quit IRC (Ping timeout: 483 seconds) [03:05] *** Morbus has joined #archiveteam [03:06] *** VADemon has quit IRC (Quit: left4dead) [03:07] *** MorbusIff has quit IRC (Read error: Operation timed out) [03:14] *** Elegance_ has quit IRC (:(){ :|:& };:) [03:14] *** Elegance has joined #archiveteam [03:27] *** mistym has quit IRC (Remote host closed the connection) [03:36] I'm going to downgrade reddit's page on our wiki to endangered status [03:37] *** vitzli has joined #archiveteam [03:41] *** Coderjoe has quit IRC (Read error: Connection reset by peer) [03:41] *** Coderjoe has joined #archiveteam [03:48] *** Ungstein1 has joined #archiveteam [03:50] *** Coderjoe has quit IRC (Read error: Operation timed out) [03:50] *** mistym has joined #archiveteam [03:51] *** Ungstein has quit IRC (Ping timeout: 265 seconds) [03:55] *** vitzli has quit IRC (Quit: Leaving) [04:21] *** Ungstein1 has quit IRC (Quit: Leaving.) [04:31] *** Coderjoe has joined #archiveteam [04:32] *** aaaaaaaaa has quit IRC (Leaving) [04:44] Gigaom.com Acquired by Knowingly Corp: https://gigaom.com/2015/05/26/gigaom-com-acquired-by-knowingly-corp/ [04:44] "Knowingly plans to relaunch the site on August 15, 2015." [06:32] *** mistym has quit IRC (Remote host closed the connection) [06:48] *** WinterFox has joined #archiveteam [07:15] *** trill has joined #archiveteam [07:26] *** bzc6p has left [07:30] *** Medowar0 has joined #archiveteam [07:33] *** mistym has joined #archiveteam [07:34] *** Medowar has quit IRC () [07:46] *** mistym has quit IRC (Ping timeout: 606 seconds) [07:53] *** atomotic has joined #archiveteam [08:06] *** primus104 has joined #archiveteam [08:40] *** Ymgve has joined #archiveteam [08:40] *** Ymgve has quit IRC (Client Quit) [08:42] *** Ymgve has joined #archiveteam [08:52] *** primus104 has quit IRC (Leaving.) [09:00] *** godane has quit IRC (Read error: Operation timed out) [09:09] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [09:13] *** BlueMaxim has joined #archiveteam [09:19] *** godane has joined #archiveteam [09:27] rip [09:28] *** SilSte has joined #archiveteam [09:28] Hi guys [09:28] ever thought about backing up reddit? [09:29] SilSte, I had that thought yesterday [09:31] I mean especially some of /r/IAmA are worth a thought... like the snowden stuff for example [09:31] well reddit as a whole is a gigant amount of usefull ressource [09:32] Since I have no idea about creating projects... if someone would start I would add ressources ;) [09:33] +, tired of slowly climbing urlteam ;) [09:33] gonna have a large server ready. Someone needs to overtake me on Xfire [09:33] xfire really slow atm [09:37] I would strongly advise at this point that we get a warrior project going and unleash all hell [09:37] subs are seriously dropping like flies [09:38] there's reported admin fuckery at /r/pics [09:38] it's becoming quite the shitshow real fast [09:40] agreed, but seriously, good luck with that, they will most likely try to stop you [09:41] then again, they've never dealt with the archiveteam.l [09:51] *** Laverne has joined #archiveteam [10:02] *** Medowar0 has quit IRC (Quit: Leaving) [10:03] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [10:06] *** Medowar has joined #archiveteam [10:29] *** vitzli has joined #archiveteam [10:36] *** mistym has joined #archiveteam [10:43] *** mistym has quit IRC (Read error: Operation timed out) [11:03] *** vitzli has quit IRC (Quit: Leaving) [11:04] *** atomotic has joined #archiveteam [11:16] http://archiveteam.org/index.php?title=Reddit [11:16] Looks like someone allready thought about reddit [11:17] /join #deadit [11:17] whoops [11:22] *** Rickster has quit IRC (Quit: ZNC - http://znc.in) [11:26] *** Rickster has joined #archiveteam [11:41] *** trill has quit IRC (Quit: Page closed) [12:08] oh [12:08] *** SilSte has quit IRC (Ping timeout: 240 seconds) [12:13] *** primus104 has joined #archiveteam [12:19] *** zenguy_pc has quit IRC (Read error: Operation timed out) [12:19] *** zhongfu_ is now known as zhongfu [12:23] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [12:28] trill: hi I created that page AMA [12:32] *** zenguy_pc has joined #archiveteam [12:39] also HEY [12:40] take the following with a grain of salt [12:40] actually a tablespoon's worth [12:41] but rumor has it Microsoft and Google may be in a pissing contest to buy reddit [12:41] possibly as soon as today [12:41] but that's a big rumor, biggerthan the one of MS buying AMD [12:42] so be skeptical but aware [12:49] *** BlueMaxim has quit IRC (Quit: Leaving) [12:58] *** Medowar has quit IRC (Quit: Leaving) [13:33] wp494: this would explain why kn0thing was being a dick, if he stands to make some ridiculous amount of cash from the pending sale... [13:35] *** nox2 has joined #archiveteam [13:38] *** VADemon has joined #archiveteam [13:39] *** vitzli has joined #archiveteam [14:08] *** mistym has joined #archiveteam [14:16] *** mistym has quit IRC (Ping timeout: 483 seconds) [14:18] SketchCow: Grab all of reddit? [14:33] *** mistym has joined #archiveteam [14:59] *** Froggypwn has quit IRC (Read error: Connection reset by peer) [15:00] *** Froggypwn has joined #archiveteam [15:53] *** mistym has quit IRC (Remote host closed the connection) [16:12] *** bzc6p has joined #archiveteam [16:13] *** bzc6p has left [16:35] *** mistym has joined #archiveteam [16:40] *** Emcy has joined #archiveteam [16:44] *** Emcy_ has quit IRC (Ping timeout: 483 seconds) [17:01] *** SimpBrain has joined #archiveteam [17:03] *** codl_ has quit IRC () [17:03] *** codl_ has joined #archiveteam [17:03] *** SimpBrai1 has joined #archiveteam [17:05] *** DopefishJ has joined #archiveteam [17:06] *** SimpBrain has quit IRC (Ping timeout: 258 seconds) [17:07] *** Emcy has quit IRC (Ping timeout: 306 seconds) [17:12] *** Emcy has joined #archiveteam [17:15] *** DFJustin has quit IRC (Ping timeout: 740 seconds) [17:20] *** primus104 has quit IRC (Leaving.) [17:43] *** aaaaaaaaa has joined #archiveteam [17:43] *** DopefishJ is now known as DFJustin [17:51] *** Emcy has quit IRC (Read error: Connection reset by peer) [17:52] *** Emcy has joined #archiveteam [17:52] *** Aranje has joined #archiveteam [18:15] *** Emcy_ has joined #archiveteam [18:19] *** Emcy has quit IRC (Ping timeout: 306 seconds) [18:23] *** kisspunch has quit IRC (Ping timeout: 252 seconds) [18:27] *** vitzli has quit IRC (Quit: Leaving) [18:35] *** kisspunch has joined #archiveteam [18:43] Is there a plan in place for google code once it goes read only? [18:44] it's about a month and a half [18:58] *** Aranje has quit IRC (Read error: Connection reset by peer) [18:58] *** Aranje has joined #archiveteam [18:59] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:00] *** Aranje has joined #archiveteam [19:01] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:01] *** Aranje has joined #archiveteam [19:09] *** mistym has quit IRC (Remote host closed the connection) [19:11] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:12] *** Aranje has joined #archiveteam [19:12] *** db48x has quit IRC (Read error: Connection reset by peer) [19:47] *** Wyatt has joined #archiveteam [19:50] At long last, I'm breaking out of my work-induced malaise and I have a big pile of shit to ias3upload. What should I put under the contributor field in my metadata.csv? IA username? [19:54] "contributor" is usually someone who contributed to the work uploaded, not to the uploading process [19:54] Then of course the lines can be blurry [19:55] Ah, I see. [19:59] *** primus104 has joined #archiveteam [20:00] *** Ravenloft has joined #archiveteam [20:08] *** Froggypwn has quit IRC (Read error: Connection reset by peer) [20:09] *** Froggypwn has joined #archiveteam [20:14] Any idea how long it usually takes for a collection to be made? [20:15] *** Aranje has quit IRC (Read error: Connection reset by peer) [20:16] *** mistym has joined #archiveteam [20:16] *** Aranje has joined #archiveteam [20:22] *** schbirid has quit IRC (Leaving) [20:22] Wyatt: once you get an admin to do it, just a few minutes [20:23] SketchCow: we have found an easy way to grab all posts of reddit [20:23] Wyatt: if you're not aware, it's a holiday weekend in the US, so if you sent an email i would say monday around this time [20:23] SketchCow: if you give the GO, I'll write the scripts and we'll start asap [20:23] Oh. Right. That IS why I have the day off at all.... [20:23] :) [20:39] Carp, now that I look at the FAQ page, they want things uploaded for a collection before it can be made. Do they bend on that at all? [20:40] magikarp [20:41] Wyatt: doesn't it really matter [20:41] fixWordOrder() [20:42] Wyatt: just upload to "opensource" as usual, there's no hurry to get a collection [20:42] Oh, okay. [20:42] But do add some meaningful tag and so on otherwise it just looks like a noise flood [20:44] Naturally. Okay, let's fixup my metadata file... [20:44] Playing Antti Tuisku - Jää tai mee-JP-8IKoZM7E.m4a. [20:44] sorry, paste fail [20:47] Oh, missed that detail before. A bunch of these fields are optional so rather than leaving them empty I can just omit them. [20:48] Sometimes. [20:48] But then with ias3upload it's hard to mess things up, usually it either explodes or works. [20:51] *** mistym_ has joined #archiveteam [20:51] I'm just removing description, date, and contributor because that's really difficult to determine programmatically for this stuff. [20:52] *** sjgsgj has joined #archiveteam [20:52] Hi [20:53] I want to generate archives but I'm not sure where to start. [20:53] my goal is to make a bot that agressivley stalks and records actions of someone [20:54] bit stalkerish [20:54] so? [20:55] Lo [20:55] :p [20:55] also how is pomf.se archive? [20:55] it's what, 8tb? [20:58] *** sjgsgj has quit IRC (Quit: http://chat.efnet.org ) [20:59] *** mistym__ has joined #archiveteam [20:59] Creepy. [21:00] *** mistym has quit IRC (Ping timeout: 606 seconds) [21:04] *** mistym_ has quit IRC (Read error: Operation timed out) [21:12] oh my god [21:12] wyatt [21:12] ._. [21:22] people sure are great aren't they [21:26] haha [21:27] *** SimpBrai1 has quit IRC (Quit: Leaving) [21:35] *** caber has quit IRC (Remote host closed the connection) [21:45] *** aaaaaaaaa has quit IRC (Leaving) [21:45] *** BlueMaxim has joined #archiveteam [22:01] *** caber has joined #archiveteam [22:10] *** Ravenloft has quit IRC (Ping timeout: 362 seconds) [22:19] *** godane has quit IRC (Read error: Operation timed out) [22:37] *** philpem has joined #archiveteam [22:39] *** SN4T14_ has quit IRC (Read error: Connection reset by peer) [22:40] *** SN4T14 has joined #archiveteam [22:46] *** WinterFox has quit IRC (Remote host closed the connection) [22:47] *** WinterFox has joined #archiveteam [23:02] Well, this is awkward. I just realised I compressed with zip and gave them a cbr extension. Should I stop this uploader and fix that or does it even matter? [23:32] *** signius has quit IRC (Ping timeout: 307 seconds) [23:44] *** signius has joined #archiveteam [23:57] *** mistym__ has quit IRC (Ping timeout: 492 seconds) [23:57] *** mistym has joined #archiveteam