Time |
Nickname |
Message |
00:02
๐
|
|
mistym__ has quit IRC (Read error: Operation timed out) |
00:26
๐
|
|
mistym has quit IRC (Remote host closed the connection) |
00:39
๐
|
pikhq |
Anyone familiar with the state of reddit archival? A number of larger subreddits (r/AskReddit, r/IAmA) have gone private for the forseeable future. |
00:47
๐
|
phiren |
they will be back in a day or two |
00:49
๐
|
phiren |
but it would be nice to archive reddit, once things go beyond the 1000 item limit they get really hard to find |
00:50
๐
|
phiren |
and it would be nice to know what the front page looked like every 5min |
00:50
๐
|
Apathy |
unlikely that this will be permanent |
00:51
๐
|
Apathy |
with 5/10 of the top subscribed subs being private the admins are going to have to do something about it that satisfies the respective moderators |
00:51
๐
|
pikhq |
Just made me realize that reddit archival is *probably* something that should happen. |
00:51
๐
|
Apathy |
not an acceptable state of affairs from a business standpoint even |
00:51
๐
|
phiren |
yeah, it's a mod strike |
00:51
๐
|
pikhq |
Not that it needs to happen Right Now. Especially given that it'd miss the respective subreddits. :) |
00:52
๐
|
phiren |
because reddit really sucks at mod --> admin comunication |
00:52
๐
|
Apathy |
so yeah not permanent no reason to fret yet |
00:52
๐
|
Apathy |
its a very large job though |
00:52
๐
|
phiren |
the other direction (admin --> mod) is generally ok |
00:52
๐
|
pikhq |
No kidding. Reddit is a pretty large site. |
00:53
๐
|
phiren |
a few years ago, I did work out how to abuse the search system to get links to all (undeleted) posts out of it |
00:54
๐
|
Apathy |
search feature was recently revamped |
00:54
๐
|
Apathy |
not sure if that would affect it |
00:55
๐
|
Apathy |
apparently the search is worse than it was before |
00:55
๐
|
Apathy |
and that is saying something |
00:55
๐
|
phiren |
with custom systax you could as for all posts after a timestamp, grab the 1000 posts then look at the timestamp of the last post |
00:55
๐
|
phiren |
the old search method is still avaliable |
00:55
๐
|
phiren |
through a special link |
00:57
๐
|
phiren |
I wrote a post about the method |
00:57
๐
|
Lord_Nigh |
oh god the reddit shitstorm at /u/chooter being fired from reddit, possibly in response to the 'jesse jackson ama gone horribly wrong' |
00:58
๐
|
phiren |
but finding it would require a good reddit search |
00:58
๐
|
phiren |
I found my old post regarding not finding it https://www.reddit.com/r/redditdev/comments/1c209w/reddit_has_now_made_it_impossible_to_get_old/c9cfi65?context=2 |
00:59
๐
|
pikhq |
I both have no comments and no *knowledge* of the shit storm. |
01:00
๐
|
pikhq |
It just made me realize that there's a *lot* of data there. |
01:00
๐
|
phiren |
here: https://www.reddit.com/search?sort=top&q=timestamp%3A1372982400..1373068800&restrict_sr=on&syntax=cloudsearch |
01:00
๐
|
phiren |
&syntax=cloudsearch at the end is the key |
01:01
๐
|
pikhq |
That's also kinda at the whims of a single company. |
01:01
๐
|
phiren |
yeah, it should be archived |
01:01
๐
|
Start |
#deaddit |
01:01
๐
|
pikhq |
Maybe more appropriate for -bs though. |
01:01
๐
|
pikhq |
I mean, it's a problem but it's not literally dying as we speak. I don't think? |
01:02
๐
|
phiren |
as far as I know it's still on an upwards trend |
01:02
๐
|
Start |
well the default subreddits (and several other major ones) are all currently going private |
01:02
๐
|
phiren |
but remember how fast digg died |
01:03
๐
|
pikhq |
*nod* Not massive archive brigade time yet, but worth thinking about. |
01:12
๐
|
|
waddlespl has joined #archiveteam |
01:12
๐
|
waddlespl |
uh guys |
01:12
๐
|
waddlespl |
reddit is going down |
01:13
๐
|
waddlespl |
lots of subreddits are going private (voluntarily) |
01:13
๐
|
waddlespl |
oh, nvm. #archivebot is on it |
01:14
๐
|
|
schbirid has quit IRC (Read error: Operation timed out) |
01:14
๐
|
xmc |
reddit has life in it yet |
01:14
๐
|
xmc |
gsent |
01:14
๐
|
xmc |
misfire |
01:17
๐
|
|
filippo__ has quit IRC (Ping timeout: 265 seconds) |
01:19
๐
|
|
filippo__ has joined #archiveteam |
01:20
๐
|
|
WinterFox has quit IRC (Read error: Operation timed out) |
01:27
๐
|
|
godane has joined #archiveteam |
01:28
๐
|
|
waddlespl has left |
01:29
๐
|
|
schbirid has joined #archiveteam |
01:33
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
01:34
๐
|
|
Aranje has joined #archiveteam |
01:39
๐
|
|
ersi has quit IRC (Ping timeout: 265 seconds) |
01:46
๐
|
|
ersi has joined #archiveteam |
01:48
๐
|
|
mistym has joined #archiveteam |
02:07
๐
|
|
primus104 has quit IRC (Leaving.) |
02:13
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
02:14
๐
|
|
Aranje has joined #archiveteam |
02:27
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
02:28
๐
|
|
Aranje has joined #archiveteam |
02:31
๐
|
|
Aranje has quit IRC (Client Quit) |
02:32
๐
|
|
Emcy_ has joined #archiveteam |
02:36
๐
|
|
Emcy has quit IRC (Ping timeout: 483 seconds) |
03:05
๐
|
|
Morbus has joined #archiveteam |
03:06
๐
|
|
VADemon has quit IRC (Quit: left4dead) |
03:07
๐
|
|
MorbusIff has quit IRC (Read error: Operation timed out) |
03:14
๐
|
|
Elegance_ has quit IRC (:(){ :|:& };:) |
03:14
๐
|
|
Elegance has joined #archiveteam |
03:27
๐
|
|
mistym has quit IRC (Remote host closed the connection) |
03:36
๐
|
wp494 |
I'm going to downgrade reddit's page on our wiki to endangered status |
03:37
๐
|
|
vitzli has joined #archiveteam |
03:41
๐
|
|
Coderjoe has quit IRC (Read error: Connection reset by peer) |
03:41
๐
|
|
Coderjoe has joined #archiveteam |
03:48
๐
|
|
Ungstein1 has joined #archiveteam |
03:50
๐
|
|
Coderjoe has quit IRC (Read error: Operation timed out) |
03:50
๐
|
|
mistym has joined #archiveteam |
03:51
๐
|
|
Ungstein has quit IRC (Ping timeout: 265 seconds) |
03:55
๐
|
|
vitzli has quit IRC (Quit: Leaving) |
04:21
๐
|
|
Ungstein1 has quit IRC (Quit: Leaving.) |
04:31
๐
|
|
Coderjoe has joined #archiveteam |
04:32
๐
|
|
aaaaaaaaa has quit IRC (Leaving) |
04:44
๐
|
garyrh |
Gigaom.com Acquired by Knowingly Corp: https://gigaom.com/2015/05/26/gigaom-com-acquired-by-knowingly-corp/ |
04:44
๐
|
garyrh |
"Knowingly plans to relaunch the site on August 15, 2015." |
06:32
๐
|
|
mistym has quit IRC (Remote host closed the connection) |
06:48
๐
|
|
WinterFox has joined #archiveteam |
07:15
๐
|
|
trill has joined #archiveteam |
07:26
๐
|
|
bzc6p has left |
07:30
๐
|
|
Medowar0 has joined #archiveteam |
07:33
๐
|
|
mistym has joined #archiveteam |
07:34
๐
|
|
Medowar has quit IRC () |
07:46
๐
|
|
mistym has quit IRC (Ping timeout: 606 seconds) |
07:53
๐
|
|
atomotic has joined #archiveteam |
08:06
๐
|
|
primus104 has joined #archiveteam |
08:40
๐
|
|
Ymgve has joined #archiveteam |
08:40
๐
|
|
Ymgve has quit IRC (Client Quit) |
08:42
๐
|
|
Ymgve has joined #archiveteam |
08:52
๐
|
|
primus104 has quit IRC (Leaving.) |
09:00
๐
|
|
godane has quit IRC (Read error: Operation timed out) |
09:09
๐
|
|
BlueMaxim has quit IRC (Read error: Connection reset by peer) |
09:13
๐
|
|
BlueMaxim has joined #archiveteam |
09:19
๐
|
|
godane has joined #archiveteam |
09:27
๐
|
Ctrl-S |
rip |
09:28
๐
|
|
SilSte has joined #archiveteam |
09:28
๐
|
SilSte |
Hi guys |
09:28
๐
|
SilSte |
ever thought about backing up reddit? |
09:29
๐
|
HCross |
SilSte, I had that thought yesterday |
09:31
๐
|
SilSte |
I mean especially some of /r/IAmA are worth a thought... like the snowden stuff for example |
09:31
๐
|
T31M |
well reddit as a whole is a gigant amount of usefull ressource |
09:32
๐
|
SilSte |
Since I have no idea about creating projects... if someone would start I would add ressources ;) |
09:33
๐
|
T31M |
+, tired of slowly climbing urlteam ;) |
09:33
๐
|
HCross |
gonna have a large server ready. Someone needs to overtake me on Xfire |
09:33
๐
|
T31M |
xfire really slow atm |
09:37
๐
|
wp494 |
I would strongly advise at this point that we get a warrior project going and unleash all hell |
09:37
๐
|
wp494 |
subs are seriously dropping like flies |
09:38
๐
|
wp494 |
there's reported admin fuckery at /r/pics |
09:38
๐
|
wp494 |
it's becoming quite the shitshow real fast |
09:40
๐
|
BlueMaxim |
agreed, but seriously, good luck with that, they will most likely try to stop you |
09:41
๐
|
BlueMaxim |
then again, they've never dealt with the archiveteam.l |
09:51
๐
|
|
Laverne has joined #archiveteam |
10:02
๐
|
|
Medowar0 has quit IRC (Quit: Leaving) |
10:03
๐
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
10:06
๐
|
|
Medowar has joined #archiveteam |
10:29
๐
|
|
vitzli has joined #archiveteam |
10:36
๐
|
|
mistym has joined #archiveteam |
10:43
๐
|
|
mistym has quit IRC (Read error: Operation timed out) |
11:03
๐
|
|
vitzli has quit IRC (Quit: Leaving) |
11:04
๐
|
|
atomotic has joined #archiveteam |
11:16
๐
|
trill |
http://archiveteam.org/index.php?title=Reddit |
11:16
๐
|
trill |
Looks like someone allready thought about reddit |
11:17
๐
|
trill |
/join #deadit |
11:17
๐
|
trill |
whoops |
11:22
๐
|
|
Rickster has quit IRC (Quit: ZNC - http://znc.in) |
11:26
๐
|
|
Rickster has joined #archiveteam |
11:41
๐
|
|
trill has quit IRC (Quit: Page closed) |
12:08
๐
|
Smiley |
oh |
12:08
๐
|
|
SilSte has quit IRC (Ping timeout: 240 seconds) |
12:13
๐
|
|
primus104 has joined #archiveteam |
12:19
๐
|
|
zenguy_pc has quit IRC (Read error: Operation timed out) |
12:19
๐
|
|
zhongfu_ is now known as zhongfu |
12:23
๐
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
12:28
๐
|
wp494 |
trill: hi I created that page AMA |
12:32
๐
|
|
zenguy_pc has joined #archiveteam |
12:39
๐
|
wp494 |
also HEY |
12:40
๐
|
wp494 |
take the following with a grain of salt |
12:40
๐
|
wp494 |
actually a tablespoon's worth |
12:41
๐
|
wp494 |
but rumor has it Microsoft and Google may be in a pissing contest to buy reddit |
12:41
๐
|
wp494 |
possibly as soon as today |
12:41
๐
|
wp494 |
but that's a big rumor, biggerthan the one of MS buying AMD |
12:42
๐
|
wp494 |
so be skeptical but aware |
12:49
๐
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
12:58
๐
|
|
Medowar has quit IRC (Quit: Leaving) |
13:33
๐
|
Lord_Nigh |
wp494: this would explain why kn0thing was being a dick, if he stands to make some ridiculous amount of cash from the pending sale... |
13:35
๐
|
|
nox2 has joined #archiveteam |
13:38
๐
|
|
VADemon has joined #archiveteam |
13:39
๐
|
|
vitzli has joined #archiveteam |
14:08
๐
|
|
mistym has joined #archiveteam |
14:16
๐
|
|
mistym has quit IRC (Ping timeout: 483 seconds) |
14:18
๐
|
arkiver |
SketchCow: Grab all of reddit? |
14:33
๐
|
|
mistym has joined #archiveteam |
14:59
๐
|
|
Froggypwn has quit IRC (Read error: Connection reset by peer) |
15:00
๐
|
|
Froggypwn has joined #archiveteam |
15:53
๐
|
|
mistym has quit IRC (Remote host closed the connection) |
16:12
๐
|
|
bzc6p has joined #archiveteam |
16:13
๐
|
|
bzc6p has left |
16:35
๐
|
|
mistym has joined #archiveteam |
16:40
๐
|
|
Emcy has joined #archiveteam |
16:44
๐
|
|
Emcy_ has quit IRC (Ping timeout: 483 seconds) |
17:01
๐
|
|
SimpBrain has joined #archiveteam |
17:03
๐
|
|
codl_ has quit IRC () |
17:03
๐
|
|
codl_ has joined #archiveteam |
17:03
๐
|
|
SimpBrai1 has joined #archiveteam |
17:05
๐
|
|
DopefishJ has joined #archiveteam |
17:06
๐
|
|
SimpBrain has quit IRC (Ping timeout: 258 seconds) |
17:07
๐
|
|
Emcy has quit IRC (Ping timeout: 306 seconds) |
17:12
๐
|
|
Emcy has joined #archiveteam |
17:15
๐
|
|
DFJustin has quit IRC (Ping timeout: 740 seconds) |
17:20
๐
|
|
primus104 has quit IRC (Leaving.) |
17:43
๐
|
|
aaaaaaaaa has joined #archiveteam |
17:43
๐
|
|
DopefishJ is now known as DFJustin |
17:51
๐
|
|
Emcy has quit IRC (Read error: Connection reset by peer) |
17:52
๐
|
|
Emcy has joined #archiveteam |
17:52
๐
|
|
Aranje has joined #archiveteam |
18:15
๐
|
|
Emcy_ has joined #archiveteam |
18:19
๐
|
|
Emcy has quit IRC (Ping timeout: 306 seconds) |
18:23
๐
|
|
kisspunch has quit IRC (Ping timeout: 252 seconds) |
18:27
๐
|
|
vitzli has quit IRC (Quit: Leaving) |
18:35
๐
|
|
kisspunch has joined #archiveteam |
18:43
๐
|
balrog |
Is there a plan in place for google code once it goes read only? |
18:44
๐
|
balrog |
it's about a month and a half |
18:58
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
18:58
๐
|
|
Aranje has joined #archiveteam |
18:59
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
19:00
๐
|
|
Aranje has joined #archiveteam |
19:01
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
19:01
๐
|
|
Aranje has joined #archiveteam |
19:09
๐
|
|
mistym has quit IRC (Remote host closed the connection) |
19:11
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
19:12
๐
|
|
Aranje has joined #archiveteam |
19:12
๐
|
|
db48x has quit IRC (Read error: Connection reset by peer) |
19:47
๐
|
|
Wyatt has joined #archiveteam |
19:50
๐
|
Wyatt |
At long last, I'm breaking out of my work-induced malaise and I have a big pile of shit to ias3upload. What should I put under the contributor field in my metadata.csv? IA username? |
19:54
๐
|
Nemo_bis |
"contributor" is usually someone who contributed to the work uploaded, not to the uploading process |
19:54
๐
|
Nemo_bis |
Then of course the lines can be blurry |
19:55
๐
|
Wyatt |
Ah, I see. |
19:59
๐
|
|
primus104 has joined #archiveteam |
20:00
๐
|
|
Ravenloft has joined #archiveteam |
20:08
๐
|
|
Froggypwn has quit IRC (Read error: Connection reset by peer) |
20:09
๐
|
|
Froggypwn has joined #archiveteam |
20:14
๐
|
Wyatt |
Any idea how long it usually takes for a collection to be made? |
20:15
๐
|
|
Aranje has quit IRC (Read error: Connection reset by peer) |
20:16
๐
|
|
mistym has joined #archiveteam |
20:16
๐
|
|
Aranje has joined #archiveteam |
20:22
๐
|
|
schbirid has quit IRC (Leaving) |
20:22
๐
|
xmc |
Wyatt: once you get an admin to do it, just a few minutes |
20:23
๐
|
arkiver |
SketchCow: we have found an easy way to grab all posts of reddit |
20:23
๐
|
xmc |
Wyatt: if you're not aware, it's a holiday weekend in the US, so if you sent an email i would say monday around this time |
20:23
๐
|
arkiver |
SketchCow: if you give the GO, I'll write the scripts and we'll start asap |
20:23
๐
|
Wyatt |
Oh. Right. That IS why I have the day off at all.... |
20:23
๐
|
xmc |
:) |
20:39
๐
|
Wyatt |
Carp, now that I look at the FAQ page, they want things uploaded for a collection before it can be made. Do they bend on that at all? |
20:40
๐
|
Nemo_bis |
magikarp |
20:41
๐
|
Nemo_bis |
Wyatt: doesn't it really matter |
20:41
๐
|
Nemo_bis |
fixWordOrder() |
20:42
๐
|
Nemo_bis |
Wyatt: just upload to "opensource" as usual, there's no hurry to get a collection |
20:42
๐
|
Wyatt |
Oh, okay. |
20:42
๐
|
Nemo_bis |
But do add some meaningful tag and so on otherwise it just looks like a noise flood |
20:44
๐
|
Wyatt |
Naturally. Okay, let's fixup my metadata file... |
20:44
๐
|
Nemo_bis |
Playing Antti Tuisku - Jรครค tai mee-JP-8IKoZM7E.m4a. |
20:44
๐
|
Nemo_bis |
sorry, paste fail |
20:47
๐
|
Wyatt |
Oh, missed that detail before. A bunch of these fields are optional so rather than leaving them empty I can just omit them. |
20:48
๐
|
Nemo_bis |
Sometimes. |
20:48
๐
|
Nemo_bis |
But then with ias3upload it's hard to mess things up, usually it either explodes or works. |
20:51
๐
|
|
mistym_ has joined #archiveteam |
20:51
๐
|
Wyatt |
I'm just removing description, date, and contributor because that's really difficult to determine programmatically for this stuff. |
20:52
๐
|
|
sjgsgj has joined #archiveteam |
20:52
๐
|
sjgsgj |
Hi |
20:53
๐
|
sjgsgj |
I want to generate archives but I'm not sure where to start. |
20:53
๐
|
sjgsgj |
my goal is to make a bot that agressivley stalks and records actions of someone |
20:54
๐
|
HCross |
bit stalkerish |
20:54
๐
|
sjgsgj |
so? |
20:55
๐
|
sjgsgj |
Lo |
20:55
๐
|
sjgsgj |
:p |
20:55
๐
|
sjgsgj |
also how is pomf.se archive? |
20:55
๐
|
sjgsgj |
it's what, 8tb? |
20:58
๐
|
|
sjgsgj has quit IRC (Quit: http://chat.efnet.org ) |
20:59
๐
|
|
mistym__ has joined #archiveteam |
20:59
๐
|
Wyatt |
Creepy. |
21:00
๐
|
|
mistym has quit IRC (Ping timeout: 606 seconds) |
21:04
๐
|
|
mistym_ has quit IRC (Read error: Operation timed out) |
21:12
๐
|
wyatt8740 |
oh my god |
21:12
๐
|
wyatt8740 |
wyatt |
21:12
๐
|
wyatt8740 |
._. |
21:22
๐
|
xmc |
people sure are great aren't they |
21:26
๐
|
garyrh |
haha |
21:27
๐
|
|
SimpBrai1 has quit IRC (Quit: Leaving) |
21:35
๐
|
|
caber has quit IRC (Remote host closed the connection) |
21:45
๐
|
|
aaaaaaaaa has quit IRC (Leaving) |
21:45
๐
|
|
BlueMaxim has joined #archiveteam |
22:01
๐
|
|
caber has joined #archiveteam |
22:10
๐
|
|
Ravenloft has quit IRC (Ping timeout: 362 seconds) |
22:19
๐
|
|
godane has quit IRC (Read error: Operation timed out) |
22:37
๐
|
|
philpem has joined #archiveteam |
22:39
๐
|
|
SN4T14_ has quit IRC (Read error: Connection reset by peer) |
22:40
๐
|
|
SN4T14 has joined #archiveteam |
22:46
๐
|
|
WinterFox has quit IRC (Remote host closed the connection) |
22:47
๐
|
|
WinterFox has joined #archiveteam |
23:02
๐
|
Wyatt |
Well, this is awkward. I just realised I compressed with zip and gave them a cbr extension. Should I stop this uploader and fix that or does it even matter? |
23:32
๐
|
|
signius has quit IRC (Ping timeout: 307 seconds) |
23:44
๐
|
|
signius has joined #archiveteam |
23:57
๐
|
|
mistym__ has quit IRC (Ping timeout: 492 seconds) |
23:57
๐
|
|
mistym has joined #archiveteam |