| Time |
Nickname |
Message |
|
00:00
🔗
|
nightpool |
you're a lot more experienced then me though so I was hoping you'd be able to lay down some of the framework |
|
00:16
🔗
|
xmc |
nightpool: i'll see what i can do sure |
|
00:30
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
00:33
🔗
|
|
godane has joined #archiveteam-bs |
|
01:01
🔗
|
|
Ravenloft has quit IRC (Ping timeout: 190 seconds) |
|
01:07
🔗
|
|
DoomTay has joined #archiveteam-bs |
|
01:08
🔗
|
|
Coderjoe has quit IRC (Read error: Operation timed out) |
|
01:28
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
01:50
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
02:36
🔗
|
|
Aranje has quit IRC (Ping timeout: 260 seconds) |
|
03:11
🔗
|
hook54321 |
Question: why was I banned from #linux ? |
|
03:12
🔗
|
xmc |
perhaps you were being irritating |
|
03:17
🔗
|
hook54321 |
I didn't even say anything in the channel :/ |
|
03:17
🔗
|
hook54321 |
They banned all it cloud users |
|
03:17
🔗
|
hook54321 |
Oops, no it |
|
03:18
🔗
|
hook54321 |
Irccloud |
|
03:18
🔗
|
nightpool |
I'm wondering why archiveteam would know |
|
03:19
🔗
|
hook54321 |
I assumed it was an archive team related channel |
|
03:22
🔗
|
nightpool |
#linux? |
|
03:49
🔗
|
|
Coderjoe has quit IRC (Read error: Operation timed out) |
|
04:12
🔗
|
|
Aranje has joined #archiveteam-bs |
|
04:35
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
04:38
🔗
|
hook54321 |
yeah |
|
04:39
🔗
|
hook54321 |
@nightpool |
|
04:45
🔗
|
DoomTay |
Apparently WikiLeaks just got some juicy stuff |
|
04:45
🔗
|
DoomTay |
http://www.washingtontimes.com/news/2016/jul/23/twitter-users-erupt-dncleaks-disappears-from-trend/ |
|
04:46
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
04:52
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
04:58
🔗
|
xmc |
uh, no, efnet is much more than archiveteam |
|
04:58
🔗
|
xmc |
much as we would like it to be otherwise |
|
05:13
🔗
|
pikhq_ |
EFNet is kinda the original IRC network. |
|
05:14
🔗
|
Frogging |
efnet is cool |
|
05:14
🔗
|
Frogging |
i s'pose |
|
05:17
🔗
|
joepie91_ |
pikhq_: well not quite |
|
05:17
🔗
|
joepie91_ |
it's the original rebel IRC network ;) |
|
05:18
🔗
|
pikhq_ |
In a more literal sense, it's result of most of the original IRC network kicking out eris. |
|
05:18
🔗
|
pikhq_ |
*the result |
|
05:31
🔗
|
|
DoomTay has quit IRC (Quit: Page closed) |
|
05:34
🔗
|
Frogging |
fuckin eris |
|
05:53
🔗
|
|
yipdw has quit IRC (Read error: Operation timed out) |
|
05:54
🔗
|
|
Aranje has quit IRC (Quit: Three sheets to the wind) |
|
05:56
🔗
|
|
JesseW has joined #archiveteam-bs |
|
06:08
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
06:08
🔗
|
|
yipdw has joined #archiveteam-bs |
|
06:29
🔗
|
|
Ravenloft has quit IRC (Ping timeout: 633 seconds) |
|
06:33
🔗
|
|
tomwsmf has quit IRC (Ping timeout: 258 seconds) |
|
07:07
🔗
|
|
metal_cam has joined #archiveteam-bs |
|
07:31
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
09:16
🔗
|
|
schbirid has joined #archiveteam-bs |
|
10:14
🔗
|
|
GLaDOS has quit IRC (Read error: Connection reset by peer) |
|
10:14
🔗
|
|
GLaDOS has joined #archiveteam-bs |
|
10:21
🔗
|
|
terg has joined #archiveteam-bs |
|
10:26
🔗
|
arkiver |
This is for our not-so-important messages |
|
10:27
🔗
|
* |
terg notes |
|
10:27
🔗
|
arkiver |
#archiveteam is for project announcements and important updates and alll |
|
10:27
🔗
|
arkiver |
Anyway, we have a good copy o rutracker in the wayback machine |
|
10:27
🔗
|
Igloo |
(and queries as to what our crawlers are doing) |
|
10:27
🔗
|
arkiver |
Planning on doing the other site too |
|
10:29
🔗
|
terg |
I wanted to create one giant index of torrents from current/dying/dead websites, no ads, no profit, nothing suspicious - so a combination of TPB, isoHunt (which I threw some firepower at when we were archiving it), ruTracker and KAT if possible |
|
10:30
🔗
|
arkiver |
well, everything we grab is going into the wayback machine. |
|
10:31
🔗
|
arkiver |
WARC files contain the data |
|
10:31
🔗
|
arkiver |
You can extract data from those |
|
10:34
🔗
|
terg |
yeah, I've been taking a look at it all. above everything I'd like to see if there's a pragmatic way to save as much as possible of torrent indexes as possible |
|
10:35
🔗
|
terg |
torrent sites are like hydra, as soon as they're investigated and taken down, they'll be cloned and replaced multiple times - the anti-piracy effort seems futile to me |
|
10:35
🔗
|
terg |
I see there are mirrors of KAT for example, but they're missing lots and lots of torrents and metadata and that's a large problem |
|
10:36
🔗
|
arkiver |
yeah |
|
10:39
🔗
|
terg |
it'd be lessened if they offered daily database dumps, but from what I've been reading it seems the operator of KAT was involved in money laundering on a pretty big scale, so I'm presuming he didn't offer such a database to protect his interests |
|
10:44
🔗
|
terg |
TPB might be a good target to archive, even though it's seemingly immortal |
|
10:45
🔗
|
Smiley |
tpb already has a daily dump I believe. |
|
10:46
🔗
|
Smiley |
demonoid is ran by teh FBI... |
|
10:47
🔗
|
terg |
really? I looked around but couldn't find anywhere with recent TPB dumps |
|
10:47
🔗
|
terg |
there are torrents on the site itself with scrapes of everything though |
|
10:49
🔗
|
Smiley |
yeah those |
|
12:06
🔗
|
|
Coderjoe has quit IRC (Read error: Operation timed out) |
|
12:06
🔗
|
|
terg has quit IRC (My Mac has gone to sleep. ZZZzzz…) |
|
12:16
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
12:49
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
12:49
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
13:12
🔗
|
schbirid |
oh yaaaaay, the munich guy got his gun from "darknet" |
|
13:13
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
13:20
🔗
|
|
Coderjoe has quit IRC (Read error: Operation timed out) |
|
13:23
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
13:31
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
13:31
🔗
|
|
Ravenloft has quit IRC (Client Quit) |
|
13:49
🔗
|
|
GLaDOS has quit IRC (Quit: Oh crap, I died.) |
|
13:49
🔗
|
|
GLaDOS has joined #archiveteam-bs |
|
13:56
🔗
|
|
REiN^ has quit IRC (Ping timeout: 244 seconds) |
|
14:14
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
14:16
🔗
|
|
REiN^ has joined #archiveteam-bs |
|
15:05
🔗
|
|
DoomTay has joined #archiveteam-bs |
|
17:02
🔗
|
|
kristian_ has quit IRC (Leaving) |
|
17:43
🔗
|
yipdw |
oh nice, Windows 10's Resource Monitor is like what happens if you merge htop and lsof and allow filtering by process |
|
17:43
🔗
|
yipdw |
I like this |
|
17:50
🔗
|
|
JesseW has joined #archiveteam-bs |
|
18:12
🔗
|
|
tomwsmf has joined #archiveteam-bs |
|
18:30
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
18:38
🔗
|
|
metal_cam is now known as metalcamp |
|
19:05
🔗
|
|
Start has quit IRC (Read error: Connection reset by peer) |
|
19:05
🔗
|
|
Start has joined #archiveteam-bs |
|
19:11
🔗
|
|
Ravenloft has quit IRC (Ping timeout: 190 seconds) |
|
19:15
🔗
|
DoomTay |
Woah, bwn, any idea why your warrior seems to have gone down to a crawl? |
|
19:19
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
20:09
🔗
|
Smiley |
baby happened |
|
20:09
🔗
|
Smiley |
!http://imgur.com/xj2vKME.jpg7 |
|
20:09
🔗
|
Smiley |
http://imgur.com/xj2vKME.jpg |
|
20:40
🔗
|
Kazzy |
Smiley: congrats! |
|
20:45
🔗
|
Smiley |
ty |
|
20:51
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
21:08
🔗
|
|
Kazzy is now known as Kaz |
|
21:17
🔗
|
bwn |
doomtay: not sure, I'll check it out in a bit |
|
21:52
🔗
|
|
godane has joined #archiveteam-bs |
|
21:53
🔗
|
godane |
i lost internet last night |
|
21:53
🔗
|
godane |
i finally got on now after i came back |
|
21:54
🔗
|
godane |
i was asleep until 4pm then had to go out with my brother |
|
22:02
🔗
|
|
metalcamp has quit IRC (Ping timeout: 244 seconds) |
|
22:09
🔗
|
|
Dyskette has joined #archiveteam-bs |
|
22:10
🔗
|
Dyskette |
Heyo |
|
22:10
🔗
|
|
kristian_ has quit IRC (Leaving) |
|
22:13
🔗
|
Dyskette |
I'm a little new to this while thing - I've been collecting a library of zines and other writings for a long time, mostly LGBT (especially trans) culture because, well, we have so little surviving history, and it is mostly second-hand accounts of people's experiences and identities at best. I've been wanting to look into archiving a lot of blogs and personal websites as well, as I've noticed a bun |
|
22:13
🔗
|
Dyskette |
ch of these starting to disappear. I'm not sure if this is an apporpriate place to ask, but I'm not SUPER technical, and I'd like to be sure I'm doing things sensibly before just starting to dump chunks of internet to disk. |
|
22:14
🔗
|
Dyskette |
I *think* I've got wget grabbing WARC archives, but I don't actually KNOW. Is there an easy way to view or verify WARC archives? |
|
22:15
🔗
|
Dyskette |
(Apologies if I'm in the wrong place to be asking this sort of thing!) |
|
22:20
🔗
|
arkiver |
You can use webarchiveplayer to try and replay the WARCs |
|
22:20
🔗
|
arkiver |
https://github.com/ikreymer/webarchiveplayer |
|
22:21
🔗
|
arkiver |
Which OS are you using? |
|
22:21
🔗
|
Dyskette |
Debian |
|
22:22
🔗
|
Dyskette |
Yeah, this looks perfect! Thanks a bunch :) |
|
22:22
🔗
|
arkiver |
What are you going to do with the archives? |
|
22:23
🔗
|
Dyskette |
I'm not quite sure yet |
|
22:23
🔗
|
arkiver |
Maybe you can upload them to IA with mediatype 'web' |
|
22:23
🔗
|
Dyskette |
I have some reservations about just putting it up, because of the... sensitive nature of a lot of it |
|
22:23
🔗
|
arkiver |
They'll be in the wayback machine then |
|
22:23
🔗
|
arkiver |
The Wayback Machine doesn't care about sensitivity ;) |
|
22:24
🔗
|
arkiver |
Librarians should never choose sides :) |
|
22:24
🔗
|
arkiver |
You might also want to have a look at https://github.com/ludios/grab-site |
|
22:24
🔗
|
Dyskette |
I know, but some of the people who were running websites that effectively out them as trans that they've taken down might, and it's an area where I'm more concerned than I would be otherwise |
|
22:24
🔗
|
arkiver |
I see |
|
22:25
🔗
|
Dyskette |
So for now I'm just making sure I have all this stuff, with redundant backups |
|
22:25
🔗
|
arkiver |
Ok |
|
22:26
🔗
|
arkiver |
If you ever want them in the wayback machine and need help, let us know :) |
|
22:26
🔗
|
Dyskette |
Like a lot of the paper stuff I collect (which I also digitise) I would have less reservation about making it available (ie throwing it at the IA) with a bit more distance, timewise |
|
22:28
🔗
|
Dyskette |
But yeah, I fully don't expect people to necessarily agree with my approach, and to be honest, I wouldn't claim to have any sort of grand master plan |
|
22:29
🔗
|
Dyskette |
But at the same time, I figure doing SOMETHING is better than letting the artefacts of a culture that has been evolving and changing incredibly quickly just disappear |
|
22:29
🔗
|
* |
Dyskette shrugs |
|
22:29
🔗
|
Dyskette |
Thanks for the help again. |
|
22:29
🔗
|
arkiver |
:) |
|
22:29
🔗
|
arkiver |
If you need any more help, you can always ask us |
|
22:29
🔗
|
Dyskette |
And, you guys are awesome in general, and what you're doing is fantastic. |
|
22:30
🔗
|
arkiver |
:D |
|
22:30
🔗
|
* |
arkiver agrees |
|
22:30
🔗
|
Dyskette |
Heh heh |
|
22:33
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
22:37
🔗
|
|
Coderjoe has quit IRC (Ping timeout: 260 seconds) |
|
22:38
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
22:51
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
23:11
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
23:19
🔗
|
|
Coderjoe has quit IRC (Ping timeout: 260 seconds) |
|
23:34
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
23:37
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
23:55
🔗
|
|
closure has joined #archiveteam-bs |