| Time |
Nickname |
Message |
|
00:10
🔗
|
|
Stiletto has quit IRC (Read error: Connection reset by peer) |
|
00:11
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
00:15
🔗
|
|
Muad-Dib has quit IRC (Ping timeout: 260 seconds) |
|
00:17
🔗
|
|
Muad-Dib has joined #archiveteam-bs |
|
00:23
🔗
|
|
Stiletto has quit IRC (Read error: Connection reset by peer) |
|
00:23
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
00:24
🔗
|
|
Stiletto has quit IRC (Read error: Connection reset by peer) |
|
00:24
🔗
|
|
Chorca has quit IRC (Read error: Operation timed out) |
|
00:25
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
00:29
🔗
|
|
Chorca has joined #archiveteam-bs |
|
00:43
🔗
|
|
Stiletto has quit IRC (Read error: Connection reset by peer) |
|
00:44
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
01:07
🔗
|
kyan |
I really want Terastash to be out. I'd like to hack it to use IA as a backend for rolling archives |
|
01:07
🔗
|
HCross |
kyan, you can send custom UA's |
|
01:07
🔗
|
kyan |
Wait, what? |
|
01:08
🔗
|
HCross |
--user-agent-alias firefox |
|
01:08
🔗
|
kyan |
OH! about the earlier comment |
|
01:08
🔗
|
HCross |
--user-agent-alias=firefox |
|
01:08
🔗
|
kyan |
Yes, I did that |
|
01:08
🔗
|
kyan |
thanks :) |
|
01:09
🔗
|
kyan |
I thought that was a reply to the one I just made, and was like wut |
|
01:23
🔗
|
|
Stiletto has quit IRC (Ping timeout: 246 seconds) |
|
01:37
🔗
|
|
SN4T14 has joined #archiveteam-bs |
|
01:52
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
01:53
🔗
|
|
toad2 has joined #archiveteam-bs |
|
01:56
🔗
|
|
toad1 has quit IRC (Read error: Operation timed out) |
|
02:10
🔗
|
|
vitzli has joined #archiveteam-bs |
|
02:46
🔗
|
|
Frogging1 is now known as Frogging |
|
03:26
🔗
|
|
altlabel has quit IRC (hub.dk irc.homelien.no) |
|
03:26
🔗
|
|
i0npulse has quit IRC (hub.dk irc.homelien.no) |
|
03:26
🔗
|
|
PotcFdk has quit IRC (hub.dk irc.homelien.no) |
|
03:26
🔗
|
|
limebyte has quit IRC (hub.dk irc.homelien.no) |
|
03:26
🔗
|
|
coretx has quit IRC (hub.dk irc.homelien.no) |
|
03:26
🔗
|
|
pikhq has quit IRC (hub.dk irc.homelien.no) |
|
03:26
🔗
|
|
PurpleSym has quit IRC (hub.dk irc.homelien.no) |
|
04:02
🔗
|
|
achip has quit IRC (hub.efnet.us irc.Prison.NET) |
|
04:18
🔗
|
snape_ |
Heh, just found a zip file of nine text files from a BBS in 1994, none of which seem to be on textfiles.com, or anywhere online for that matter. :3 |
|
04:22
🔗
|
kyan |
Upload upload upload |
|
04:22
🔗
|
SketchCow |
Let's be clear. |
|
04:22
🔗
|
kyan |
:D |
|
04:22
🔗
|
SketchCow |
Internet Archive does not "slow things down" because we're "running out of space" |
|
04:23
🔗
|
SketchCow |
And I guarantee that when we get to the edge, we'll see another couple petabytes pop up |
|
04:24
🔗
|
kyan |
Some CC licensed media apparently got darked today |
|
04:25
🔗
|
kyan |
The Internet Archive is wonderful, but sometimes they do things that really seem at odds with their mission |
|
04:26
🔗
|
SketchCow |
You literally fucking have an IA guy here |
|
04:26
🔗
|
SketchCow |
Let's try and use that fact to get actual information |
|
04:26
🔗
|
|
Stiletto has quit IRC (Remote host closed the connection) |
|
04:26
🔗
|
SketchCow |
Instead of acting like you're guessing what the climate of Neptune is |
|
04:26
🔗
|
kyan |
That is why I mention it :) |
|
04:26
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
04:26
🔗
|
SketchCow |
You did it wrong. |
|
04:26
🔗
|
SketchCow |
23:25 < kyan> The Internet Archive is wonderful, but sometimes they do things that really seem at odds with their mission |
|
04:26
🔗
|
SketchCow |
See that? |
|
04:27
🔗
|
kyan |
Yep, I think I have a pretty good point |
|
04:27
🔗
|
SketchCow |
That's how you piss me off. |
|
04:27
🔗
|
kyan |
Ok, so? I think I have valid concerns. If you don't like it, feel free to ban me from the channel |
|
04:29
🔗
|
SketchCow |
Oh, no doubt they are valid. |
|
04:29
🔗
|
SketchCow |
It's just the ridiculous conspiratorial way you're putting it. It's pathetic. |
|
04:29
🔗
|
SketchCow |
Somthing out of ntohing. |
|
04:30
🔗
|
kyan |
Conspiratorial? I'm hardly conspiring with anyone |
|
04:30
🔗
|
SketchCow |
"They do things" |
|
04:30
🔗
|
kyan |
(or accusing anyone of conspiring) |
|
04:30
🔗
|
|
Stiletto has quit IRC (Remote host closed the connection) |
|
04:30
🔗
|
kyan |
Yeah, IA sometimes makes decisions that I strongly disagree with |
|
04:30
🔗
|
kyan |
That's not nothing. It's a difference of viewpoints. |
|
04:31
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
04:31
🔗
|
SketchCow |
Sigh. |
|
04:31
🔗
|
snape_ |
What was the media? Was it disturbing jihadi shit? I'm betting it was disturbing jihadi shit. |
|
04:31
🔗
|
kyan |
It was some guy playing EVE Online |
|
04:31
🔗
|
|
achip has joined #archiveteam-bs |
|
04:31
🔗
|
godane |
SketchCow: youtubearchive collection is blocked |
|
04:31
🔗
|
SketchCow |
Give me the item name, retard. |
|
04:31
🔗
|
SketchCow |
godane: Which? |
|
04:32
🔗
|
SketchCow |
Blocked which way |
|
04:32
🔗
|
kyan |
It was part of that collection, I assume. Heard about it from Fletcher |
|
04:32
🔗
|
Fletcher |
"We're contacting you as a courtesy to let you know that the items in the collection youtubearchive have been removed and your account locked. The uploaded items appear to not adhere to the archive.org terms of use (https://archive.org/about/terms.php)." emailed four hours ago |
|
04:33
🔗
|
Fletcher |
http://archive.org/details/youtubearchive |
|
04:33
🔗
|
snape_ |
http://69.30.218.174/EDENASC.ZIP <- Oct 1994 BBS text files |
|
04:34
🔗
|
Fletcher |
SketchCow, the CC items referenced above were in that collection and included the tag "SeamusDonohueEVE" (for easy searching) |
|
04:35
🔗
|
SketchCow |
OK, so, news flash |
|
04:35
🔗
|
SketchCow |
There are basically 2 people who do this work. |
|
04:35
🔗
|
SketchCow |
They are called Jeff and Chris. |
|
04:35
🔗
|
SketchCow |
Chris is on vacation. |
|
04:35
🔗
|
SketchCow |
So Jeff. |
|
04:35
🔗
|
SketchCow |
JEFF> |
|
04:35
🔗
|
kyan |
but it seems like part of a more systemic issue — 1. Bookplates suggested as a way to track donated books — they damage the books, and labeling the boxes would be better. 2. No way to search darked items to see if something's been archived yet. 3. No way to access non-public WARCs available by Wayback, even on an individual request basis. 4. No clear response to nicely worded requests for explanation / official policy on removal of Dabiq magazine. |
|
04:35
🔗
|
kyan |
5. Spam is darked, rather than noindexed and made browsable. |
|
04:35
🔗
|
SketchCow |
OK, kyan, you moron? Not a staff, not a councel. |
|
04:35
🔗
|
SketchCow |
It's a guy. |
|
04:35
🔗
|
SketchCow |
He listens. |
|
04:36
🔗
|
SketchCow |
See, I'm doing this for Fletcher. I'm done talking to you. |
|
04:36
🔗
|
SketchCow |
Fletcher: I'm sure Jeff got worried and knocked it out in total. |
|
04:36
🔗
|
kyan |
Ok, bye for now then. However, I stand by my concerns. |
|
04:36
🔗
|
SketchCow |
Go to the hell the other hells are afraid of. |
|
04:36
🔗
|
SketchCow |
I'll wait eagerly for your own |
|
04:37
🔗
|
Fletcher |
SketchCow, is there a set process for getting my account unbanned? |
|
04:37
🔗
|
SketchCow |
Writing to info@archive.org to discuss the issue. |
|
04:37
🔗
|
SketchCow |
But I'm also in there. I'm going to ask Jeff. |
|
04:38
🔗
|
Fletcher |
Thanks |
|
04:38
🔗
|
Fletcher |
On a side note, could you make sure Jeff knows he's sending emails as "collections-service@archive.org"? |
|
04:38
🔗
|
|
Chorca has quit IRC (Ping timeout: 252 seconds) |
|
04:38
🔗
|
SketchCow |
That's the accurate name. |
|
04:39
🔗
|
Fletcher |
kk |
|
04:39
🔗
|
SketchCow |
23:35 < kyan> 5. Spam is darked, rather than noindexed and made browsable. |
|
04:39
🔗
|
SketchCow |
Holy shit, what a moron |
|
04:39
🔗
|
kyan |
O RLY I think I've got a good point? |
|
04:39
🔗
|
kyan |
If spam is filtered out of browsing and search results, what's wrong with having it there? |
|
04:40
🔗
|
SketchCow |
You think the spammers who use IA bandwidth to put up porn and movies in our environment won't just use those links on their spam sites so they have free bandwidth AND they don't have to host, AND we are the ones who get banned? |
|
04:40
🔗
|
SketchCow |
Idiot. |
|
04:40
🔗
|
SketchCow |
Take a day off. |
|
04:40
🔗
|
|
SketchCow sets mode: +b *!*kyan@184.75.223.* |
|
04:40
🔗
|
|
kyan was kicked by SketchCow (kyan) |
|
04:40
🔗
|
|
Chorca has joined #archiveteam-bs |
|
04:40
🔗
|
SketchCow |
Idiot. |
|
04:41
🔗
|
SketchCow |
15,021 items in youtubearchive all blocked. |
|
04:41
🔗
|
SketchCow |
Darked, really. Interesting |
|
04:41
🔗
|
SketchCow |
(Blocked isn't the right term; blocked is) |
|
04:42
🔗
|
SketchCow |
SOrry |
|
04:42
🔗
|
SketchCow |
SO angry I'm swapping words. |
|
04:42
🔗
|
SketchCow |
(Blocked isn't the right term; darked is) |
|
04:42
🔗
|
SketchCow |
I'm assuming Jeff got a message about something mirrored on youtubearchive |
|
04:43
🔗
|
SketchCow |
I pinged him, but it's Sunday and we have tomorrow off. |
|
04:43
🔗
|
SketchCow |
He could be anywhere |
|
04:43
🔗
|
SketchCow |
Might not be resolved until Tuesday |
|
04:44
🔗
|
MrRadar |
Thank you for your work SketchCow |
|
04:44
🔗
|
Fletcher |
No problem, that's still a decent response time in the long run |
|
04:44
🔗
|
SketchCow |
Shhh, shh. I'm being unprofessional |
|
04:46
🔗
|
SketchCow |
I'm assuming we got a threat and Jeff did a non-surgical strike |
|
04:46
🔗
|
godane |
anyways i'm uploading 2008-07 of kpfa |
|
04:46
🔗
|
SketchCow |
Thanks. |
|
04:46
🔗
|
godane |
we have half of 2008 of kpfa done |
|
04:47
🔗
|
vitzli |
Fletcher, I only PMed you, no any further emails/PMs |
|
04:47
🔗
|
Fletcher |
vitzli? |
|
04:47
🔗
|
Fletcher |
oh right, no problem :) |
|
04:47
🔗
|
godane |
in other news i got a 128gb USB for $20 at staples |
|
04:48
🔗
|
SketchCow |
Yeah, they're getting nuts |
|
04:48
🔗
|
SketchCow |
https://twitter.com/kolubat/status/699091432741675008 |
|
04:48
🔗
|
SketchCow |
Double idiot |
|
04:48
🔗
|
SketchCow |
A cry in the wilderness with 7 followers |
|
04:48
🔗
|
Fletcher |
:/ |
|
04:48
🔗
|
MrRadar |
Wow |
|
04:49
🔗
|
godane |
wow exactly |
|
04:49
🔗
|
godane |
i thought what he was taking about was just in here |
|
04:50
🔗
|
SketchCow |
I have a special trigger for when someone has something like 9% of the information, quickly fills in the other 91% and just goes off on their situation. |
|
04:51
🔗
|
SketchCow |
Blocked him. |
|
04:52
🔗
|
SketchCow |
Archive Team: Don't Be Dumb |
|
04:53
🔗
|
SketchCow |
I'm positive that some letter came in because with 15,000 videos of youtube rips, someone got pissed. |
|
04:53
🔗
|
SketchCow |
And Jeff overreached because its sunday and Chris is on vacation |
|
04:54
🔗
|
Fletcher |
Given that it included The Fine Bros, Gametrailers and IGN I'm not really surprised |
|
04:54
🔗
|
vitzli |
I bet it's React folks |
|
04:54
🔗
|
SketchCow |
Right. |
|
04:54
🔗
|
SketchCow |
So, Jeff did a weekend, HOLIDAY WEEKEND staunch-the-bleed |
|
04:54
🔗
|
SketchCow |
Because unlike some moron and his army of 7, lawyers |
|
04:55
🔗
|
godane |
luckly my stuff didn't get blocked yet: https://archive.org/details/godaneinbox?and[]=subject%3A%22TheFineBros%22 |
|
04:56
🔗
|
SketchCow |
So close the store first, then go back and make sure just the brand of soup is not on the shelves. |
|
04:56
🔗
|
SketchCow |
They know you're mine, godane |
|
04:56
🔗
|
SketchCow |
They'll come to me |
|
04:56
🔗
|
godane |
ok |
|
04:56
🔗
|
MrRadar |
SketchCow: while you might not always be "professional" you do keep this group from falling victim to the geek social fallacies (http://www.plausiblydeniable.com/opinion/gsf.html) |
|
04:57
🔗
|
SketchCow |
Well aware of that document |
|
04:57
🔗
|
* |
SketchCow kicks out cat piss guy once a month |
|
04:58
🔗
|
snape_ |
Sad butthurt saved for posterity: https://web.archive.org/web/20160215044951/https:/twitter.com/kolubat/status/699091432741675008 |
|
04:59
🔗
|
SketchCow |
Ridiculous. |
|
05:01
🔗
|
vitzli |
Is there a proper way of doing an index/audit for a collection? I grabbed the list and counted all users in the telenor grab |
|
05:02
🔗
|
Fletcher |
SketchCow, for slack should I send an email through or is irc sufficient? |
|
05:02
🔗
|
SketchCow |
It's still up in the air |
|
05:03
🔗
|
SketchCow |
We definitely should do more. |
|
05:03
🔗
|
SketchCow |
I'm working with a guy to do a mediawiki-archive.org bridge |
|
05:03
🔗
|
SketchCow |
So it pulls in all the metadata from a collection, we edit it, and then it goes in. |
|
05:05
🔗
|
vitzli |
and since I said about it - there are 12151 users (~username) that have 200 OK page |
|
05:05
🔗
|
SketchCow |
So a bunch of people can do a group edit, and then boom. |
|
05:06
🔗
|
vitzli |
would it be possible to add collections? |
|
05:07
🔗
|
SketchCow |
You still have to ask. |
|
05:07
🔗
|
vitzli |
like peer-reviewed or something |
|
05:09
🔗
|
SketchCow |
Fletcher: It's because they're all React videos |
|
05:09
🔗
|
SketchCow |
(Or many) |
|
05:11
🔗
|
SketchCow |
And Jeff doesn't have time to sort right now |
|
05:11
🔗
|
Fletcher |
around 1400/15000, would it be possible to just dark those items and I'll work out another solution for archiving dmca magnets? |
|
05:11
🔗
|
SketchCow |
It's more this. |
|
05:11
🔗
|
SketchCow |
We need you and people to: |
|
05:11
🔗
|
SketchCow |
1. Find the items that are clearly CC |
|
05:12
🔗
|
SketchCow |
2. Apparently for the moment we are darking Youtube videos that are mirrors of actual hosted materials up |
|
05:14
🔗
|
|
Swizzle has quit IRC (Read error: Operation timed out) |
|
05:38
🔗
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
|
05:45
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:54
🔗
|
SketchCow |
ANYWAY |
|
05:55
🔗
|
SketchCow |
Two quick ranty things, dovetailing into a conversation someone wanted me to have. |
|
05:56
🔗
|
SketchCow |
First, Archive Team is bigger than archive.org - archive.org is a grateful and excellent vendor and available place for archiveteam's output. But it's also going to have limits. |
|
05:57
🔗
|
SketchCow |
It is not archive.org's job to go everywhere, everyplace, in every radical direction and be considered shitlords for not doing that. |
|
05:58
🔗
|
SketchCow |
Second, the example of archiving /r/gonewild was brought up. |
|
06:00
🔗
|
SketchCow |
Within the context of what I think we've done, I do realize gonewild is a public forum and a public posting, and so therefore, archiving it is likely to happen, and we certainly have developed an amazing suite of tools to archive everything, agnostically, and quickly. |
|
06:00
🔗
|
SketchCow |
There's a chance archive.org will refuse to archive it. |
|
06:01
🔗
|
SketchCow |
And there's a chance that archive team members will all say "fuck it, not our project" |
|
06:01
🔗
|
SketchCow |
And I think it's up to whoever thinks their thing is a thing to then take tools and use them, but realize they might not have the full backup of the whole team and very likely might have to go pay the $60 and store it themselves. |
|
06:02
🔗
|
SketchCow |
Make sense? Thoughts? |
|
06:04
🔗
|
MrRadar |
That definitely makes sense to me. |
|
06:05
🔗
|
snape_ |
Makes sense to me, but my (personal) preference is for essentially curated collections of limited scope rather than unwieldy hoards, so... |
|
06:09
🔗
|
|
oldcad has quit IRC (Quit: Leaving.) |
|
06:11
🔗
|
snape_ |
SketchCow, if you don't mind, could you elaborate on the Archive darking material still on Youtube? Is it automated, or...? |
|
06:26
🔗
|
|
i0npulse has joined #archiveteam-bs |
|
06:26
🔗
|
|
altlabel has joined #archiveteam-bs |
|
06:26
🔗
|
|
PotcFdk has joined #archiveteam-bs |
|
06:26
🔗
|
|
limebyte has joined #archiveteam-bs |
|
06:26
🔗
|
|
coretx has joined #archiveteam-bs |
|
06:26
🔗
|
|
pikhq has joined #archiveteam-bs |
|
06:26
🔗
|
|
PurpleSym has joined #archiveteam-bs |
|
06:26
🔗
|
|
irc.homelien.no sets mode: +o PurpleSym |
|
06:30
🔗
|
SketchCow |
Not much to elaborate - clearly marked "don't distribute" - harder |
|
06:52
🔗
|
|
JW_work2 has joined #archiveteam-bs |
|
07:13
🔗
|
|
Aranje has quit IRC (Quit: Three sheets to the wind) |
|
07:15
🔗
|
|
jut has joined #archiveteam-bs |
|
08:09
🔗
|
Fletcher |
rsync is flying along now \o/ |
|
08:38
🔗
|
yipdw |
~8.5 TB of docstoc from archiveteam.kenshin.sg uploaded |
|
08:38
🔗
|
yipdw |
the speed on this machine is fantastic, ~630 Mbit/s sustained |
|
08:38
🔗
|
yipdw |
up to IA that is |
|
08:47
🔗
|
|
signius has quit IRC (Ping timeout: 300 seconds) |
|
08:49
🔗
|
|
antomatic has quit IRC (Read error: Connection reset by peer) |
|
08:50
🔗
|
|
antomatic has joined #archiveteam-bs |
|
08:51
🔗
|
vitzli |
HCross, viola-beach from soundcloud was archived to https://archive.org/details/soundcloud-indp-viola-beach |
|
09:00
🔗
|
|
signius has joined #archiveteam-bs |
|
09:28
🔗
|
|
schbirid has joined #archiveteam-bs |
|
09:46
🔗
|
arkiver |
<SketchCow>I'm working with a guy to do a mediawiki-archive.org bridge |
|
09:46
🔗
|
arkiver |
Will this be something like our wikiteam project? |
|
09:46
🔗
|
arkiver |
Because the WARC-part of the wikiteam project will save mediawiki to WARCs |
|
09:46
🔗
|
arkiver |
and external links from mediawikis to WARCs |
|
09:53
🔗
|
|
PurpleSym sets mode: +o arkiver |
|
10:25
🔗
|
|
lytv has quit IRC (Read error: Operation timed out) |
|
10:26
🔗
|
|
lytv has joined #archiveteam-bs |
|
10:31
🔗
|
SmileyG |
is there anymore to load for fotolog? |
|
11:11
🔗
|
|
VADemon has joined #archiveteam-bs |
|
11:16
🔗
|
|
Swizzle has joined #archiveteam-bs |
|
11:33
🔗
|
|
Swizzle has quit IRC (Read error: Operation timed out) |
|
11:43
🔗
|
|
i0npulse has quit IRC (leaving) |
|
11:47
🔗
|
|
i0npulse has joined #archiveteam-bs |
|
12:26
🔗
|
|
arkiver3 has joined #archiveteam-bs |
|
12:44
🔗
|
|
Rickster has quit IRC (Ping timeout: 260 seconds) |
|
12:44
🔗
|
|
marvinw has quit IRC (Ping timeout: 260 seconds) |
|
12:46
🔗
|
|
Kenshin has quit IRC (Read error: Connection reset by peer) |
|
12:46
🔗
|
|
Kenshin has joined #archiveteam-bs |
|
12:46
🔗
|
|
Famicoman has quit IRC (Ping timeout: 260 seconds) |
|
12:47
🔗
|
|
goekesmi has quit IRC (Ping timeout: 260 seconds) |
|
12:47
🔗
|
|
goekesmi has joined #archiveteam-bs |
|
12:55
🔗
|
|
Rickster has joined #archiveteam-bs |
|
13:00
🔗
|
|
marvinw has joined #archiveteam-bs |
|
13:33
🔗
|
Fletcher |
arkiver, the mediawiki bridge will allow group editing of metadata through the mediawiki interface that is then mirrored on IA |
|
13:34
🔗
|
|
VADemon has quit IRC (Read error: Operation timed out) |
|
13:36
🔗
|
|
Famicoman has joined #archiveteam-bs |
|
13:47
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 252 seconds) |
|
13:51
🔗
|
|
arkiver3 has joined #archiveteam-bs |
|
13:53
🔗
|
arkiver3 |
Fletcher: I see, so it's totally different from the WikiTeam WARC project |
|
13:54
🔗
|
arkiver3 |
I still haven't started the grab of the actual mediawiki's yet |
|
13:54
🔗
|
arkiver3 |
Needs a bit of more testing, but it should be almost ready to go |
|
13:54
🔗
|
Fletcher |
yeah, it's just a way to get around the not fantastic IA user/item management |
|
13:55
🔗
|
phuzion |
arkiver3: I've got a question about that videobot you were talking about. Is it supposed to be more archivebot or newsbuddy? Meaning is it intended for on-demand archival or regular recurring archival? |
|
13:56
🔗
|
arkiver3 |
phuzion: currently I'm thinking more more archivebot |
|
13:56
🔗
|
arkiver3 |
But I'd like to add an option to automatically scrape channels periodically |
|
13:57
🔗
|
arkiver3 |
Basically the project will have special scripts for the supported websites to ensure as good playback as possible and the extraction of as much metadata as possible. |
|
13:58
🔗
|
HCross |
arkiver3, werent you thinking of adding Selenium or something to newsbuddy. Might that also work here? |
|
14:01
🔗
|
phuzion |
arkiver3: I only ask because podcasts would be great to add to it. |
|
14:01
🔗
|
phuzion |
Throw it an RSS and say "Check it every sunday" or whenever the podcast updates, and have the podcast automatically pushed to the proper collection and everything. |
|
14:01
🔗
|
HCross |
I know this is a long shot, what about Apple podcasts |
|
14:02
🔗
|
phuzion |
What about them? |
|
14:02
🔗
|
HCross |
could we get them? |
|
14:02
🔗
|
phuzion |
If they can be imported into a podcast program, then theoretically yeah |
|
14:02
🔗
|
phuzion |
Podcasts are basically RSS files pointing to audio files. |
|
14:03
🔗
|
phuzion |
http://feeds.twit.tv/twit.xml TWiT for example |
|
14:04
🔗
|
HCross |
ah, its possible but requires someone to use iTunes to grab it http://superuser.com/questions/78415/get-rss-feed-from-itunes-podcast-links/782413 |
|
14:05
🔗
|
phuzion |
Oh wow |
|
14:05
🔗
|
HCross |
Its Apple. They love doing stuff like this |
|
14:05
🔗
|
phuzion |
Didn't know Apple had a proprietary format for podcasts |
|
14:05
🔗
|
phuzion |
which is stupid |
|
14:22
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 252 seconds) |
|
14:49
🔗
|
|
Boltsie__ has joined #archiveteam-bs |
|
14:50
🔗
|
|
Boltsie__ is now known as Boltsie |
|
14:55
🔗
|
|
VADemon has joined #archiveteam-bs |
|
14:57
🔗
|
|
arkiver3 has joined #archiveteam-bs |
|
15:17
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 252 seconds) |
|
15:29
🔗
|
|
RichardG has quit IRC (Read error: Operation timed out) |
|
15:48
🔗
|
|
GLaDOS has quit IRC (Read error: Operation timed out) |
|
15:49
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
15:56
🔗
|
|
RichardG has joined #archiveteam-bs |
|
16:14
🔗
|
|
GLaDOS has joined #archiveteam-bs |
|
16:23
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
16:26
🔗
|
SketchCow |
arkiver: This is not a wikimedia to archive.org bridge like "save a wiki". This is being able to group-edit archive.org descriptions and metadata. |
|
16:26
🔗
|
SketchCow |
I see this was answered. Sorry, just got up. |
|
17:16
🔗
|
arkiver |
Thanks |
|
17:22
🔗
|
arkiver |
HCross: phuzion: podcasts is aso something we can add to videobot |
|
17:22
🔗
|
phuzion |
ok cool |
|
17:22
🔗
|
arkiver |
And also add the option to upload the files as audio item to IA |
|
17:23
🔗
|
arkiver |
Other things might be support for some photo sites |
|
17:25
🔗
|
vitzli |
gif/webm? |
|
17:26
🔗
|
arkiver |
sure |
|
17:26
🔗
|
arkiver |
Basically videobot will be a bot with specially written support for websites to do a grab as good as possible |
|
17:26
🔗
|
arkiver |
SketchCow, more info on videobot ^ |
|
17:27
🔗
|
arkiver |
Where archivebot is a more general archiving bot, videobot would not support all websites, but the websites it does support will be grabbed better using videobot then archivebot |
|
17:29
🔗
|
phuzion |
arkiver: Would it be possible to have archivebot intelligently forward requests to videobot when it knows that videobot can handle it better? |
|
17:30
🔗
|
arkiver |
yeah, that can be added |
|
17:30
🔗
|
phuzion |
For example, if someone does !ao on a youtube channel, have archivebot be like "Hey, that would be a great job for videobot. Forwarding the request for your convenience" |
|
17:31
🔗
|
arkiver |
yes, but that would also need some change on the side of archivebot |
|
17:31
🔗
|
|
espes__ has quit IRC (Read error: Operation timed out) |
|
17:37
🔗
|
Fletcher |
Given the sometimes sporadic support for youtube-dl in archivebot it may be a good idea. |
|
18:02
🔗
|
|
vitzli has quit IRC (Leaving) |
|
18:06
🔗
|
|
Swizzle has joined #archiveteam-bs |
|
18:07
🔗
|
|
i0npulse has quit IRC (hub.dk irc.homelien.no) |
|
18:07
🔗
|
|
altlabel has quit IRC (hub.dk irc.homelien.no) |
|
18:07
🔗
|
|
PotcFdk has quit IRC (hub.dk irc.homelien.no) |
|
18:07
🔗
|
|
limebyte has quit IRC (hub.dk irc.homelien.no) |
|
18:07
🔗
|
|
coretx has quit IRC (hub.dk irc.homelien.no) |
|
18:07
🔗
|
|
pikhq has quit IRC (hub.dk irc.homelien.no) |
|
18:07
🔗
|
|
PurpleSym has quit IRC (hub.dk irc.homelien.no) |
|
18:38
🔗
|
|
i0npulse has joined #archiveteam-bs |
|
18:38
🔗
|
|
PurpleSym has joined #archiveteam-bs |
|
18:38
🔗
|
|
altlabel has joined #archiveteam-bs |
|
18:38
🔗
|
|
PotcFdk has joined #archiveteam-bs |
|
18:38
🔗
|
|
limebyte has joined #archiveteam-bs |
|
18:38
🔗
|
|
coretx has joined #archiveteam-bs |
|
18:38
🔗
|
|
pikhq has joined #archiveteam-bs |
|
18:56
🔗
|
|
wyatt8740 has joined #archiveteam-bs |
|
19:01
🔗
|
|
JW_work2 has quit IRC (Leaving.) |
|
19:25
🔗
|
|
zino has joined #archiveteam-bs |
|
19:31
🔗
|
zino |
I should probably move to a less analogue method of handling the data on my home servers... |
|
19:31
🔗
|
Frogging |
arkiver: So, how does archiveteam work? Who downloads files, and where do they get stored, and who submits them to IA? |
|
19:31
🔗
|
zino |
https://goo.gl/photos/2A56FZk448zWhGmL6 |
|
19:31
🔗
|
Frogging |
And how is it ensured that people aren't redundantly downloading the same things |
|
19:32
🔗
|
schbirid |
it's all REALLY WELL ORGANIZED |
|
19:33
🔗
|
Frogging |
Is it? :p |
|
19:34
🔗
|
Fletcher |
Frogging, smaller sites/individual pages are handled by ArchiveBot (#archivebot) which outsources jobs to volunteer pipelines. Those pipelines will get a copy of the content in Warc format and upload it to a staging server where they're then loaded into the wayback machine for general consumption |
|
19:35
🔗
|
snape_ |
It's the BEST ORGANIZED independent autonomous decentralized worldwide volunteer anarcho-syndicalist commune of archivist downloaders on the web today! |
|
19:35
🔗
|
|
metalcamp has joined #archiveteam-bs |
|
19:36
🔗
|
Fletcher |
Large projects are handled by a central tracker that hands out individual items to anyone running the ArchiveTeam Warrior (vm that runs wpull) and people running the scripts directly |
|
19:36
🔗
|
|
RichardG has quit IRC (Read error: Operation timed out) |
|
19:37
🔗
|
Fletcher |
From there content is uploaded to a staging server where it's prepared for uploading into IA, combining individual items into 50G warcs and performing any other tasks to make the content easily viewable |
|
19:37
🔗
|
joepie91 |
snape_: out of three! |
|
19:37
🔗
|
joepie91 |
:P |
|
19:37
🔗
|
zino |
There are 3? Do tell. |
|
19:38
🔗
|
joepie91 |
bibanon does a similar thing, there's another one I forgot the name of |
|
19:38
🔗
|
* |
zino Googles bibanon |
|
19:38
🔗
|
schbirid |
http://www.stephenfry.com/2016/02/15/peedinthepool/ |
|
19:38
🔗
|
* |
arkiver googles bibanon |
|
19:38
🔗
|
Frogging |
I see |
|
19:39
🔗
|
arkiver |
bibanon is mostly 4chan archiving it seems |
|
19:44
🔗
|
|
GLaDOS has quit IRC (Ping timeout: 260 seconds) |
|
19:45
🔗
|
joepie91 |
they do a bunch of stuff, also run an archivebot instance |
|
19:45
🔗
|
joepie91 |
as in |
|
19:46
🔗
|
joepie91 |
tracker |
|
19:46
🔗
|
joepie91 |
not quite archiveteam scale afaik |
|
19:46
🔗
|
xmc |
ah nice |
|
19:46
🔗
|
arkiver |
where is that located? |
|
19:46
🔗
|
joepie91 |
but they exist nevertheless :P |
|
19:46
🔗
|
arkiver |
ArchiveTeam still biggest :) |
|
19:46
🔗
|
xmc |
always nice to hear that quality things are getting reused |
|
19:46
🔗
|
joepie91 |
arkiver: best ask on their IRC |
|
19:50
🔗
|
schbirid |
http://nugnugnug.com/pc/master/ |
|
19:52
🔗
|
|
Laverne has joined #archiveteam-bs |
|
19:57
🔗
|
arkiver |
I see Fletcher just joined too |
|
19:57
🔗
|
Fletcher |
:D |
|
20:00
🔗
|
Fletcher |
"Archive Team is another rogue archiving organisation, one that’s bigger than us. DO NOT bring up our organisation in their channels or in discussions with them unless you discuss it with Antonizoon or Dan_ on the IRC channel beforehand." |
|
20:00
🔗
|
arkiver |
wut |
|
20:00
🔗
|
arkiver |
where did you read that |
|
20:01
🔗
|
Fletcher |
the rules in their topic |
|
20:02
🔗
|
arkiver |
interesting |
|
20:02
🔗
|
arkiver |
I see a dan here |
|
20:04
🔗
|
ersi |
derpanon |
|
20:08
🔗
|
joepie91 |
Fletcher: arkiver: there's a reason for that |
|
20:08
🔗
|
joepie91 |
had some issues here in the past with some of their users |
|
20:08
🔗
|
arkiver |
only dec3199? |
|
20:08
🔗
|
joepie91 |
another one whose name I forgot |
|
20:08
🔗
|
joepie91 |
that has been resolved |
|
20:09
🔗
|
joepie91 |
but it's been decided to keep cross-pollination to a minimum to avoid future drama :P |
|
20:09
🔗
|
joepie91 |
which is probably a wise decision |
|
20:09
🔗
|
joepie91 |
so yeah, that topic is just a drama-prevention measure |
|
20:09
🔗
|
snape_ |
Do not poke the autistic weaboos, check. |
|
20:10
🔗
|
* |
ersi giggles |
|
20:10
🔗
|
arkiver |
I only know about dec3199 |
|
20:11
🔗
|
arkiver |
as for the rest, I might have missed something |
|
20:12
🔗
|
schbirid |
"organisation" http://images.memes.com/character/meme/dr-evil |
|
20:13
🔗
|
snape_ |
"organization" sounds better than "gang", you have to admit... |
|
20:14
🔗
|
godane |
i'm downloading all of the glennbeck facebook videos |
|
20:14
🔗
|
Frogging |
Archive Gang |
|
20:18
🔗
|
snape_ |
We could pretend to be a 3l33t scene group. 4RCHiV3T34M |
|
20:19
🔗
|
midas |
arkiver: dec was...wow |
|
20:19
🔗
|
zino |
AI is the new exclusive topsite. |
|
20:30
🔗
|
|
metalcamp has quit IRC (Ping timeout: 492 seconds) |
|
20:30
🔗
|
|
espes__ has joined #archiveteam-bs |
|
20:37
🔗
|
ersi |
midas: mindblowingly silly, to be mild |
|
20:41
🔗
|
godane |
i'm uploading 2008-08 of kpfa mp3s |
|
21:25
🔗
|
|
jut has quit IRC (Read error: Connection reset by peer) |
|
21:29
🔗
|
|
wyatt8740 has quit IRC (Read error: Operation timed out) |
|
21:34
🔗
|
|
RichardG has joined #archiveteam-bs |
|
21:36
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
21:46
🔗
|
|
RichardG has quit IRC (Ping timeout: 633 seconds) |
|
22:06
🔗
|
dan- |
yeah pretty much drama prevention stuff |
|
22:07
🔗
|
dan- |
as you guys probably know, users can be pretty annoyingly insistent regarding 4chan archiving ;) |
|
22:14
🔗
|
dan- |
usually best if they yell at us first, before running to you guys |
|
22:16
🔗
|
|
RichardG has joined #archiveteam-bs |
|
22:23
🔗
|
|
RichardG has quit IRC (Ping timeout: 360 seconds) |
|
22:32
🔗
|
|
Lord_Nigh has quit IRC (Ping timeout: 252 seconds) |
|
22:33
🔗
|
joepie91 |
dan-: ohai :P |
|
22:33
🔗
|
dan- |
joepie91: heyo! |
|
22:35
🔗
|
|
superkuh has quit IRC (Ping timeout: 252 seconds) |
|
22:37
🔗
|
|
Lord_Nigh has joined #archiveteam-bs |
|
22:39
🔗
|
|
superkuh has joined #archiveteam-bs |
|
23:28
🔗
|
|
mismatch has quit IRC (Remote host closed the connection) |
|
23:28
🔗
|
|
mismatch has joined #archiveteam-bs |
|
23:53
🔗
|
godane |
btw I'm getting a copy of Movie Magic tv series from 1994 |