| Time |
Nickname |
Message |
|
00:10
🔗
|
|
Zerote has quit IRC (Ping timeout: 604 seconds) |
|
00:15
🔗
|
|
ATrescue has joined #archiveteam-bs |
|
00:55
🔗
|
|
ayanami_ has joined #archiveteam-bs |
|
00:55
🔗
|
ayanami_ |
https://vanillo.co Videosharing site Vanillo is shutting down in 4 days |
|
00:55
🔗
|
JAA |
Yup |
|
00:55
🔗
|
ayanami_ |
Think we can run an ArchiveBot or download the videos? |
|
00:56
🔗
|
ayanami_ |
Oh, you've heard? |
|
00:56
🔗
|
JAA |
Running already. |
|
00:56
🔗
|
ayanami_ |
Oh, nice! |
|
00:56
🔗
|
ayanami_ |
Is there any link to a tracker? |
|
00:56
🔗
|
JAA |
http://dashboard.at.ninjawedding.org/ |
|
00:56
🔗
|
JAA |
Job 4txte5r78lzxz86g5hag0awb7 |
|
00:57
🔗
|
ealgase |
Wow, Vanillo didn't even exist for long enough to get an official youtube-dl extractor |
|
00:57
🔗
|
JAA |
lol |
|
00:57
🔗
|
ayanami_ |
Will video/image files be archived or just plain HTML? |
|
00:58
🔗
|
JAA |
Videos and images are directly linked, so they get grabbed as well. |
|
00:58
🔗
|
ealgase |
seems like it's grabbing a lot of bitchute videos for some reason |
|
00:58
🔗
|
JAA |
Yeah, outlinks from descriptions etc. |
|
00:59
🔗
|
ealgase |
I'd exclude those since Vanillo is almost yahoo'ing at this point |
|
00:59
🔗
|
ATrescue |
ayanami_: Before we lose it: Unlisted video on Vanillo.co: If you enable the adblocker, it refers you to an unlisted video telling you to disable ads. (I can not do it right now becausse my AddOns do not work due to Firefox disaster). |
|
00:59
🔗
|
JAA |
Should probably be fine. We still have a few days, and the site's pretty small. |
|
00:59
🔗
|
ayanami_ |
Okay |
|
01:00
🔗
|
ayanami_ |
Also, didn't an update come out for that disaster? 66.0.4? |
|
01:00
🔗
|
ayanami_ |
Also, I have a question about the BBM shutdown, if it hasn't been asked already: You think that everything archiveable can be saved w/ ArchiveBot? (News articles, documentation, official media) |
|
01:01
🔗
|
ealgase |
ATrescue: BTW, go to nixnet.xyz to get the addon fix |
|
01:01
🔗
|
JAA |
BBM? |
|
01:02
🔗
|
JAA |
Move the addon discussion to -ot please. |
|
01:02
🔗
|
ayanami_ |
Blackberry Messenger |
|
01:02
🔗
|
JAA |
Ah, right. |
|
01:02
🔗
|
ATrescue |
→ #archiveteam-ot |
|
01:02
🔗
|
ayanami_ |
I talked about it some time ago |
|
01:03
🔗
|
ATrescue |
(Not that it bothers me) |
|
01:04
🔗
|
ayanami_ |
Also, looking at the tracker, apparently Sketch is going to just be an ArchiveBot job? |
|
01:04
🔗
|
ayanami_ |
300,000+ MB saved already |
|
01:04
🔗
|
JAA |
No, #SketchedOut |
|
01:04
🔗
|
JAA |
It's too big for AB. |
|
01:05
🔗
|
ayanami_ |
Oh, but I see it on the tracker, why is that? |
|
01:05
🔗
|
ayanami_ |
Is it just saving some other content? |
|
01:05
🔗
|
JAA |
And AB also can't save everything due to a bug in wpull. |
|
01:05
🔗
|
|
enowaldo has quit IRC (Ping timeout: 265 seconds) |
|
01:06
🔗
|
JAA |
It's just a safety net in case we don't get the other project running or something goes wrong or... |
|
01:06
🔗
|
ealgase |
What is Sketch? |
|
01:07
🔗
|
JAA |
https://archiveteam.org/index.php?title=Sketch |
|
01:07
🔗
|
ealgase |
Ah ok, sounds like it'll be kinda painful to archive |
|
01:14
🔗
|
|
qw3rty114 has quit IRC (Ping timeout: 600 seconds) |
|
01:15
🔗
|
marked1 |
an image only Sketch is 2.2TB, @100Mbps -> 2days |
|
01:16
🔗
|
marked1 |
I think that would be 200 worker threads |
|
01:33
🔗
|
JAA |
PurpleSym: The bot seems to swallow some edits...? |
|
01:35
🔗
|
ealgase |
it didn't show the one I made to Vanillo |
|
01:47
🔗
|
ealgase |
OK I'm curious, is archiveteam against archiving NSFW sites? Because there aren't articles on many of the major porn sites |
|
01:47
🔗
|
JAA |
We've archived Eroshare. Does that answer your question? |
|
01:48
🔗
|
ealgase |
Yes |
|
01:48
🔗
|
JAA |
:-) |
|
01:48
🔗
|
marked1 |
tumblr doesn't count? |
|
01:48
🔗
|
JAA |
Yeah, and Tumblr. |
|
01:48
🔗
|
JAA |
Eroshare was only porn though, while Tumblr also has a lot of other content obviously. |
|
01:48
🔗
|
ealgase |
I'm sad we missed HentaiHaven |
|
01:49
🔗
|
Flashfire |
Eroshare was unique content and user uploaded while there are some amateur content most porn sites arent going down and the smallers ones are usually just mirrors of the bigger ones |
|
01:50
🔗
|
ealgase |
Ah, that makes sense. I'm guessing that's a similar reason to Tumblr, then? |
|
01:50
🔗
|
Flashfire |
At least that is my understanding of it |
|
01:50
🔗
|
Flashfire |
I mean if like a small porn site with completely user generated content was found to be shutting down we may grab it but it most likely wouldnt even make it to us |
|
01:52
🔗
|
|
ATrescue has quit IRC (Ping timeout: 260 seconds) |
|
01:55
🔗
|
JAA |
Yeah, our focus is unique data. Commercial porn isn't exactly that. |
|
01:56
🔗
|
JAA |
I'm not sure what we'd do if PornHub went down, for example. |
|
01:57
🔗
|
Flashfire |
Save amateur section first and leaved the rest to the horny fuckers at datahoarders |
|
01:59
🔗
|
JAA |
Yeah, something like that. |
|
02:00
🔗
|
ealgase |
LMAO, yeah. I'm remembering a post from a few days ago "Datahoarders who have gfs or wives, how does your gf/wife feel about your porn collection?" |
|
02:00
🔗
|
ealgase |
guy had 20TB+ |
|
02:00
🔗
|
Flashfire |
I mean we would probably go after the community section the user uploaded content not the verified members |
|
02:04
🔗
|
JAA |
That's cute. There's someone over there who had over a PB of cam recordings on Amazon Drive... Not sure if that collection made it anywhere else before the shutdown. |
|
02:04
🔗
|
JAA |
Anyway, this is getting off-topicky. |
|
02:05
🔗
|
ealgase |
That's true. And I remember that guy, he got a decent amount of news coverage. |
|
02:18
🔗
|
|
ATrescue has joined #archiveteam-bs |
|
02:23
🔗
|
|
ATrescue has quit IRC (Quit: Page closed) |
|
02:25
🔗
|
|
ATrescue has joined #archiveteam-bs |
|
02:27
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
02:41
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
03:16
🔗
|
|
odemg has quit IRC (Ping timeout: 615 seconds) |
|
03:22
🔗
|
|
odemg has joined #archiveteam-bs |
|
03:44
🔗
|
|
ayanami_ has quit IRC (Quit: Leaving) |
|
03:45
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
04:39
🔗
|
|
marked1 has quit IRC (Read error: Operation timed out) |
|
05:26
🔗
|
|
kbtoo_ has joined #archiveteam-bs |
|
05:29
🔗
|
|
kbtoo has quit IRC (Ping timeout: 255 seconds) |
|
05:36
🔗
|
|
godane has joined #archiveteam-bs |
|
05:58
🔗
|
PurpleSym |
JAA: Hm, that is strange. All I did was adding rcshow=!bot to the search query. |
|
06:16
🔗
|
|
kbtoo__ has joined #archiveteam-bs |
|
06:19
🔗
|
|
kbtoo_ has quit IRC (Ping timeout: 255 seconds) |
|
06:23
🔗
|
|
Zerote has joined #archiveteam-bs |
|
07:28
🔗
|
|
Zerote has quit IRC (Ping timeout: 604 seconds) |
|
07:35
🔗
|
|
Zerote has joined #archiveteam-bs |
|
07:50
🔗
|
|
HashbangI has quit IRC (Read error: Connection reset by peer) |
|
08:41
🔗
|
|
icedice has joined #archiveteam-bs |
|
08:41
🔗
|
godane |
SketchCow: i'm digitizing tapes again |
|
08:42
🔗
|
|
ATrescue has quit IRC (Ping timeout: 260 seconds) |
|
08:42
🔗
|
godane |
i think if i keep my pidgin to only a few chat rooms the swap zram doesn't get full |
|
08:42
🔗
|
godane |
at least thats the theory |
|
08:48
🔗
|
|
qw3rty114 has joined #archiveteam-bs |
|
09:01
🔗
|
|
icedice2 has joined #archiveteam-bs |
|
09:07
🔗
|
|
icedice has quit IRC (Read error: Operation timed out) |
|
09:08
🔗
|
|
icedice2 has quit IRC (Quit: Leaving) |
|
09:08
🔗
|
|
icedice has joined #archiveteam-bs |
|
09:12
🔗
|
|
ranma_ has quit IRC (Ping timeout: 255 seconds) |
|
09:12
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
09:14
🔗
|
|
deevious has joined #archiveteam-bs |
|
09:15
🔗
|
|
ranma_ has joined #archiveteam-bs |
|
09:17
🔗
|
|
enowaldo has quit IRC (Ping timeout: 268 seconds) |
|
09:32
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
10:07
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
10:11
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
10:57
🔗
|
|
deevious has quit IRC (Ping timeout: 252 seconds) |
|
10:58
🔗
|
|
deevious has joined #archiveteam-bs |
|
11:40
🔗
|
godane |
lastest tapes : https://www.patreon.com/posts/digitize-tapes-26701843 |
|
11:40
🔗
|
godane |
*latest |
|
11:56
🔗
|
|
HashbangI has joined #archiveteam-bs |
|
12:03
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
12:16
🔗
|
|
marked has joined #archiveteam-bs |
|
12:18
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
13:06
🔗
|
|
zhongfu_ has joined #archiveteam-bs |
|
13:11
🔗
|
|
zhongfu__ has joined #archiveteam-bs |
|
13:11
🔗
|
|
zhongfu has quit IRC (Ping timeout: 615 seconds) |
|
13:17
🔗
|
|
deevious has quit IRC (Ping timeout: 252 seconds) |
|
13:17
🔗
|
|
zhongfu_ has quit IRC (Ping timeout: 615 seconds) |
|
13:22
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
13:25
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
13:25
🔗
|
|
deevious has joined #archiveteam-bs |
|
13:29
🔗
|
|
enowaldo has quit IRC (Ping timeout: 252 seconds) |
|
13:36
🔗
|
|
martinlig has joined #archiveteam-bs |
|
13:44
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
13:50
🔗
|
Fusl |
godane: using pidgin for irc? |
|
13:54
🔗
|
eythian |
my archive warrior has stopped processing any job, I just get a yellow webpage with no tasks visible. Is this expected? |
|
13:58
🔗
|
Flashfire |
eythian urlteam tracker might be borked I can’t log in on my iPod will check tomorrow |
|
13:59
🔗
|
marked |
Main tracker says: Cannot GET / |
|
14:00
🔗
|
marked |
nevermind, i have it blackholed. sorry. |
|
14:03
🔗
|
godane |
Fusl: yep |
|
14:09
🔗
|
Fusl |
godane: my condolence |
|
14:10
🔗
|
Fusl |
marked: for fox sake, don't run a warrior if you're blocking certain domains |
|
14:10
🔗
|
Fusl |
or i'm gonna personally ban you across the entire project |
|
14:15
🔗
|
|
Zerote has quit IRC (Read error: Operation timed out) |
|
14:21
🔗
|
|
deevious has quit IRC (Ping timeout: 252 seconds) |
|
14:22
🔗
|
|
deevious has joined #archiveteam-bs |
|
14:28
🔗
|
eythian |
Flashfire: well, it's not urlteam specifically. It's as though I had concurrent items set to 0. |
|
14:28
🔗
|
eythian |
maybe I'll kick the running container, see if that does anything. |
|
14:29
🔗
|
eythian |
that made a difference. I'd forgotten that it has --restart always, so if I tell it to shut down in the web UI it comes straight back. That's useful. |
|
14:32
🔗
|
|
enowaldo has quit IRC (Ping timeout: 265 seconds) |
|
14:36
🔗
|
godane |
SketchCow: i think you want to know about this item: https://archive.org/details/micomBASIC19841994 |
|
14:37
🔗
|
godane |
there are 117 issues of Basic Magazine from japan |
|
14:37
🔗
|
godane |
from 1984-12 to 1994-12 |
|
14:37
🔗
|
godane |
also this : https://archive.org/details/OhMZOhx19861989 |
|
14:38
🔗
|
godane |
and this : https://archive.org/details/OhX1990-1995 |
|
14:43
🔗
|
PurpleSym |
JAA: I don’t see which edits purplebot would have swallowed. It delays showing multiple edits for a single pages though (by about 20 minutes), so it may seems like that. |
|
14:43
🔗
|
JAA |
PurpleSym: Actually, it didn't silence anything, but it only reported them with a delay; so much delay in fact that the order of the edits reported in here changed. I noticed that before, and that delay is usually between 20 and 25 minutes. Any idea where that comes from? |
|
14:43
🔗
|
JAA |
Damn, ninja'd. |
|
14:44
🔗
|
PurpleSym |
It’s ok :) |
|
14:44
🔗
|
JAA |
Ah |
|
14:44
🔗
|
JAA |
So it showed one edit for Vanillo.co, then delayed the further edits to that page, but showed the edit for Vanillo after the move immediately. |
|
14:45
🔗
|
PurpleSym |
Yes. The idea was to accumulate multiple edits to avoid flooding the channel. |
|
14:45
🔗
|
JAA |
Yeah, right. |
|
14:53
🔗
|
marked |
Fusl: you would have to join -dev if you want that explanation |
|
14:55
🔗
|
|
icedice has joined #archiveteam-bs |
|
14:58
🔗
|
|
yano_ is now known as yano |
|
15:01
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
15:28
🔗
|
|
ranma_ has quit IRC () |
|
15:32
🔗
|
|
frainz has quit IRC (Ping timeout: 265 seconds) |
|
15:38
🔗
|
|
Zerote has joined #archiveteam-bs |
|
15:56
🔗
|
|
martinlig has quit IRC (Quit: Connection closed for inactivity) |
|
15:58
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
16:08
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
16:52
🔗
|
|
Zerote has quit IRC (Ping timeout: 600 seconds) |
|
17:05
🔗
|
|
wp494 has quit IRC (Ping timeout: 252 seconds) |
|
17:07
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
17:08
🔗
|
|
cfarquhar has joined #archiveteam-bs |
|
17:09
🔗
|
|
wp494 has joined #archiveteam-bs |
|
17:29
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
17:30
🔗
|
|
cfarquhar has joined #archiveteam-bs |
|
17:38
🔗
|
|
Pixi has quit IRC (Quit: Pixi) |
|
17:42
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
17:43
🔗
|
|
cfarquhar has joined #archiveteam-bs |
|
17:47
🔗
|
|
Dallas has quit IRC (Quit: The Lounge - https://thelounge.chat) |
|
17:48
🔗
|
|
Dallas has joined #archiveteam-bs |
|
18:09
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
18:29
🔗
|
|
Joseph_ has joined #archiveteam-bs |
|
18:29
🔗
|
|
VerifiedJ has quit IRC (Read error: Connection reset by peer) |
|
18:30
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
18:32
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
18:33
🔗
|
|
Joseph_ has quit IRC (Read error: Connection reset by peer) |
|
18:53
🔗
|
|
Pixi has joined #archiveteam-bs |
|
18:53
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
18:56
🔗
|
|
Zerote has joined #archiveteam-bs |
|
19:08
🔗
|
|
VerifiedJ has quit IRC (Ping timeout: 252 seconds) |
|
19:25
🔗
|
|
Terbium_ has quit IRC (Ping timeout: 268 seconds) |
|
19:30
🔗
|
ivan |
https://github.com/mikf/gallery-dl |
|
19:50
🔗
|
|
PhrackD- has joined #archiveteam-bs |
|
19:51
🔗
|
|
PhrackD has quit IRC (Ping timeout: 600 seconds) |
|
19:51
🔗
|
|
PhrackD- is now known as PhrackD |
|
20:07
🔗
|
|
Medowar has joined #archiveteam-bs |
|
21:10
🔗
|
SketchCow |
godane: Good eye. I'll get them somewhere. |
|
21:39
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
22:04
🔗
|
JAA |
Is anyone here interested in helping with election-related archival? Overview of my recent efforts: https://archiveteam.org/index.php?title=Elections |
|
22:08
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
22:13
🔗
|
|
enowaldo has quit IRC (Ping timeout: 265 seconds) |
|
22:14
🔗
|
jodizzle |
JAA: Yeah sure, I can probably help. What do you need? |
|
22:15
🔗
|
JAA |
jodizzle: The key issue is usually finding all the campaign sites, candidates, parties, associated social media accounts, etc. In other words, creating those lists you see linked there. |
|
22:16
🔗
|
JAA |
I'm going after today's referendum in Belize right now, and there are also general elections in South Africa today. |
|
22:16
🔗
|
JAA |
The big one will be the European Parliament elections later this month. |
|
22:16
🔗
|
|
Medowar has quit IRC (Quit: Connection closed for inactivity) |
|
22:18
🔗
|
astrid |
there's a LOT of candidates standing for election every day |
|
22:19
🔗
|
JAA |
Yeah, if it's parliamentary elections, I only go after the parties normally. |
|
22:20
🔗
|
JAA |
And campaigns on the party or party-like level. |
|
22:20
🔗
|
JAA |
Because yeah, covering every candidate is impossible. |
|
22:20
🔗
|
jodizzle |
Hmm alright, I'll start looking around. |
|
22:21
🔗
|
|
BartoCH has quit IRC (Ping timeout: 615 seconds) |
|
22:22
🔗
|
jodizzle |
This reminds me that a while back I helped collect some data on the U.S. 2018 midterms. I managed to scrape some sites with well-structured data on candidates, even down to the local level, including home pages, social media accounts, etc.. Didn't get around to archiving it all, though. |
|
22:22
🔗
|
jodizzle |
I should wrap back around to that as well (though I imagine the U.S. has better coverage than a lot of the world). |
|
22:23
🔗
|
JAA |
It definitely has from what I've seen in the past few months since I started doing this. |
|
22:23
🔗
|
JAA |
You can usually find a list of candidates somewhere on an official government site, but that's about it. |
|
22:24
🔗
|
JAA |
Which doesn't help at all with referendums. |
|
22:24
🔗
|
JAA |
I base a lot of my discovery on Wikipedia, either English or the native language. |
|
22:25
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
22:28
🔗
|
jodizzle |
JAA: How granular should the elections pages be? Like would this election get it's own tracking page?: https://en.wikipedia.org/wiki/2019_Tshwane_mayoral_election |
|
22:30
🔗
|
JAA |
jodizzle: I've been going after national-level elections only so far, mainly because regional and local elections are even harder to research. In this case, I'd include it in a "2019 South African general election" page as a subsection I think. |
|
22:31
🔗
|
jodizzle |
Okay, sounds reasonable |
|
22:31
🔗
|
JAA |
Ok, one exception, I went after the mayoral election in Ankara since that's pretty influential on Turkish politics. |
|
22:32
🔗
|
|
Zerote has quit IRC (Read error: Connection reset by peer) |
|
22:42
🔗
|
jodizzle |
Yeah, I mean all this stuff is pretty particular so I would imagine there are exceptions. But I think I get the basic idea. |
|
22:44
🔗
|
JAA |
Oh wait, that election in Tshwane was something separate. I didn't look at it and assumed it also happened today. Hmm. |
|
22:45
🔗
|
JAA |
It was also an indirect election with only one candidate, so probably there aren't too many things related to it anyway. |
|
22:48
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
22:48
🔗
|
jodizzle |
Yeah I guess that one's a little weird to place (but also probably easy to grab). But this one, for instance, would fall under general elections? https://en.wikipedia.org/wiki/2019_Western_Cape_provincial_election |
|
22:49
🔗
|
jodizzle |
Since my understanding is that the elections in the South African general election happen on a per-province basis |
|
22:49
🔗
|
JAA |
Yeah |
|
22:50
🔗
|
JAA |
Might not technically be absolutely correct, but close enough. |
|
22:56
🔗
|
|
enowaldo has quit IRC (Ping timeout: 252 seconds) |
|
23:04
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
23:20
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
23:23
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
23:24
🔗
|
|
Flux^^ has joined #archiveteam-bs |
|
23:28
🔗
|
|
enowaldo has quit IRC (Ping timeout: 265 seconds) |
|
23:31
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
23:32
🔗
|
JAA |
^ The bot is finally documented. |
|
23:32
🔗
|
JAA |
VoynichCr: ^ FYI |
|
23:38
🔗
|
|
cfarquhar has joined #archiveteam-bs |
|
23:39
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
23:39
🔗
|
|
wyatt8740 has quit IRC (Ping timeout: 246 seconds) |
|
23:41
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
23:55
🔗
|
|
Flashfire has quit IRC (Excess Flood) |
|
23:55
🔗
|
|
Flashfire has joined #archiveteam-bs |