| Time |
Nickname |
Message |
|
00:20
🔗
|
|
n00b284 has quit IRC (Quit: Page closed) |
|
00:59
🔗
|
|
af10b3e5e has joined #archiveteam-bs |
|
00:59
🔗
|
|
d5f4a3622 has quit IRC (Read error: Connection reset by peer) |
|
02:06
🔗
|
|
ShellyRol has quit IRC (Read error: Connection reset by peer) |
|
02:08
🔗
|
|
ShellyRol has joined #archiveteam-bs |
|
02:17
🔗
|
|
zhongfu_ has quit IRC (Ping timeout: 745 seconds) |
|
02:18
🔗
|
|
ShellyRol has quit IRC (Leaving) |
|
02:18
🔗
|
|
ShellyRol has joined #archiveteam-bs |
|
04:42
🔗
|
|
odemgi has joined #archiveteam-bs |
|
04:47
🔗
|
|
odemgi_ has quit IRC (Read error: Operation timed out) |
|
04:51
🔗
|
|
qw3rty2 has joined #archiveteam-bs |
|
04:53
🔗
|
|
odemg has quit IRC (Ping timeout: 745 seconds) |
|
04:57
🔗
|
|
odemg has joined #archiveteam-bs |
|
04:58
🔗
|
|
qw3rty has quit IRC (Ping timeout: 745 seconds) |
|
06:00
🔗
|
|
zhongfu has joined #archiveteam-bs |
|
06:06
🔗
|
|
odemg has quit IRC (Ping timeout: 745 seconds) |
|
06:06
🔗
|
|
odemg has joined #archiveteam-bs |
|
06:18
🔗
|
|
ScruffyB has joined #archiveteam-bs |
|
06:18
🔗
|
|
phillipsj has quit IRC (Read error: Operation timed out) |
|
07:12
🔗
|
|
Raccoon has quit IRC (Remote host closed the connection) |
|
08:00
🔗
|
godane |
SketchCow: i noticed you talked about the japanese manuals that i uploaded |
|
08:00
🔗
|
godane |
more are comeing |
|
08:11
🔗
|
|
legoktm has quit IRC (Ping timeout: 612 seconds) |
|
08:15
🔗
|
|
legoktm has joined #archiveteam-bs |
|
08:17
🔗
|
JAA |
So my DiscussionApps crawl got caught in an infinite pagination. "Fixing" that now by breaking the connection with ip6tables. |
|
08:17
🔗
|
JAA |
Yay hacks. |
|
08:20
🔗
|
JAA |
350 of 531 forums are done. |
|
08:21
🔗
|
JAA |
I'm first grabbing all content once, then I'll bruteforce the "article ID" and fetch all kinds of redundant URLs used throughout the site. |
|
08:21
🔗
|
JAA |
There's a good chance the latter will not complete in time. |
|
09:09
🔗
|
|
bluefoo_ has joined #archiveteam-bs |
|
09:09
🔗
|
JAA |
The first phase is almost done now. |
|
09:12
🔗
|
|
bluefoo has quit IRC (Read error: Operation timed out) |
|
09:21
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
09:34
🔗
|
|
af10b3e5e has quit IRC (Read error: Operation timed out) |
|
09:35
🔗
|
|
af10b3e5e has joined #archiveteam-bs |
|
09:48
🔗
|
|
mls_ has quit IRC (Quit: leaving) |
|
09:54
🔗
|
JAA |
s/almost // |
|
09:56
🔗
|
JAA |
Two more "apps" (forums) are in an infinite pagination loop now, but I can't fix that right now. |
|
09:59
🔗
|
|
Hani111 has joined #archiveteam-bs |
|
10:02
🔗
|
|
Hani has quit IRC (Ping timeout: 745 seconds) |
|
10:02
🔗
|
|
Hani111 is now known as Hani |
|
10:38
🔗
|
JAA |
Well, and now I murdered it again. |
|
11:06
🔗
|
|
mc2 has quit IRC (Read error: Connection reset by peer) |
|
11:10
🔗
|
JAA |
But it recovered quickly this time. :-) |
|
11:23
🔗
|
JAA |
ETA for completing those redudant URLs is ~7 days, so yeah, that's not going to happen. |
|
11:24
🔗
|
Kaz |
limited by their side? |
|
11:24
🔗
|
JAA |
Yeah |
|
11:24
🔗
|
Kaz |
:( |
|
11:24
🔗
|
JAA |
Server falls over immediately if I put more than 10k requests per minute on it. |
|
11:25
🔗
|
JAA |
This bruteforcing would take 111 million requests or so. |
|
11:26
🔗
|
JAA |
Although actually I can reduce that quite drastically. I'll look into that in a bit. |
|
11:27
🔗
|
JAA |
(I'm requesting six URLs for each "article", but most of the articles don't exist, so I can just request one and then fetch the other five only if it exists. That'll reduce the ETA to a day or so.) |
|
11:29
🔗
|
JAA |
In other news, the Royal Society PDF grabs from mips are uploading to https://archive.org/details/royalsocietypublishing.org_pdfs_201910 now. |
|
11:31
🔗
|
jodizzle |
Nice |
|
11:35
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
|
11:39
🔗
|
|
omglolba- has quit IRC (Quit: ZNC - https://znc.in) |
|
11:48
🔗
|
|
omglolbah has joined #archiveteam-bs |
|
12:21
🔗
|
JAA |
Welp, I murdered DiscussionApps again. |
|
12:21
🔗
|
JAA |
10k requests per minute are not fine if it's not entirely 4xx. |
|
12:25
🔗
|
kiska |
lol |
|
12:26
🔗
|
|
X-Scale has joined #archiveteam-bs |
|
12:26
🔗
|
JAA |
Maybe I should rename qwarc to qkill. |
|
13:32
🔗
|
|
X-Scale` has joined #archiveteam-bs |
|
13:34
🔗
|
|
X-Scale has quit IRC (Ping timeout: 252 seconds) |
|
13:35
🔗
|
|
X-Scale has joined #archiveteam-bs |
|
13:37
🔗
|
|
X-Scale` has quit IRC (Ping timeout: 252 seconds) |
|
13:52
🔗
|
|
swebb has quit IRC (Read error: Operation timed out) |
|
13:59
🔗
|
sec^nd |
Activism and movements are moving to github and perhaps gitlab. We should probably be archiving these repos. Even if we don't archive a ton of repos we should archive the few we come across. Thoughts? |
|
14:01
🔗
|
JAA |
ETA for the DiscussionsApps bruteforce is now a bit over 2 days. |
|
14:02
🔗
|
JAA |
Assuming the site doesn't die again. |
|
14:02
🔗
|
sec^nd |
It also feels like censorship is on the rise, is this correct or just the news? |
|
14:10
🔗
|
sec^nd |
https://github.com/github/gov-takedowns/blob/master/China/2019/2019-09-05-MPS.md |
|
14:10
🔗
|
sec^nd |
https://github.com/jdzs1/djy/blob/master/gb/n24hr.md?dfh#1 |
|
14:10
🔗
|
sec^nd |
https://github.com/goodabc/news |
|
14:34
🔗
|
|
ats has quit IRC (Quit: soundcard) |
|
14:35
🔗
|
|
systwi_ has joined #archiveteam-bs |
|
14:37
🔗
|
|
systwi has quit IRC (Ping timeout: 612 seconds) |
|
14:44
🔗
|
|
systwi_ has quit IRC (Read error: Operation timed out) |
|
14:47
🔗
|
|
systwi has joined #archiveteam-bs |
|
15:04
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
|
15:08
🔗
|
kiska |
Hrm.... irista has an interesting way of sharing images with people.... eg https://www.irista.com/gallery/jhgp1vesawhl |
|
15:15
🔗
|
Dallas |
That's just a blank square right ? Or is my browser broke haha |
|
15:16
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
|
15:16
🔗
|
|
RichardG has joined #archiveteam-bs |
|
15:17
🔗
|
|
swebb has joined #archiveteam-bs |
|
15:21
🔗
|
|
ScruffyB has quit IRC (Ping timeout: 612 seconds) |
|
15:22
🔗
|
kiska |
Yep its a blank rectangle :D |
|
15:22
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
15:22
🔗
|
|
ScruffyB has joined #archiveteam-bs |
|
15:25
🔗
|
kiska |
Looks like the gallery is ([a-z0-9]{0,12}) I am unsure if there is more characters or less, but through the examples I have generated today/yesterday since finding out about irista its always been that |
|
15:25
🔗
|
|
ats has joined #archiveteam-bs |
|
15:40
🔗
|
Dallas |
If you stick that on the end of this you get a nice json page oohhhh |
|
15:40
🔗
|
Dallas |
https://www.irista.com/lifecake/album/jhgp1vesawhl |
|
15:40
🔗
|
Dallas |
and invalid for anything else |
|
15:40
🔗
|
Dallas |
https://www.irista.com/lifecake/album/jhgp1vesawhlasd |
|
15:40
🔗
|
Dallas |
I wonder if the lifecake/album is a specific user or some generic api thing they use |
|
15:42
🔗
|
Dallas |
why lifecake.... |
|
15:50
🔗
|
|
systwi has joined #archiveteam-bs |
|
16:12
🔗
|
|
v1r has joined #archiveteam-bs |
|
16:16
🔗
|
|
mls_ has joined #archiveteam-bs |
|
16:24
🔗
|
|
v1r has quit IRC (Quit: Page closed) |
|
16:40
🔗
|
kiska |
From that first lifecake url "date":"1800-01-01" |
|
16:40
🔗
|
kiska |
I see.... |
|
16:42
🔗
|
|
Smiley has joined #archiveteam-bs |
|
16:59
🔗
|
Dallas |
oh yeah toooottallly |
|
16:59
🔗
|
Dallas |
Have you got anymore links ? are they all served off /lifecake/ |
|
17:19
🔗
|
markedL |
Anyone see Igloo last couple days? He said we wanted to do/provide targets for radio24syv but we're held up without him |
|
18:24
🔗
|
|
Mayonaise has quit IRC (Read error: Operation timed out) |
|
18:27
🔗
|
|
Raccoon has joined #archiveteam-bs |
|
18:46
🔗
|
|
Pixi` has quit IRC (Quit: Pixi`) |
|
18:47
🔗
|
|
Pixi has joined #archiveteam-bs |
|
19:08
🔗
|
|
af10b3e5e has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4) |
|
19:10
🔗
|
|
d5f4a3622 has joined #archiveteam-bs |
|
19:18
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
19:20
🔗
|
godane |
SketchCow: do you have any scans of Computer Magazine : https://www.ebay.com/itm/77-Issues-of-Computer-Magazine-from-the-1980s-and-1990s/264513427994 |
|
19:20
🔗
|
godane |
its a magazine called Computer but i can't find it on archive.org |
|
19:21
🔗
|
Kaz |
markedL: channel? |
|
19:22
🔗
|
markedL |
#radioshmadio |
|
19:34
🔗
|
|
sirvy has quit IRC (Quit: WeeChat 2.3) |
|
19:36
🔗
|
|
sirvy has joined #archiveteam-bs |
|
19:54
🔗
|
|
Smiley has joined #archiveteam-bs |
|
20:01
🔗
|
|
ShellyRol has quit IRC (Read error: Operation timed out) |
|
20:08
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
20:12
🔗
|
|
Smiley has joined #archiveteam-bs |
|
20:47
🔗
|
|
Mayonaise has joined #archiveteam-bs |
|
20:54
🔗
|
|
ShellyRol has joined #archiveteam-bs |
|
21:17
🔗
|
|
schbirid has joined #archiveteam-bs |
|
22:01
🔗
|
|
systwi_ has joined #archiveteam-bs |
|
22:07
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
|
22:25
🔗
|
|
tapedrive has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
antomatic has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
sHATNER has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
MrRadar2 has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
brayden has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Dallas has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Smiley has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
odemgi has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
VerifiedJ has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
ctrl has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Maylay has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
nepeat has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Damme_ has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
fuzzy8021 has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Dj-Wawa_ has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
chfoo has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
ndiddy has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
underscor has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
wp494 has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
zerkalo has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
TC01 has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Lord_Nigh has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Dark-Star has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
yuitimoth has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
yano has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
halt_ has quit IRC (se.hub irc.efnet.nl) |
|
22:25
🔗
|
|
Xibalba has quit IRC (se.hub irc.nordunet.se) |
|
22:36
🔗
|
|
DFJustin has quit IRC (Ping timeout: 745 seconds) |
|
22:37
🔗
|
|
betamax has quit IRC (Quit: leaving) |
|
22:38
🔗
|
|
betamax has joined #archiveteam-bs |
|
22:39
🔗
|
|
MrRadar2 has joined #archiveteam-bs |
|
22:39
🔗
|
|
Dallas has joined #archiveteam-bs |
|
22:39
🔗
|
|
Smiley has joined #archiveteam-bs |
|
22:39
🔗
|
|
odemgi has joined #archiveteam-bs |
|
22:39
🔗
|
|
tapedrive has joined #archiveteam-bs |
|
22:39
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
22:39
🔗
|
|
antomatic has joined #archiveteam-bs |
|
22:39
🔗
|
|
sHATNER has joined #archiveteam-bs |
|
22:39
🔗
|
|
brayden has joined #archiveteam-bs |
|
22:39
🔗
|
|
ctrl has joined #archiveteam-bs |
|
22:39
🔗
|
|
Maylay has joined #archiveteam-bs |
|
22:39
🔗
|
|
nepeat has joined #archiveteam-bs |
|
22:39
🔗
|
|
Damme_ has joined #archiveteam-bs |
|
22:39
🔗
|
|
fuzzy8021 has joined #archiveteam-bs |
|
22:39
🔗
|
|
Dj-Wawa_ has joined #archiveteam-bs |
|
22:39
🔗
|
|
chfoo has joined #archiveteam-bs |
|
22:39
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
22:39
🔗
|
|
underscor has joined #archiveteam-bs |
|
22:39
🔗
|
|
wp494 has joined #archiveteam-bs |
|
22:39
🔗
|
|
zerkalo has joined #archiveteam-bs |
|
22:39
🔗
|
|
TC01 has joined #archiveteam-bs |
|
22:39
🔗
|
|
Lord_Nigh has joined #archiveteam-bs |
|
22:39
🔗
|
|
Dark-Star has joined #archiveteam-bs |
|
22:39
🔗
|
|
yuitimoth has joined #archiveteam-bs |
|
22:39
🔗
|
|
yano has joined #archiveteam-bs |
|
22:39
🔗
|
|
halt_ has joined #archiveteam-bs |
|
22:39
🔗
|
|
irc.efnet.nl sets mode: +o chfoo |
|
22:39
🔗
|
|
Fusl sets mode: +o chfoo |
|
22:39
🔗
|
|
Fusl__ sets mode: +o chfoo |
|
22:39
🔗
|
|
Fusl_ sets mode: +o chfoo |
|
22:49
🔗
|
|
mtntmnky has quit IRC (Remote host closed the connection) |
|
22:50
🔗
|
|
mtntmnky has joined #archiveteam-bs |
|
22:56
🔗
|
|
Smiley has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
odemgi has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
VerifiedJ has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
ctrl has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
Maylay has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
nepeat has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
Damme_ has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
fuzzy8021 has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
Dj-Wawa_ has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
chfoo has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
ndiddy has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
underscor has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
wp494 has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
zerkalo has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
TC01 has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
Lord_Nigh has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
Dark-Star has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
yuitimoth has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
yano has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
halt_ has quit IRC (irc.efnet.nl efnet.deic.eu) |
|
22:56
🔗
|
|
MrRadar2 has quit IRC (Read error: Connection reset by peer) |
|
22:56
🔗
|
|
MrRadar2 has joined #archiveteam-bs |
|
22:57
🔗
|
|
LordNigh2 has joined #archiveteam-bs |
|
23:12
🔗
|
|
LordNigh2 is now known as Lord_Nigh |
|
23:22
🔗
|
godane |
i'm putting that bid on the computer magazine i found |
|
23:22
🔗
|
godane |
its less then $1 per a issue and i can't find it at all on archive.org |
|
23:23
🔗
|
godane |
2nd this computer magazine goes back to 1960s based on may 1987 issue being volume 20 issue 5 |
|
23:36
🔗
|
Raccoon |
what was the title? |
|
23:56
🔗
|
|
Smiley has joined #archiveteam-bs |
|
23:56
🔗
|
|
odemgi has joined #archiveteam-bs |
|
23:56
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
23:56
🔗
|
|
ctrl has joined #archiveteam-bs |
|
23:56
🔗
|
|
Maylay has joined #archiveteam-bs |
|
23:56
🔗
|
|
nepeat has joined #archiveteam-bs |
|
23:56
🔗
|
|
Damme_ has joined #archiveteam-bs |
|
23:56
🔗
|
|
fuzzy8021 has joined #archiveteam-bs |
|
23:56
🔗
|
|
Dj-Wawa_ has joined #archiveteam-bs |
|
23:56
🔗
|
|
chfoo has joined #archiveteam-bs |
|
23:56
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
23:56
🔗
|
|
underscor has joined #archiveteam-bs |
|
23:56
🔗
|
|
wp494 has joined #archiveteam-bs |
|
23:56
🔗
|
|
zerkalo has joined #archiveteam-bs |
|
23:56
🔗
|
|
TC01 has joined #archiveteam-bs |
|
23:56
🔗
|
|
Dark-Star has joined #archiveteam-bs |
|
23:56
🔗
|
|
yuitimoth has joined #archiveteam-bs |
|
23:56
🔗
|
|
yano has joined #archiveteam-bs |
|
23:56
🔗
|
|
halt_ has joined #archiveteam-bs |
|
23:56
🔗
|
|
efnet.deic.eu sets mode: +o chfoo |
|
23:56
🔗
|
|
Fusl sets mode: +o chfoo |
|
23:57
🔗
|
|
Fusl__ sets mode: +o chfoo |
|
23:57
🔗
|
|
Fusl_ sets mode: +o chfoo |
|
23:58
🔗
|
|
Hani111 has joined #archiveteam-bs |