[00:20] *** n00b284 has quit IRC (Quit: Page closed) [00:59] *** af10b3e5e has joined #archiveteam-bs [00:59] *** d5f4a3622 has quit IRC (Read error: Connection reset by peer) [02:06] *** ShellyRol has quit IRC (Read error: Connection reset by peer) [02:08] *** ShellyRol has joined #archiveteam-bs [02:17] *** zhongfu_ has quit IRC (Ping timeout: 745 seconds) [02:18] *** ShellyRol has quit IRC (Leaving) [02:18] *** ShellyRol has joined #archiveteam-bs [04:42] *** odemgi has joined #archiveteam-bs [04:47] *** odemgi_ has quit IRC (Read error: Operation timed out) [04:51] *** qw3rty2 has joined #archiveteam-bs [04:53] *** odemg has quit IRC (Ping timeout: 745 seconds) [04:57] *** odemg has joined #archiveteam-bs [04:58] *** qw3rty has quit IRC (Ping timeout: 745 seconds) [06:00] *** zhongfu has joined #archiveteam-bs [06:06] *** odemg has quit IRC (Ping timeout: 745 seconds) [06:06] *** odemg has joined #archiveteam-bs [06:18] *** ScruffyB has joined #archiveteam-bs [06:18] *** phillipsj has quit IRC (Read error: Operation timed out) [07:12] *** Raccoon has quit IRC (Remote host closed the connection) [08:00] SketchCow: i noticed you talked about the japanese manuals that i uploaded [08:00] more are comeing [08:11] *** legoktm has quit IRC (Ping timeout: 612 seconds) [08:15] *** legoktm has joined #archiveteam-bs [08:17] So my DiscussionApps crawl got caught in an infinite pagination. "Fixing" that now by breaking the connection with ip6tables. [08:17] Yay hacks. [08:20] 350 of 531 forums are done. [08:21] I'm first grabbing all content once, then I'll bruteforce the "article ID" and fetch all kinds of redundant URLs used throughout the site. [08:21] There's a good chance the latter will not complete in time. [09:09] *** bluefoo_ has joined #archiveteam-bs [09:09] The first phase is almost done now. [09:12] *** bluefoo has quit IRC (Read error: Operation timed out) [09:21] *** killsushi has quit IRC (Quit: Leaving) [09:34] *** af10b3e5e has quit IRC (Read error: Operation timed out) [09:35] *** af10b3e5e has joined #archiveteam-bs [09:48] *** mls_ has quit IRC (Quit: leaving) [09:54] s/almost // [09:56] Two more "apps" (forums) are in an infinite pagination loop now, but I can't fix that right now. [09:59] *** Hani111 has joined #archiveteam-bs [10:02] *** Hani has quit IRC (Ping timeout: 745 seconds) [10:02] *** Hani111 is now known as Hani [10:38] Well, and now I murdered it again. [11:06] *** mc2 has quit IRC (Read error: Connection reset by peer) [11:10] But it recovered quickly this time. :-) [11:23] ETA for completing those redudant URLs is ~7 days, so yeah, that's not going to happen. [11:24] limited by their side? [11:24] Yeah [11:24] :( [11:24] Server falls over immediately if I put more than 10k requests per minute on it. [11:25] This bruteforcing would take 111 million requests or so. [11:26] Although actually I can reduce that quite drastically. I'll look into that in a bit. [11:27] (I'm requesting six URLs for each "article", but most of the articles don't exist, so I can just request one and then fetch the other five only if it exists. That'll reduce the ETA to a day or so.) [11:29] In other news, the Royal Society PDF grabs from mips are uploading to https://archive.org/details/royalsocietypublishing.org_pdfs_201910 now. [11:31] Nice [11:35] *** BlueMax has quit IRC (Read error: Connection reset by peer) [11:39] *** omglolba- has quit IRC (Quit: ZNC - https://znc.in) [11:48] *** omglolbah has joined #archiveteam-bs [12:21] Welp, I murdered DiscussionApps again. [12:21] 10k requests per minute are not fine if it's not entirely 4xx. [12:25] lol [12:26] *** X-Scale has joined #archiveteam-bs [12:26] Maybe I should rename qwarc to qkill. [13:32] *** X-Scale` has joined #archiveteam-bs [13:34] *** X-Scale has quit IRC (Ping timeout: 252 seconds) [13:35] *** X-Scale has joined #archiveteam-bs [13:37] *** X-Scale` has quit IRC (Ping timeout: 252 seconds) [13:52] *** swebb has quit IRC (Read error: Operation timed out) [13:59] Activism and movements are moving to github and perhaps gitlab. We should probably be archiving these repos. Even if we don't archive a ton of repos we should archive the few we come across. Thoughts? [14:01] ETA for the DiscussionsApps bruteforce is now a bit over 2 days. [14:02] Assuming the site doesn't die again. [14:02] It also feels like censorship is on the rise, is this correct or just the news? [14:10] https://github.com/github/gov-takedowns/blob/master/China/2019/2019-09-05-MPS.md [14:10] https://github.com/jdzs1/djy/blob/master/gb/n24hr.md?dfh#1 [14:10] https://github.com/goodabc/news [14:34] *** ats has quit IRC (Quit: soundcard) [14:35] *** systwi_ has joined #archiveteam-bs [14:37] *** systwi has quit IRC (Ping timeout: 612 seconds) [14:44] *** systwi_ has quit IRC (Read error: Operation timed out) [14:47] *** systwi has joined #archiveteam-bs [15:04] *** systwi has quit IRC (Read error: Operation timed out) [15:08] Hrm.... irista has an interesting way of sharing images with people.... eg https://www.irista.com/gallery/jhgp1vesawhl [15:15] That's just a blank square right ? Or is my browser broke haha [15:16] *** RichardG has quit IRC (Read error: Connection reset by peer) [15:16] *** RichardG has joined #archiveteam-bs [15:17] *** swebb has joined #archiveteam-bs [15:21] *** ScruffyB has quit IRC (Ping timeout: 612 seconds) [15:22] Yep its a blank rectangle :D [15:22] *** Smiley has quit IRC (Read error: Operation timed out) [15:22] *** ScruffyB has joined #archiveteam-bs [15:25] Looks like the gallery is ([a-z0-9]{0,12}) I am unsure if there is more characters or less, but through the examples I have generated today/yesterday since finding out about irista its always been that [15:25] *** ats has joined #archiveteam-bs [15:40] If you stick that on the end of this you get a nice json page oohhhh [15:40] https://www.irista.com/lifecake/album/jhgp1vesawhl [15:40] and invalid for anything else [15:40] https://www.irista.com/lifecake/album/jhgp1vesawhlasd [15:40] I wonder if the lifecake/album is a specific user or some generic api thing they use [15:42] why lifecake.... [15:50] *** systwi has joined #archiveteam-bs [16:12] *** v1r has joined #archiveteam-bs [16:16] *** mls_ has joined #archiveteam-bs [16:24] *** v1r has quit IRC (Quit: Page closed) [16:40] From that first lifecake url "date":"1800-01-01" [16:40] I see.... [16:42] *** Smiley has joined #archiveteam-bs [16:59] oh yeah toooottallly [16:59] Have you got anymore links ? are they all served off /lifecake/ [17:19] Anyone see Igloo last couple days? He said we wanted to do/provide targets for radio24syv but we're held up without him [18:24] *** Mayonaise has quit IRC (Read error: Operation timed out) [18:27] *** Raccoon has joined #archiveteam-bs [18:46] *** Pixi` has quit IRC (Quit: Pixi`) [18:47] *** Pixi has joined #archiveteam-bs [19:08] *** af10b3e5e has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4) [19:10] *** d5f4a3622 has joined #archiveteam-bs [19:18] *** Smiley has quit IRC (Read error: Operation timed out) [19:20] SketchCow: do you have any scans of Computer Magazine : https://www.ebay.com/itm/77-Issues-of-Computer-Magazine-from-the-1980s-and-1990s/264513427994 [19:20] its a magazine called Computer but i can't find it on archive.org [19:21] markedL: channel? [19:22] #radioshmadio [19:34] *** sirvy has quit IRC (Quit: WeeChat 2.3) [19:36] *** sirvy has joined #archiveteam-bs [19:54] *** Smiley has joined #archiveteam-bs [20:01] *** ShellyRol has quit IRC (Read error: Operation timed out) [20:08] *** Smiley has quit IRC (Read error: Operation timed out) [20:12] *** Smiley has joined #archiveteam-bs [20:47] *** Mayonaise has joined #archiveteam-bs [20:54] *** ShellyRol has joined #archiveteam-bs [21:17] *** schbirid has joined #archiveteam-bs [22:01] *** systwi_ has joined #archiveteam-bs [22:07] *** systwi has quit IRC (Read error: Operation timed out) [22:25] *** tapedrive has quit IRC (se.hub irc.efnet.nl) [22:25] *** antomatic has quit IRC (se.hub irc.efnet.nl) [22:25] *** sHATNER has quit IRC (se.hub irc.efnet.nl) [22:25] *** MrRadar2 has quit IRC (se.hub irc.efnet.nl) [22:25] *** brayden has quit IRC (se.hub irc.efnet.nl) [22:25] *** Dallas has quit IRC (se.hub irc.efnet.nl) [22:25] *** Smiley has quit IRC (se.hub irc.efnet.nl) [22:25] *** odemgi has quit IRC (se.hub irc.efnet.nl) [22:25] *** VerifiedJ has quit IRC (se.hub irc.efnet.nl) [22:25] *** ctrl has quit IRC (se.hub irc.efnet.nl) [22:25] *** Maylay has quit IRC (se.hub irc.efnet.nl) [22:25] *** nepeat has quit IRC (se.hub irc.efnet.nl) [22:25] *** Damme_ has quit IRC (se.hub irc.efnet.nl) [22:25] *** fuzzy8021 has quit IRC (se.hub irc.efnet.nl) [22:25] *** Dj-Wawa_ has quit IRC (se.hub irc.efnet.nl) [22:25] *** chfoo has quit IRC (se.hub irc.efnet.nl) [22:25] *** ndiddy has quit IRC (se.hub irc.efnet.nl) [22:25] *** underscor has quit IRC (se.hub irc.efnet.nl) [22:25] *** wp494 has quit IRC (se.hub irc.efnet.nl) [22:25] *** zerkalo has quit IRC (se.hub irc.efnet.nl) [22:25] *** TC01 has quit IRC (se.hub irc.efnet.nl) [22:25] *** Lord_Nigh has quit IRC (se.hub irc.efnet.nl) [22:25] *** Dark-Star has quit IRC (se.hub irc.efnet.nl) [22:25] *** yuitimoth has quit IRC (se.hub irc.efnet.nl) [22:25] *** yano has quit IRC (se.hub irc.efnet.nl) [22:25] *** halt_ has quit IRC (se.hub irc.efnet.nl) [22:25] *** Xibalba has quit IRC (se.hub irc.nordunet.se) [22:36] *** DFJustin has quit IRC (Ping timeout: 745 seconds) [22:37] *** betamax has quit IRC (Quit: leaving) [22:38] *** betamax has joined #archiveteam-bs [22:39] *** MrRadar2 has joined #archiveteam-bs [22:39] *** Dallas has joined #archiveteam-bs [22:39] *** Smiley has joined #archiveteam-bs [22:39] *** odemgi has joined #archiveteam-bs [22:39] *** tapedrive has joined #archiveteam-bs [22:39] *** VerifiedJ has joined #archiveteam-bs [22:39] *** antomatic has joined #archiveteam-bs [22:39] *** sHATNER has joined #archiveteam-bs [22:39] *** brayden has joined #archiveteam-bs [22:39] *** ctrl has joined #archiveteam-bs [22:39] *** Maylay has joined #archiveteam-bs [22:39] *** nepeat has joined #archiveteam-bs [22:39] *** Damme_ has joined #archiveteam-bs [22:39] *** fuzzy8021 has joined #archiveteam-bs [22:39] *** Dj-Wawa_ has joined #archiveteam-bs [22:39] *** chfoo has joined #archiveteam-bs [22:39] *** ndiddy has joined #archiveteam-bs [22:39] *** underscor has joined #archiveteam-bs [22:39] *** wp494 has joined #archiveteam-bs [22:39] *** zerkalo has joined #archiveteam-bs [22:39] *** TC01 has joined #archiveteam-bs [22:39] *** Lord_Nigh has joined #archiveteam-bs [22:39] *** Dark-Star has joined #archiveteam-bs [22:39] *** yuitimoth has joined #archiveteam-bs [22:39] *** yano has joined #archiveteam-bs [22:39] *** halt_ has joined #archiveteam-bs [22:39] *** irc.efnet.nl sets mode: +o chfoo [22:39] *** Fusl sets mode: +o chfoo [22:39] *** Fusl__ sets mode: +o chfoo [22:39] *** Fusl_ sets mode: +o chfoo [22:49] *** mtntmnky has quit IRC (Remote host closed the connection) [22:50] *** mtntmnky has joined #archiveteam-bs [22:56] *** Smiley has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** odemgi has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** VerifiedJ has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** ctrl has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** Maylay has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** nepeat has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** Damme_ has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** fuzzy8021 has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** Dj-Wawa_ has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** chfoo has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** ndiddy has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** underscor has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** wp494 has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** zerkalo has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** TC01 has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** Lord_Nigh has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** Dark-Star has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** yuitimoth has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** yano has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** halt_ has quit IRC (irc.efnet.nl efnet.deic.eu) [22:56] *** MrRadar2 has quit IRC (Read error: Connection reset by peer) [22:56] *** MrRadar2 has joined #archiveteam-bs [22:57] *** LordNigh2 has joined #archiveteam-bs [23:12] *** LordNigh2 is now known as Lord_Nigh [23:22] i'm putting that bid on the computer magazine i found [23:22] its less then $1 per a issue and i can't find it at all on archive.org [23:23] 2nd this computer magazine goes back to 1960s based on may 1987 issue being volume 20 issue 5 [23:36] what was the title? [23:56] *** Smiley has joined #archiveteam-bs [23:56] *** odemgi has joined #archiveteam-bs [23:56] *** VerifiedJ has joined #archiveteam-bs [23:56] *** ctrl has joined #archiveteam-bs [23:56] *** Maylay has joined #archiveteam-bs [23:56] *** nepeat has joined #archiveteam-bs [23:56] *** Damme_ has joined #archiveteam-bs [23:56] *** fuzzy8021 has joined #archiveteam-bs [23:56] *** Dj-Wawa_ has joined #archiveteam-bs [23:56] *** chfoo has joined #archiveteam-bs [23:56] *** ndiddy has joined #archiveteam-bs [23:56] *** underscor has joined #archiveteam-bs [23:56] *** wp494 has joined #archiveteam-bs [23:56] *** zerkalo has joined #archiveteam-bs [23:56] *** TC01 has joined #archiveteam-bs [23:56] *** Dark-Star has joined #archiveteam-bs [23:56] *** yuitimoth has joined #archiveteam-bs [23:56] *** yano has joined #archiveteam-bs [23:56] *** halt_ has joined #archiveteam-bs [23:56] *** efnet.deic.eu sets mode: +o chfoo [23:56] *** Fusl sets mode: +o chfoo [23:57] *** Fusl__ sets mode: +o chfoo [23:57] *** Fusl_ sets mode: +o chfoo [23:58] *** Hani111 has joined #archiveteam-bs