[00:06] odemg - one of the good things about ampslam and tindeck and audioindy not having announced their shutdowns is that archiving can be done more sedately [00:07] so as to not freak them out, y'know? [00:07] that's not usually my speed [00:07] but I guess [00:07] I hadn't even heard of any of them until today [00:08] tindeck holds a lot of stuff generated by webforums [00:19] godane: monitors come with a "native" contrast setting that doesn't cut off the whites or blacks, typically something like 50 or 75, if you move the contrast above that setting, you get cutoff [00:19] you should be able to distinguish everything on http://www.lagom.nl/lcd-test/img/gradient-h-32col.png [00:20] if you have an HDMI or DVI connection to your monitor you might need to configure your graphics settings to output to the full 0-255 range instead of 16-235 [00:20] #knowledge! [00:23] you might be able to reset the settings or switch the monitor colorspace to sRGB or User [00:25] *** balrog has quit IRC (Ping timeout: 492 seconds) [00:28] ivan: my black level had to be set high [00:28] thats the only setting that fix that problem on a reset [00:49] I just looked at the tigerdirect magazine, the scan seems pretty good quality (as good as you can get when scanning a magazine), interesting that clock speeds on mid-range CPUs still seem to be the same today as they were back then [01:06] *** DragonMon has quit IRC (Ping timeout: 252 seconds) [01:07] *** DragonMon has joined #archiveteam-bs [01:36] "to prevent server overloads, we have placed a 30-second limit between downloads. Please wait before trying to download another song." [01:57] (f3music.com, which appears slightly moribund) [01:57] I assume that this 30-second delay can be built into a harvesting script? [02:01] *** balrog has joined #archiveteam-bs [02:01] *** swebb sets mode: +o balrog [02:04] SketchCo1: https://archive.org/details/smartcomputing-learning-series-v6i3 [02:04] one of the bigger ones i had trouble with before [02:08] *** medowar has quit IRC (Ping timeout: 252 seconds) [02:08] *** DragonMon has quit IRC (Ping timeout: 252 seconds) [02:10] *** medowar has joined #archiveteam-bs [02:11] Arrhenius, yes [02:11] *** DragonMon has joined #archiveteam-bs [02:12] *** ta9le has quit IRC (Quit: Connection closed for inactivity) [02:14] odemg - thought so. The music-hosting sites that are still active and thriving - reverbnation, noisetrade, etc - are in my opinion low-priority; it's the moribund and withering ones that we need to worry about. [02:15] Arrhenius, do you have anywhere to store them? [02:15] *** icedice2 has joined #archiveteam-bs [02:19] *** icedice has quit IRC (Ping timeout: 268 seconds) [02:19] *** medowar has quit IRC (Ping timeout: 252 seconds) [02:20] *** medowar has joined #archiveteam-bs [02:22] odemg - personally, no. I've only got.... [02:22] * Arrhenius checks [02:23] about 1300 GB free, on three drives [02:23] and I need some of this for work. [02:23] I mean, I could *help*, sure [02:24] I dread to think how large tindeck is going to be, I've got around 120TB hot free and 400TB cold which maybe put to use storing github if it gets that out of hand and If I'm going to do tindeck I may as well do them all [02:25] sorry to bring you new tasks [02:26] 'the task is not yours to complete - but neither is it yours to abandon' [02:27] odemg - at least tindeck is smaller than soundcloud [02:28] true [02:30] wayback has audiostreet and mixstreet's artist pages and song pages, but not the actual songs [02:30] which is depressing, but we can't grab it all. [02:35] *** icedice2 has quit IRC (Quit: Leaving) [02:36] *** icedice has joined #archiveteam-bs [02:39] *** i0npulse has joined #archiveteam-bs [02:41] *** Flashfire has joined #archiveteam-bs [02:51] *** medowar has quit IRC (Ping timeout: 252 seconds) [02:52] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [02:55] *** medowar has joined #archiveteam-bs [02:55] *** i0npulse has joined #archiveteam-bs [02:56] *** m007a83 has joined #archiveteam-bs [03:09] *** Flashfire has quit IRC (Ping timeout: 268 seconds) [03:28] *** odemg has quit IRC (Ping timeout: 246 seconds) [03:30] *** Flashfire has joined #archiveteam-bs [03:41] *** odemg has joined #archiveteam-bs [03:42] *** Stilett0- has quit IRC (Read error: Connection reset by peer) [03:42] *** Stilett0- has joined #archiveteam-bs [03:59] *** m007a83_ has joined #archiveteam-bs [03:59] *** qw3rty113 has joined #archiveteam-bs [04:01] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [04:02] *** qw3rty112 has quit IRC (Read error: Operation timed out) [04:30] *** Flashfire has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…) [04:47] *** Cameron_D has quit IRC (Read error: Operation timed out) [04:48] *** Cameron_D has joined #archiveteam-bs [04:48] *** midas4 sets mode: +o Cameron_D [04:54] *** icedice has quit IRC (Ping timeout: 268 seconds) [05:19] *** BlueMax has quit IRC (Leaving) [05:33] *** SimpBrain has quit IRC (Quit: Leaving) [05:44] *** james__ has quit IRC (Quit: Leaving) [05:46] *** icedice has joined #archiveteam-bs [05:50] *** icedice2 has joined #archiveteam-bs [05:56] *** icedice has quit IRC (Read error: Operation timed out) [06:07] *** BlueMax has joined #archiveteam-bs [06:08] *** Arrhenius has quit IRC (Read error: Operation timed out) [06:13] *** medowar has quit IRC (Ping timeout: 252 seconds) [06:14] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [06:15] *** i0npulse has joined #archiveteam-bs [06:16] *** medowar has joined #archiveteam-bs [06:22] *** ta9le has joined #archiveteam-bs [06:26] *** m007a83__ has joined #archiveteam-bs [06:29] *** m007a83_ has quit IRC (Ping timeout: 252 seconds) [06:37] *** m007a83__ is now known as m007a83 [06:47] *** m007a83_ has joined #archiveteam-bs [06:49] *** medowar has quit IRC (Ping timeout: 252 seconds) [06:50] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [06:50] *** medowar has joined #archiveteam-bs [06:52] *** Flashfire has joined #archiveteam-bs [07:23] *** medowar has quit IRC (Ping timeout: 252 seconds) [07:24] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [07:25] *** i0npulse has joined #archiveteam-bs [07:26] *** medowar has joined #archiveteam-bs [07:31] *** schbirid has joined #archiveteam-bs [08:16] *** LordNigh2 has joined #archiveteam-bs [08:16] *** nyaomi has joined #archiveteam-bs [08:16] *** moufu_ has joined #archiveteam-bs [08:24] *** Gfy_ has joined #archiveteam-bs [08:26] *** ta9le has quit IRC (se.hub efnet.portlane.se) [08:26] *** nyaomin has quit IRC (se.hub efnet.portlane.se) [08:26] *** Lord_Nigh has quit IRC (se.hub efnet.portlane.se) [08:26] *** VoynichCr has quit IRC (se.hub efnet.portlane.se) [08:26] *** Aoede has quit IRC (se.hub efnet.portlane.se) [08:26] *** Gfy has quit IRC (se.hub efnet.portlane.se) [08:26] *** dxrt_ has quit IRC (se.hub efnet.portlane.se) [08:26] *** Kaz has quit IRC (se.hub efnet.portlane.se) [08:26] *** moufu has quit IRC (se.hub efnet.portlane.se) [08:28] *** Aoede_ has joined #archiveteam-bs [08:31] Odd0002: Yeah, CPU frequencies haven't changed much in the past 15 years or so. It's essentially a power efficiency problem; going to even higher clock rates leads to a much higher power consumption with only small performance gains. That's why everything has been moving to more parallelism since the early 2000s (multiple cores, multiple threads per core, etc.). [08:34] *** Aoede_ has quit IRC (Ping timeout: 252 seconds) [08:34] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [08:37] *** medowar has quit IRC (Ping timeout: 252 seconds) [08:40] *** medowar has joined #archiveteam-bs [08:41] *** i0npulse has joined #archiveteam-bs [08:42] *** LordNigh2 is now known as Lord_Nigh [08:54] *** icedice2 has quit IRC (Ping timeout: 252 seconds) [08:56] *** tsr has quit IRC (Read error: Operation timed out) [08:57] *** synm0nger has quit IRC (Ping timeout: 268 seconds) [08:57] *** tsr has joined #archiveteam-bs [08:57] *** Tenebrae has quit IRC (Ping timeout: 365 seconds) [08:59] *** Rai-chan has quit IRC (Ping timeout: 268 seconds) [08:59] *** SynMonger has joined #archiveteam-bs [09:00] *** Tenebrae has joined #archiveteam-bs [09:00] *** midas2 has quit IRC (Ping timeout: 268 seconds) [09:00] *** ReimuHaku has quit IRC (Ping timeout: 268 seconds) [09:00] *** TC01 has quit IRC (Ping timeout: 268 seconds) [09:02] *** altlabel has quit IRC (Ping timeout: 268 seconds) [09:03] *** Rai-chan has joined #archiveteam-bs [09:03] *** Flashfire has quit IRC (Ping timeout: 268 seconds) [09:04] *** ebel has quit IRC (Ping timeout: 268 seconds) [09:04] *** tapedrive has quit IRC (Ping timeout: 268 seconds) [09:04] *** altlabel has joined #archiveteam-bs [09:04] *** TC01 has joined #archiveteam-bs [09:05] *** Tenebrae has quit IRC (Ping timeout: 268 seconds) [09:05] *** Frogging has quit IRC (Ping timeout: 268 seconds) [09:06] *** tsr has quit IRC (Ping timeout: 268 seconds) [09:07] *** ReimuHaku has joined #archiveteam-bs [09:07] *** Frogging has joined #archiveteam-bs [09:08] *** ebel has joined #archiveteam-bs [09:09] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [09:09] *** medowar has quit IRC (Ping timeout: 252 seconds) [09:09] *** kevinr_ has quit IRC (Ping timeout: 365 seconds) [09:10] *** medowar has joined #archiveteam-bs [09:11] *** i0npulse has joined #archiveteam-bs [09:11] *** PurpleSym has quit IRC (Ping timeout: 268 seconds) [09:12] *** Ceryn^ has quit IRC (Ping timeout: 268 seconds) [09:13] *** espes__ has quit IRC (Ping timeout: 268 seconds) [09:14] *** kevinr_ has joined #archiveteam-bs [09:16] *** BnAboyZ has quit IRC (Ping timeout: 268 seconds) [09:17] *** PurpleSym has joined #archiveteam-bs [09:18] *** tsr has joined #archiveteam-bs [09:19] *** BnAboyZ has joined #archiveteam-bs [09:23] *** tsr has quit IRC (Ping timeout: 268 seconds) [09:25] *** Ceryn^ has joined #archiveteam-bs [09:29] *** tsr has joined #archiveteam-bs [09:39] *** medowar has quit IRC (Ping timeout: 252 seconds) [09:41] *** medowar has joined #archiveteam-bs [09:42] *** Flashfire has joined #archiveteam-bs [10:11] *** Flashfire has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [10:55] acidplanet project is now totally finished! [10:55] it's off the tracker [10:55] the trackerfrontpage that is [10:55] which is depressing, but we can't grab it all. [10:55] why not? [10:55] oh I see it's not shutting down [12:03] *** espes__ has joined #archiveteam-bs [12:04] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [12:04] *** medowar has quit IRC (Ping timeout: 252 seconds) [12:05] *** medowar has joined #archiveteam-bs [12:05] *** i0npulse has joined #archiveteam-bs [12:33] *** SilSte has quit IRC (Read error: Operation timed out) [12:35] *** SilSte has joined #archiveteam-bs [12:55] *** Soni has quit IRC (Read error: Operation timed out) [13:02] *** Soni has joined #archiveteam-bs [13:03] *** BlueMax has quit IRC (Leaving) [13:11] *** m007a83_ is now known as m007a83 [13:13] *** medowar has quit IRC (Ping timeout: 252 seconds) [13:14] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [13:14] *** i0npulse has joined #archiveteam-bs [13:15] *** medowar has joined #archiveteam-bs [13:15] *** C4K3 has quit IRC (Read error: Operation timed out) [13:23] *** james__ has joined #archiveteam-bs [13:35] *** C4K3 has joined #archiveteam-bs [13:44] *** medowar has quit IRC (Ping timeout: 252 seconds) [13:44] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [13:45] *** i0npulse has joined #archiveteam-bs [13:46] *** medowar has joined #archiveteam-bs [14:19] *** medowar has quit IRC (Ping timeout: 252 seconds) [14:20] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [14:20] *** i0npulse has joined #archiveteam-bs [14:20] *** medowar has joined #archiveteam-bs [15:37] *** Kaz has joined #archiveteam-bs [15:42] so i think the reference series by sandhills is a different series then reference series [15:43] anyways i have like 17 reference/learning series to scan [15:43] most are close to the ~150 page size [16:04] *** Aoede has joined #archiveteam-bs [16:23] *** ta9le has joined #archiveteam-bs [16:25] *** antomatic has quit IRC (Read error: Operation timed out) [16:32] *** antomatic has joined #archiveteam-bs [16:32] *** swebb sets mode: +o antomatic [16:43] *** medowar has quit IRC (Ping timeout: 252 seconds) [16:43] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [16:44] *** Aoede has quit IRC (Ping timeout: 252 seconds) [16:45] *** Aoede has joined #archiveteam-bs [16:45] *** medowar has joined #archiveteam-bs [16:51] *** i0npulse has joined #archiveteam-bs [17:06] *** ndiddylap has joined #archiveteam-bs [17:06] WELL CONGRATIONS [17:06] YOU PISSED OFF GITHUB [17:06] HIGH FIVES [17:06] whee [17:06] https://twitter.com/textfiles/status/1006220611994161152 [17:07] we've got a fella from github in #getgit atm [17:07] *** SketchCo1 is now known as SketchCow [17:08] *** icedice has joined #archiveteam-bs [17:14] *** deathy has joined #archiveteam-bs [17:17] *** ndiddylap has quit IRC (Read error: Operation timed out) [17:20] *** medowar has quit IRC (Ping timeout: 252 seconds) [17:21] *** medowar has joined #archiveteam-bs [17:25] *** ndiddylap has joined #archiveteam-bs [17:25] SketchCow: https://archive.org/details/smartcomputing-learning-series-v8i12 [17:51] unrelated -- has anyone done discovery of Yahoo groups? [17:51] it seems to be a dying platform [17:51] and is a mess because you need to be a member of a particular group to access all the data on in [17:51] on it* [17:54] *** medowar has quit IRC (Ping timeout: 252 seconds) [17:55] *** Aoede has quit IRC (Ping timeout: 252 seconds) [17:55] *** Aoede has joined #archiveteam-bs [17:55] *** medowar has joined #archiveteam-bs [18:00] balrog: I’ve been grabbing it for two(?) years now. [18:00] PurpleSym: is there a channel for it? what's your process like? [18:01] No channel. I have a script that downloads public messages. See https://archive.org/details/archiveteam_yahoogroups [18:02] have you looked into how much effort it would be to (1) figure out which groups are public-join-without approval and (2) automate joining/scraping them? [18:03] No, so far my priority has been public groups/messages. [18:04] https://github.com/csaftoiu/yahoo-groups-backup seems to be able to do some of the scraping [18:05] are you scraping much in the way of metadata (meaning -- type of group)? [18:06] I guess we could just log in manually and hand over the cookie. [18:07] The script is saving raw API responses. [18:07] ahh, you're doing it through API? [18:07] Yes. [18:08] I see [18:08] Going for rendered HTML would yield way more data. [18:08] just the type of group (public join vs. join by approval) is a useful piece of info [18:08] I have about 1.5 TB compressed (xz) JSON so far. [18:09] Let me see if I can get you a sample group description… [18:10] Here we go: https://hastebin.com/qoxubuzoni.json [18:11] nice, you can just look at memberShipType [18:13] You’re right, I have all the data necessary to do this. [18:13] *** medowar has quit IRC (Ping timeout: 252 seconds) [18:13] I see all these messagesVis, photosVis, filesVis, etc flags [18:14] I'm assuming this API is not well documented? [18:14] It’s not meant to be public. [18:14] So no. [18:15] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [18:15] *** medowar has joined #archiveteam-bs [18:15] *** i0npulse has joined #archiveteam-bs [18:16] are there any applications other than the web interface that use this API? [18:17] and yeah, just scraping group descriptions goes a long looooong way for discovery [18:17] is there a group directory? [18:18] I’m not sure how the mobile application works, but I think it was just a WebView. [18:19] There is a directory, but it returns only a limited amount of groups, see https://www.archiveteam.org/index.php?title=Yahoo!_Groups [18:20] "Note that all paginated responses are limited to the first 500 results and do not return anything new beyond that." ugh [18:20] Yep, that’s the catch. I’ve done my discovery as best as I could, abusing their search with all possible two and three letter strings. [18:21] But there are private groups which cannot be found through search. [18:21] *** Despatche has quit IRC (Quit: Read error: Connection reset by peer) [18:21] *** Despatche has joined #archiveteam-bs [18:21] And joining groups is protected by a captcha, which is probably the reason I did not implement it yet. [18:21] yeah. [18:22] just figuring out which are the biggest / most interesting groups would be a start, though, and it sounds like you might already have that metadata [18:23] I can get you a copy if you want. A list of groups plus their creation date is available here: https://6xq.net/paste/yg_list.txt.xz [18:26] *** icedice has quit IRC (Read error: Connection reset by peer) [18:28] also looks smart computing as guide series that is different from learning series [18:28] i say that cause volume 8 for learning series is 2001 [18:29] where guides volume 9 series is also 2001 [18:35] *** Gfy_ is now known as Gfy [18:43] godane: The Godanerator (Godane Inbox Sorter) now runs automatically a couple times a day. Should keep godaneinbox nice and clean going forward. [19:03] i noticed that [19:05] *** i0npulse has quit IRC (Ping timeout: 252 seconds) [19:06] SketchCow: so are you at the IA [19:06] *** i0npulse has joined #archiveteam-bs [19:16] *** wp494 has quit IRC (Ping timeout: 260 seconds) [19:16] *** wp494 has joined #archiveteam-bs [19:26] *** davisonio has joined #archiveteam-bs [19:35] *** icedice has joined #archiveteam-bs [19:50] *** phuz is now known as phuzion [20:13] No, I'm here [20:13] In NY [20:13] ok [20:13] Otherwise I'd be filling your life with tapes [20:13] i figure that later [20:13] this week [20:14] i'm trying to get all the magazines i have scanned before then [20:14] *** icedice has quit IRC (Ping timeout: 268 seconds) [20:28] *** tuluu has joined #archiveteam-bs [21:17] *** schbirid has quit IRC (Quit: Leaving) [21:23] so 2 of the smart computing guide series are going up [21:57] SketchCow: https://archive.org/details/smartcomputing-guide-series-v9i1 [21:57] SketchCow: https://archive.org/details/smartcomputing-guide-series-v9i7 [22:40] *** me_ is now known as yipdw [22:43] this is very sad: https://www.youtube.com/watch?v=uCCuwqPFLfk [23:52] *** BlueMax has joined #archiveteam-bs