[00:18] *** icedice has joined #archiveteam-ot [00:37] I may have to upload gallons of ascii art, so future civilizations "finally figured it out" and have a nice fluff piece to air on the evening news. [01:00] *** X-Scale has joined #archiveteam-ot [01:15] *** killsushi has quit IRC (Quit: Leaving) [01:15] *** yawkat has quit IRC (Ping timeout: 246 seconds) [01:44] *** yawkat has joined #archiveteam-ot [01:51] *** VerifiedJ has quit IRC (Quit: Leaving) [01:57] *** ShellyRol has quit IRC (Ping timeout: 745 seconds) [02:06] *** ShellyRol has joined #archiveteam-ot [02:31] *** jake_test has joined #archiveteam-ot [03:22] *** manjaro-u has quit IRC (Read error: Operation timed out) [04:22] *** scorche` has joined #archiveteam-ot [04:22] *** scorche has quit IRC (Read error: Operation timed out) [04:22] *** scorche` is now known as scorche [04:26] *** qw3rty2 has joined #archiveteam-ot [04:30] *** Mateon1 has quit IRC (Read error: Connection reset by peer) [04:30] *** Mateon1 has joined #archiveteam-ot [04:32] *** paul2520 has quit IRC (Read error: Operation timed out) [04:32] *** markedL has quit IRC (Read error: Operation timed out) [04:33] *** qw3rty has quit IRC (Ping timeout: 745 seconds) [04:34] *** nyany__ has quit IRC (Read error: Operation timed out) [04:35] *** odemg has quit IRC (Ping timeout: 746 seconds) [04:36] *** godane has quit IRC (Ping timeout: 246 seconds) [04:36] *** paul2520 has joined #archiveteam-ot [04:37] *** markedL has joined #archiveteam-ot [04:39] *** odemg has joined #archiveteam-ot [04:40] *** nyany_ has joined #archiveteam-ot [04:53] *** godane has joined #archiveteam-ot [05:18] *** benjins has quit IRC (Read error: Operation timed out) [05:19] *** benjins has joined #archiveteam-ot [05:43] *** scorche has quit IRC (Read error: Operation timed out) [05:50] *** scorche has joined #archiveteam-ot [05:57] *** dewdrop has joined #archiveteam-ot [05:59] *** dewdropaw has quit IRC (Ping timeout: 255 seconds) [06:37] *** dhyan_nat has joined #archiveteam-ot [07:02] *** kiska18 has quit IRC (Remote host closed the connection) [07:02] *** Ryz has quit IRC (Remote host closed the connection) [07:02] *** kiska18 has joined #archiveteam-ot [07:02] *** Fusl__ sets mode: +o kiska18 [07:02] *** Fusl sets mode: +o kiska18 [07:02] *** Fusl_ sets mode: +o kiska18 [07:03] *** Ryz has joined #archiveteam-ot [07:42] *** godane has quit IRC (Ping timeout: 258 seconds) [08:03] *** benjins has quit IRC (Read error: Operation timed out) [08:05] *** benjins has joined #archiveteam-ot [08:20] *** LowLevelM has quit IRC (Read error: Operation timed out) [08:31] *** thelounge has joined #archiveteam-ot [08:53] *** dhyan_nat has quit IRC (Read error: Operation timed out) [09:57] JAA I added an example to this https://github.com/JustAnotherArchivist/snscrape/pull/53 since it fits in, if ya want it :) [10:01] Dallas: Thanks, but please put that in a separate PR to keep the PRs tidy. (I.e. separate branch, and force-push this branch to the previous commit.) [10:02] Also, that just made me realise that the InstagramHashtagScraper & Co. classes lack a proper __init__ method. Thanks. [10:02] By the way, this would fit better into #archiveteam-dev. [10:08] Didn't know that was a channel ty [10:32] *** dhyan_nat has joined #archiveteam-ot [12:09] *** deevious has quit IRC (Ping timeout: 252 seconds) [12:16] *** deevious has joined #archiveteam-ot [12:48] *** godane has joined #archiveteam-ot [13:34] *** icedice has quit IRC (Read error: Connection reset by peer) [13:34] *** phillipsj has quit IRC (Read error: Connection reset by peer) [13:35] *** deevious has quit IRC (Read error: Connection reset by peer) [13:35] *** Zerote has joined #archiveteam-ot [13:35] *** phillipsj has joined #archiveteam-ot [13:35] *** icedice has joined #archiveteam-ot [13:36] *** Flashfire has quit IRC (Read error: Connection reset by peer) [13:36] *** antomati_ has joined #archiveteam-ot [13:36] *** dxrt has quit IRC (Read error: Connection reset by peer) [13:36] *** dxrt has joined #archiveteam-ot [13:36] *** Fusl__ sets mode: +o dxrt [13:36] *** Fusl_ sets mode: +o dxrt [13:37] *** benjinsmi has joined #archiveteam-ot [13:37] *** benjins has quit IRC (Ping timeout: 252 seconds) [13:37] *** Maylay_ has quit IRC (Ping timeout: 252 seconds) [13:38] *** ats has quit IRC (Ping timeout: 252 seconds) [13:38] *** prq has quit IRC (Ping timeout: 252 seconds) [13:38] *** Zerote__ has quit IRC (Ping timeout: 252 seconds) [13:38] *** Fusl has quit IRC (Ping timeout: 252 seconds) [13:38] *** eientei95 has quit IRC (Read error: Connection reset by peer) [13:39] *** antomatic has quit IRC (Ping timeout: 252 seconds) [13:39] *** kiska has quit IRC (Read error: Connection reset by peer) [13:39] *** SketchCow has quit IRC (Ping timeout: 252 seconds) [13:39] *** ats has joined #archiveteam-ot [13:39] *** SynMonger has quit IRC (Read error: Connection reset by peer) [13:40] *** SynMonger has joined #archiveteam-ot [13:40] *** SketchCow has joined #archiveteam-ot [13:40] *** Fusl__ sets mode: +o SketchCow [13:41] *** Fusl_ sets mode: +o SketchCow [13:41] *** eientei95 has joined #archiveteam-ot [13:41] *** Fusl has joined #archiveteam-ot [13:41] *** Fusl__ sets mode: +o Fusl [13:41] *** Fusl_ sets mode: +o Fusl [13:41] *** prq has joined #archiveteam-ot [13:42] *** Maylay has joined #archiveteam-ot [13:43] *** X-Scale has quit IRC (Quit: HydraIRC -> http://www.hydrairc.com <- Would you like to know more?) [13:44] *** X-Scale has joined #archiveteam-ot [13:45] *** deevious has joined #archiveteam-ot [13:45] *** Flashfire has joined #archiveteam-ot [14:06] *** icedice has quit IRC (Read error: Operation timed out) [14:23] *** manjaro-u has joined #archiveteam-ot [14:41] *** deevious1 has joined #archiveteam-ot [14:42] *** deevious has quit IRC (Ping timeout: 252 seconds) [14:42] *** deevious1 is now known as deevious [14:50] *** Flashfire has quit IRC (Ping timeout: 252 seconds) [14:50] *** eientei95 has quit IRC (Ping timeout: 252 seconds) [14:51] *** ShellyRol has quit IRC (Read error: Operation timed out) [14:57] *** Flashfire has joined #archiveteam-ot [14:57] *** kiska has joined #archiveteam-ot [14:57] *** Fusl__ sets mode: +o kiska [14:57] *** Fusl sets mode: +o kiska [14:57] *** Fusl_ sets mode: +o kiska [14:58] Hrm.... I will eventually get a better irc client :D [15:00] *** eientei95 has joined #archiveteam-ot [15:04] *** ShellyRol has joined #archiveteam-ot [15:17] *** BlueMax has quit IRC (Read error: Connection reset by peer) [15:21] *** odemg has quit IRC (Remote host closed the connection) [15:33] https://playerservices.streamtheworld.com/api/livestream-redirect/CSPANRADIO.mp3 [15:45] *** ShellyRol has quit IRC (Ping timeout: 252 seconds) [15:46] Oh, SYS has a sale for the E3-SSD-1-32 again. -25% renewable. But no way around the setup fee this time. [15:46] *** ShellyRol has joined #archiveteam-ot [15:48] *** Flashfire has quit IRC (Ping timeout: 252 seconds) [15:49] Do any decent providers do black friday sales ? I might try and get a bigger storage box this year [15:50] *** kiska has quit IRC (Ping timeout: 252 seconds) [15:51] No way to know yet. [15:51] looks like the intel driver thing that is going away, there happens (hypothetically) to be a bittorrent floating around of an archive of all of their EOL stuff [15:51] ahh fair, I'll keep an eye out then [15:52] *** kiska has joined #archiveteam-ot [15:52] *** Fusl__ sets mode: +o kiska [15:52] *** Fusl sets mode: +o kiska [15:52] *** Fusl_ sets mode: +o kiska [15:53] *** Flashfire has joined #archiveteam-ot [15:54] yano: Would be nice to compare that to our grab. [15:55] https://www.bleepingcomputer.com/news/hardware/intel-is-removing-end-of-life-drivers-and-bios-downloads/ [15:55] JAA: would you like the infohash? [15:56] Nah, I already have too many things on my todo list anyway. But maybe someone else does. [15:56] ah [15:57] (hypothetically) this is the infohash: ab2341213861fd9af1a1f9628c094c2a894fa84c [15:58] *** dhyan_nat has quit IRC (Read error: Operation timed out) [16:17] *** deevious has quit IRC (Remote host closed the connection) [16:17] *** kiska has quit IRC (Ping timeout: 252 seconds) [16:21] *** Flashfire has quit IRC (Ping timeout: 252 seconds) [16:21] So apparently SYS does still have that "pay for 6+ months, no setup fee" offer. At least it appears in the order form. Not mentioned on the website anymore though as far as I can see. [16:24] *** kiska has joined #archiveteam-ot [16:24] *** Fusl__ sets mode: +o kiska [16:24] *** Fusl sets mode: +o kiska [16:24] *** Fusl_ sets mode: +o kiska [16:25] *** Flashfire has joined #archiveteam-ot [16:27] *** deevious has joined #archiveteam-ot [16:28] wowza @ yano's torrent. downloadmirror.intel.com_Sept20th2019.tar 342.35 GB [17:02] ~7gb of federal register pdfs for 1984-01 to 1984-06 [17:10] *** schbirid has joined #archiveteam-ot [17:10] *** nepeat has quit IRC (Read error: Connection reset by peer) [17:11] *** nepeat has joined #archiveteam-ot [17:35] *** manjaro-u has quit IRC (Ping timeout: 258 seconds) [17:46] *** kiska18 has quit IRC (Remote host closed the connection) [17:46] *** Ryz has quit IRC (Remote host closed the connection) [17:46] *** Ryz has joined #archiveteam-ot [17:46] *** kiska18 has joined #archiveteam-ot [17:46] *** Fusl__ sets mode: +o kiska18 [17:46] *** Fusl sets mode: +o kiska18 [17:46] *** Fusl_ sets mode: +o kiska18 [17:56] *** systwiALT has joined #archiveteam-ot [18:07] *** DogsRNice has joined #archiveteam-ot [18:08] *** Hani111 has joined #archiveteam-ot [18:18] *** Hani has quit IRC (Ping timeout: 745 seconds) [18:18] *** Hani111 is now known as Hani [18:33] *** thelounge is now known as LowLevelM [19:14] *** manjaro-u has joined #archiveteam-ot [19:21] What's the preferred way to archive entire subreddits? I know reddit has this stupid thing with comment trees and not showing ALL threads. Are there any tools/methods to grab as much as possible? [19:22] archive all of reddit by incrementing the id and you will also get your subreddit [19:23] yeah the comment thing is bad [19:23] maybe write a behavior for webrecorder [19:28] *** MaximeleG has joined #archiveteam-ot [19:29] anybody with experience with the reddit api? I'm getting 403 for everything, no matter what I do [19:31] I've registered a "personal use script" on https://www.reddit.com/prefs/apps/ and everything should just work™ [19:34] Hah if I could archive all of reddit I would [19:34] I have little experience with webrecorder [19:35] Too bad there isn't a way to export comments to a json file or something [19:42] oh well.. it turned out I need to call do_login explicitly with the api client I use [19:43] still sucks there's 0 feedback, but at least I could fix it on my end [20:39] *** MaximeleG has quit IRC (Quit: MaximeleG) [20:47] *** Jens has quit IRC (Remote host closed the connection) [20:47] *** Jens has joined #archiveteam-ot [20:52] *** schbirid has quit IRC (Quit: Leaving) [20:53] *** dhyan_nat has joined #archiveteam-ot [21:46] *** dhyan_nat has quit IRC (Read error: Operation timed out) [22:30] Pushshift is already archiving all of Reddit, though not as WARCs. [22:30] It's compressed JSON from the API. [22:31] The same dataset also powers redditsearch.io, which, unlike the search on Reddit itself, actually works. [23:17] *** godane has quit IRC (Quit: Leaving.) [23:41] *** HP_Archiv has joined #archiveteam-ot [23:53] *** BlueMax has joined #archiveteam-ot