[00:04] *** Dimtree has joined #archiveteam-bs [00:14] *** wp494 has quit IRC (Read error: Operation timed out) [00:15] *** wp494 has joined #archiveteam-bs [00:27] *** BlueMax has joined #archiveteam-bs [00:37] *** RichardG_ has joined #archiveteam-bs [00:37] *** RichardG has quit IRC (Read error: Connection reset by peer) [01:24] *** DFJustin has quit IRC (Read error: Operation timed out) [01:25] *** Mateon1 has quit IRC (Ping timeout: 260 seconds) [01:25] *** Mateon1 has joined #archiveteam-bs [01:34] *** DFJustin has joined #archiveteam-bs [01:34] *** swebb sets mode: +o DFJustin [01:43] *** DFJustin has quit IRC (Read error: Operation timed out) [01:44] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [01:48] *** DFJustin has joined #archiveteam-bs [01:48] *** swebb sets mode: +o DFJustin [01:50] SketchCow: https://archive.org/details/startrek.net-earthlink-2002-06-cd [01:50] now you got all the magazine stuff i got from Savers on sunday [01:50] i have 8 vhs tapes next that i will digitize that also got from savers [02:00] latest digitize tapes: https://www.patreon.com/posts/digitize-tapes-20598411 [02:05] Any Warrior devs available? been stuck on this issue for a while... [02:21] *** adinbied has quit IRC (Quit: Leaving) [03:05] *** vectr0n has quit IRC (Quit: ZNC - https://znc.in) [03:06] *** Atom-- has joined #archiveteam-bs [03:06] *** vectr0n has joined #archiveteam-bs [03:09] *** Atom__ has quit IRC (Read error: Operation timed out) [03:44] *** DragonMon has joined #archiveteam-bs [04:02] *** m007a83_ has joined #archiveteam-bs [04:08] *** m007a83__ has joined #archiveteam-bs [04:10] *** m007a83_ has quit IRC (Ping timeout: 252 seconds) [04:10] *** m007a83 has quit IRC (Read error: Operation timed out) [04:12] *** SketchCow has quit IRC (Read error: Operation timed out) [04:18] *** SketchCow has joined #archiveteam-bs [04:18] *** swebb sets mode: +o SketchCow [05:03] *** m007a83__ has quit IRC (Leaving) [05:05] *** m007a83 has joined #archiveteam-bs [06:18] *** fredgido has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** Rai-chan has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** nyaomi has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** underscor has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** closure has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** TC01 has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** kisspunch has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** Coderjo has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** decay has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** bsmith093 has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** VoynichCr has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** BnARobin has quit IRC (hub.efnet.us irc.efnet.nl) [06:18] *** Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl) [06:21] *** fredgido has joined #archiveteam-bs [06:21] *** Rai-chan has joined #archiveteam-bs [06:21] *** nyaomi has joined #archiveteam-bs [06:21] *** underscor has joined #archiveteam-bs [06:21] *** closure has joined #archiveteam-bs [06:21] *** TC01 has joined #archiveteam-bs [06:21] *** BnAboyZ has joined #archiveteam-bs [06:21] *** kisspunch has joined #archiveteam-bs [06:21] *** Coderjo has joined #archiveteam-bs [06:21] *** decay has joined #archiveteam-bs [06:21] *** bsmith093 has joined #archiveteam-bs [06:21] *** VoynichCr has joined #archiveteam-bs [06:21] *** BnARobin has joined #archiveteam-bs [06:21] *** Tenebrae has joined #archiveteam-bs [06:21] *** MrRadar2 has joined #archiveteam-bs [06:21] *** irc.efnet.nl sets mode: +oo underscor MrRadar2 [06:21] *** swebb sets mode: +o underscor [06:56] *** wp494 has quit IRC (Read error: Operation timed out) [06:57] *** wp494 has joined #archiveteam-bs [07:32] *** brayden has quit IRC (Read error: Operation timed out) [07:34] *** brayden has joined #archiveteam-bs [07:34] *** swebb sets mode: +o brayden [07:34] *** fludd has joined #archiveteam-bs [07:37] What's the best approach to deal with archiving a website that makes heavy use of JavaScript for loading page content? [07:38] In particular, the website I'm thinking of uses AJAX POST requests to load content, which is even worse. [07:39] Would it be better to just dump the DOM using Selenium and give up on getting a WARC? [07:49] *** fludd has quit IRC (*.net *.split) [09:02] godane you around? [09:04] Actually any member of the archive team will do for this [09:43] sup Flashfire ? [09:46] Hold on let me link it [09:47] https://www.reddit.com/r/DataHoarder/comments/958d22/rare_british_tv_archive_soon_to_be_lost_please/?st=JKJITS5X&sh=d22d7598 IGLOO [09:52] It seems pretty well covered thus far by the data hoarder guys... I've made a comment offering help but so far he's not come back to anyone [09:56] https://www.reddit.com/r/Archiveteam/comments/95a03m/is_it_possible_to_archive_google_groups/?st=JKJJ5C7M&sh=a6820a39 [10:00] Not sure about google groups [10:28] *** Sk2d has joined #archiveteam-bs [10:30] *** Sk1d has quit IRC (Read error: Operation timed out) [10:30] *** Sk2d is now known as Sk1d [10:54] *** c4rc4s has quit IRC (Ping timeout: 360 seconds) [11:06] *** c4rc4s has joined #archiveteam-bs [11:35] *** RichardG_ is now known as RichardG [11:49] *** icedice has joined #archiveteam-bs [11:57] *** Jens has quit IRC (Remote host closed the connection) [11:58] *** Jens has joined #archiveteam-bs [12:47] *** MrRadar has quit IRC (Read error: Operation timed out) [12:49] #domtitles is available again. Ping Aoede, arkiver, Ctrl-S, Flashfire, Gfy, Hecatz, jut, kiska [12:53] *** MrRadar has joined #archiveteam-bs [12:54] *** svchfoo1 sets mode: +o MrRadar [13:01] *** icedice has quit IRC (Ping timeout: 260 seconds) [13:12] *** BlueMax has quit IRC (Read error: Connection reset by peer) [13:13] *** m007a83_ has joined #archiveteam-bs [13:14] *** m007a83_ has quit IRC (Client Quit) [13:17] *** m007a83 has quit IRC (Read error: Operation timed out) [13:20] *** m007a83 has joined #archiveteam-bs [14:05] *** icedice has joined #archiveteam-bs [14:27] *** ta9le has joined #archiveteam-bs [15:29] SketchCow: do we have any new emails at archiveteam@archiveteam.org now? [15:33] from who [15:35] Went through the spam back to July 1, nothing [15:37] From Google News Archive [15:37] Nope, nothing [15:37] We´re trying to archive the Google Newspapers Archive [15:38] They keep banning our user agent and I suspect this is manual bans. We don´t know how to contact them, so out last used user agent was `We don't know how to contact you. Can you please email us at archiveteam@archiveteam.org? Thank you, Archive Team.`. [15:38] our* [15:38] I know you hate it when I laugh in your face, so I'm going to be behind this suspiciously shaking curtain [15:40] I´m wondering what our next user agent will be [15:40] I didn't understand what you're looking for [15:40] Like, I thought you were waiting on an actual correspondence [15:40] Kind of [15:40] You wrote a hopeful fan letter and wonder why Elvis hasn't gotten back [15:41] Well we could keep changing user agents and archiving them. [15:41] But I don´t want it to get to the point of IP bans from Google [15:52] Nobody, anywhere, in Google wants us to scrape the newspapers, arkiver [15:52] Anywhere. [15:52] Fun [15:53] We will anyway [16:03] *** m007a83_ has joined #archiveteam-bs [16:10] *** m007a83 has quit IRC (Read error: Operation timed out) [16:12] *** m007a83_ has quit IRC (Read error: Operation timed out) [16:38] *** Stilett0 has quit IRC (Read error: Connection reset by peer) [16:39] *** midas1 has quit IRC (Read error: Operation timed out) [16:40] *** midas1 has joined #archiveteam-bs [16:41] *** Stilett0 has joined #archiveteam-bs [16:50] *** godane has quit IRC (Ping timeout: 260 seconds) [16:55] *** TheFrench has joined #archiveteam-bs [17:36] *** godane has joined #archiveteam-bs [17:36] my wifi disconnected [17:37] SketchCow: don't upload the vhs captures for a while [17:38] Yeah Google hands out bans for suspected bots like it's somebody's full time job [17:39] I knew a guy who scripted the rotation of every Amazon IP he could get his hands on and scraped until he exhausted/burned them all. Then he asked me about ipv6 XD [17:46] godane: You got it [18:02] *** JH88 has joined #archiveteam-bs [18:30] SketchCow: I think my uploads need sorting and collecting again please [19:06] *** DragonMon has quit IRC (Ping timeout: 252 seconds) [19:15] *** DragonMon has joined #archiveteam-bs [19:44] *** TheFrench has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** icedice has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** fredgido has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** Rai-chan has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** nyaomi has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** underscor has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** closure has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** TC01 has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** kisspunch has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** Coderjo has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** decay has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** bsmith093 has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** VoynichCr has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** BnARobin has quit IRC (hub.efnet.us irc.efnet.nl) [19:44] *** Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl) [19:47] *** TheFrench has joined #archiveteam-bs [19:47] *** icedice has joined #archiveteam-bs [19:47] *** fredgido has joined #archiveteam-bs [19:47] *** Rai-chan has joined #archiveteam-bs [19:47] *** nyaomi has joined #archiveteam-bs [19:47] *** underscor has joined #archiveteam-bs [19:47] *** closure has joined #archiveteam-bs [19:47] *** TC01 has joined #archiveteam-bs [19:47] *** BnAboyZ has joined #archiveteam-bs [19:47] *** kisspunch has joined #archiveteam-bs [19:47] *** Coderjo has joined #archiveteam-bs [19:47] *** decay has joined #archiveteam-bs [19:47] *** bsmith093 has joined #archiveteam-bs [19:47] *** VoynichCr has joined #archiveteam-bs [19:47] *** BnARobin has joined #archiveteam-bs [19:47] *** Tenebrae has joined #archiveteam-bs [19:47] *** MrRadar2 has joined #archiveteam-bs [19:47] *** irc.efnet.nl sets mode: +oo underscor MrRadar2 [19:47] *** swebb sets mode: +o underscor [19:52] * vectr0n pets efnet for being so stable [20:05] *** TheFrench has quit IRC (Read error: Operation timed out) [20:14] *** Dimtree has quit IRC (Peace) [21:23] *** Dimtree has joined #archiveteam-bs [21:29] *** schbirid has joined #archiveteam-bs [22:00] latest tapes and scans: https://www.patreon.com/posts/digitize-tapes-20618744 [22:02] btw i'm going to scanning 10 more issues of Star Trek Communicator [22:02] i got luckly and was able to grab the rest of them [22:07] Godane if I was to send you some books and magazines would you be able to send them back to me when you were done? I have an 11th edition Guinness world records as well as some old magazines but no scanner [22:08] if you put a return label in the box sure [22:09] I might put a small box together and get back to you [22:11] Some old Murray fields magazines amongst other things [22:12] Sorry Maurie Fields I spelt it wrong [22:29] *** BlueMax has joined #archiveteam-bs [22:37] *** schbirid has quit IRC (Quit: Leaving) [22:40] *** m007a83 has joined #archiveteam-bs [22:59] http://www.nintendolife.com/news/2018/08/feature_what_does_nintendos_shutdown_of_rom-sharing_sites_mean_for_video_game_preservation [23:03] *** dan- has quit IRC (Ping timeout: 260 seconds) [23:04] *** jsa has quit IRC (Quit: No Ping reply in 180 seconds.) [23:05] *** zhongfu has quit IRC (Remote host closed the connection) [23:06] *** zhongfu has joined #archiveteam-bs [23:07] *** apache2 has quit IRC (Remote host closed the connection) [23:09] *** apache2 has joined #archiveteam-bs [23:12] *** dan- has joined #archiveteam-bs [23:24] *** Mateon1 has quit IRC (Ping timeout: 260 seconds) [23:25] *** Mateon1 has joined #archiveteam-bs [23:38] *** icedice has quit IRC (Ping timeout: 268 seconds) [23:50] *** adinbied has joined #archiveteam-bs [23:56] https://old.reddit.com/r/SCPSecretLab/ is having some kind of drama [23:56] !a that