[00:02] *** enowaldo has quit IRC (Read error: Operation timed out) [00:35] *** BlueMax has quit IRC (Read error: Connection reset by peer) [01:17] i'm uploading the last 2 years worth of sean hannity show [01:36] *** cfarquhar has quit IRC (Read error: Operation timed out) [01:44] *** cfarquhar has joined #archiveteam-bs [01:57] *** enowaldo has joined #archiveteam-bs [02:18] *** enowaldo has quit IRC (Read error: Operation timed out) [02:28] *** kbtoo has joined #archiveteam-bs [02:31] *** znak_ has joined #archiveteam-bs [02:32] *** schbirid2 has joined #archiveteam-bs [02:32] *** SketchCo1 has joined #archiveteam-bs [02:32] *** Fusl sets mode: +o SketchCo1 [02:33] *** marked has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** kbtoo__ has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** Oddly has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** schbirid has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** SketchCow has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** zino has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** chirlu has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** phirephly has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** wacky has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** superkuh has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** znak has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** second has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** tephra_ has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** betamax has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** achip has quit IRC (west.us.hub irc.Prison.NET) [02:34] *** superkuh_ has joined #archiveteam-bs [02:34] *** Oddly2 has joined #archiveteam-bs [02:34] *** chirlu` has joined #archiveteam-bs [02:35] *** zino_ has joined #archiveteam-bs [02:35] *** betamax_ has joined #archiveteam-bs [02:35] *** tephra has joined #archiveteam-bs [02:35] *** wacky_ has joined #archiveteam-bs [02:43] *** phirephl- has joined #archiveteam-bs [02:45] *** second_ has joined #archiveteam-bs [02:51] *** marked has joined #archiveteam-bs [02:52] *** marked has quit IRC (west.us.hub irc.Prison.NET) [03:06] *** marked has joined #archiveteam-bs [03:07] *** achip has joined #archiveteam-bs [03:08] *** superkuh_ is now known as superkuh [03:13] *** mr_archiv has quit IRC (Ping timeout: 615 seconds) [03:15] *** odemg has quit IRC (Ping timeout: 615 seconds) [03:22] *** odemg has joined #archiveteam-bs [03:22] *** odemg has quit IRC (Connection closed) [03:48] *** qw3rty115 has joined #archiveteam-bs [03:54] *** qw3rty114 has quit IRC (Read error: Operation timed out) [03:56] *** mr_archiv has joined #archiveteam-bs [03:59] *** enowaldo has joined #archiveteam-bs [04:08] *** enowaldo has quit IRC (Ping timeout: 492 seconds) [04:14] *** ColdIce has quit IRC (Remote host closed the connection) [04:14] *** ColdIce has joined #archiveteam-bs [04:26] *** MR9K4 has quit IRC (Read error: Operation timed out) [04:26] *** ivan has quit IRC (Write error: Broken pipe) [04:26] *** dxrt_ has quit IRC (Write error: Broken pipe) [04:26] *** ealgase has quit IRC (Read error: Operation timed out) [04:26] *** Stiletto has quit IRC (Read error: Operation timed out) [04:26] *** kiska1 has quit IRC (Read error: Operation timed out) [04:26] *** paul2520 has quit IRC (Write error: Broken pipe) [04:26] *** chfoo has quit IRC (Read error: Operation timed out) [04:26] *** Smiley has quit IRC (Read error: Operation timed out) [04:26] *** MR9K4 has joined #archiveteam-bs [04:26] *** Mayonaise has quit IRC (Read error: Operation timed out) [04:26] *** gandalf has quit IRC (Read error: Operation timed out) [04:26] *** chfoo has joined #archiveteam-bs [04:26] *** twigfoot has quit IRC (Read error: Operation timed out) [04:26] *** Fusl sets mode: +o chfoo [04:26] *** gandalf has joined #archiveteam-bs [04:26] *** twigfoot has joined #archiveteam-bs [04:27] *** robogoat has quit IRC (Read error: Operation timed out) [04:27] *** ivan has joined #archiveteam-bs [04:27] *** Stiletto has joined #archiveteam-bs [04:27] *** HashbangI has quit IRC (Write error: Broken pipe) [04:27] *** Odd0002 has quit IRC (Read error: Operation timed out) [04:27] *** undersco2 has quit IRC (Read error: Operation timed out) [04:27] *** ats has quit IRC (Read error: Operation timed out) [04:27] *** TigerbotH has quit IRC (Read error: Operation timed out) [04:27] *** Odd0002 has joined #archiveteam-bs [04:28] *** jspiros has quit IRC (Read error: Operation timed out) [04:28] *** undersco2 has joined #archiveteam-bs [04:28] *** Mayonaise has joined #archiveteam-bs [04:28] *** fredgido_ has joined #archiveteam-bs [04:28] *** chuckx has quit IRC (Read error: Operation timed out) [04:30] *** Prissy_To has joined #archiveteam-bs [04:30] *** SynMonger has quit IRC (Read error: Operation timed out) [04:30] *** benjins has quit IRC (Read error: Operation timed out) [04:30] *** SynMonger has joined #archiveteam-bs [04:30] *** unlobito has quit IRC (Read error: Operation timed out) [04:30] *** unlobito has joined #archiveteam-bs [04:30] *** PotcFdk has quit IRC (Read error: Operation timed out) [04:30] *** PhrackD has quit IRC (Read error: Operation timed out) [04:30] *** robogoat has joined #archiveteam-bs [04:31] *** fredgido has quit IRC (Read error: Operation timed out) [04:31] jodizzle: I like that separation, should probably do that for the other elections as well. [04:31] *** Jusque has quit IRC (Read error: Operation timed out) [04:31] *** Smiley has joined #archiveteam-bs [04:31] *** Jusque has joined #archiveteam-bs [04:31] JAA: The separation between political parties and general election, you mean? [04:31] One page for the parties, which will still be around for years, and another for the campaigns, candidates, etc. specific to an election. [04:32] Yeah I saw that had been done for Lithuania [04:32] *** qw3rty115 has quit IRC (Read error: Operation timed out) [04:32] In some sense [04:32] Yeah right, because I didn't do it. :-P [04:32] *** benjins has joined #archiveteam-bs [04:32] Those pages still need some cleanup. Will do that later. [04:35] *** ats has joined #archiveteam-bs [04:38] *** ealgase has joined #archiveteam-bs [04:40] JAA: Awesome stuff! Thanks. [04:57] *** jspiros has joined #archiveteam-bs [04:57] *** BlueMax has joined #archiveteam-bs [05:22] *** SketchCo1 is now known as SketchCow [05:25] *** qw3rty115 has joined #archiveteam-bs [05:25] *** kiska1 has joined #archiveteam-bs [05:25] *** wyatt8740 has joined #archiveteam-bs [05:26] *** svchfoo3 sets mode: +o kiska1 [05:28] *** chuckx has joined #archiveteam-bs [05:29] *** TigerbotH has joined #archiveteam-bs [05:34] *** HashbangI has joined #archiveteam-bs [05:34] *** PhrackD has joined #archiveteam-bs [05:34] *** dxrt_ has joined #archiveteam-bs [05:34] *** dxrt sets mode: +o dxrt_ [05:38] *** PotcFdk has joined #archiveteam-bs [05:46] *** paul2520 has joined #archiveteam-bs [06:07] *** deevious has quit IRC (Quit: deevious) [06:38] *** wyatt8740 has quit IRC (Read error: Operation timed out) [06:43] *** deevious has joined #archiveteam-bs [07:02] *** godane has quit IRC (Ping timeout: 268 seconds) [07:20] *** godane has joined #archiveteam-bs [08:11] *** logchfoo4 starts logging #archiveteam-bs at Thu May 09 08:11:48 2019 [08:11] *** logchfoo4 has joined #archiveteam-bs [08:23] *** Coderjo has joined #archiveteam-bs [09:01] *** phiresky has joined #archiveteam-bs [09:01] *** Laverne has joined #archiveteam-bs [09:01] *** kiskabak has joined #archiveteam-bs [09:01] *** svchfoo1 sets mode: +o kiskabak [09:03] *** Gfy has joined #archiveteam-bs [09:15] *** Prissy_To has quit IRC (Quit: Here is my journey's end, here is my butt.) [11:03] *** BlueMax has quit IRC (Quit: Leaving) [11:09] *** wp494 has quit IRC (Read error: Operation timed out) [11:10] *** wp494 has joined #archiveteam-bs [11:57] *** enowaldo has joined #archiveteam-bs [12:04] *** godane has quit IRC (Ping timeout: 246 seconds) [12:10] *** icedice has joined #archiveteam-bs [12:11] *** Zerote has joined #archiveteam-bs [12:17] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [12:19] *** godane has joined #archiveteam-bs [12:32] *** icedice has quit IRC (Quit: Leaving) [12:51] *** enowaldo has joined #archiveteam-bs [13:00] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [13:39] *** antomatic has joined #archiveteam-bs [13:40] *** antomati_ has quit IRC (Read error: Operation timed out) [13:51] *** af10b3e5e has quit IRC (Read error: Connection reset by peer) [13:54] *** af10b3e5e has joined #archiveteam-bs [14:08] *** enowaldo has joined #archiveteam-bs [14:59] *** Ravenloft has quit IRC (Read error: Connection reset by peer) [15:57] *** enowaldo has quit IRC (Read error: Operation timed out) [16:10] *** enowaldo has joined #archiveteam-bs [16:55] *** mr_trouse has joined #archiveteam-bs [16:57] *** mulischaf has joined #archiveteam-bs [16:58] *** mr_trouse has quit IRC (Client Quit) [17:47] *** icedice has joined #archiveteam-bs [18:45] *** Pixi has quit IRC (Quit: Pixi) [18:45] *** enowaldo has quit IRC (Read error: Operation timed out) [18:53] *** Pixi has joined #archiveteam-bs [18:56] *** enowaldo has joined #archiveteam-bs [19:02] Here's a question. [19:02] Do we have an EASY way to generate a webpage snapshot from a WARC? [19:02] I just want to make preview images for archivebot uploads. [19:06] like, extracting the entire warc into a directory as if it was downloaded using wget -r, or rather like extracting a single url out of the warc? [19:08] maybe some combination of pywb and puppeteer [19:09] https://archive.org/details/archiveteam_archivebot_go_20150107190002 is what I am shooting for [19:09] I used an incredibly pain in the ass system to do this, it's surely easier now. [19:12] a simple python script might do the trick? ive never extracted data from any warcs before so there might be an easier way [19:17] SketchCow: Load WARC into pywb, load the site with headless Google Chrome and use Page.captureScreenshot (https://chromedevtools.github.io/devtools-protocol/1-3/Page#method-captureScreenshot)? [19:21] *** Dimtree has quit IRC () [19:21] *** PurpleSym has quit IRC (Quit: *) [19:24] *** PurpleSym has joined #archiveteam-bs [19:25] Yeah, pywb + headless browser sounds like the easiest route. [19:31] Actually, it’s easier with Chrome: `google-chrome-stable --hide-scrollbars --headless --disable-gpu --screenshot ` [19:33] isnt that an easy way to archive tweets [19:34] Sure, if you want to have an image. [19:34] It’ll only show the content of the viewport though, not the whole page. [19:35] jodizzle: Oh, one thing I hadn't mentioned, party leaders are also a good thing to archive. Not sure whether they'd belong on the party or the election page though. [19:37] JAA: Yeah, I'm trying to track those down as well. But I agree it's confusing to organize. [19:37] I don't think it's that bad to have duplication across the "ArchiveBot/" pages, though. [19:38] It's already sorta done for the Venezuela politics and Governments/Venezuela pages [19:38] Though some of that is just messiness [19:39] *** K4k__ has quit IRC (Read error: Connection reset by peer) [19:40] *** killsushi has joined #archiveteam-bs [19:44] jodizzle: Yeah, I guess we can duplicate it. "Current & former party leaders" on the party page, and the current ones at election time on the election page. [19:57] *** mulischaf has left [20:00] VoynichCr: Good catch, thanks. [20:14] :p [21:17] *** enowaldo has quit IRC (Read error: Operation timed out) [21:30] *** enowaldo has joined #archiveteam-bs [21:55] *** BlueMax has joined #archiveteam-bs [21:55] *** ATrescue has joined #archiveteam-bs [21:56] *** enowaldo has quit IRC (Read error: Operation timed out) [22:03] *** enowaldo has joined #archiveteam-bs [22:25] *** Mateon1 has quit IRC (Remote host closed the connection) [22:28] *** Mateon1 has joined #archiveteam-bs [22:28] *** BlueMax has quit IRC (Read error: Connection reset by peer) [22:32] *** icedice has quit IRC (Quit: Leaving) [22:42] Do we really need a page for Mozilla Firefox? What's the point? [22:46] they're removing their old addons [22:51] !ao https://www.archiveteam.org/index.php?title=Mozilla_Firefox [22:51] Whoops, wrong page. [22:53] I meant: Wrong IRC channel [22:54] ndiddy: They did that last autumn, and that's not Firefox but AMO, which we have a separate page for. [22:58] *** killsushi has quit IRC (Quit: Leaving) [23:28] Template:U? Really? Typing URL is too long? [23:29] I appreciate your enthusiasm, but... [23:31] Same with W/W2/W2+ and whatever other variants exist. {{Wikipedia|...}} is much more obvious what it does. [23:43] *** enowaldo has quit IRC (Read error: Operation timed out) [23:45] *** enowaldo has joined #archiveteam-bs [23:54] *** Darkstar has quit IRC (Remote host closed the connection)