[00:01] *** odemg has joined #archiveteam-bs [00:04] *** midas1 has joined #archiveteam-bs [00:04] *** achip has joined #archiveteam-bs [00:27] *** brayden has joined #archiveteam-bs [00:28] *** swebb sets mode: +o brayden [00:41] *** wp494_ is now known as wp494 [00:48] *** dashcloud has joined #archiveteam-bs [01:13] *** Zachary has joined #archiveteam-bs [01:19] *** fie has quit IRC (Ping timeout: 244 seconds) [01:53] *** Stil3tt0 is now known as Stiletto [02:00] *** odemg has quit IRC (Remote host closed the connection) [02:11] *** pizzaiolo has left [02:17] *** Zachary has quit IRC (Lost terminal) [02:28] *** odemg has joined #archiveteam-bs [02:41] *** username1 has joined #archiveteam-bs [02:44] *** schbirid2 has quit IRC (Read error: Operation timed out) [03:30] *** kristian_ has quit IRC (Quit: Leaving) [03:33] *** fie has joined #archiveteam-bs [03:33] *** tychot has joined #archiveteam-bs [03:50] godane: I suspected that this guy didn't know we've kind of already done his job for him. [03:50] But I wanted you to walk it over and verify. [03:51] *** beardicus has quit IRC (bye) [03:55] *** VADemon has quit IRC (Read error: Operation timed out) [03:58] i think we did most of it [03:58] *** Specular has joined #archiveteam-bs [03:58] i know rev3games encoded mp4s on revsion3.com was saved [03:59] but i don't think everything from youtube channel was put as on there revsion3 site [03:59] also there numbers missing from it [04:07] *** Specular has quit IRC (Ping timeout: 370 seconds) [04:08] *** Specular has joined #archiveteam-bs [04:16] *** Specular has quit IRC (Ping timeout: 370 seconds) [04:16] *** Specular has joined #archiveteam-bs [04:24] *** Specular has quit IRC (Read error: Operation timed out) [04:24] *** Specular has joined #archiveteam-bs [04:27] *** Coderjoe has joined #archiveteam-bs [04:33] *** Specular has quit IRC (Ping timeout: 370 seconds) [04:35] *** Specular has joined #archiveteam-bs [04:43] *** Specular has quit IRC (Read error: Operation timed out) [04:43] *** Specular has joined #archiveteam-bs [04:51] *** Specular has quit IRC (Read error: Operation timed out) [04:51] *** Specular has joined #archiveteam-bs [04:59] *** Specular has quit IRC (Ping timeout: 370 seconds) [04:59] *** Specular has joined #archiveteam-bs [05:00] *** dashcloud has quit IRC (Read error: Operation timed out) [05:03] *** dashcloud has joined #archiveteam-bs [05:06] *** Coderjoe has quit IRC (Quit: Changing server) [05:06] *** Cojo-adhd has joined #archiveteam-bs [05:07] *** Cojo-adhd is now known as Coderjoe [05:19] *** ndiddy has quit IRC (Read error: Connection reset by peer) [05:28] *** dashcloud has quit IRC (Read error: Operation timed out) [05:28] *** balrog has quit IRC (Read error: Operation timed out) [05:33] *** brayden has quit IRC (Read error: Operation timed out) [05:34] *** dashcloud has joined #archiveteam-bs [05:35] *** balrog has joined #archiveteam-bs [05:35] *** swebb sets mode: +o balrog [05:45] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [05:46] xmc: I'm new. I'll go read the etiquette blurb in more detail. [05:47] no worries, just: we're all in both channels, so filter heavily. your line about sampling was useful and ontopic and worth sharing [05:48] Indeed. And I've re-read the IRC wiki page, and I think I have a better sense of the topicality now. [05:48] kool [05:49] that channel is best kept quiet so that people can go afk for six hours and catch up in only a few minutes [05:50] Ah, makes sense. [05:50] How the noobs are treated says a lot about a channel. I appreciate the polite clarity. :) [05:50] that, depends on who's around to whip you all into shape [05:51] *** Sk1d has joined #archiveteam-bs [05:51] *** dashcloud has quit IRC (Ping timeout: 633 seconds) [05:53] Boy, I hear that. I'm in #hashcat on freenode a lot and it's luck-of-the-draw. :) Glad I lucked out. [05:53] On the topic of me being useful ... [05:53] Alaskan bandwidth is semi-metered, so full-on downloads are probably not really where I can be high-leverage. [05:54] I can slice-and-dice DNS and IP stuff pretty well, when that's needed. [05:54] *** dashcloud has joined #archiveteam-bs [05:54] I could also help with docs. Though maybe right now isn't the best time for noobs do be jumping in. I won't be offended, if so. [05:56] I like how hitting the copy button on scientific data is a rogue action now [05:56] ENVIRONMENTAL PROTECTION AGENCY: ROGUE ONE [05:56] actually that gives me an idea for archivebot's twitter avatar [06:00] Uh-oh. [06:00] hah [06:00] No, not that. [06:00] I just randomly started googling NASA groups, including their Earth Sciences websites. [06:00] And... [06:00] This is one of their "where do I find data" portals [06:00] https://search.earthdata.nasa.gov/search [06:00] Top of page: [06:00] "NSIDC Scheduled Maintenance (Jan 25 2017 08:00 PST to Jan 25 2017 10:30 PST) AMSR-E, Aquarius, IceBridge,ICESat/GLAS, MODIS, NISE, and SMAP data will be unavailable for ordering from 9:00 AM - 11 PM Wednesday 25 Jan 2016 (U.S. Mountain Standard Time) due to system maintenance. We apologize for any inconvenience that this may cause. Please contact NSIDC User Services at nsidc@nsidc.org if you have any questions." [06:01] They're going to be down ALL DAY TOMORROW. [06:01] Maybe a coincidence, but... [06:01] AMSR-E, Aquarius, IceBridge,ICESat/GLAS, MODIS, NISE, and SMAP -- that's a lot of data to be down. [06:01] you should contact them with this very reasonable question [06:02] Oh, like they're at the office at 10:00 PM Pacific? [06:02] i wouldn't think so [06:02] message is a little confusing. the part at the beginning says 11:00 EST to 13:30 EST [06:02] which is only 2.5 hours, but then it says 9AM to 11PM [06:02] the first is PST, the second is MST [06:03] remember MST is not EST [06:03] no I get that but is it 2.5 hours or 15 hours [06:04] i would bet 15 hours [06:04] I wonder if anyone knows someone here who can shadowrun terabytes of data out [06:05] that interface is unfortunately not too archivebottable [06:05] yeah I was going to say this web app looks like a nightmare to archive [06:05] you really can't, you need the dataset and the viewer app [06:05] i've worked with these kinds of datasets, usually you have to submit a request and then a tape robot goes and gets it and you get an email half an hour later [06:05] it's a titanic amount of data [06:05] the viewer app maybe not so much because there's stuff like this already [06:06] I have been playing with the interface and I can't even figure out where to start to download. [06:06] I think it's the kind of thing that would have to be FOIA'ed [06:06] oh you need login anywa [06:06] yes [06:06] so, each entry you get in the left pane is a single granule in the map [06:06] so [06:06] yeah [06:07] gotta get the dataset out some other way [06:07] or I guess bang the download button a lot [06:07] the "Retrieve Collection Data" button might download everything [06:08] no, yipdw, this is a website that's backed by at least one tape library [06:08] yeah [06:08] I ran into an interface like that when I was grabbing old aerial photos from USGS a number of years ago [06:08] I guess those rogue scientists have this one covered [06:09] many climatologists died to bring us this information [06:09] MAID has got to be less expensive than a tape robot and tons of tapes these days, right? [06:10] Side question, maybe more actionable in the short term: I saw that Health and Human Services comms is also endangered? [06:10] Looks pretty harvestable: https://www.healthdata.gov/search/type/dataset [06:10] tape libraries are capex that lasts decades, you can upgrade the tapes and drives without changing the robot one bit [06:10] what about NIH pubmed? [06:11] is that in peril? [06:11] Hmm, maybe. Don't they distribute that quarterly on DVD to libraries? [06:11] .edu, that is [06:13] https://www.nlm.nih.gov/NIHbmic/nih_data_sharing_repositories.html [06:15] man, the data storage/retrieval for those is all over the map - it'd need to be inventoried [06:16] and a bunch of it would be tape-grade (yay, genomes!) [06:18] hmm ... https://www.ncbi.nlm.nih.gov/guide/howto/dwn-records/ [06:18] *** Aranje has quit IRC (Quit: Three sheets to the wind) [06:18] *** gui7 has joined #archiveteam-bs [06:20] *** gui7 has quit IRC (Client Quit) [06:27] *** Specular has quit IRC (Ping timeout: 370 seconds) [06:28] *** Specular has joined #archiveteam-bs [06:38] *** Honno has joined #archiveteam-bs [06:42] *** kristian_ has joined #archiveteam-bs [06:53] hmm [06:53] "Teen Vogue has been dropping articles that eviscerate Trump. They did a piece on Gaslighting." [06:54] er [06:54] I suspect "drop" means release in this sentence, now that I re-read it a few times. [06:58] yeah that sounds right [07:01] why are tape drives so bloody expensive? [07:01] are they super complex? [07:07] Supply / Demand + R&D costs [07:13] NOAA has been deleting data crucial to accurate counts of fishery stock [07:13] you could say they dropped the bass [07:14] -_- [07:16] *** Specular has quit IRC (Ping timeout: 370 seconds) [07:20] I'm doing a deletion of ROMs so boring my brain may leave my body [07:21] make sure your memories are marked read-only to protect them from the ethereal thieves [07:23] The entertainment software companies have stepped up the games [07:23] requesting removal of games inside my ZIPs [07:23] rude [07:30] IA is low hanging fruit for that sort of thing I guess [08:03] *** odemg has quit IRC (Remote host closed the connection) [08:04] i'm slowly starting to upload VHS Video Vault youtube channel [08:29] *** kristian_ has quit IRC (Quit: Leaving) [08:51] *** Honno has quit IRC (Ping timeout: 370 seconds) [09:01] *** GE has joined #archiveteam-bs [09:11] *** Specular has joined #archiveteam-bs [09:20] *** Specular has quit IRC (Ping timeout: 370 seconds) [09:21] *** Specular has joined #archiveteam-bs [09:28] *** Specular has quit IRC (Ping timeout: 370 seconds) [09:30] *** Specular has joined #archiveteam-bs [09:42] *** gui7 has joined #archiveteam-bs [09:59] godane: Thank you [10:00] I'd prefer the title of the item over the VHS Video Vault name [10:01] *** abc123 has joined #archiveteam-bs [10:01] *** gui7 has quit IRC (Read error: Connection reset by peer) [10:02] *** gui7 has joined #archiveteam-bs [10:02] *** abc123 has quit IRC (Read error: Connection reset by peer) [10:02] Yeah, I'd have preferred one item per video [10:03] Sorry we didn't coordinate [10:03] i normally dump youtube channels [10:03] i can ways just upload to FOS for you to do that then [10:04] *always [10:04] Well, yes. [10:04] I'd like you to do that, then. [10:04] Because I kind of want to split apart the uploads as they are. [10:05] just know they will be uploaded in year/month/day folders [10:05] That's fine [10:05] I can probably fix up the ones you uploaded, so don't upload those again [10:14] so every before 2014-09 is uploaded [10:14] i'm uploading videos from 2014-09 forward [10:17] *** Specular has quit IRC (Ping timeout: 370 seconds) [10:18] *** Specular has joined #archiveteam-bs [10:26] *** Specular has quit IRC (Read error: Operation timed out) [10:26] *** Specular has joined #archiveteam-bs [10:44] *** abc123 has joined #archiveteam-bs [10:48] *** gui7 has quit IRC (Ping timeout: 370 seconds) [10:50] *** Specular has quit IRC (Quit: Leaving) [10:53] *** dashcloud has quit IRC (Read error: Operation timed out) [10:58] *** dashcloud has joined #archiveteam-bs [11:06] *** gui7 has joined #archiveteam-bs [11:06] *** abc123 has quit IRC (Read error: Connection reset by peer) [11:06] *** gui7 has quit IRC (Client Quit) [11:12] *** Honno has joined #archiveteam-bs [11:22] *** brayden has joined #archiveteam-bs [11:22] *** swebb sets mode: +o brayden [11:24] *** GE has quit IRC (Quit: zzz) [11:33] *** brayden has quit IRC (Read error: Connection reset by peer) [11:33] *** brayden has joined #archiveteam-bs [11:33] *** swebb sets mode: +o brayden [12:28] *** BlueMaxim has quit IRC (Quit: Leaving) [13:10] *** GE has joined #archiveteam-bs [13:25] *** odemg has joined #archiveteam-bs [13:37] *** pizzaiolo has joined #archiveteam-bs [14:11] *** Honno_ has joined #archiveteam-bs [14:12] *** Honno has quit IRC (Ping timeout: 370 seconds) [14:53] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [15:26] *** RichardG has joined #archiveteam-bs [16:01] *** RichardG has quit IRC (Read error: Operation timed out) [16:01] *** RichardG has joined #archiveteam-bs [16:41] *** odemg has quit IRC (Remote host closed the connection) [17:02] *** Boppen has quit IRC (Ping timeout: 194 seconds) [17:23] *** Aranje has joined #archiveteam-bs [17:40] *** Boppen has joined #archiveteam-bs [17:53] *** odemg has joined #archiveteam-bs [17:53] *** odemg has quit IRC (Connection closed) [17:56] *** odemg has joined #archiveteam-bs [18:34] *** Aranje has quit IRC (Quit: Three sheets to the wind) [18:35] *** kristian_ has joined #archiveteam-bs [18:37] *** Aranje has joined #archiveteam-bs [19:22] Are we gonna do a warrior job for this url shortener? https://go.usa.gov/ [19:24] *** Aranje has quit IRC (Ping timeout: 260 seconds) [19:35] *** kristian_ has quit IRC (Quit: Leaving) [20:01] *** icedice has joined #archiveteam-bs [20:13] *** t2t2 has quit IRC (Ping timeout: 260 seconds) [20:15] hook54321: add it to the wiki if not already there [20:27] Not that anyone should slow down, but: http://talkingpointsmemo.com/livewire/trump-epa-climate-change-website [20:34] *** Stiletto has quit IRC () [20:53] *** kristian_ has joined #archiveteam-bs [21:11] *** GE has quit IRC (Remote host closed the connection) [21:20] *** kyounko has joined #archiveteam-bs [21:24] I am doing a grab of a newsgroup webviewer, grab-site is cycling through font size buttons, I add ^http?://example\.com*&FontSize=* to ignore and it still seems to be slipping through. Where am I going wrong with this regex? [21:34] *** GE has joined #archiveteam-bs [21:41] *** mundus201 has quit IRC (Read error: Operation timed out) [21:41] *** yeoldeto1 has quit IRC (Read error: Operation timed out) [21:41] *** chazchaz has quit IRC (Read error: Operation timed out) [21:41] *** yeoldetoa has joined #archiveteam-bs [21:42] *** mundus201 has joined #archiveteam-bs [21:42] *** chazchaz has joined #archiveteam-bs [21:43] *** espes__ has quit IRC (Ping timeout: 250 seconds) [21:58] * needs a . before it to match things [21:58] .* means "any number of anything" [21:58] "com*" means "com or commmmmmmmmmmm etc" [22:07] *** Ravenloft has joined #archiveteam-bs [22:11] or co [22:13] right [22:16] *** BlueMaxim has joined #archiveteam-bs [22:16] *** nickname_ has joined #archiveteam-bs [22:17] *** nickname_ has left [22:17] *** nickname_ has joined #archiveteam-bs [22:21] https://www.data.gov/climate/highlights [22:22] *** ndiddy has joined #archiveteam-bs [22:23] ftp://ftp.ncdc.noaa.gov/pub/data/hourly_precip-3240/ [22:39] *** odemg has quit IRC (Remote host closed the connection) [22:40] *** Aranje has joined #archiveteam-bs [22:44] *** odemg has joined #archiveteam-bs [23:20] *** GE has quit IRC (Quit: zzz) [23:21] *** odemg has quit IRC (Remote host closed the connection) [23:28] xmc, thanks. Switching between regex implementations fucks me up. [23:28] np [23:40] *** Honno_ has quit IRC (Ping timeout: 370 seconds) [23:42] *** nickname_ has quit IRC (Read error: Operation timed out) [23:49] *** Stil3tt0 has joined #archiveteam-bs [23:53] *** Stil3tt0 is now known as Stiletto [23:53] *** nickname_ has joined #archiveteam-bs [23:55] *** BlueMaxim has quit IRC (Read error: Operation timed out)