| Time |
Nickname |
Message |
|
00:01
🔗
|
|
odemg has joined #archiveteam-bs |
|
00:04
🔗
|
|
midas1 has joined #archiveteam-bs |
|
00:04
🔗
|
|
achip has joined #archiveteam-bs |
|
00:27
🔗
|
|
brayden has joined #archiveteam-bs |
|
00:28
🔗
|
|
swebb sets mode: +o brayden |
|
00:41
🔗
|
|
wp494_ is now known as wp494 |
|
00:48
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
01:13
🔗
|
|
Zachary has joined #archiveteam-bs |
|
01:19
🔗
|
|
fie has quit IRC (Ping timeout: 244 seconds) |
|
01:53
🔗
|
|
Stil3tt0 is now known as Stiletto |
|
02:00
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
02:11
🔗
|
|
pizzaiolo has left |
|
02:17
🔗
|
|
Zachary has quit IRC (Lost terminal) |
|
02:28
🔗
|
|
odemg has joined #archiveteam-bs |
|
02:41
🔗
|
|
username1 has joined #archiveteam-bs |
|
02:44
🔗
|
|
schbirid2 has quit IRC (Read error: Operation timed out) |
|
03:30
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
03:33
🔗
|
|
fie has joined #archiveteam-bs |
|
03:33
🔗
|
|
tychot has joined #archiveteam-bs |
|
03:50
🔗
|
SketchCow |
godane: I suspected that this guy didn't know we've kind of already done his job for him. |
|
03:50
🔗
|
SketchCow |
But I wanted you to walk it over and verify. |
|
03:51
🔗
|
|
beardicus has quit IRC (bye) |
|
03:55
🔗
|
|
VADemon has quit IRC (Read error: Operation timed out) |
|
03:58
🔗
|
godane |
i think we did most of it |
|
03:58
🔗
|
|
Specular has joined #archiveteam-bs |
|
03:58
🔗
|
godane |
i know rev3games encoded mp4s on revsion3.com was saved |
|
03:59
🔗
|
godane |
but i don't think everything from youtube channel was put as on there revsion3 site |
|
03:59
🔗
|
godane |
also there numbers missing from it |
|
04:07
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
04:08
🔗
|
|
Specular has joined #archiveteam-bs |
|
04:16
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
04:16
🔗
|
|
Specular has joined #archiveteam-bs |
|
04:24
🔗
|
|
Specular has quit IRC (Read error: Operation timed out) |
|
04:24
🔗
|
|
Specular has joined #archiveteam-bs |
|
04:27
🔗
|
|
Coderjoe has joined #archiveteam-bs |
|
04:33
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
04:35
🔗
|
|
Specular has joined #archiveteam-bs |
|
04:43
🔗
|
|
Specular has quit IRC (Read error: Operation timed out) |
|
04:43
🔗
|
|
Specular has joined #archiveteam-bs |
|
04:51
🔗
|
|
Specular has quit IRC (Read error: Operation timed out) |
|
04:51
🔗
|
|
Specular has joined #archiveteam-bs |
|
04:59
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
04:59
🔗
|
|
Specular has joined #archiveteam-bs |
|
05:00
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
|
05:03
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
05:06
🔗
|
|
Coderjoe has quit IRC (Quit: Changing server) |
|
05:06
🔗
|
|
Cojo-adhd has joined #archiveteam-bs |
|
05:07
🔗
|
|
Cojo-adhd is now known as Coderjoe |
|
05:19
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
05:28
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
|
05:28
🔗
|
|
balrog has quit IRC (Read error: Operation timed out) |
|
05:33
🔗
|
|
brayden has quit IRC (Read error: Operation timed out) |
|
05:34
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
05:35
🔗
|
|
balrog has joined #archiveteam-bs |
|
05:35
🔗
|
|
swebb sets mode: +o balrog |
|
05:45
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
05:46
🔗
|
tychot |
xmc: I'm new. I'll go read the etiquette blurb in more detail. |
|
05:47
🔗
|
xmc |
no worries, just: we're all in both channels, so filter heavily. your line about sampling was useful and ontopic and worth sharing |
|
05:48
🔗
|
tychot |
Indeed. And I've re-read the IRC wiki page, and I think I have a better sense of the topicality now. |
|
05:48
🔗
|
xmc |
kool |
|
05:49
🔗
|
xmc |
that channel is best kept quiet so that people can go afk for six hours and catch up in only a few minutes |
|
05:50
🔗
|
tychot |
Ah, makes sense. |
|
05:50
🔗
|
tychot |
How the noobs are treated says a lot about a channel. I appreciate the polite clarity. :) |
|
05:50
🔗
|
xmc |
that, depends on who's around to whip you all into shape |
|
05:51
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:51
🔗
|
|
dashcloud has quit IRC (Ping timeout: 633 seconds) |
|
05:53
🔗
|
tychot |
Boy, I hear that. I'm in #hashcat on freenode a lot and it's luck-of-the-draw. :) Glad I lucked out. |
|
05:53
🔗
|
tychot |
On the topic of me being useful ... |
|
05:53
🔗
|
tychot |
Alaskan bandwidth is semi-metered, so full-on downloads are probably not really where I can be high-leverage. |
|
05:54
🔗
|
tychot |
I can slice-and-dice DNS and IP stuff pretty well, when that's needed. |
|
05:54
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
05:54
🔗
|
tychot |
I could also help with docs. Though maybe right now isn't the best time for noobs do be jumping in. I won't be offended, if so. |
|
05:56
🔗
|
yipdw |
I like how hitting the copy button on scientific data is a rogue action now |
|
05:56
🔗
|
yipdw |
ENVIRONMENTAL PROTECTION AGENCY: ROGUE ONE |
|
05:56
🔗
|
yipdw |
actually that gives me an idea for archivebot's twitter avatar |
|
06:00
🔗
|
Asparagir |
Uh-oh. |
|
06:00
🔗
|
Frogging |
hah |
|
06:00
🔗
|
Asparagir |
No, not that. |
|
06:00
🔗
|
Asparagir |
I just randomly started googling NASA groups, including their Earth Sciences websites. |
|
06:00
🔗
|
Asparagir |
And... |
|
06:00
🔗
|
Asparagir |
This is one of their "where do I find data" portals |
|
06:00
🔗
|
Asparagir |
https://search.earthdata.nasa.gov/search |
|
06:00
🔗
|
Asparagir |
Top of page: |
|
06:00
🔗
|
Asparagir |
"NSIDC Scheduled Maintenance (Jan 25 2017 08:00 PST to Jan 25 2017 10:30 PST) AMSR-E, Aquarius, IceBridge,ICESat/GLAS, MODIS, NISE, and SMAP data will be unavailable for ordering from 9:00 AM - 11 PM Wednesday 25 Jan 2016 (U.S. Mountain Standard Time) due to system maintenance. We apologize for any inconvenience that this may cause. Please contact NSIDC User Services at nsidc@nsidc.org if you have any questions." |
|
06:01
🔗
|
Asparagir |
They're going to be down ALL DAY TOMORROW. |
|
06:01
🔗
|
Asparagir |
Maybe a coincidence, but... |
|
06:01
🔗
|
Asparagir |
AMSR-E, Aquarius, IceBridge,ICESat/GLAS, MODIS, NISE, and SMAP -- that's a lot of data to be down. |
|
06:01
🔗
|
xmc |
you should contact them with this very reasonable question |
|
06:02
🔗
|
Asparagir |
Oh, like they're at the office at 10:00 PM Pacific? |
|
06:02
🔗
|
xmc |
i wouldn't think so |
|
06:02
🔗
|
Frogging |
message is a little confusing. the part at the beginning says 11:00 EST to 13:30 EST |
|
06:02
🔗
|
Frogging |
which is only 2.5 hours, but then it says 9AM to 11PM |
|
06:02
🔗
|
xmc |
the first is PST, the second is MST |
|
06:03
🔗
|
xmc |
remember MST is not EST |
|
06:03
🔗
|
Frogging |
no I get that but is it 2.5 hours or 15 hours |
|
06:04
🔗
|
xmc |
i would bet 15 hours |
|
06:04
🔗
|
yipdw |
I wonder if anyone knows someone here who can shadowrun terabytes of data out |
|
06:05
🔗
|
yipdw |
that interface is unfortunately not too archivebottable |
|
06:05
🔗
|
Frogging |
yeah I was going to say this web app looks like a nightmare to archive |
|
06:05
🔗
|
yipdw |
you really can't, you need the dataset and the viewer app |
|
06:05
🔗
|
xmc |
i've worked with these kinds of datasets, usually you have to submit a request and then a tape robot goes and gets it and you get an email half an hour later |
|
06:05
🔗
|
xmc |
it's a titanic amount of data |
|
06:05
🔗
|
yipdw |
the viewer app maybe not so much because there's stuff like this already |
|
06:06
🔗
|
Asparagir |
I have been playing with the interface and I can't even figure out where to start to download. |
|
06:06
🔗
|
Asparagir |
I think it's the kind of thing that would have to be FOIA'ed |
|
06:06
🔗
|
yipdw |
oh you need login anywa |
|
06:06
🔗
|
xmc |
yes |
|
06:06
🔗
|
yipdw |
so, each entry you get in the left pane is a single granule in the map |
|
06:06
🔗
|
yipdw |
so |
|
06:06
🔗
|
yipdw |
yeah |
|
06:07
🔗
|
yipdw |
gotta get the dataset out some other way |
|
06:07
🔗
|
yipdw |
or I guess bang the download button a lot |
|
06:07
🔗
|
yipdw |
the "Retrieve Collection Data" button might download everything |
|
06:08
🔗
|
xmc |
no, yipdw, this is a website that's backed by at least one tape library |
|
06:08
🔗
|
yipdw |
yeah |
|
06:08
🔗
|
Coderjoe |
I ran into an interface like that when I was grabbing old aerial photos from USGS a number of years ago |
|
06:08
🔗
|
yipdw |
I guess those rogue scientists have this one covered |
|
06:09
🔗
|
yipdw |
many climatologists died to bring us this information |
|
06:09
🔗
|
Coderjoe |
MAID has got to be less expensive than a tape robot and tons of tapes these days, right? |
|
06:10
🔗
|
tychot |
Side question, maybe more actionable in the short term: I saw that Health and Human Services comms is also endangered? |
|
06:10
🔗
|
tychot |
Looks pretty harvestable: https://www.healthdata.gov/search/type/dataset |
|
06:10
🔗
|
xmc |
tape libraries are capex that lasts decades, you can upgrade the tapes and drives without changing the robot one bit |
|
06:10
🔗
|
Coderjoe |
what about NIH pubmed? |
|
06:11
🔗
|
Coderjoe |
is that in peril? |
|
06:11
🔗
|
tychot |
Hmm, maybe. Don't they distribute that quarterly on DVD to libraries? |
|
06:11
🔗
|
tychot |
.edu, that is |
|
06:13
🔗
|
tychot |
https://www.nlm.nih.gov/NIHbmic/nih_data_sharing_repositories.html |
|
06:15
🔗
|
tychot |
man, the data storage/retrieval for those is all over the map - it'd need to be inventoried |
|
06:16
🔗
|
tychot |
and a bunch of it would be tape-grade (yay, genomes!) |
|
06:18
🔗
|
tychot |
hmm ... https://www.ncbi.nlm.nih.gov/guide/howto/dwn-records/ |
|
06:18
🔗
|
|
Aranje has quit IRC (Quit: Three sheets to the wind) |
|
06:18
🔗
|
|
gui7 has joined #archiveteam-bs |
|
06:20
🔗
|
|
gui7 has quit IRC (Client Quit) |
|
06:27
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
06:28
🔗
|
|
Specular has joined #archiveteam-bs |
|
06:38
🔗
|
|
Honno has joined #archiveteam-bs |
|
06:42
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
06:53
🔗
|
Coderjoe |
hmm |
|
06:53
🔗
|
Coderjoe |
"Teen Vogue has been dropping articles that eviscerate Trump. They did a piece on Gaslighting." |
|
06:54
🔗
|
Coderjoe |
er |
|
06:54
🔗
|
Coderjoe |
I suspect "drop" means release in this sentence, now that I re-read it a few times. |
|
06:58
🔗
|
Frogging |
yeah that sounds right |
|
07:01
🔗
|
Frogging |
why are tape drives so bloody expensive? |
|
07:01
🔗
|
Frogging |
are they super complex? |
|
07:07
🔗
|
vantec |
Supply / Demand + R&D costs |
|
07:13
🔗
|
yipdw |
NOAA has been deleting data crucial to accurate counts of fishery stock |
|
07:13
🔗
|
yipdw |
you could say they dropped the bass |
|
07:14
🔗
|
Frogging |
-_- |
|
07:16
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
07:20
🔗
|
SketchCow |
I'm doing a deletion of ROMs so boring my brain may leave my body |
|
07:21
🔗
|
yipdw |
make sure your memories are marked read-only to protect them from the ethereal thieves |
|
07:23
🔗
|
SketchCow |
The entertainment software companies have stepped up the games |
|
07:23
🔗
|
SketchCow |
requesting removal of games inside my ZIPs |
|
07:23
🔗
|
Frogging |
rude |
|
07:30
🔗
|
Frogging |
IA is low hanging fruit for that sort of thing I guess |
|
08:03
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
08:04
🔗
|
godane |
i'm slowly starting to upload VHS Video Vault youtube channel |
|
08:29
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
08:51
🔗
|
|
Honno has quit IRC (Ping timeout: 370 seconds) |
|
09:01
🔗
|
|
GE has joined #archiveteam-bs |
|
09:11
🔗
|
|
Specular has joined #archiveteam-bs |
|
09:20
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
09:21
🔗
|
|
Specular has joined #archiveteam-bs |
|
09:28
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
09:30
🔗
|
|
Specular has joined #archiveteam-bs |
|
09:42
🔗
|
|
gui7 has joined #archiveteam-bs |
|
09:59
🔗
|
SketchCow |
godane: Thank you |
|
10:00
🔗
|
SketchCow |
I'd prefer the title of the item over the VHS Video Vault name |
|
10:01
🔗
|
|
abc123 has joined #archiveteam-bs |
|
10:01
🔗
|
|
gui7 has quit IRC (Read error: Connection reset by peer) |
|
10:02
🔗
|
|
gui7 has joined #archiveteam-bs |
|
10:02
🔗
|
|
abc123 has quit IRC (Read error: Connection reset by peer) |
|
10:02
🔗
|
SketchCow |
Yeah, I'd have preferred one item per video |
|
10:03
🔗
|
SketchCow |
Sorry we didn't coordinate |
|
10:03
🔗
|
godane |
i normally dump youtube channels |
|
10:03
🔗
|
godane |
i can ways just upload to FOS for you to do that then |
|
10:04
🔗
|
godane |
*always |
|
10:04
🔗
|
SketchCow |
Well, yes. |
|
10:04
🔗
|
SketchCow |
I'd like you to do that, then. |
|
10:04
🔗
|
SketchCow |
Because I kind of want to split apart the uploads as they are. |
|
10:05
🔗
|
godane |
just know they will be uploaded in year/month/day folders |
|
10:05
🔗
|
SketchCow |
That's fine |
|
10:05
🔗
|
SketchCow |
I can probably fix up the ones you uploaded, so don't upload those again |
|
10:14
🔗
|
godane |
so every before 2014-09 is uploaded |
|
10:14
🔗
|
godane |
i'm uploading videos from 2014-09 forward |
|
10:17
🔗
|
|
Specular has quit IRC (Ping timeout: 370 seconds) |
|
10:18
🔗
|
|
Specular has joined #archiveteam-bs |
|
10:26
🔗
|
|
Specular has quit IRC (Read error: Operation timed out) |
|
10:26
🔗
|
|
Specular has joined #archiveteam-bs |
|
10:44
🔗
|
|
abc123 has joined #archiveteam-bs |
|
10:48
🔗
|
|
gui7 has quit IRC (Ping timeout: 370 seconds) |
|
10:50
🔗
|
|
Specular has quit IRC (Quit: Leaving) |
|
10:53
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
|
10:58
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
11:06
🔗
|
|
gui7 has joined #archiveteam-bs |
|
11:06
🔗
|
|
abc123 has quit IRC (Read error: Connection reset by peer) |
|
11:06
🔗
|
|
gui7 has quit IRC (Client Quit) |
|
11:12
🔗
|
|
Honno has joined #archiveteam-bs |
|
11:22
🔗
|
|
brayden has joined #archiveteam-bs |
|
11:22
🔗
|
|
swebb sets mode: +o brayden |
|
11:24
🔗
|
|
GE has quit IRC (Quit: zzz) |
|
11:33
🔗
|
|
brayden has quit IRC (Read error: Connection reset by peer) |
|
11:33
🔗
|
|
brayden has joined #archiveteam-bs |
|
11:33
🔗
|
|
swebb sets mode: +o brayden |
|
12:28
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
13:10
🔗
|
|
GE has joined #archiveteam-bs |
|
13:25
🔗
|
|
odemg has joined #archiveteam-bs |
|
13:37
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
14:11
🔗
|
|
Honno_ has joined #archiveteam-bs |
|
14:12
🔗
|
|
Honno has quit IRC (Ping timeout: 370 seconds) |
|
14:53
🔗
|
|
RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) |
|
15:26
🔗
|
|
RichardG has joined #archiveteam-bs |
|
16:01
🔗
|
|
RichardG has quit IRC (Read error: Operation timed out) |
|
16:01
🔗
|
|
RichardG has joined #archiveteam-bs |
|
16:41
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
17:02
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
17:23
🔗
|
|
Aranje has joined #archiveteam-bs |
|
17:40
🔗
|
|
Boppen has joined #archiveteam-bs |
|
17:53
🔗
|
|
odemg has joined #archiveteam-bs |
|
17:53
🔗
|
|
odemg has quit IRC (Connection closed) |
|
17:56
🔗
|
|
odemg has joined #archiveteam-bs |
|
18:34
🔗
|
|
Aranje has quit IRC (Quit: Three sheets to the wind) |
|
18:35
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
18:37
🔗
|
|
Aranje has joined #archiveteam-bs |
|
19:22
🔗
|
hook54321 |
Are we gonna do a warrior job for this url shortener? https://go.usa.gov/ |
|
19:24
🔗
|
|
Aranje has quit IRC (Ping timeout: 260 seconds) |
|
19:35
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
20:01
🔗
|
|
icedice has joined #archiveteam-bs |
|
20:13
🔗
|
|
t2t2 has quit IRC (Ping timeout: 260 seconds) |
|
20:15
🔗
|
pizzaiolo |
hook54321: add it to the wiki if not already there |
|
20:27
🔗
|
tychot |
Not that anyone should slow down, but: http://talkingpointsmemo.com/livewire/trump-epa-climate-change-website |
|
20:34
🔗
|
|
Stiletto has quit IRC () |
|
20:53
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
21:11
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
21:20
🔗
|
|
kyounko has joined #archiveteam-bs |
|
21:24
🔗
|
rocode |
I am doing a grab of a newsgroup webviewer, grab-site is cycling through font size buttons, I add ^http?://example\.com*&FontSize=* to ignore and it still seems to be slipping through. Where am I going wrong with this regex? |
|
21:34
🔗
|
|
GE has joined #archiveteam-bs |
|
21:41
🔗
|
|
mundus201 has quit IRC (Read error: Operation timed out) |
|
21:41
🔗
|
|
yeoldeto1 has quit IRC (Read error: Operation timed out) |
|
21:41
🔗
|
|
chazchaz has quit IRC (Read error: Operation timed out) |
|
21:41
🔗
|
|
yeoldetoa has joined #archiveteam-bs |
|
21:42
🔗
|
|
mundus201 has joined #archiveteam-bs |
|
21:42
🔗
|
|
chazchaz has joined #archiveteam-bs |
|
21:43
🔗
|
|
espes__ has quit IRC (Ping timeout: 250 seconds) |
|
21:58
🔗
|
xmc |
* needs a . before it to match things |
|
21:58
🔗
|
xmc |
.* means "any number of anything" |
|
21:58
🔗
|
xmc |
"com*" means "com or commmmmmmmmmmm etc" |
|
22:07
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
22:11
🔗
|
Frogging |
or co |
|
22:13
🔗
|
xmc |
right |
|
22:16
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
22:16
🔗
|
|
nickname_ has joined #archiveteam-bs |
|
22:17
🔗
|
|
nickname_ has left |
|
22:17
🔗
|
|
nickname_ has joined #archiveteam-bs |
|
22:21
🔗
|
nickname_ |
https://www.data.gov/climate/highlights |
|
22:22
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
22:23
🔗
|
nickname_ |
ftp://ftp.ncdc.noaa.gov/pub/data/hourly_precip-3240/ |
|
22:39
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
22:40
🔗
|
|
Aranje has joined #archiveteam-bs |
|
22:44
🔗
|
|
odemg has joined #archiveteam-bs |
|
23:20
🔗
|
|
GE has quit IRC (Quit: zzz) |
|
23:21
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
23:28
🔗
|
rocode |
xmc, thanks. Switching between regex implementations fucks me up. |
|
23:28
🔗
|
xmc |
np |
|
23:40
🔗
|
|
Honno_ has quit IRC (Ping timeout: 370 seconds) |
|
23:42
🔗
|
|
nickname_ has quit IRC (Read error: Operation timed out) |
|
23:49
🔗
|
|
Stil3tt0 has joined #archiveteam-bs |
|
23:53
🔗
|
|
Stil3tt0 is now known as Stiletto |
|
23:53
🔗
|
|
nickname_ has joined #archiveteam-bs |
|
23:55
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |