[00:05] *** zenguy_pc has joined #archiveteam-bs [00:20] *** phuzion has quit IRC (Read error: Operation timed out) [00:36] DFJustin: ooh, neat [00:50] *** cvb has quit IRC (Ping timeout: 255 seconds) [01:50] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [01:51] *** BlueMaxim has joined #archiveteam-bs [01:52] *** zenguy_pc has quit IRC (Read error: Operation timed out) [01:56] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [02:01] *** schbirid2 has joined #archiveteam-bs [02:02] *** BlueMaxim has joined #archiveteam-bs [02:03] *** schbirid has quit IRC (Read error: Operation timed out) [02:05] *** zenguy_pc has joined #archiveteam-bs [02:05] *** primus105 has quit IRC (Leaving.) [02:11] *** phuzion has joined #archiveteam-bs [02:23] WAIT [02:23] OK, whew, DFJustin just highlighted synergy [02:23] that's how I do it [02:59] *** username1 has joined #archiveteam-bs [03:01] *** schbirid2 has quit IRC (Read error: Operation timed out) [03:29] *** bwn__ has quit IRC (Ping timeout: 252 seconds) [03:51] *** zenguy_pc has quit IRC (Read error: Operation timed out) [04:02] *** chazchaz has quit IRC (ny.us.hub irc.umich.edu) [04:02] *** jspiros has quit IRC (ny.us.hub irc.umich.edu) [04:09] *** atlogbot has quit IRC (Read error: Operation timed out) [04:15] *** chazchaz has joined #archiveteam-bs [04:15] *** jspiros has joined #archiveteam-bs [04:16] *** BlueMaxim has quit IRC (Read error: Operation timed out) [04:16] *** atlogbot has joined #archiveteam-bs [04:17] *** BlueMaxim has joined #archiveteam-bs [04:17] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [04:23] *** BlueMaxim has joined #archiveteam-bs [04:24] yipdw: can you echo it | nc -u 255.255.255.255 [04:24] or even yes it [04:27] *** chazchaz has quit IRC (ny.us.hub irc.umich.edu) [04:27] *** jspiros has quit IRC (ny.us.hub irc.umich.edu) [04:30] *** RedType has quit IRC (Read error: Operation timed out) [04:41] *** RedType has joined #archiveteam-bs [05:01] *** rentrin has joined #archiveteam-bs [05:04] *** aaaaaaaaa has quit IRC (Leaving) [05:08] Your html brings tears to my eyes SketchCow :/ no char encoding, parse mode, doctype [05:08] http://textfiles.com/jason/ [05:08] What are closing

tags :/ [05:10] *** rentrin has quit IRC (Read error: Connection reset by peer) [05:10] thanks for that interlude [05:10] *** rentrin has joined #archiveteam-bs [05:11] rentrin: In case you weren't aware, Google' [05:11] Google's homepage is pretty bad with HTML, if I'm not mistkane. [05:11] mistaken* [05:13] ps, it's 2015, as long as it works, if someone doesn't define the doctype, who cares? [05:15] *** rentrin has quit IRC (Read error: Operation timed out) [05:18] *** aposson has joined #archiveteam-bs [05:18] I guess pointing out the html illiteracy of our overlord SketchCrow is against policy. Sorry for interrupting, may the circle jerk continue~ [05:18] peace. [05:18] *** aposson has quit IRC (Client Quit) [05:18] *** chazchaz has joined #archiveteam-bs [05:18] *** jspiros has joined #archiveteam-bs [05:25] caw caw [05:26] *** Smiley has joined #archiveteam-bs [05:27] *** SmileyG has quit IRC (Read error: Operation timed out) [05:28] *** Barry has quit IRC (Read error: Operation timed out) [05:28] *** Barry has joined #archiveteam-bs [05:29] *** lytv has quit IRC (Read error: Operation timed out) [05:31] *** RedType_ has joined #archiveteam-bs [05:31] *** rduser has quit IRC (Ping timeout: 499 seconds) [05:31] *** rduser has joined #archiveteam-bs [05:33] *** RedType has quit IRC (Ping timeout: 499 seconds) [05:39] phuzion: Google's compression != bad [05:40] what is this discussion about? [05:41] are you really whining about some guy's home page's markup? [05:44] https://xkcd.com/386/ I guess [05:45] I think what confused me the most was the random changing their name between bouts of ... whatever that was. [05:46] Jordan_: er, what? who brought up Google's compression? [05:46] and compression of what? Their HTML? [05:46] >22:11 Google's homepage is pretty bad with HTML, if I'm not mistkane. [05:47] right, that was about the (presumably standards compliance) of Google's homepage. What does that have to do with how compressed (or not) it is? [05:48] Because Google doesn't have any issue with standard compliance?... lol. [05:48] what? Who did you think claimed that? [05:49] JesseW: Basically, I was pointing out that pages may not be standards compliant, but they still work nowadays because browsers are pretty friggin crafty and it's often not necessary to have a page that's 100% standards compliant [05:50] because rentrin was ragging on jason's homepage for really stupid shit (omg the html isn't compliant!!!) [05:50] yeah, that was what I thought you meant. I'm just confused how Jordan_ went from there to talking about compression, or people claiming that "Google doesn't have any issue with standard compliance". [05:51] Blender Bottles are awesome [05:52] tbh i've never really seen the point [05:52] ice cubes do just as well and they're more ecologically friendly [05:52] they do make more noise though, disturbing the people across the table [05:52] I haven't tried ice cubes before [05:52] maybe I should [05:52] oh yeah it's a whole new ballgame [05:53] When people look at Google's source and think "holy fuck, mah readability", it's due to compression [05:53] also you don't have that problem with the blender ball thingy getting stuck in your teeth [05:53] As it follows correct standards, that's all I could assuming phuzion was talking about [05:53] I've never had that problem; the top usually keeps it in [05:53] hm [05:53] Jordan_: google's homepage actually errors a lot on w3c validator. [05:53] well i eat from a wide mouth nalgene [05:53] Jordan_: ah, ok, I think I understand what you meant now. [05:53] eat from? [05:53] all my meals [05:54] Nothing game-breaking though, phuzion [05:55] Right, but neither are the "problems" on jason's homepage. I was pointing out that, look, yes, there are imperfections in the HTML on jason's page, but guess what, even Google has similar html errors. Not a big deal, since browsers work around it. [05:56] anyway, yipdw, crushed ice or tiny ice cubes work really well [05:56] big cubes don't mix it enough [05:56] I'll give it a shot [05:56] but if you put too much ice in then the shake becomes a sludge because of the cold [05:57] that's fine, the bottle usually warms up pretty fast [05:57] IME [05:57] i usually have 400mL powder, 150mL ice, 600mL water [05:57] yeah [05:57] the ice just makes it cool, especially if you use unchilled tapwater [05:57] Sure, but there's a big difference between the two. There's value in html validation, but yeah I know where you're coming from phuzion. [05:57] what? [05:57] we're talking about food [05:57] "food" [05:58] more like hacking fuel i guess [05:58] hey smoothies are food in some sense [05:58] yeah, they're food more than water is food at least [05:59] so what do you put in your blender bottle? [06:00] it's usually that Vega protein powder stuff [06:00] I'm basically the Whole Foods customer archetype, with all that negatively implies [06:01] hahaha [06:01] fair enough [06:13] *** remsen has quit IRC (Read error: Connection reset by peer) [06:18] *** primus104 has joined #archiveteam-bs [06:26] *** vitzli has joined #archiveteam-bs [06:33] *** primus104 has quit IRC (Leaving.) [06:35] *** atlogbot has quit IRC (Ping timeout: 369 seconds) [06:40] *** BlueMaxim has quit IRC (Read error: Operation timed out) [06:40] *** BlueMaxim has joined #archiveteam-bs [06:40] *** atlogbot has joined #archiveteam-bs [06:41] *** bwn has joined #archiveteam-bs [06:41] *** Rye has quit IRC (hub.se irc.underworld.no) [06:51] *** Smiley has quit IRC (Read error: Operation timed out) [06:54] NERDS gonna nerd [06:54] I come back here from, you know, getting shit done [06:54] and someone I've never heard of is telling me about DOCTYPE [06:54] which my system predates [06:54] as it probably predates him [06:55] So also: Guy on twitter telling me if I don't use ZFS for my storage of these floppies, it's "no better than the original medium" [06:55] If I'm going to jail for murder, it obviously has to be serial murder [06:55] I mean, really go the val-u-pak [06:55] Making a list, checking it twice, etc [06:57] Oh, I see he left. [06:57] Another nerd tourist [06:57] Another aspie looky-loo [07:03] well, he came back ... under a different name ... a few minutes later. For whatever bizarre reason. [07:03] and didn't seem to notice he'd changed names... [07:04] speaking of getting things done -- I've been using my newfound powers for good over in #urlteam (hopefully) [07:05] We can hope [07:05] I like action. [07:05] I don't like pointing and "you missed a spot" [07:05] ACTION! [07:05] CAMERAS! [07:05] AIM! [07:05] (or is it supposed to go in a different order...) [07:06] (well, ask the documentarian... :-) ) [07:06] I work very hard and nerds explaining to me the "right" way to do things is not appreciated. [07:06] And then, I idly take the laser-like focus I apply to things and I want to make someone cry [07:10] *** remsen has joined #archiveteam-bs [07:12] right way = doing it at all IMO [07:13] thank you, SketchCow [07:14] for the linux_distributions collection [07:15] http://archive.org/details/linux_distributions [07:16] Easily done [07:16] When you give me a collection of item names, I can do a thing against them [07:19] I noticed (like I do) that one was marked by the uploader as "delete". I'll send that to info@, unless you want to do it... [07:19] *** cvb has joined #archiveteam-bs [07:19] https://archive.org/details/Puppy_Linux_LighthousePup-412_pets_sfs_173 [07:20] *** vitzli has quit IRC (Quit: Leaving) [07:21] SketchCow: is giving you a search query (maybe including a list of items *not* to include) equally good, or is it better to have them expanded? [07:42] *** Rye has joined #archiveteam-bs [08:13] *** Fletcher has joined #archiveteam-bs [08:13] *** diacope has joined #archiveteam-bs [08:13] *** JesseW has quit IRC (Leaving.) [08:15] *** Smiley has joined #archiveteam-bs [08:40] *** primus104 has joined #archiveteam-bs [08:41] *** bwn_ has joined #archiveteam-bs [08:45] *** bwn has quit IRC (Read error: Operation timed out) [09:05] *** remsen has quit IRC (Read error: Connection reset by peer) [09:07] Thumbnails in the wiki seem to be broken for large images: http://archiveteam.org/index.php?title=File:Code.google.com_shutdown_screencapture.png [09:25] *** bwn_ is now known as bwn [09:26] *** brayden has joined #archiveteam-bs [10:13] *** cvb has quit IRC (Quit: Leaving) [10:37] *** cvb has joined #archiveteam-bs [11:02] *** VADemon has joined #archiveteam-bs [11:06] *** arkiver2 has joined #archiveteam-bs [11:43] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [11:52] *** primus104 has quit IRC (Leaving.) [11:54] *** zenguy_pc has joined #archiveteam-bs [12:10] *** vitzli has joined #archiveteam-bs [12:36] *** bwn has quit IRC (Read error: Operation timed out) [12:39] *** remsen has joined #archiveteam-bs [12:49] *** chazchaz has quit IRC (Ping timeout: 186 seconds) [12:50] *** chazchaz has joined #archiveteam-bs [13:16] *** bwn has joined #archiveteam-bs [13:44] *** BlueMaxim has quit IRC (Quit: Leaving) [13:56] *** dashcloud has quit IRC (Read error: Operation timed out) [13:59] *** dashcloud has joined #archiveteam-bs [14:42] *** VADemon has quit IRC (left4dead) [15:06] *** primus104 has joined #archiveteam-bs [15:29] *** primus104 has quit IRC (Leaving.) [15:39] *** zenguy_pc has quit IRC (Ping timeout: 252 seconds) [17:00] *** JesseW has joined #archiveteam-bs [17:22] *** JesseW has quit IRC (Leaving.) [17:41] *** vitzli has quit IRC (Quit: Leaving) [17:43] *** jspiros has quit IRC (hub.efnet.us irc.umich.edu) [17:58] *** primus104 has joined #archiveteam-bs [18:13] *** jspiros has joined #archiveteam-bs [18:16] *** jspiros has quit IRC (hub.efnet.us irc.umich.edu) [18:17] *** Start has quit IRC (Read error: Connection reset by peer) [18:18] *** Start has joined #archiveteam-bs [18:22] *** lytv has joined #archiveteam-bs [18:23] *** remsen has quit IRC (Read error: Operation timed out) [19:56] *** aaaaaaaaa has joined #archiveteam-bs [20:08] *** username1 has quit IRC (Quit: Leaving) [20:15] *** bwn has quit IRC (Read error: Operation timed out) [20:23] *** JW_work has joined #archiveteam-bs [20:24] SketchCow: I see my email about sorting items in magazine_rack was in a useful form. BTW, please attribute https://archive.org/details/the_agitator&tab=about to https://www.marxists.org/history/usa/pubs/agitator/index.htm . :-) [20:25] And https://archive.org/details/labor_age&tab=about to https://www.marxists.org/history/usa/pubs/laborage/index.htm . I'll try to provide descriptions along with my lists of items in future emails. [20:26] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [20:32] *** superkuh has quit IRC (Read error: Connection reset by peer) [20:32] I credited both to marxists.org. Sufficient. [20:33] as you like. I thought it useful to link directly, so people can find where it was previously published (and where they can find more). [20:34] Six people care about this [20:34] six? more than I thought it was. :-) [20:34] About six [20:34] heh. [20:34] in any case, thanks for making the collections [20:38] *** superkuh has joined #archiveteam-bs [20:40] *** godane has quit IRC (Ping timeout: 310 seconds) [20:45] *** bwn has joined #archiveteam-bs [20:45] *** SmileyG has joined #archiveteam-bs [20:48] *** vtyl has joined #archiveteam-bs [20:52] *** lytv has quit IRC (hub.se efnet.port80.se) [20:52] *** Smiley has quit IRC (hub.se efnet.port80.se) [20:52] *** Fletcher has quit IRC (hub.se efnet.port80.se) [20:52] *** diacope has quit IRC (hub.se efnet.port80.se) [20:58] *** godane has joined #archiveteam-bs [21:01] *** Fletcher_ has joined #archiveteam-bs [21:17] *** pgoetz has joined #archiveteam-bs [21:19] pgoetz: we try to keep #archiveteam quiet so that important information doesn't get buried [21:21] pgoetz: Was I reading correctly that you have approximately 12TB of data to offline-archive? [21:23] phuzion: yes, this is correct; with data piling up as we speak. I'm working with a national archive to try and come up with some strategy. We've been backing up to 1TB SSD's, but I read an article that these can be highly unstable when unplugged under certain conditions. [21:23] xmc: I totallly understand [21:23] Yeah, SSDs start losing bits pretty quickly IIRC. [21:23] Have you guys evaluated LTO tape as an option? [21:23] #archiveteam-bs pls [21:24] oops [21:24] Probably much cheaper than the optical solution you were linking in the other channel, and readers will be much more available for the forseeable future. [21:24] already there [21:24] i'd go for bluray, LG has 125GB disks [21:25] phuzion: we used tape before, and might consider it. I'm just a bit leary, because the tape drive technology keeps changing, and the hardward isn't as robust as one would like. [21:25] hardward --> hardware [21:26] How robust do you need of hardware? You're probably talking about maintaining a library of 50 tapes or less, even your entry level LTO drive should handle 50 tapes a month. [21:26] phuzion: regarding SSD, it's not clear. As soon as the swath of articles came out claiming that you can experience data loss in as little as 30 minutes, this was immediately debunked as coming from an industry-internal tech document that was never meant for public consumption and was highly misleading. [21:27] bluray lth vs htl: some people in here are familiar with the difference, but if you're not, you should look it up [21:27] basically, lth is the dye based tech that existing cdr/dvdrs use, with the same oxidation/degredation issues [21:27] phuzion: I'm more worried about long term offline storage. The benchmark I'm using is 10 years. [21:28] pgoetz: 10 years in what kind of environment, what kind of institutional support do you have [21:28] and what kind of budget [21:28] When I brought up the issue of using tape again, the users were fairly opposed to this option due to various issues we had previously (mostly driver stuff) [21:29] pgoetz: you said you're working for a national archive of some sorts? [21:29] pgoetz works for a cut-rate spy agency, they want to be the nsa but don't have the budget [21:29] $20K? Yes. The Archives of the Episcopal Church [21:29] oh [21:30] They typically aren't swimming in cash, but are accumulating quite a bit of data. [21:31] No thoughts on this product? https://pro.sony.com/bbsc/ssr/mkt-nab2015/mkt-nab2015mediaworkflow/product-ODSD77U/ [21:31] *** zenguy_pc has joined #archiveteam-bs [21:31] I was pretty thrilled when I found it. You can backup about 1.5TB on each cartridge, and the cartridges are dirt cheap. [21:31] it sounds really expensive [21:31] My thoughts on that product are that Sony has no obligation to make replacements for that device in 10 years, whereas LTO has a big enough marketshare that there absolutely should be LTO drives available that can read an LTO6 tape in 10-20 years. [21:32] phuzion: this is a good point. [21:32] *** Fletcher_ is now known as fletcher [21:32] you should budget to check and recopy all your data every few years (3 or 5 max) [21:32] *** fletcher is now known as Fletcher [21:33] The Sony drive was until recently available on amazon for about $5K. I think the strategy would be to buy an extra drive. Also, Sony has desigend these for archival storage and guarantees the medium for something like 40 years. [21:33] do you trust sony for continuity? they have new connectors on every product they release [21:33] RedType_: I think this addresses the question of whether or not this would be using archival quality optical disks. [21:34] Also, the media is only manufactured by one company. If Sony decides it's not profitable, that product could hit the cutting room floor tomorrow. [21:34] xmc: No, I don't trust any hardware manufacturer, frankly. We would buy an extra drive to hold in reserve. USB 3.0 will probably be supported fora long time. [21:34] maybe :) [21:35] phuzion: another good point, although I think there are other people (Phillips?) getting into the cartridge manufacturing business. [21:36] It's a typical self-fulfilling prophecy: if enough people buy the drives, it will probably be supported for a long time. Seems like there hasn't been much interest, though. [21:36] "if enough people buy the drives, it will probably be supported for a long time." Are you willing to gamble on that though? [21:37] they already said no [21:37] pgoetz: Well, it's definitely better than the current strategy of doing offsite backups to external SSD's. [21:38] I haven't bought a tape library in a while, and have mostly been implementing the google strategy of just having each piece of data available on several machines [21:38] However all the servers are currently at one location; hence the need for offsite. [21:39] Using something like Glacier would be an option, but relying on Glacier would likely violate their charter. [21:39] xmc: The current data refresh is every 6 months. [21:40] pgoetz: cost to store 12TB on glacier for 10 years is about $10K [21:40] point of order, $10,000 over ten years gets you $100 a month [21:40] I still don't understand how they can make money doing this; this seems unbelievably cheap. [21:41] Any recommendations for a very reliable LTO library system? [21:41] pgoetz: it screams selling an internal solution to me [21:42] they needed glacier, they built it with extra capacity, and now they're selling it. The already had all of the billing/data transfer infrastructure in place. [21:42] RedType_: Literally how AWS started in the first place. [21:43] "We need a technology. Let's build it. Oh, we built it and it works really well. Let's build more of it and sell it to people." [21:43] RedType_: this sounds about right. I have a friend who works at Google and he claims that the win for providing cloud storage is they end up buying more hardware and can consequently leverage the margins a bit better. [21:44] I.e. they don't actually make money on the people buying the service, just end up saving on hardware costs for their own use. [21:44] the math of business models at that scale is always mind boggling [21:45] one of the better explanations of glacier I've seen (I think facebook did something similar) is a bunch of storage arrays that are brought offline when they are full and brought back up once every few months just to verify the bits and check drives, that may be an option worth looking at [21:46] achip: Yeah, I saw a video on how facebook does its archival storage, pretty cool. [21:46] achip: Or they just dump everything to massive tape libraries, and pull it into fast storage when the customer is trying to access it. [21:47] i believe glacier is robot based as well [21:47] so aside from someone picking up the storage pod from the fedex truck, plugging it in, and cleaning it with a damp cloth when it's done, it's all robots [21:49] BTW, I think the typical Archives strategy for stuff like old tapes (does anyone remember 12" optical disks) etc. is to always purchase at least 2 hardware readers and keep one in a box unused after testing. [21:50] What's the discussion [21:50] sdlfkjsdlkfjsdf [21:51] The discussion is how best to back up several TB of data and store it offline for lengthy periods of time with a reasonable expectation that there won't be any loss of data integrity. [21:53] HDD and SSD are too unstable when unplugged for more than 6 months; tape seems to be pretty good, although not nearly as good as archival-grade optical disks. [21:54] midas: yeah, the (soon 200GB) blu-ray disks might be the middle path. For 12TB, this amounts to about 60 disks, which is just within the realm of managable. (Most of this data is stuff like images which are not very compressible) [22:00] LTO-6 lets you backup 3TB (uncompressed) per tape, which is pretty good. I still have some concerns about the longer term stability of the tapes, but I guess you just keep refreshing the tape at least once a year and keep 3 sets in rotation. [22:02] pgoetz: last i cared to look it up, tape has very good long-term durability if it's not stored in stupid conditions [22:03] (source: a thing i read a few years ago that i can't remember but seemed well-reasoned, so don't take me too seriously) [22:03] http://searchdatabackup.techtarget.com/tip/How-to-estimate-the-lifespan-of-LTO-tapes [22:05] This is what worries me. From that article: There is also the matter of obsolescence. The LTO specification, introduced in 1999, calls for an LTO drive to be able to read tapes two generations back. Thus, the current LTO-3 drives will read LTO-1 tapes, but the new LTO-4 won't read anything earlier than LTO-2. [22:07] ah, yeah [22:08] The other thing is we manage several tape libraries at my day job and they're always screwing up: tapes get stuck, ripped up, etc.. [22:25] *** anomie has quit IRC (Read error: Connection reset by peer) [22:36] *** anomie has joined #archiveteam-bs [22:36] *** JW_work has quit IRC (Read error: Connection reset by peer) [22:47] *** chazchaz has quit IRC (Read error: Operation timed out) [22:48] *** atlogbot has quit IRC (Read error: Operation timed out) [22:48] *** cvb has quit IRC (Ping timeout: 369 seconds) [22:49] *** cvb has joined #archiveteam-bs [22:49] *** atlogbot has joined #archiveteam-bs [22:54] *** chazchaz has joined #archiveteam-bs [23:11] *** aaaaaaaaa has joined #archiveteam-bs [23:13] on the AWS point mentioned earlier: http://www.businessinsider.com/why-amazon-is-so-hard-to-topple-in-the-cloud-and-where-everybody-else-falls-2015-10 [23:18] *** bwn has quit IRC (Read error: Operation timed out) [23:28] *** aaaaaaaa_ has joined #archiveteam-bs [23:28] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [23:29] *** aaaaaaaa_ is now known as aaaaaaaaa [23:33] SketchCow: if i can find a way to get past the rate limit i can do kpfa [23:33] does anyone know how to do that? [23:35] *** wednesda- has quit IRC (Ping timeout: 360 seconds) [23:45] *** cvb has quit IRC (Read error: Operation timed out) [23:53] *** ohhdemgir has joined #archiveteam-bs