[00:01] pc in cardboard box: http://imgur.com/a/wtd4Q [00:18] I like [00:58] godane, servers in cardboard boxes: http://itknowledgeexchange.techtarget.com/IT-watch-blog/fdcservers-colocation-data-center-gives-new-life-to-the-term-boxen/ [01:23] the alienware sticker really makes it [01:35] http://www.thespaceinvaders.org/ [03:19] When you say the word "poop" your mouth does the same motion your butt hole does when you poop. [05:39] lol [05:40] POOP [06:12] * omf_ throws a pancake at SmileyG [06:13] * GLaDOS pancakes omf_ back with a SmileyG [06:21] I wonder how hard it would be to convince a client to buy me the Jakob Neilson reports [06:33] Is the Kindle Paperwhite still the best ereader in terms of legibility? I am looking into finally getting an ereader instead of my laptop [06:35] I tried the latest nook out and I was not impressed [06:57] * BlueMax pancakes omf_ [06:57] so i'm passed 54k videos in my g4video-web collection [06:58] also i will be able to start uploaded the 'g4 unpublic video ids' [07:38] hmmm [07:38] I have forgotton where to get the S3 script [07:39] ah sorted it :P [07:44] uploaded: https://archive.org/details/17Bit_Collection_A [08:08] uploaded: https://archive.org/details/17Bit_Collection_B [08:20] So my spare computer fried [08:20] i'm grabing the linux format dvds again [08:20] and I need to hook up an internal bluray drive so I pull out my backup from the closet. That bitch is so old it is running windows XP [08:21] The last time I used windows XP on a computer was 2003 [08:21] I think I need to do some computer upgrades and get a more modern backup machine [08:22] I have had more computer failures this year than any year I can remember, it is such a bummer because we all get so used to stuff just working [08:23] We always go on about backing up data but what about having spare fulling working computers around [08:23] shit I gotta find an IDE hard drive [08:32] hey SketchCow, you around? [08:36] so i'm uploading some of the dual side linux format dvds i had [08:36] disk 80, 88, and 138 [08:54] The machine is so old it does not have sata on the motherboard and the sata card I have will not let me boot off the bluray drive ugh. [08:56] boot.. off of bluray? woot [08:56] a linux live dvd [08:57] ah, so not a bluray disc - multi-format drive ftw [08:57] I had over 25% of my bluray backup disks fail so I switched up to raid hard drives for backups which works great but I still have more disks to go through [08:58] I don't have a single unit that can eat bluray [08:58] it is not worth it [08:58] that's what I figured :) [08:58] I tried three different brands and they still suck [08:59] the media is just too fucking cheap [08:59] I am just trying to finish wrapping up a multi month media move [08:59] I want it over so I can pitch these bluray disks and drives [09:00] sounds like a plan [09:00] never had this problem with cdrs or dvdrs [09:01] I tested some dvdr backups from 13 years ago and they still worked 100% [09:01] and yet a fucking bluray disc can go bad in under 2 years [09:01] well, they figure most of the people who wanna back up that amount of data will never check it [09:01] ;D [09:02] I just do not get how bluray can be such an abortion [09:02] me neither [09:02] well, they probably don't mind if the blurays go bad [09:02] then I remind myself that fucking SONY invented that shit [09:02] goes bad? buy another one [09:03] HDDVD [09:03] how I miss you [09:04] I just chip my backups into rocks. [09:04] I thought about 32 or 64gb thumb drives but those can be inconsistent as well [09:04] I just pour mine into the cloud [09:04] I get it back when it rains [09:04] The cloud <3 [09:04] I don't always back up my data, but when I do, I put it in The cloud(TM) [09:05] Anyone ever seen a 24 hour computer parts store? we need that [09:05] It's called the Internet and globalisation [09:06] they cannot get me the parts today so they fail [09:06] I can *walk* down the street and get 24/7 groceries or 24/7 pharmarcy [09:07] Well, I'm technically correct since you didn't specify that's what you wanted :) [09:07] true ersi [09:07] but yes, that would be awesome [09:07] I bet they'd be expensive though :) [09:08] 24/7 works in large cities. I live in a city that has close to 2 million people, I would like to think it could support 1 store like that [09:08] Stockholm has about the same population [09:08] the transit system shuts down at midnight [09:08] There is at least 10 24/7 groceries in town, hell we got 24/7 bowling alleys [09:09] buses shutdown here at midnight too [09:09] Yeah, but fuck driving a car in Sweden [09:09] but the road is empty so bicycles all the way down :) [09:09] ah, heh [09:09] Figured that might be silly if buying electronics [09:10] I got two bicycles. One of them has the rear carrying brackets so I can haul shit [09:10] I've been thinking of making a bike cart for my bike [09:12] I am going to buy two of these adapters since they are only $9.99 each [09:12] What's a "cash call"? [09:14] Sounds like a "thing", saw fifty names looking like 1800cashcall in my LJ-scraper [09:14] 1800 makes me think "1-800" like US phone numbers [09:15] they are a mortgage loan shit house [09:15] ah [09:15] spam from them is not surprising [09:16] One title from CashCallMortages; "American Dream Special" [09:16] I laughed [09:20] lol I just found my copy of "The Dark Half" in this old dvd drive [09:20] heh backup on blu rays? [09:20] hell, back up on optical media? [09:21] quality dvdrs you get more than 10 years [09:21] but now they are too small for most things [09:24] I am definitely going to drop some serious coin before the end of the summer to have working backup machines [09:24] then again for most backup purposes a raspberry pi is enough [09:51] I do not even have a 32bit linux cd anywhere [09:52] fuck it, I'll just wait for the store to open to do more, at least I will have most of this wrapped up by the end of the day [10:05] what brands of bluray are you using? [10:06] I tried all the verbatim types, windata and one other I cannot remember. I also used 3 different bluray burning branded drives. I have extensive data I plan on publishing once I finish up this last stack of disks [10:07] i have some verbatim [10:07] I burned over 500 disks over the course of two years [10:08] i also use memorex also [10:08] If I had losts of spare money I would go back to tape [10:09] i don't have that option [10:09] if i'm luckly i can buy another 2TB usb drive in 3 to 4 months [10:09] I ain't got no money either [10:22] Oh yeah, by the way: http://www.gamasutra.com/view/feature/195148/dwarf_fortress_in_2013.php?print=1 [10:22] Full of good gems [10:28] we may need to start archiving this guy's work: http://www.giantbomb.com/articles/ryan-davis-1979-2013/1100-4685/ [10:30] his twitter account: https://twitter.com/taswell [10:39] so i'm mirroring the gaint bombcast podcast [11:13] so i got some good news on the giant bombcast podcast [11:14] all mp3s are one rss feed [11:14] page [11:14] and i can sed it to have keywords, title, desciptions and dates [11:15] so it will be like when i was uploading cbc spark [11:21] hey, jason was on cbc spark [11:22] here is the collection: https://archive.org/details/spark_cbc [11:35] the facebook graph search is the easiest stalking program I have ever used [11:36] yeah they are doing wide release of it now [11:39] never mind. This query did not work "My friends who like photos of Cats" [11:39] that is fucking basic [11:42] and I get pinterest style photo pages [11:42] oh shit no [11:42] what the fuck am I seeing here [11:42] pinterest-style unaligned columns are a cancer [11:43] it is psychological warfare [11:43] i start to doubt myself, like if that's just me spergin' the fuck out, given how eeeeveryone is doing it now [11:44] most websites have shit ux and no taste [11:44] hey guys, github or bitbucket [11:44] INFINITE SCROLL [11:44] we got most or stuff on github [11:45] I like looking at photos sorted by region where the person lives [11:46] okay github it is then [11:46] I am a super huge graph database nerd [11:46] https://github.com/ArchiveTeam/ [11:48] I am now going state by state because I can [11:48] I bet they have freebase tied into this [11:48] i suppose if you're all using git, then it makes sense to use git, and github is the obvious choice for a repo [11:48] so there it is [11:49] well look what I found. Slutty Halloween pictures. [11:49] ^_^ [11:51] hmm. does it recognise 'big knockers' as an attribute when searching for slutty Halloween pictures? ;) [11:51] let me try [11:51] this search just popped up in autocomplete [11:51] " Photos of my friends who have liked ArchiveTeam " [11:52] fucking skynet [11:52] hah [11:52] that's curious phrasing. "have liked" as opposed to "like"... [11:53] yes [11:53] "liked" is a facebook flag [11:54] I "liked" Rage Against the Machine [11:54] they are trying to make the search "natural" language [11:54] most people this shit is still too hard but I think it is pretty simple to use [11:55] then again I am a programmer [11:55] Yeah, I've had the preview for months and I found it super easy [11:56] like you said...if you want to creep on people it makes it insanely easy [11:57] mm, I can understand why they use that as the flag, but they use the "like" form a lot too; "So-and-so likes Something You've Never Heard Of", etc. [11:57] I am going to write a program to login as me and markov chain the fuck out of that search [11:57] which does it use in results, if any? [11:57] I can search by state but not by region of the country [11:58] they must not be using freebase because it has identifiers for regions and the like so it is possible to use that as a search criteria [11:59] holy crap [11:59] i may have figured out how to do muliable line descs now [12:00] add this for link brake: [12:03] o_O???? [12:03] Sent 3156111360 bytes (1%) [12:04] lolololol [12:04] yeah [12:04] i only found out about it cause i'm using a older version of cbc podcast desc page [12:04] i can't remember where to view the S3 stats [12:04] I hope the store has the raspberry pi power adapters in stock [12:04] SmileyG, that page is offline due to security issues [12:05] omf_: doh! [12:05] nevermind they put it back up [12:05] must have fixed it. http://archive.org/stats/s3.php [12:05] http://home.us.archive.org/~tracey/mrtg/ is back too [12:06] https://github.com/lewiscollard/mwlinkscrape [12:22] http://highscalability.com/blog/2013/7/8/the-architecture-twitter-uses-to-deal-with-150m-active-users.html [12:23] Holy moley [12:30] At any given time thereâs about 1 million sockets open to the push cluster. :O [12:30] 22MB/s data on ze firehose [12:30] yah [12:31] 176Mbit/s~ [12:31] 1 million sockets, so even if we presumed consumers like... google, have 1 per server for a large part of what ever process they are sucking them down via.... DAMN thats a lot of people listening [12:36] ersi: very interesting [12:39] heh, awesome for testing our line here :D [12:40] SmileyG: Testing your line? [12:40] ersi: at work [12:40] 500Mbit [12:40] does anyone know about the cbc spark missing podcasts yet? [12:41] there are still missing podcasts on there from what i can tell [12:41] nope [12:41] also: http://officialpiczoblog.piczo.com/ [12:42] this has been "soon" since october 2012 [12:42] SmileyG: You won't get access to the Firehose [12:43] So dream on [12:43] wat do? [12:45] ersi: Oh I know that [12:45] just saying it'd be neat. [12:47] the line "Internal clients use roughly the same API as external clients" amuses me somewhat [12:48] didn't Microsoft try that excuse with the DoJ a while back? ;) [12:48] roughly usually means "does not use anything similar to the public APIs" [12:48] Baljem: Uh? What? [12:49] It's usually a good idea to use the same API for external as well as internal things, you get a lot better quality cover [12:49] not always, but usually [12:49] I seem to recall one of the MS anti-trust claims revolved around internal APIs allowing MS apps to do things that 3rd party apps couldn't [12:49] Kind of different when you're installed on every damn computer [12:50] which is why there's now a slew of MSDN pages warning about the functions they document being subject to random breakage, etc. [12:50] well, sure, but the hype behind social media would suggest that it's not all /that/ different ;) [12:50] (I'm not *entirely* serious here, you understand, just musing randomly) [12:50] It's not all that different from Operating Systems? [12:51] ... no, it's not all that different from the point of view of blocking competitors apps [12:51] which, as I recall, Twitter has recently been doing with quite some glee [12:52] I mean, OK, from one point of view it's just a load of whining about ephermal nonsense that nobody cares about [12:52] but on the other hand, Twitter /is/ fairly big and dominant in its sector, isn't it? [12:52] Baljem: so was myspace, so was friendster, so was geocities [12:53] ah, but did they provide an API and (initially) encourage 3rd party developers to write competing client apps? [12:54] yes [12:54] they don't owe anyone else a business model [12:54] i mean it's crappy and awful to punch your ecosystem in the face, but it's not antitrust material [12:55] well, no, I suspect the entire thing is too frivolous. but it seems to be the same arguments, just a matter of degree [12:56] (NB: not thinking about the abusive-monopoly part of the MS antitrust suits, but the unfair-advantage-over-ISVs part) [13:04] eh, i don't know [13:05] * ersi just shrugs and ignores the conversation [13:06] yeah, sorry, I just have a weird sense of dry humour at times. I'll shut up ;) [13:07] * winr4r pets Baljem [13:08] Humour? Anti-trust and abusive-monopolies? Mmmh. [13:09] well, my initial comment was a tongue-in-cheek "where have we heard that before?" type joke. it kinda spiralled out of control when I started over-thinking it ;) [13:11] Right [13:19] Baljem: how much did you pay for twitter again? [13:19] Thats the big thing everyone seems to forget about windows _ALL THE TIME_ [13:19] you paid for it, if it came with your PC. [13:20] You pay with brain cells, when using Tweetarh [13:21] is this horse dead yet folks best beat it to make sure [13:21] Let's [13:21] whack whack whack [13:21] You fuckin' horse! [13:21] * ersi kicks it about [13:21] * ersi sends his dwarf army to beat up the horse [13:21] * GLaDOS horses the dead horse around with a bit of horse [13:22] YEAH, LETS HORSE THIS DEAD HORSE [13:22] HORSE IT REAL GOOD [13:22] heh. I'm not touching it. I apologise unreservedly for dragging the horse into the ring in the first place ;) [13:22] * ersi brings another horse into the ring [13:22] The game is ON! Go living horse, beat that dead horse! [13:22] is it pre-dead? [13:22] oh [13:24] I don't think your horse understood your instruction, ersi :( [13:25] Yeah, it killed itself [13:26] skills! [13:26] so now, two dead horsies [13:26] It was all like "NEIGH I'M A HORSIE" and then died. [13:26] Rather spectacular [13:27] spooky thing: there's a drama on TV *right now* that i'm not following, and someone just euthanised his horse [13:27] apropos of nothing, I have just learned of the existence of 'Fizzy Pepsi Cola' flavoured corn snacks. uh, what. [13:27] so how about that [13:27] is that a euphemism for something, winr4r? ;) [13:27] A horse is a horse, euthanized of course [13:28] "excuse me a minute, I'm just off to, uh, euthanise my horse, if you know what I mean" [13:28] And nobody shoots a lame horse of course [13:28] morning SketchCow [13:28] hey SketchCow [13:28] i'm starting to upload more linux format dvds [13:29] Bed delivery here in NYC [13:29] Before heading north [13:30] We turned the heat up on the internet archive digitizer upstate [13:33] Hmmm, wouldn't one say "zed" to the Z character? Not "C" [see]? Heard several say "see"/"C" instead of zed ;o [13:33] ersi: "zee" in american english [13:33] "zed" is british/commonwealth english [13:33] Wow, alright [13:34] 'cause "zee" sounds a lot more like "C" [13:34] SketchCow: i'm going to be uploading giantbombcast podcast [13:34] one of the guys died at 34 [14:00] hey, does anyone know what format this is in: http://archive.org/details/2013_common_crawl_index_urls [14:00] when uncompressed [14:01] (can't download 21gb of stuff here) [14:02] I'm sure ivan` does, since he made it :) [14:02] I guess it's just a textfile with URL\nURL\n [14:03] ah okay [14:04] i'm writing a page on teh wiki, i'd like to know for sure [14:05] hmm. is there a trick to downloading that file with curl? I can grab it from the browser but I don't want the whole thing, obviously, just want to pipe it into bunzip2 | head... [14:07] curl --no-buffer thing | bunzip2 | head ? [14:09] ah, got it - right-click, copy link gives a redirector link, I think, grabbed the actual file URL from the Web Inspector and that worked [14:09] oh! i misunderstood the question [14:09] want me to paste the first few lines in query as an example, winr4r, or is that not going to be particularly useful? [14:10] pastebin that stuff babbbby [14:10] Baljem: yup, pastebin pl0x [14:12] http://pastebin.com/zfqwbPRW [14:12] sorry for the delay, brain went dead and I couldn't remember where the ArchiveTeam pastebin thingy was - so used the boring one ;) [14:13] those look weird. [14:13] ..it's flipped them around [14:13] but just split on : [14:13] GLaDOS: non. [14:13] hm! [14:14] what [14:14] maybe the ones at the top are malformed ones [14:14] actually maybe it has [14:14] and the rest are all normal [14:14] winr4r: ones at the top are mailto's [14:15] SmileyG: right, but if it's *normally* flipped around, then why would there only be two .coms at the top? [14:16] lool, why does it start with tld and end with protocol [14:16] shrug [14:17] shades of JANET addressing there! [14:17] ersi: yeah, that makes me think that those ones are outliers in the set [14:17] at least on the count of starting with the tld [14:18] haha, nice URLs :D #15 -> http://www.meatmembers.com (Yes, it's as NSFW as it sounds) [14:18] I was disappointed by the apparent content of http://www.bindher.com ;) [14:18] dear lord :D [14:18] * SmileyG doesn't click either. [14:19] That's why the second one sucks. [14:19] "" [14:19] Anyone want to help me moving 50kg racks containing 30kg powered on, live servers? [14:19] SmileyG: yes [14:19] SmileyG: yeah sure why not [14:19] OK, a handful taken from around line 2,500,000 look the same [14:20] e.g. "ar.com.elsurhoy/:http" [14:20] don't ask why the racks weigh so much, no one seems to be able to answer other than "Like their servers, dell racks weigh far more than thought possible). [14:20] Baljem: hmm [14:20] someone needs to for x in ./list; do wget $x; done these. [14:20] * SmileyG looks at underscor [14:20] mind you, line 2,500,000 is only 20.2MB into the file [14:21] * winr4r does magic spell, summons underscor [14:21] Baljem: yes, exactly [14:21] yey my S3 upload is 2% done. [14:21] use this to build markov chains. Instantly know all websites ever? [14:21] the machine I was doing that from pull it down at about 1MB/sec so if we wanted to pick a suitably huge number I could try again... just can't save it because it doesn't have enough disk space [14:22] Baljem: thanks for helping anyway :) [14:22] holy shit, 28MB free on /? I need to shuffle some VMs around. turn the old host crate into a Warrior machine perhaps [14:22] i think it may well be backwards as you suspect [14:25] would seem a curious format to provide results in though [14:26] well, apart from it allowing sorting by TLD, that is [14:26] ... whether that's a useful thing to make easy is another matter [14:32] Baljem: i'm throwing together a set of tips for finding sites on a soon-to-be-dead host [14:32] (related to what i threw up on github earlier) [14:32] so, making it easy is not a concern [14:32] *nods* [14:33] I was just trying to think of motivations for reversing the FQDN, really, and coming up short :) [14:33] ohh, gotcha [14:34] sorry misunderstood [14:34] I really need to stop musing out loud *grin* [14:35] some sets of hints and tips certainly sound useful though. when I got involved with you crazy lot a while back, it was a case of pestering people for help and hoping not to piss anyone off with total ineptness [14:35] Probably for sorting on TLD, like you said earlier - I wouldn't find that super weird, albeit maybe a little [14:36] Or maybe the common crawl people got Java in their brains and made them look like packages [14:36] yeah, it just seems a bit of an edge case to optimise for [14:36] com.oracle.utils.lols.FinderCakeFactory [14:36] heh, yes [14:37] ersi: yup [14:37] or maybe ivan` sorted it that way :) I know he did a top-list per TLD [14:38] right, line 50,000,000 is "be.zoover.www/griekenland/lefkas-levkas/hortata/sitemap:http" [14:38] I think it's probably safe to assume there aren't that many 'weird' entries, and that is in fact normal [14:38] (that corresponds to about 392MB into the file) [14:38] Baljem: thanks man :) [14:39] Baljem: 392mb into the uncompressed or compressed one? [14:39] compressed [14:39] Baljem: alright yeah, it probably is backward-ordered then [14:39] so approximately the 2% mark [14:39] thanks :) [14:39] no worries. it was a welcome distraction from the horrors of Other People's Code ;) [14:40] haha [14:41] seriously. just found a file full of MFC code, with a comment buried in the middle "this is a workaround for an issue with Borland Turbo C++ 1.0" [14:41] ... wat. [14:41] wat [14:42] ... it was supposedly written in 2003! [14:42] it doesn't help that this project wasn't under source control until mid-2005 when I took over from the ex-boss :( [14:43] :( [14:59] http://www.archiveteam.org/index.php?title=Site_exploration [15:04] good job :) [15:06] i'll probably clean that bing script up into something worth releasing soon enough [15:11] ersi: Baljem: the commoncrawl data is unmodified (using their strings as-is) [15:11] i found a lost episode of CBC Spark: https://archive.org/details/spark_20070919_3346 [15:11] I have a Python script that turns it into real URLs but note their data is sometimes ambiguious [15:12] ivan`: ah :) [15:12] ivan`: See any point in their format? [15:13] it is useful for sorting domains properly but they did not do it right (can't tell port apart from :n at the end of a URL) [15:16] ivan`: can you shove that script into paste.archivingyoursh.it please? :) [15:16] godane: good job :) [15:17] I just pasted to https://www.refheap.com/16448/raw [15:17] Baljem: ^ [15:17] hastebin is bad software and I try to avoid it [15:18] yeah, but on the other hand, it's run by us [15:18] or rather, GLaDOS i think [15:18] indeed [15:19] ivan`: Guess they assume everything either runs on :80 or :443 and just care about the end being http:// or https:// [15:19] https://github.com/trivio/common_crawl_index/issues/12 [15:19] there are other bugs [15:20] https://github.com/trivio/common_crawl_index/issues [15:20] ivan: nice - I was just fiddling with a really nasty Perl one-liner to do it, but wasn't liking it at all [15:21] no warranty, doesn't handle some of their broken stuff [15:21] at least it doesn't crash ;) [15:22] well, it saves me making a pillock of myself by suggesting a hack that only handles the test cases I threw at it ;) [15:23] ivan`: thanks, updated the page :) [15:35] we may have a problem: http://torrentfreak.com/shut-down-the-pirate-bay-founder-says-130708/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Torrentfreak+%28Torrentfreak%29 [15:37] archive.org does the same backwards thing with domain names if you look at the index files they generate https://archive.org/download/archive.pdp11.org.ru-20130504/archive.pdp11.org.ru-20130504.cdx.idx [15:37] they seem to automatically fold example.com and www.example.com into the same wayback machine entry so it probably facilitates that [15:38] oh uh [15:39] we've *had* a problem: apparently piczo actually disappeared [15:39] piczo.com returns a "we're dead", but subdomains (on which the sites were hosted, and where all the shit was) still work [15:40] and there's lots of other pages that still seem to work [15:40] (piczo: like geocities but more so) [15:42] or "social geocities" [15:42] "There.s actually been more downtime for the site due to drunk admins, than downtime due to raids." <- heh. my servers always wait until I'm well oiled to demand attention, too [15:42] is piczo another one we only hear about on the day it actually dies? :( [15:43] Baljem: it was announced a while back as "closing down soon" [15:43] ah, OK. first I'd heard of the site was someone linking to that 'closing soon' blog post earlier today [15:44] yeah, that was me [15:44] it actually happened earlier this year some time [15:45] they seem to be keeping the sites themselves up though [15:45]