[01:16] norbert79: yes [07:06] hm [07:06] apparently you can make weed infused pig fat spread [07:09] what [07:26] pig fat spread is a kind of sauce made from pork drippings I guess? [07:26] there's a restaurant next door to the hackerspace, and they're experimenting with the newly-legal options [07:48] sounds yummy [08:07] chronomex: haha [08:08] joepie92: Thanks, not anymore actual, I was asleep when you replied :) But thanks anyway [08:10] norbert79: ah, what was the question? :P [08:10] No, but again, it's not anymore actual, so it's not worth talking about it :) [08:18] mm [08:18] but now I'm curious [08:18] :( [08:25] man i'm finding all kinds of good stuff, going through my old posterous [08:26] http://kennethreitz.posterous.com/dont-copy-that-floppy-0 [08:34] http://lazylaces.com/56Kmodem/ [08:35] awwwwyeah [08:40] 60k urls and 77kurls both still going. [08:40] * Smiley ponders if ersi has caught up yet. [08:40] not yet [08:40] your getting there tho!! [08:40] You're at 110GB and I'm at 86GB [08:40] I'm getting the image of two Rowan Atkinsons in Rat Race. "It's a race! I'm winning! I'm winning!" [08:41] #winning [08:41] ;) [08:41] #tigerblood [08:41] #bluemaxisalamer [08:47] when is the library of congress going to publish all of their twitter data. it was awhile ago thy said thy were still figuring out how [08:47] probably not for a while [08:47] that data belongs to the american people [08:48] no, that data belongs to, um, I dunno who [08:48] twitter? [08:50] That guy over there! [08:50] * GLaDOS points [08:50] * BlueMax slaps GLaDOS's hand away [08:50] It's rude to point [08:50] :-( [08:50] umm my taxes pay to archive it dont they [08:51] you can get your tax' worth of twitter by just visiting a random feed [08:51] I want my money back [08:52] haha [08:53] im going to start one of those petitions maybe obama will help [08:53] Here is the most recent article. Basically big data is too big for them [08:53] http://business.time.com/2013/02/25/what-the-library-of-congress-plans-to-do-with-all-your-tweets/ [08:53] Thanks obama [08:54] Wasn't the FBI unable to store 2TB of data on a computer hacker because that would take up 10% of their global network or something? [08:54] They do not have the know how to make a *fast* search. Another article I read said it takes over half a day to run 1 query across the whole database [08:55] watson [08:55] facebook sucks down over 70 billion photos a year [08:55] and they make that shit searchable with facial recognition [08:56] sigh [08:56] they also crop the fuck out of it [08:56] looks like its time for me to investigate how to run a proxy for myself so I can grab torrents via South africa or something [08:56] ersi true [08:57] that amount of tweets should not be a big data problem [08:57] and facebook loses how much money a year? [08:57] you realise facebook wasn't ever about providing a service about facebook right? [08:57] it's about handling big data. [08:57] It's the R&D arm of Hadoop orwhatever they are using now :D [08:58] Big Dataz [08:58] you're not making sense imo [08:58] They have more customers than anyone else. [08:58] ersi: Have you heard of Ingress? The game from Google? [08:58] im just saying library doesnt have 20 datacenters full of servers [08:58] I bet if the government gave the money the LOC gets to do this tweet shit and gave it to the IA there would already be a running solution [08:58] and funding to burn [08:58] probably [08:59] Smiley: Yes. [08:59] It really comes down to most hackers and programmers would only work for the government doing something cool like military shit [08:59] Which makes more sense. Its a pointless game. Or is a great way to get people to use GPS+wifi to help map out areas? [08:59] Smiley: it's a way to gather more wifi location data [08:59] that is foursquare [08:59] chronomex: exactly :D [09:00] not that it stops me playing, I just find it funny most of them don't realise what they are doing [09:00] it comes down to government needing and wanting hackers but not getting clearance/bs [09:00] omf_: and that each govermental/govermental subsided business fights for allocation and there's a massive pile of papers to file [09:00] chronomex: I don't think Ingress in particular is for that.. They already have GMaps rolled out since the last 5 years [09:01] ingress encourages you to turn on all your radios and walk around [09:01] Each Android hand-set will grab that infoz continously if you have GPS+3G on [09:01] yeah the red tape is anti-creative/hacker/smart guy [09:01] Using maps, practically forces you to enable your radios [09:01] no it only does gps at long intervals, not continuously [09:01] unless you're actively using it [09:02] whatever [09:02] ersi: how many people actively report errors in maps? [09:02] you know what I mean because you said exactly the same thing again [09:02] Smiley: doesn't matter [09:02] People love reporting errors in ingress. Gamification! [09:02] I report errors, that shit never gets fixed [09:02] I edit openstreetmap, problem solved [09:02] ! [09:02] ? [09:03] i was just going to link http://openstreetbugs.schokokeks.org/ [09:03] OSM rocks [09:03] I'm working on a comprehensive survey of my neighborhood [09:05] there we go, filed a bug for you. [09:05] footpath in completely the wrong place. [09:06] blargh, my workstation at work is a bit sluggish with all these punchfork instances chugging along [09:06] I'll spin 'em down and spin up a few elsewhere [09:06] Smiley: link? [09:07] urgh, broke it trying to zoom in [09:07] http://openstreetbugs.schokokeks.org/?lon=-1.54525&lat=52.40373&zoom=18&layers=B0T [09:07] theres two footpaths there [09:07] One of them doesn't exist, and is dangerous to corss that cross to the round about. [09:08] instead they both join the road where the proper zig zag crossing is. [09:08] cool [09:08] hopefully someone will be able to go out there and take a look at it [09:08] yeah [09:08] Smiley: thanks! :) [09:09] what IS there, is a stand for a 50foot light [09:09] such as those they use to light football pitches etc [09:09] we seemingly had someone thinkg it was a good idea at some point to put those lights randomly around the city [09:09] When they are on, they light up for a few miles :/ So so bright, it looks like day light in the middle of the night. [09:09] THat one has been removed, but the "stand" is still on the ground... [09:09] that's super weird [09:10] huh [09:10] indeed [09:10] What, the lights? [09:10] yes [09:10] yup [09:10] they point directly down... but are so stupidly bright. [09:10] let's see if I can find a pic of one [09:11] I've only ever seen them on once. [09:12] Wouldn't the pic only be white? [09:12] ;D [09:12] hahaha yeah, but i meant when they are off :P [09:12] brown, instagram! [09:13] sorry, i mean sepia [09:13] sepia pantona selection 42 [09:13] trying to think where I know where one is. [09:13] I remember it well because I was waling home one night [09:13] went around the corner and was like OMG I'M BLIDN [09:15] https://maps.google.co.uk/maps?q=52.407294,-1.516788&num=1&ie=UTF8&t=h&ll=52.403975,-1.545877&spn=0.000389,0.000534&z=21&vpsrc=6&layer=c&cbll=52.403975,-1.545877&panoid=Z8v0x9xIpwA6Ix9Jp3T3nA&cbp=12,43.04,,0,0 [09:15] wtf [09:17] https://maps.google.co.uk/maps?q=52.407294,-1.516788&num=1&ie=UTF8&t=m&ll=52.406624,-1.519278&spn=0.001554,0.002138&z=19&vpsrc=6&layer=c&cbll=52.406624,-1.519278&panoid=Wr86gHyXbS9KfJaqV0LGhg&cbp=12,288.56,,0,-24.53 [09:18] u can see one there. [09:20] Smiley: - Downloaded: 105960 URLs. [09:20] :D [09:20] D: [09:20] gonna break you think? [09:21] naw, I "fixed" ZipExport [09:21] also, my ones do ZipExport before the WgetDownload [09:21] so if they're WgetDownloading, they're fine [09:21] oh yeah, you said [09:43] Just took a few steps out of my TOSEC upload. [09:45] alard: Just curious; How many items are there left on Punchy? [09:45] Oh yeah, I should probably upload my chumby.com stuff to IA [10:04] TOSEC upload? [10:38] - Downloaded: 96740 URLs. [10:45] Smiley: - Downloaded: 118520 URLs. [10:45] that one seems to like to keep going [10:52] :O [10:54] - Downloaded: 100060 URLs. [10:56] yay [11:44] 3022 recipes :o [11:44] 75k urls that one [11:45] - Downloaded: 110790 URLs..... [12:02] - Downloaded: 114130 URLs. [12:02] yey the 3022 recipes is uploading :) [12:02] Finished PrepareStatsForTracker for Item user-nyghtmare - hahah fitting name [12:08] Smiley: - Downloaded: 130950 URLs. [12:08] :D [12:10] :D nice [12:10] ersi: user-KateRen 1500MB [12:10] :O [12:10] D: [12:10] * Smiley goes home [12:10] yeah :D [12:17] Smiley: the user's final is: - Downloaded: 134210 URLs. ;D [12:18] Nice. [12:19] Starting WgetDownload for Item user-Mai - Downloaded: 117550 URLs. [12:26] Mwahaha, soon overtaking Muad-Dib [12:35] * Smiley hides [12:41] Smiley: that 130k user is 3.1GB ;o [12:42] :O [12:42] * Smiley does some quick science. [12:43] yeah my warrior has 2gb memory. [12:43] And I'm now pulling down 1.8Mbit o_O [12:43] 2x50k users, 1x121k [12:54] http://everyfuckingwebsite.com/ [12:54] punchfork.com-user-nyghtmare-20130304-040236.warc.gz [12:54] 1014661120 63% 248.75kB/s 0:38:25 [12:56] ersi, Isn't that the best site ever [12:57] It makes me smile :) [12:57] haha awesome. [12:57] is #preposterus logged somewhere? [12:57] probably not [12:58] ok [13:08] Smiley: mwahaha, gunning for your top10 rank [13:18] I'm logging it... [13:19] Do we want the log? :/ [13:19] punchfork.com-user-nyghtmare-20130304-040236.warc.gz [13:19] 1390706688 87% 208.50kB/s 0:15:47 [13:19] whats that, 1.3Gb? [13:19] no, GB :3 [13:29] over 100GB \o [13:32] o_O [13:32] my warrior only has 80GB so I hope its not 100 ;D [13:33] I'm over 100GB uploaded now [13:33] punchfork.com-user-nyghtmare-20130304-040236.warc.gz [13:33] 1390706688 87% 208.50kB/s 0:15:47 [13:33] punchfork.com-user-nyghtmare-20130304-040236.warc.gz [13:33] 1390706688 87% 208.50kB/s 0:15:47 [13:33] errrr [13:33] Mai is now 132k [13:33] fail [13:51] Smiley: Only 10GB from you now >:) [13:51] :D [13:51] - Downloaded: 135180 URLs. - hoping she'll help :P [14:20] Starting WgetDownload for Item user-Mai - Downloaded: 139560 URLs. [14:20] Smiley: user-nyghtmare 1696MB [14:33] alard: many left? [14:37] Starting WgetDownload for Item user-Mai - Downloaded: 143270 URLs. [14:42] nice, new record :P [14:42] I'm not getting more/new users :o [14:43] #:O [14:43] 108out - someone possibly got 108 users somewhere? [14:44] dunno [14:44] 284out [14:46] o#_O [14:46] I'm wondering if I have a load of users assigned to me still. [15:00] - Downloaded: 148180 URLs. [15:24] Starting WgetDownload for Item user-Mai - Downloaded: 154310 URLs. [15:24] lordy lordy [16:14] * Smiley waves to ersi on the tracker. [16:15] - Found 4723 cards. [16:15] Downloading recipe index: [16:50] hmmm, [16:50] Starting WgetDownload for Item user-juliacirone - Downloaded: 93720 URLs. [16:50] Can one of the admins see if I've got many more jobs, and pass some over to ersi? [20:17] alard: .... can you split jobs between me and ersi again, he has far more b/w it seems (and ability to possibly cope with larger users). [20:17] also it seems mai may of disappeared into the ether :/ [20:22] you guys may get some repeats with the missing videos i'm getting [20:22] but the video id is different [20:24] even the file name is dfferent [20:26] Saving is better than not saving [20:26] i'm downloading them all [20:27] the podcast stuff at least explains the missing ids [20:28] also the missing videos equal around 2177 [20:28] there is more i have to grab [20:29] thats only up to 43997 id [20:33] looks like glenn beck had the same errror as wilkow had [20:33] no commecails and no blaze ticker [20:34] was questioning the file size and time length [21:02] alard: poke :) [21:03] ersi: Hello. [21:03] I'm somewhat lost. [21:03] Oh no [21:03] lol where to start :D [21:03] * ersi goes to find alard [21:03] 1. soultcer did something to posterous as we were breaking it [21:04] 2. we've done _most_ of the punchfork stuff.... theres still a few errored out users but I think ersi has fixed his code. [21:04] yah [21:04] 3. a posterous engineer stopped by, said hi.... I'll pm you a log about that in a sc [21:04] sec( [21:04] 1. I saw that message, but I think the todo list is back to where it was and it's now back to per-minute-limit = 0? [21:04] 0 = not running? [21:05] Yeah, posterous is back to 0. Since posterous was/is broken [21:05] yeah. 0 per minut = nothing gets done, ie stopped [21:05] Smiley: Btw, I pushed my changes to the master branch. So you have the updated code as well ;) [21:05] 2. Do you want the unfinished punchfork users another time? [21:05] ersi: Oh sweet, I wasn't sure and didn't want to presume yet. [21:05] Yeah, unleash them again alard :) [21:06] i'm getting retroauts podcast [21:06] its from ign [21:06] I see soultcer has admin access to the tracker now. Good. [21:06] yeah, he haxed redis access or something like that :) [21:06] godane: good job!! [21:07] can we feed rss feeds or something itno the IA? XD [21:07] a guy had transcode it on underground gamer to m4a [21:07] so its half the size [21:08] but he did it cause of random bitrate and meta data problems [21:08] I've given full tracker access to S[h]O[r]T now. underscor and chronomex already had that. (And they can add new users if necessary.) [21:09] neat [21:09] Cool [21:09] I'll annoy them [21:09] Any of them EU based btw? [21:09] As thats teh biggest issue... [21:09] ok its 1up's retroauts [21:09] not ign [21:09] No one is around at 9am when we break things :D [21:15] i have decide to go after the original mp3s [21:17] you guys could do it for me if you want? [21:17] http://www.1up.com/do/minisite?cId=3156908 [21:21] wget only mp3 files? [21:22] depth=1..... [21:22] and just run it for the 5 pages? [21:23] sorry i have alot of uploading [21:23] wget -r -l1 -H -t1 -nd -N -np -A.mp3 -erobots=off -i ~/mp3blogs.txt something like this [21:23] godane: not ap roblem, I'm just triyng to figure out the exact wget command [21:23] just make a warc.gz of the 5 pages [21:24] then zcat *.warc.gz | grep .mp3 [21:24] wget -r -l1 -H -t1 -N -np -A.mp3 -erobots=off [21:24] there ytou go [21:24] now to run it :D [21:25] i was renameing the files so didn't get confused about them [21:26] errr [21:26] how to save to warc with wget again? :S [21:26] or does it matter for the mp3s? [21:30] ./warc-proxy/mp3s/www.podtrac.com/pts/redirect.mp3/podcast.the1upnetwork.com/flat/Retronauts/R020813.mp3: Audio file with ID3 version 2.2.0, contains: MPEG ADTS, layer III, v1, 160 kbps, 44.1 kHz, JntStereo [21:30] Coming down now godane [21:31] alard: I don't know what my auth secret is, or how to get to the login :P [21:32] right guys I'm off [21:32] godane: don't worry, those mp3s are coming down now, I'll likely upload them tomorrow possibly. [21:32] I gave it all 5 pages to grab from, might get some random extra ones. [21:33] chronomex: Do you want an auth secret? [21:34] well unless I can log in without it, yes [21:56] * SketchCow moving around files on FOS like CRAZY [21:56] Trying to clear stuff off now. [21:57] SketchCow: i have uploaded 12k+ files to g4video-web collection [21:58] i also found over 2000+ videos from my wii service [22:02] Excellent [22:02] SketchCow: also i have faster upload speed [22:02] i noticed on friday [22:03] *it was 03/02 morning [22:04] SketchCow: Did you move any posterous files yet? [22:05] THey're moving now. [22:06] root@teamarchive-1:/1/TOSEC/TOSEC_SETS_2012_04_23# du -sh /2/POSTEROUS-BIN/ [22:06] 24G /2/POSTEROUS-BIN/ [22:11] When you say move, is that uploading to achive.org or just moving to a different disk? [22:11] holy crap [22:12] 12+mb images on g4tv.com [22:12] this is between 130001 to 140000 [22:13] also 120001 to 130000 must not have alot of images cause i'm close to the first 2000 urls with 0 images so far