#archiveteam 2012-01-20,Fri

↑back Search

Time Nickname Message
00:06 🔗 Ymgve Sixty (60) Dell R710 computer servers;
00:07 🔗 Ymgve I imagined megaupload had more
00:07 🔗 Coderjoe there are probably still servers in HK
00:09 🔗 Ymgve true
00:09 🔗 Coderjoe another salvo in big content's fight to cut off independants?
00:10 🔗 Ymgve Nah, I think independents are just collateral damage
00:10 🔗 Ymgve It's a bit tinfoil-hat-y to believe these things happen due to independent/non-signed artists
00:10 🔗 Ymgve After all, bandcamp
00:13 🔗 DFJustin from wikipedia it sounds like they're incorporated in hk but don't do anything there
00:34 🔗 dashcloud so SketchCow, is this the start of another big floppy copying push?
00:34 🔗 don excuse me, didn't you guys learn NOT to copy that floppy?
00:35 🔗 don also home taping is destorying music
00:35 🔗 don destroying also
00:36 🔗 dashcloud and remember VHS tape recording is like the Boston Strangler
00:36 🔗 Ymgve fuck, I'm afraid now
00:37 🔗 Ymgve what if they come to take my 1985 warez?
00:37 🔗 chronomex extreme home taping!
00:39 🔗 Ymgve I just finished downloading all game patches on direct2drive.com
00:39 🔗 Ymgve just in case they fuck up the transfer to gamefly
00:47 🔗 gui77 is there even any interest om archving RS/MU though?
00:47 🔗 gui77 most of it is either warez, or personal files that are irrelevant to anyone but the owner
00:48 🔗 gui77 and even if you want to archive the warez, legal issues aside, it would be useful because most of it is uploaded in passworded .rar files (the passwords are given out in the forums/sites that provide the links)
00:48 🔗 gui77 so you would end up with petabytes of duplicated information (there must be thousands of copies of a popular movie at RS or MU) which is passworded, and thus useless
00:49 🔗 underscor fbi.gov down for anyone else?
00:49 🔗 underscor Getting a footprint 503 error
00:49 🔗 chronomex damnt you're making us all part of your ddos effort
00:49 🔗 underscor HTTP/1.1 503 Service Unavailable
00:49 🔗 underscor Server: Footprint 4.8/FPMCP
00:49 🔗 don hahaha
00:49 🔗 underscor lol
00:49 🔗 don yeah down for me too
00:49 🔗 gui77 yup, down for me too
00:50 🔗 chronomex I get a valid HTTP response and body
00:50 🔗 gui77 buess anon is ddosing it too
00:50 🔗 gui77 *guess
00:50 🔗 gui77 i don't even get a response, it times out
00:50 🔗 chronomex increase your timeout
00:51 🔗 gui77 how can i do that? :/
00:52 🔗 gui77 what might be a decent archive effort would be, maybe, .torrent sites. you could archive/index different torrents and save the .torrent file, allowing it to be saved and re-used in the future - if you're interested in backing up such sites
00:53 🔗 Ymgve I'm already doing piratebay
00:54 🔗 Ymgve the problem comes when they turn to magnet URLs only
00:54 🔗 Ymgve maybe I should look into creating a simple magnet scraper
00:54 🔗 gui77 but still they'll onyl work as long as the tracker is up
00:54 🔗 Ymgve DHT?
00:54 🔗 gui77 not necesariyl theirs, but someone else's tracker
00:54 🔗 chronomex you should start a magnet scraper that creates .torrent files.
00:55 🔗 underscor That would be rad
00:55 🔗 NovaKing chronomex
00:55 🔗 NovaKing we already do that ;)
00:55 🔗 chronomex what hi
00:55 🔗 gui77 ah yesh i was forgetting about DHT... i guess that would work
00:55 🔗 chronomex ok
00:56 🔗 Ymgve DHT and magnet == no chance of takedown
00:56 🔗 Ymgve unless they outlaw non-recognized protocols
00:56 🔗 NovaKing problem with DHT is distribution of torrent meta on low seeded content
00:56 🔗 NovaKing will take a while to search the DHT network
00:56 🔗 NovaKing to get ot
00:56 🔗 NovaKing it**
00:56 🔗 NovaKing but as i said
00:56 🔗 NovaKing we are indexing all DHT torrent meta
00:56 🔗 NovaKing well, slowly
00:56 🔗 NovaKing i think we are at 14mil torrents
00:57 🔗 underscor <adjectivecat> linux is like that knife i keep in the vase behind my sink that i use to cut big poops so i don't have to use the plunger. it's useful on rare occasion and for dirty jobs and i feel awkward about it afterwards :3
00:57 🔗 Ymgve scraping the .torrent files?
00:57 🔗 NovaKing http://zoink.it/sync/all201112.txt.bz2 <-- hash list as of end of 2011
00:57 🔗 NovaKing that is a list of everything zoink.it is hosting
00:57 🔗 Ymgve cool
00:57 🔗 NovaKing we have a DHT torrent scraper
00:58 🔗 NovaKing developed by the guy who made Vuze
00:58 🔗 soultcer Sweet, I wanted to do one when I have the time
00:59 🔗 NovaKing it requires about 260 IPv6 IPs atm
00:59 🔗 soultcer Though, I am more interested if the theory with the DDoS via fake announces on DHT really works or if you can't reach a high enough volume
00:59 🔗 soultcer Why does it need so many IPs?
00:59 🔗 NovaKing due to how DHT works
00:59 🔗 NovaKing and to spread the listeners
00:59 🔗 NovaKing to catch as many torrent meta as possible
00:59 🔗 Ymgve wait, only 260?
01:00 🔗 NovaKing it grows
01:00 🔗 NovaKing it's at 260 atm
01:00 🔗 NovaKing started with 10
01:00 🔗 Ymgve also, why IPv6?
01:00 🔗 NovaKing cause we have many IPv6's available
01:00 🔗 Ymgve but can you cover the whole hash space with so little?
01:00 🔗 NovaKing no
01:00 🔗 Ymgve also, won't IPv6 exclude you from seeing a lot of the DHT?
01:01 🔗 NovaKing but it has to naturally grow
01:01 🔗 NovaKing otherwise DHT will be flooded
01:01 🔗 NovaKing which is not good
01:01 🔗 NovaKing but yeah, we are at about 14mil torrents
01:01 🔗 NovaKing it's growing
01:01 🔗 NovaKing we do probably 250k a week
01:01 🔗 Ymgve can you inject hashes?
01:01 🔗 NovaKing we just listen
01:01 🔗 NovaKing nothing more
01:01 🔗 NovaKing i could ask
01:02 🔗 Ymgve I mean, take hashes from another source to populate your db
01:02 🔗 Ymgve like piratebay
01:02 🔗 Ymgve or http://publicbt.com/all.txt.bz2
01:03 🔗 NovaKing how resent is that?
01:03 🔗 Ymgve http://publicbt.com/ - "An aggregated scrape file for the entire cluster can be found here. The file is updated every 5 minutes. and is ~50 MB, instead of the ~125 MB from each node in the cluster."
01:03 🔗 NovaKing 60MB
01:03 🔗 NovaKing mine is 293MB
01:04 🔗 soultcer Do you only store the infohash or do you download the torrent metadata as well?
01:04 🔗 NovaKing well
01:04 🔗 soultcer Awesome.
01:04 🔗 NovaKing if you /torrent/{hash}.torrent
01:04 🔗 NovaKing you can get the torrent
01:04 🔗 soultcer So you put all scraped results on zoink?
01:04 🔗 NovaKing it was also pushed onto torrage.com
01:04 🔗 NovaKing but it had a hdd crash
01:05 🔗 Ymgve "Torrents that have not been downloaded for a period of 6 months will automatically be removed from the system."
01:05 🔗 Ymgve :(
01:05 🔗 NovaKing it doesn't get nuked
01:05 🔗 NovaKing we just say that :)
01:05 🔗 Ymgve ah
01:05 🔗 soultcer NovaKing: Is it ok if I download all torrents from zoink.it? Any rules to follow?
01:05 🔗 NovaKing well
01:05 🔗 NovaKing i prefer to push to you
01:05 🔗 NovaKing it's about 550gb atm i think
01:06 🔗 soultcer Just imagine all this imported into a searchable db
01:07 🔗 NovaKing it exists ;)
01:07 🔗 NovaKing Filesystem Size Used Avail Use% Mounted on
01:07 🔗 NovaKing /dev/sda1 927G 368G 560G 40% /
01:07 🔗 NovaKing 560GB
01:07 🔗 NovaKing http://torrindex.com/ <-- searchable index of what torrage had in it's system
01:08 🔗 soultcer To be honest I am not so much interested in "where can I find House season 5 as torrent" but more in other stuff like average torrent size, biggest torrent and so on
01:09 🔗 soultcer Even cooler if could have scrape (as in tracker scrape) data as well
01:09 🔗 Ymgve NovaKing: you got stuff that's not on torrage, apparently
01:10 🔗 underscor NovaKing: Can I PM?
01:12 🔗 chronomex don't fucking ask permission to /msg
01:12 🔗 Ymgve I kinda hope someone with too much money and a fat connection is sitting somewhere fetching everything on usenet
01:12 🔗 chronomex drives me up the wall
01:13 🔗 soultcer It's the polite thing to do.
01:13 🔗 chronomex no
01:13 🔗 chronomex it doesn't make sense
01:13 🔗 chronomex do you ask permission before you email someone?
01:14 🔗 soultcer Nope, but email is not the same as IRC private message
01:14 🔗 chronomex if you don't want random /msg, set yourself +g
01:14 🔗 chronomex soultcer: right, irc is less personal
01:15 🔗 soultcer That's why asking for permission to PM makes it so much more classy ;-)
01:15 🔗 underscor that's true
01:15 🔗 underscor fuck that shit
01:15 🔗 underscor I'm just used to channels where that's required
01:15 🔗 gui77 i agree chronomex, i think most people ask permission because some people get a lot of them and have developed quite teh sensitivity to being msg'd hehe :)
01:15 🔗 chronomex the only reason to talk about /msg in public channel is if you think someone is ignoring you / has a client that isn't dinging them
01:16 🔗 gui77 if you go to a tech-support channel with thousands of users, a single expert can easily be flooded with questions for anything he says
01:16 🔗 gui77 and that can make it hard for them to distinsguish urgent messages from those hundreds of tech-support messages... but yeah they should jjust +g themselves
01:22 🔗 soultcer I just watched the Megaupload song for the first time
01:22 🔗 underscor Me too
01:22 🔗 soultcer I do now fully support the US government in shutting them down
01:22 🔗 soultcer That song is awful and needs to be nuked from orbit
01:23 🔗 Ymgve haha
01:23 🔗 don the point of the song wasn't to be good.
01:24 🔗 Ymgve the song will be exhibit A on the trial that the guys were a menace to society
01:26 🔗 tef yipdw: are you sticking your sopa warcs anywhere ?
01:29 🔗 tef I've got < 0.5 gig but it has screenshots of sites too
01:53 🔗 Coderjoe http://i.imgur.com/rR592.png
01:58 🔗 DFJustin well this has to take the price for 'most effort on an under construction logo' http://kvartirakrasivo.ru/404/index.php
01:58 🔗 DFJustin prize
02:00 🔗 chronomex wow
02:01 🔗 Coderjoe every day he's shufflin'
02:01 🔗 Coderjoe woah
02:01 🔗 Coderjoe it rotates with the mouse position
02:36 🔗 Coderjoe http://9gag.com/gag/1951427
02:38 🔗 underscor Hahahahahah
03:05 🔗 NovaKing ok, back
03:05 🔗 NovaKing Ymgve: torrage.com's hdd died
03:05 🔗 NovaKing we keep our sites in sync
03:05 🔗 NovaKing i hadn't done it in 2 months though as i was on holidays
03:05 🔗 NovaKing so we were about 1mil out of sync
03:05 🔗 Ymgve ah
03:06 🔗 NovaKing i will be syncing it back up with torrage when he gets the new hdd cluster up
03:06 🔗 NovaKing underscor: pm away
03:06 🔗 NovaKing soultcer: scrapping that many torrents = a lot of resources
03:07 🔗 NovaKing and relies on trackers being up at the time
03:07 🔗 NovaKing scraping multiple tracker
03:07 🔗 NovaKing getting the uniques
03:07 🔗 NovaKing and DHT scraping is not viable
03:07 🔗 NovaKing there is a bloom scrape spec in proposal
03:07 🔗 NovaKing but that is only a rough guess average
03:08 🔗 NovaKing as DHT is decentralized
03:23 🔗 tev chronomex: I think people tend to ask permission because there are some networks/people who get really cranky if you don't, so it's like you can't win either way. :( Though I personally agree that it's kind of stupid to expect someone to ask permission first.
06:58 🔗 yipdw tef: yeah
06:58 🔗 yipdw tef: I'd like to make an index of them first and dedupe them
06:58 🔗 yipdw as I had an error in my grabber that grabbed like 50 copies of many articleds
06:58 🔗 yipdw but I have been just rsyncing to batcave
07:58 🔗 tef ah
08:00 🔗 tef cool
09:55 🔗 Nemo_ter so, I've deleted my local copy of Splinder because I needed some space for a while and have now some space free
09:56 🔗 Nemo_ter how ca I help with Proust (or something else)?
10:10 🔗 soultcer Something is wrong with the wiki. A user that has been blocked months ago just created a spam page?!?
10:12 🔗 soultcer Hm, maybe because the account got deleted back then
10:15 🔗 Nemo_ter who deletes accounts :o
10:15 🔗 Nemo_ter ah, that evil extension
10:16 🔗 soultcer We had thousands of fake spam accounts in the form of "name nn" where nn was some integer and needed to get rid of them
11:07 🔗 Soojin https://www.youtube.com/watch?v=wyzwA5Qjd20
12:42 🔗 emijrp The day after SOPA protest, MegaUpload is closed. LOLOLOL.
12:43 🔗 emijrp By the way, I had an account with Jamendo albums and free culture books there.
12:50 🔗 emijrp Has anyone got a copy of MegaUpload?
12:50 🔗 soultcer Rapidshare probably ;-)
12:52 🔗 emijrp If they take down MU, they will take down all them.
12:52 🔗 emijrp This is probably only a test.
13:03 🔗 nitro2k01 Hmm... MU is down here too, Sweden
13:04 🔗 Soojin down everywhere
13:05 🔗 Soojin click on More on the side here http://www.filestube.com/search.html?q=gameboy&select=All
13:05 🔗 Soojin thats how many file services there are, not counting all chinese ones
13:05 🔗 Soojin mission impossible :)
13:06 🔗 nitro2k01 What.s really eye-opening about this indictment is the property that the Feds have seized from the defendants. It lists a number of bank accounts, PayPal accounts, 15 Mercedes-Benz vehicles, a Rolls-Royce with the license plate .GOD,. a rare Lamborghini and a Maserati. It seems the defendants had a number of vehicles with creative license plates including .HACKER,. .POLICE,. .STONED,. .GOOD,. .CEO,. and the ominous .GUILTY.. (See below for the full l
13:06 🔗 nitro2k01 Whoa, a license plate that says guilty?
13:06 🔗 nitro2k01 They're SOOO screwed
13:13 🔗 nitro2k01 I hate when shit like this happens because I don't remember exactly what I had on my account
13:13 🔗 nitro2k01 And worse, if anything there was my only copy
13:20 🔗 emijrp MegaUpload has probably a lot of money, so, this may be a cool legal fight. But, they may pay a big amount and avoid the case.
13:23 🔗 nitro2k01 He MIGHT be able to settle this out of court, BUT I doubt my beloved files are coming back ._.
13:26 🔗 emijrp On 18 January the Supreme Court of the United States upheld the Uruguay Round Agreements Act (URAA), which may result in the deletion of thousands of files on Wikimedia Commons published outside the US between 1923 and 1977. The community is discussing appropriate action to take.
13:27 🔗 emijrp http://commons.wikimedia.org/wiki/Commons:Deletion_requests/All_files_copyrighted_in_the_US_under_the_URAA
13:28 🔗 ersi nitro2k01: It's always a bad idea to only have one copy
13:28 🔗 nitro2k01 Of course
13:28 🔗 nitro2k01 If it was the only copy of something, it probably wasn't something important
13:29 🔗 nitro2k01 The problem more has to do with not knowing what I actually had on there
13:29 🔗 nitro2k01 A bit obsessive, yes
13:30 🔗 ersi No, I feel ya'. I hate the thought that I didn't know what was lost, more than the fact that I lost something
16:27 🔗 DFJustin cool scored a superdisk drive at work
18:03 🔗 yipdw Nemo_bis: if you want to help with Proust, I've got some scripts but no way to deduplicate
18:04 🔗 yipdw well actally
18:04 🔗 yipdw what I *really* need for Proust is some way to access private content of profiles
18:04 🔗 yipdw I have not been able to find one
18:08 🔗 yipdw Nemo_bis: although I think where effort is really needed is mobileme
18:26 🔗 SketchCow We have to move to mobileme now.
18:27 🔗 yipdw on that note, I've been uploading a few hundred gigs of mobileme for the past week now
18:27 🔗 yipdw why do Apple users store so much shit in the cloud
19:00 🔗 DFJustin SketchCow: I've had good success using apple II + adt for flippies
19:00 🔗 DFJustin it seems to be more successful at reading disks than the kryoflux even although that may be down to a crappy pc 5.25" drive
19:01 🔗 DFJustin caveats: copy protected disks don't work, and in my experience you need a pc with a real serial port, the usb serial is crap (at least the one I got)
19:02 🔗 DFJustin I'll need to get my real commercial disks properly kryofluxed at some point but for the stacks of warez and user group disks, a sector dump is fine
19:02 🔗 Cowering wow.. adt.. had forgotten about that.. used to use it all the time
19:05 🔗 SketchCow Yeah, that's true.
19:06 🔗 Nemo_bis yipdw, ok, then I'll do some MobileMe... though it seems a huge task, too huge for my hard disk
19:09 🔗 yipdw how much storage do you have?
19:09 🔗 yipdw I'm just offloading to a 1TB disk
19:10 🔗 Nemo_bis I'm using my desktop, 500 GiB total and some 160 free or possibly free
19:10 🔗 Nemo_bis although I can rsync --delete
19:10 🔗 Nemo_bis $ sh get-wget-warc.sh
19:10 🔗 Nemo_bis get-wget-warc.sh: 19: builtin: not found
19:12 🔗 yipdw GNU bash, version 3.2.48(1)-release (x86_64-apple-darwin10.0)
19:12 🔗 yipdw haven't seen that one before
19:12 🔗 yipdw Copyright (C) 2007 Free Software Foundation, Inc.
19:12 🔗 yipdw I know this version works
19:12 🔗 yipdw as should bash 4
19:12 🔗 yipdw are you sure sh is actually bash?
19:12 🔗 yipdw that's not true on many systems
19:13 🔗 Nemo_bis hm, you're right
19:13 🔗 Nemo_bis sorry
19:14 🔗 Nemo_bis I'm not tech-savvy, just pretending
19:15 🔗 Nemo_bis how many streams are needed to download at 10 Mb/s, more or less?
19:15 🔗 yipdw and for what it's worth, I think downloading Mobileme and e.g. RapidShare are equally risky wrt copyright minefields
19:15 🔗 yipdw there is some serious shit in these public.me.com directories
19:15 🔗 chronomex oh?
19:15 🔗 chronomex look not, lest ye be corrupted
19:15 🔗 yipdw I'm just looking at the URL files
19:15 🔗 yipdw they could be lying
19:16 🔗 yipdw but that's all the MPAA does, so
19:16 🔗 chronomex ahahaha
19:16 🔗 chronomex hipsters got in a huge tizzy over 37signals looking at log files last week
19:16 🔗 chronomex so....
19:16 🔗 yipdw what, them looking at their server and app log files?
19:17 🔗 yipdw http://37signals.com/svn/posts/3076-i-heard-you-like-numbers?58#comments
19:17 🔗 yipdw oh
19:17 🔗 yipdw jesus christ
19:17 🔗 chronomex MMhMMMM
19:18 🔗 yipdw SHIT YOU SEND TO OTHER PEOPLE CAN BE SEEN
19:18 🔗 yipdw NO FILM AT 11
19:18 🔗 chronomex I'm more worried about them having /svn/ in the url
19:19 🔗 yipdw the followup is pretty lame
19:19 🔗 yipdw http://37signals.com/svn/posts/3078-trust-is-fragile#extended
19:21 🔗 yipdw there's a post in there by an Oracle employee that is ridiculous and completely misses the trust relationship
19:21 🔗 yipdw "you can tell your customers you are using ORACLE DATABASE VAULT and give them absolutely no way to verify that anything you are saying is not bullshit, but IT WILL MAKE THEM FEEL BETTER"
19:22 🔗 Nemo_bis yipdw, do I need to change the grep errors checks to fit Italian output again?
19:22 🔗 yipdw certainly there are probably business and technical reasons why MySQL has no similar feature, but I think the fact that server-side encryption is completely useless in a user-generated content setting also has something to do with it
19:22 🔗 yipdw Nemo_bis: not sure -- it's possible
19:49 🔗 Dark_Star anyone know who might have archived the downloads from oracle.com from some years ago? I'm looking for a retired product that was available on the download page a few years ago, but since they retired support for it they're being less than helpful :(
20:03 🔗 tef Dark_Star: check ftp sites
20:03 🔗 tef they never get cleaned up
20:07 🔗 nitro2k01 Dark_Star: What are you looking for, exactly?
20:20 🔗 Dark_Star Oracle for VAX (don't laugh ;-)
20:27 🔗 chronomex excellent
20:27 🔗 chronomex wait they had a free download of that?
20:46 🔗 Dark_Star yep, they had a lot of their DBs available for free in the last years, but for VMS/VAX you maybe still needed a PAK to activate it, I guess. That's what I wanted to find out.
20:51 🔗 Dark_Star But I can get the PAKs (DECs fancy term for "license keys") for free from the OpenVMS hobbyist program if they're indeed needed
21:55 🔗 yipdw http://depot.ninjawedding.org/cds.png
21:55 🔗 yipdw dum di dum
21:56 🔗 yipdw guess I should archive his statements now
23:59 🔗 dashcloud the Whitehouse has released a response to the petitions about scanning all of the governement's private records: https://wwws.whitehouse.gov/petitions#!/response/digitizing-federal-public-records

irclogger-viewer