#archiveteam 2012-11-21,Wed

↑back Search

Time Nickname Message
01:09 🔗 ivan` just noticed that youtube-dl can actually grab whole blip.tv channels
01:09 🔗 ivan` though I still need to patch to get the HD versions
01:13 🔗 Famicoman how can you get it to download whole channels?
01:39 🔗 ivan` Famicoman: just give it a blip.tv/username
01:39 🔗 ivan` at least it works with http://blip.tv/linuxconfau
01:40 🔗 Famicoman that does work, thanks
01:46 🔗 dashcloud I'm not sure how many of the sites listed in this book: https://archive.org/details/cdrom-internetgamesdirectorycd are still around, but there could be some good things in the links there
01:50 🔗 dashcloud here's a useful site that tracks (and keeps copies of) youtube videos that get flagged or taken down: http://youtomb.mit.edu/
01:52 🔗 chronomex neat, do they get the advance drop or something?
01:53 🔗 chronomex oh, hm
01:53 🔗 dashcloud here's the about page: http://youtomb.mit.edu/about
01:54 🔗 chronomex iirc, IA sucks in copies of youtube videos on twitter's abbreviated firehose
01:54 🔗 chronomex *videos mentioned on
01:56 🔗 dashcloud so I was wrong about it keeping copies of the videos- it doesn't
01:57 🔗 chronomex aye
02:28 🔗 underscor I am curious if they still do
02:29 🔗 underscor and just don't publicize it for obvious reasons
02:41 🔗 Aranje mostly dicks
02:54 🔗 chronomex there are 3.5 billion dicks in the world
14:05 🔗 balrog hah, my rsync to SketchCow's box is still going
18:52 🔗 Coderjoe hmm... I wonder if I should pack up this old mirror of ftp.cavedog.com
18:52 🔗 Coderjoe cavedog was a game developer, behind the Total Annihilation series. the hostname no longer resolves.
19:57 🔗 ivan` I want to maintain a mirror of all of github, but I don't think I have the disk space, and it isn't really suitable for a one-time archiving job
19:57 🔗 ivan` anyone have 10TB+ available?
19:58 🔗 ivan` the main reason to do is that people rm their repos all the time
19:58 🔗 norbert79 Even by todays standards 10 TB is just damn hue
19:58 🔗 norbert79 huge
19:59 🔗 chronomex 10T is big, but not huge
19:59 🔗 chronomex ;)
19:59 🔗 norbert79 well, for you maybe :)
19:59 🔗 ivan` I have about 60000 repos already
20:00 🔗 DFJustin seems like the kind of thing that could really benefit from a compressing filesystem
20:00 🔗 balrog git repos are already pretty compressed
20:01 🔗 ivan` git packs are already very compressed
20:01 🔗 balrog dedup might be useful
20:01 🔗 chronomex ninja'd
20:01 🔗 balrog wait who was first? :P
20:01 🔗 chronomex balrog was
20:01 🔗 ivan` you can actually share objects/ between repos, but I haven't tried it
20:01 🔗 ivan` I think at that point you never gc
20:02 🔗 chronomex I was going to say something but then I didn't
21:02 🔗 ersi norbert79: 10TB is actually just 3.3 hard drives.. Without redundancy
21:02 🔗 chronomex that's HYUUGE
21:02 🔗 ersi which is like 500$
21:10 🔗 norbert79 ersi: Over there maybe, it's a bit more expensive around my place
21:12 🔗 ersi oops, I was calculating on 2TB disks, so that's too low actually
23:13 🔗 godane ivan`: there is some code out there that will allow you to put all the forks into one .git folder
23:13 🔗 godane i would think that will save you some space
23:14 🔗 chronomex hm, that would
23:14 🔗 chronomex git-gc would take forEVer though
23:15 🔗 godane there is stuff like this: https://github.com/joeyh/github-backup
23:15 🔗 chronomex joeyh == closure ;)
23:15 🔗 godane cool
23:17 🔗 godane i wish he made it not in bash or python or perl
23:17 🔗 godane * mean made in bash/python/perl
23:17 🔗 * chronomex shrugs
23:18 🔗 chronomex maybe you should learn haskell ;)
23:18 🔗 godane haskell needs itself just to compile haskell
23:19 🔗 chronomex woop woop woop off-topic siren
23:22 🔗 NovaKing http://git-annex.branchable.com/
23:22 🔗 NovaKing you guys seen that project?
23:22 🔗 chronomex git-annex is my lord and saviour
23:23 🔗 NovaKing :)
23:25 🔗 NovaKing closure really loves his haskell! ;D

irclogger-viewer