#archiveteam 2014-05-13,Tue

↑back Search

Time Nickname Message
13:27 πŸ”— beardicus is this archiveteam appropriate: https://twitter.com/Cmdr_Hadfield/status/466168309441122304 ?
13:28 πŸ”— beardicus commander hadley's major tom video coming down today due to their license ending.
13:28 πŸ”— beardicus link straight to the video: https://www.youtube.com/watch?v=KaOC9danxNo
13:30 πŸ”— beardicus dur. hadfield, not hadley.
13:34 πŸ”— midas got the mp4 just to be sure beardicus
13:35 πŸ”— midas available here for now: http://dat.serveert.me.uk/~midas/youtube/
13:35 πŸ”— Smiley ewww bad breath move, so overpowered.
13:36 πŸ”— midas ?
13:37 πŸ”— Smiley wtf, i accidently changed channels and didn't notice, sry :D
13:49 πŸ”— godane i'm uploading more of the australian womens weekly
15:05 πŸ”— SketchCow What's the best archivebot approach to getting all the comments on the video as well?
16:45 πŸ”— midas im guessing just !ao
16:46 πŸ”— SadDM doesn't archivebot have PhantomJS? Does anybody know the args to get it to scroll down?
16:51 πŸ”— anarllama hi there. I just started using wget
16:51 πŸ”— anarllama is it normal the index page links toward the website IҀ™m archiving
16:51 πŸ”— anarllama instead of the local files?
16:54 πŸ”— schbirid see "man wget"
16:54 πŸ”— schbirid --convert-links is the option you want
16:54 πŸ”— schbirid by default wget does not tinker with what it downloads
16:55 πŸ”— schbirid you might also like --adjust-extension
16:55 πŸ”— schbirid and of course you should always make ot create a warc archive as well
16:59 πŸ”— anarllama thanks
16:59 πŸ”— anarllama can I convert the links without having to re-download everything ?
16:59 πŸ”— anarllama IҀ™m working on a dead news website
16:59 πŸ”— anarllama owni.fr
16:59 πŸ”— anarllama they shutdown a couple years ago
16:59 πŸ”— anarllama Idk why itҀ™s still up
17:36 πŸ”— nico i forgot to archive owni.fr ?
17:37 πŸ”— nico !a http://owni.fr/ --ignore-sets=blogs
17:37 πŸ”— nico wrong channel
20:33 πŸ”— bsmith anything for the warrior, also are there instructions for running it on a headless server?
20:34 πŸ”— midas well, it's just a VM
20:35 πŸ”— midas so sure, just import it on a VM-capable box, could run just fine on it
20:35 πŸ”— bsmith midas, how do i get to the settings page?
20:36 πŸ”— bsmith port forwardign?
20:36 πŸ”— midas go to the ip of the box:port, should be enough
20:38 πŸ”— bsmith tried that. not working
21:58 πŸ”— Wabadub Hello. Will you be archiving TWOP forums?
22:02 πŸ”— Wabadub Hello?
22:03 πŸ”— DFJustin Wabadub: we already did
22:04 πŸ”— Wabadub omg
22:04 πŸ”— Wabadub when it will be accessible?
22:04 πŸ”— DFJustin http://archivebot.at.ninjawedding.org:4567/#/histories/http://forums.televisionwithoutpity.com/
22:04 πŸ”— DFJustin probably within days
22:07 πŸ”— DFJustin ah it's in https://archive.org/details/archiveteam_archivebot_go_042
22:07 πŸ”— Wabadub Thank you, people! Dont't wish to be ungrateful, but you archived it rather early. Will you be updating your mirror?
22:07 πŸ”— DFJustin so it should be in the wayback machine already
22:08 πŸ”— DFJustin it could be run again potentially but at this point if anyone loses new posts it's their own fault
22:09 πŸ”— Wabadub Pity. There will be a lot of posts till 30th.
22:11 πŸ”— Wabadub will it be availiable via torrents?
22:12 πŸ”— DFJustin there's a direct download at the archive.org link and there's also a torrent link there but you'd have to uncheck all the other files
22:12 πŸ”— DFJustin it's not very convenient to use a .warc.gz file directly though
22:20 πŸ”— Wabadub hm, i downloaded archiveteam_archivebot_go_042_archive.torrent, but there is no twop in it
22:21 πŸ”— DFJustin ah guess someone needs to regenerate it
22:24 πŸ”— yipdw_ you could just grab the warc.gz
22:24 πŸ”— yipdw_ I mean, archivebot items don't have the data in any other format
22:24 πŸ”— Wabadub oh
22:25 πŸ”— Wabadub the speed is very nice actually
22:25 πŸ”— Wabadub thought it's gonna be faster via torrent
22:25 πŸ”— Wabadub it would be
22:27 πŸ”— dashcloud Wabadub: if you need to view a warc file, your best bet is probably warcqtviewer: https://github.com/odie5533/WarcQtViewer/releases
22:27 πŸ”— DFJustin the torrent is usually faster because you get two webseeds
22:28 πŸ”— Wabadub ok. but will it possible to view archive as a forum? it looks just like a bunch if url in this https://camo.githubusercontent.com/d5edbc8da137707db7cb14c891ac22ad4a0a31ec/687474703a2f2f692e696d6775722e636f6d2f59696e55616d432e706e67
22:30 πŸ”— DFJustin you can do that on the wayback machine
22:30 πŸ”— DFJustin http://web.archive.org/http://forums.televisionwithoutpity.com/
23:06 πŸ”— bsmith000 what projects are running? the github hasn't been updated in a while.
23:16 πŸ”— DFJustin oh looks like the torrent generation is skipped if the item is > 25600 MB
23:18 πŸ”— bsmith000 dfjustin that's when you'd need a torrent.
23:27 πŸ”— fellowshi hi
23:27 πŸ”— garyrh fellowshi, hi
23:29 πŸ”— fellowshi Is there a Remote Chance of a "Preserve Game Server/Matchmaking"-Spinoff of archiveteam.org (similar to the Fileformat Thing)?
23:32 πŸ”— dashcloud sure- but it's a lot more effort
23:33 πŸ”— dashcloud folks have done it before, but it's extremely labor-intensive, and you need to get started sooner rather than later
23:34 πŸ”— dashcloud I presume you're talking about the impending GameSpy matchmaking shut down?
23:34 πŸ”— fellowshi Well yes.
23:34 πŸ”— dashcloud so, unless you are an amazing coder, you're going to need a team.
23:35 πŸ”— fellowshi Everyone shuts down Gameservers all the Time.
23:35 πŸ”— fellowshi Especially EA.
23:35 πŸ”— dashcloud they do, and relatively few of them seem to get 3rd party servers after end of life
23:35 πŸ”— fellowshi But I hoped that those Games would hold out longer... (As they only need Matchmaking Services.)
23:36 πŸ”— dashcloud this PDF covers some of the stuff you'll need to know: http://cellframework.sourceforge.net/uploads/Introduction%20to%20Server%20Side%20Emulation.pdf (it focuses on keeping MMOs online once the server is gone)
23:36 πŸ”— fellowshi I guess in this case, the Domain itself would be needed.
23:36 πŸ”— fellowshi Next Problem would be Punkbuster.
23:37 πŸ”— fellowshi Arrr.
23:37 πŸ”— fellowshi Not to speak of DRM...
23:37 πŸ”— dashcloud those are (relatively) small matters, compared to the biggest problems
23:38 πŸ”— fellowshi I wonder if ZiffDavis would consider selling.
23:38 πŸ”— dashcloud if you have to ask, you don't have the cash
23:38 πŸ”— dashcloud your biggest problem is you need to understand how the games talk to the matchmaking server, and what they expect to get from the server
23:38 πŸ”— fellowshi (Matchmaking is a comparitively small Problem.)
23:39 πŸ”— dashcloud if you don't figure that out before the servers go down, you'll be in for a world of pain trying to figure it out afterwards
23:41 πŸ”— dashcloud should you somehow cross that hurdle, everything else can mostly be done at any point- you're not dependent on the official servers for the other stuff (not that I can think of anyway)
23:44 πŸ”— fellowshi https://www.google.de/search?q=gamespy+protocol
23:45 πŸ”— fellowshi The Main Problem seems to be, that EA/Others will shut down additional Servers (Stats Collection / Accounts).
irclogger-viewer