#archiveteam 2014-10-09,Thu

↑back Search

Time Nickname Message
08:13 πŸ”— norbert79 Where can I add a new server to be mirrored to? http://c64.hardwired.hu/ plans shutting down themselves, according to entries in a forum the size of this is around 1.4 GiB
08:20 πŸ”— ersi Huh? new server to be mirrored to?
08:20 πŸ”— norbert79 Sorrya, bad wording
08:20 πŸ”— norbert79 -a
08:21 πŸ”— danneh_ I think he wants that site backed up
08:21 πŸ”— norbert79 So I just wish to get this saved too
08:21 πŸ”— norbert79 Right
08:21 πŸ”— norbert79 Sorry, I was in a hurry when typing it
08:21 πŸ”— norbert79 but my meeting got cancelled, so I am back
08:26 πŸ”— danneh_ So long as Archivebot can grab stuff in frames, it should be able to grab that just fine
08:27 πŸ”— midas added it to archivebot
08:27 πŸ”— danneh_ norbert79: Is it just that site that's going down, or other stuff on http://hardwired.hu/ as well?
08:27 πŸ”— norbert79 Not sure
08:27 πŸ”— norbert79 c64.hardwired.hu goes down, that is for sure
08:27 πŸ”— norbert79 thanks midas
08:27 πŸ”— midas hardwired.hu seems to be broken already
08:28 πŸ”— midas internet desert, whitepages of death
08:30 πŸ”— norbert79 Not been there for a while, I was using mostly their c64 subsite only
08:31 πŸ”— danneh_ yep, ah well, not much to do if that's already down: https://web.archive.org/web/20140702043017/http://hardwired.hu/
10:43 πŸ”— schbirid if i do a wget mirror with "--adjust-extension --convert-links" the warc still is ok for IA, correct?
11:31 πŸ”— Muad-Dib hey guys, want to save angelfire? look whats in robots: http://www.angelfire.com/robots.txt
11:32 πŸ”— Muad-Dib all dem sitemaps
15:03 πŸ”— joepie91 Muad-Dib: huh. that's curious.
15:29 πŸ”— Muad-Dib they are gzipped xml lists of the sitemap.xml files for every individual website
15:29 πŸ”— Muad-Dib joepie91: it´s Sitemapception
15:34 πŸ”— joepie91 haha
15:36 πŸ”— schbirid dashcloud: saved angelfire some months ago afaik
15:46 πŸ”— joepie91 does archivebot read sitemaps?
15:47 πŸ”— yipdw yes
15:47 πŸ”— yipdw as of recently
15:47 πŸ”— joepie91 :D
15:48 πŸ”— yipdw https://github.com/ArchiveTeam/ArchiveBot/commit/c48a74ce59845c2a5b2be4e7f29def967cf6d034 is the relevant commit
21:37 πŸ”— dashcloud I've got tiny pieces of angelfire- wget kept running out of memory on this laptop, and wpull wasn't an option for me at the time

irclogger-viewer