[08:13] <norbert79> Where can I add a new server to be mirrored to? http://c64.hardwired.hu/ plans shutting down themselves, according to entries in a forum the size of this is around 1.4 GiB
[08:20] <ersi> Huh? new server to be mirrored to?
[08:20] <norbert79> Sorrya, bad wording
[08:20] <norbert79> -a
[08:21] <danneh_> I think he wants that site backed up
[08:21] <norbert79> So I just wish to get this saved too
[08:21] <norbert79> Right
[08:21] <norbert79> Sorry, I was in a hurry when typing it
[08:21] <norbert79> but my meeting got cancelled, so I am back
[08:26] <danneh_> So long as Archivebot can grab stuff in frames, it should be able to grab that just fine
[08:27] <midas> added it to archivebot
[08:27] <danneh_> norbert79: Is it just that site that's going down, or other stuff on http://hardwired.hu/ as well?
[08:27] <norbert79> Not sure
[08:27] <norbert79> c64.hardwired.hu goes down, that is for sure
[08:27] <norbert79> thanks midas
[08:27] <midas> hardwired.hu seems to be broken already
[08:28] <midas> internet desert, whitepages of death
[08:30] <norbert79> Not been there for a while, I was using mostly their c64 subsite only
[08:31] <danneh_> yep, ah well, not much to do if that's already down: https://web.archive.org/web/20140702043017/http://hardwired.hu/
[10:43] <schbirid> if i do a wget mirror with "--adjust-extension --convert-links" the warc still is ok for IA, correct?
[11:31] <Muad-Dib> hey guys, want to save angelfire? look whats in robots: http://www.angelfire.com/robots.txt
[11:32] <Muad-Dib> all dem sitemaps
[15:03] <joepie91> Muad-Dib: huh. that's curious.
[15:29] <Muad-Dib> they are gzipped xml lists of the sitemap.xml files for every individual website
[15:29] <Muad-Dib> joepie91: it´s Sitemapception
[15:34] <joepie91> haha
[15:36] <schbirid> dashcloud: saved angelfire some months ago afaik
[15:46] <joepie91> does archivebot read sitemaps?
[15:47] <yipdw> yes
[15:47] <yipdw> as of recently
[15:47] <joepie91> :D
[15:48] <yipdw> https://github.com/ArchiveTeam/ArchiveBot/commit/c48a74ce59845c2a5b2be4e7f29def967cf6d034 is the relevant commit
[21:37] <dashcloud> I've got tiny pieces of angelfire- wget kept running out of memory on this laptop, and wpull wasn't an option for me at the time