[00:29] *** pikhq_ has joined #archiveteam-bs [00:30] *** pikhq has quit IRC (Ping timeout: 506 seconds) [00:35] *** JesseW has joined #archiveteam-bs [00:37] *** pikhq_ has quit IRC (Ping timeout: 244 seconds) [00:40] *** pikhq has joined #archiveteam-bs [00:56] *** pikhq has quit IRC (Ping timeout: 260 seconds) [00:58] *** pikhq has joined #archiveteam-bs [01:27] *** tfgbd_znc has quit IRC (Read error: Connection reset by peer) [01:27] *** tfgbd_znc has joined #archiveteam-bs [01:28] *** JesseW has quit IRC (Read error: Operation timed out) [01:44] *** wp494 has quit IRC (Read error: Connection reset by peer) [01:47] *** wp494 has joined #archiveteam-bs [02:06] *** JesseW has joined #archiveteam-bs [02:26] *** pikhq has quit IRC (Ping timeout: 244 seconds) [02:28] *** pikhq has joined #archiveteam-bs [02:31] *** xmc has quit IRC (Read error: Operation timed out) [02:33] *** xmc has joined #archiveteam-bs [02:33] *** swebb sets mode: +o xmc [02:52] *** sep332 has quit IRC (Read error: Operation timed out) [02:52] *** ivan has quit IRC (Leaving) [02:52] *** GLaDOS has quit IRC (Oh crap, I died.) [02:52] *** marvinw has joined #archiveteam-bs [03:02] *** Petri152 has quit IRC (Remote host closed the connection) [03:02] *** Lord_Nigh has quit IRC (Remote host closed the connection) [03:02] *** phuzion has quit IRC (Remote host closed the connection) [03:02] *** winr5r has quit IRC (Write error: Broken pipe) [03:02] *** Kenshin has quit IRC (Write error: Broken pipe) [03:02] *** arkiver has quit IRC (Write error: Broken pipe) [03:02] *** trs80 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** JesseW has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Laverne has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Cameron_D has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** zino has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** BlueMaxim has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** slyphic has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** kurt has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Igloo^_^_ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** superkuh has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** luckcolor has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** MrRadar has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** kvieta has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Frogging has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** tephra has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** aschmitz has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** decay has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** swebb has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** atlogbot has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** dxrt has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** RedType has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Smiley has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** bsmith093 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** wp494 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Start has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** signius has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Infreq has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** RichardG has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Famicoma1 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** hook54321 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** altlabel_ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** acridAxid has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** SketchCow has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** DFJustin has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** zenguy has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** coretx_ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** fie__ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** yipdw has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Zebranky has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** is- has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** rduser has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** dashcloud has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** joepie91 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** t2t2 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Aranje has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** chazchaz has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Sanqui has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** antonizoo has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** JSharp___ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Boltsie has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** sigkell has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** HCross2 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** voltagex has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** johtso has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Famicoman has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Ctrl-S___ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** _desu___ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** midas has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Rickster has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** deathy has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** dan- has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** zhongfu has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Muad-Dib has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Meroje has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** ItsYoda has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** lesderid has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** irl has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** SN4T14 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** r3c0d3x has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** FalconK has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Boppen has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Stiletto has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** w0rp has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Kaz has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** zerkalo_ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Baljem has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Sk1d has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** godane has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Medowar0 has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** HCross has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Kksmkrn has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** PotcFdk has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** xmc has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** pikhq has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** dcmorton has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** JW_work has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Jordan- has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** yeoldetoa has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** atrocity has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Madthias has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** ravetcofx has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** ndiddy has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Fletcher has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** jk[SVP] has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** tuankiet has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** espes__ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** closure has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** SilSte has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** valesi has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** MSDOS has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** alfiepate has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** edsu_ has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Medowar has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** useretail has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Rye has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** purplebot has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** i0npulse has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** PurpleSym has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** will has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** marvinw has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Darkstar has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** robink has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** Mayonaise has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** balrog has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** ranma has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** chfoo has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** jspiros has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** SadDM has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** yakfish has quit IRC (irc.choopa.net ircd.choopa.net) [03:02] *** remsen has quit IRC (irc.choopa.net ircd.choopa.net) [03:03] *** tfgbd_znc has quit IRC (Remote host closed the connection) [03:03] *** bwn has quit IRC (Remote host closed the connection) [03:03] *** cf has quit IRC (Excess Flood) [03:15] *** LordNigh2 has joined #archiveteam-bs [03:15] *** bwn_ has joined #archiveteam-bs [03:15] *** computerf has joined #archiveteam-bs [03:15] *** RKenshin has joined #archiveteam-bs [03:15] *** Arkiver2 has joined #archiveteam-bs [03:15] *** GLaDOS has joined #archiveteam-bs [03:15] *** pikhq_ has joined #archiveteam-bs [03:15] *** remsen1 has joined #archiveteam-bs [03:15] *** marvinw has joined #archiveteam-bs [03:15] *** xmc has joined #archiveteam-bs [03:15] *** JesseW has joined #archiveteam-bs [03:15] *** wp494 has joined #archiveteam-bs [03:15] *** Start has joined #archiveteam-bs [03:15] *** RedType has joined #archiveteam-bs [03:15] *** Laverne has joined #archiveteam-bs [03:15] *** signius has joined #archiveteam-bs [03:15] *** dcmorton has joined #archiveteam-bs [03:15] *** Stiletto has joined #archiveteam-bs [03:15] *** ravetcofx has joined #archiveteam-bs [03:15] *** Cameron_D has joined #archiveteam-bs [03:15] *** JW_work has joined #archiveteam-bs [03:15] *** dashcloud has joined #archiveteam-bs [03:15] *** zino has joined #archiveteam-bs [03:15] *** ndiddy has joined #archiveteam-bs [03:15] *** joepie91 has joined #archiveteam-bs [03:15] *** Fletcher has joined #archiveteam-bs [03:15] *** Darkstar has joined #archiveteam-bs [03:15] *** t2t2 has joined #archiveteam-bs [03:15] *** BlueMaxim has joined #archiveteam-bs [03:15] *** Aranje has joined #archiveteam-bs [03:15] *** slyphic has joined #archiveteam-bs [03:15] *** jk[SVP] has joined #archiveteam-bs [03:15] *** tuankiet has joined #archiveteam-bs [03:15] *** espes__ has joined #archiveteam-bs [03:15] *** closure has joined #archiveteam-bs [03:15] *** Infreq has joined #archiveteam-bs [03:15] *** SilSte has joined #archiveteam-bs [03:15] *** kurt has joined #archiveteam-bs [03:15] *** w0rp has joined #archiveteam-bs [03:15] *** chazchaz has joined #archiveteam-bs [03:15] *** RichardG has joined #archiveteam-bs [03:15] *** Famicoma1 has joined #archiveteam-bs [03:15] *** FalconK has joined #archiveteam-bs [03:15] *** lesderid has joined #archiveteam-bs [03:15] *** SN4T14 has joined #archiveteam-bs [03:15] *** ItsYoda has joined #archiveteam-bs [03:15] *** ircd.choopa.net sets mode: +oo xmc joepie91 [03:15] *** irl has joined #archiveteam-bs [03:15] *** Meroje has joined #archiveteam-bs [03:15] *** r3c0d3x has joined #archiveteam-bs [03:15] *** Muad-Dib has joined #archiveteam-bs [03:15] *** zhongfu has joined #archiveteam-bs [03:15] *** dan- has joined #archiveteam-bs [03:15] *** deathy has joined #archiveteam-bs [03:15] *** Rickster has joined #archiveteam-bs [03:15] *** midas has joined #archiveteam-bs [03:15] *** _desu___ has joined #archiveteam-bs [03:15] *** Ctrl-S___ has joined #archiveteam-bs [03:15] *** Famicoman has joined #archiveteam-bs [03:15] *** johtso has joined #archiveteam-bs [03:15] *** voltagex has joined #archiveteam-bs [03:15] *** HCross2 has joined #archiveteam-bs [03:15] *** sigkell has joined #archiveteam-bs [03:15] *** JSharp___ has joined #archiveteam-bs [03:15] *** Boltsie has joined #archiveteam-bs [03:15] *** antonizoo has joined #archiveteam-bs [03:15] *** Sanqui has joined #archiveteam-bs [03:15] *** Smiley has joined #archiveteam-bs [03:15] *** hook54321 has joined #archiveteam-bs [03:15] *** altlabel_ has joined #archiveteam-bs [03:15] *** valesi has joined #archiveteam-bs [03:15] *** MSDOS has joined #archiveteam-bs [03:15] *** Boppen has joined #archiveteam-bs [03:15] *** Kaz has joined #archiveteam-bs [03:15] *** robink has joined #archiveteam-bs [03:15] *** alfiepate has joined #archiveteam-bs [03:15] *** acridAxid has joined #archiveteam-bs [03:15] *** Jordan- has joined #archiveteam-bs [03:15] *** Igloo^_^_ has joined #archiveteam-bs [03:15] *** yeoldetoa has joined #archiveteam-bs [03:15] *** edsu_ has joined #archiveteam-bs [03:15] *** zerkalo_ has joined #archiveteam-bs [03:15] *** SketchCow has joined #archiveteam-bs [03:15] *** DFJustin has joined #archiveteam-bs [03:15] *** Baljem has joined #archiveteam-bs [03:15] *** Mayonaise has joined #archiveteam-bs [03:15] *** Sk1d has joined #archiveteam-bs [03:15] *** atrocity has joined #archiveteam-bs [03:15] *** superkuh has joined #archiveteam-bs [03:15] *** luckcolor has joined #archiveteam-bs [03:15] *** bsmith093 has joined #archiveteam-bs [03:15] *** zenguy has joined #archiveteam-bs [03:15] *** MrRadar has joined #archiveteam-bs [03:15] *** ircd.choopa.net sets mode: +ooo midas edsu_ SketchCow [03:15] *** coretx_ has joined #archiveteam-bs [03:15] *** balrog has joined #archiveteam-bs [03:15] *** ranma has joined #archiveteam-bs [03:15] *** fie__ has joined #archiveteam-bs [03:15] *** trs80 has joined #archiveteam-bs [03:15] *** kvieta has joined #archiveteam-bs [03:15] *** godane has joined #archiveteam-bs [03:15] *** Medowar0 has joined #archiveteam-bs [03:15] *** Medowar has joined #archiveteam-bs [03:15] *** chfoo has joined #archiveteam-bs [03:15] *** jspiros has joined #archiveteam-bs [03:15] *** SadDM has joined #archiveteam-bs [03:15] *** yakfish has joined #archiveteam-bs [03:15] *** yipdw has joined #archiveteam-bs [03:15] *** HCross has joined #archiveteam-bs [03:15] *** Frogging has joined #archiveteam-bs [03:15] *** tephra has joined #archiveteam-bs [03:15] *** Kksmkrn has joined #archiveteam-bs [03:15] *** Madthias has joined #archiveteam-bs [03:15] *** PotcFdk has joined #archiveteam-bs [03:15] *** swebb has joined #archiveteam-bs [03:15] *** is- has joined #archiveteam-bs [03:15] *** rduser has joined #archiveteam-bs [03:15] *** purplebot has joined #archiveteam-bs [03:15] *** atlogbot has joined #archiveteam-bs [03:15] *** dxrt has joined #archiveteam-bs [03:15] *** i0npulse has joined #archiveteam-bs [03:15] *** PurpleSym has joined #archiveteam-bs [03:15] *** ircd.choopa.net sets mode: +oooo balrog SadDM swebb PurpleSym [03:15] *** will has joined #archiveteam-bs [03:15] *** Rye has joined #archiveteam-bs [03:15] *** useretail has joined #archiveteam-bs [03:15] *** Zebranky has joined #archiveteam-bs [03:15] *** decay has joined #archiveteam-bs [03:15] *** aschmitz has joined #archiveteam-bs [03:15] *** swebb sets mode: +o antomatic [03:15] *** pikhq_ has quit IRC (Ping timeout: 250 seconds) [03:15] *** winr4r has joined #archiveteam-bs [03:15] *** LordNigh2 is now known as Lord_Nigh [03:15] *** bwn_ is now known as bwn [03:15] *** RKenshin is now known as Kenshin [03:15] *** pikhq has joined #archiveteam-bs [03:16] *** Petri152 has joined #archiveteam-bs [03:16] *** sep332 has joined #archiveteam-bs [03:17] *** tfgbd_znc has joined #archiveteam-bs [03:23] *** pikhq has quit IRC (Ping timeout: 255 seconds) [03:37] *** pikhq has joined #archiveteam-bs [04:04] *** ndiddy has quit IRC (Ping timeout: 244 seconds) [04:30] *** pikhq has quit IRC (Ping timeout: 250 seconds) [04:32] *** pikhq has joined #archiveteam-bs [04:36] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:44] *** Sk1d has joined #archiveteam-bs [04:44] *** JesseW has quit IRC (Ping timeout: 370 seconds) [04:55] *** pikhq_ has joined #archiveteam-bs [04:56] *** Aranje has quit IRC (Quit: Three sheets to the wind) [04:59] *** pikhq has quit IRC (Read error: Operation timed out) [06:18] *** schbirid has joined #archiveteam-bs [06:44] *** GE has joined #archiveteam-bs [07:18] *** trs80 has quit IRC (Ping timeout: 190 seconds) [07:29] *** BlueMaxim has quit IRC (Read error: Operation timed out) [07:50] *** Kksmkrn has quit IRC (Ping timeout: 250 seconds) [07:51] *** Kksmkrn has joined #archiveteam-bs [08:10] *** ravetcofx has quit IRC (Ping timeout: 244 seconds) [08:29] iso9660 is a curious format [09:11] https://gist.github.com/joepie91/ddbf10bbee587191e427bee6d5e4242f \o/ [09:21] *** Arkiver2 is now known as arkiver [09:26] *** BlueMaxim has joined #archiveteam-bs [09:54] suddenly, the ability to read ISO metadata over HTTP without downloading the entire ISO: https://gist.github.com/joepie91/ddbf10bbee587191e427bee6d5e4242f [09:57] *** brayden has joined #archiveteam-bs [09:57] *** swebb sets mode: +o brayden [10:15] *** BlueMaxim has quit IRC (Quit: Leaving) [10:31] *** robink has quit IRC (Ping timeout: 246 seconds) [10:52] *** robink has joined #archiveteam-bs [10:59] *** atrocity has quit IRC (Read error: Connection reset by peer) [11:44] *** atrocity has joined #archiveteam-bs [12:00] *** kristian_ has joined #archiveteam-bs [12:03] joepie91: that's very neat, are you planning in releasing it? [12:10] *** Shakespea has joined #archiveteam-bs [12:10] Afternoon [12:10] Is there a formal process for suggestings sites be archived? [12:11] (as indicated the other day I can't propose stuff on the Wiki) [12:14] My next recomendation would have been - http://www.hvsc.de/ [12:15] (which seems to ffrom time to to time have server issues) [12:15] luckcolor: naturally :) [12:15] Shakespea: generally speaking, small stuff goes into archivebot [12:15] Shakespea: how big is that site? [12:16] luckcolor: I'll probably be releasing it in a few parts... 1) a sort-of-spec for seekable resources (which is the pluggable backend thing that lets me do the over-HTTP thing), 2) the iso9660 parsing library (which suipports any seekable resource), and 3) a spider that indexes all ISOs in IA's CD-ROM collection [12:17] luckcolor: interesting tidbit: theoretically it's possible to add a torrent backend as well, relatively easily, using torrent-stream... [12:17] joepie91: in terms of 'visible' only about halff the size of a CD-ROM , but I'm not sure what else is archived away [12:18] oh, should be easily possible then [12:18] hold on [12:18] eh, maybe not [12:18] I count under 200MB as small [12:18] 200MB to 1GB as moderate [12:18] and anything over 1GB as large [12:19] goddamnit [12:19] JS crap [12:19] Anything over 40GB I count as insanely huge :0 [12:19] Shakespea: anything <10GB is tiny for archivebot purposes [12:19] :p [12:19] anyway, the JS is a problem [12:19] archivebot will choke on this [12:19] The site is using JS links? [12:19] Bother [12:19] yep [12:20] hm [12:20] okay, seems it's progressively enhanced actually [12:20] Looks like I'll have to manually save copies in Wayback then [12:20] so it might work [12:20] let [12:20] let's have a try... * [12:20] Shakespea: see http://dashboard.at.ninjawedding.org/ [12:20] yeah, seems to work [12:21] ( The parent site of c64.org also has issues, but that site is INASANEly massive) [12:21] Shakespea: how massive is massive? [12:21] Over 10GB if you include all the media I think [12:22] :P [12:22] meh, that's small by our metrics :P [12:22] sites of several hundred GB are not unusual [12:22] our current main project is 200 to 300 TB ;) [12:22] arkiver: well yeah, but that's not archivebot [12:22] I'm just talking about archivebot [12:22] :p [12:22] ah right [12:22] arkiver: also, did you see my gist above? [12:23] * Shakespea goes back to idle [12:23] It's not so much the size of a website in bytes that might be a problem [12:23] it's more the number of pages [12:23] afaik [12:23] (it's both) [12:23] joepie91: I don't think so? [12:23] (the gist( [12:24] ) [12:24] arkiver: [11:54] suddenly, the ability to read ISO metadata over HTTP without downloading the entire ISO: https://gist.github.com/joepie91/ddbf10bbee587191e427bee6d5e4242f [12:24] more recent follow-up: https://gist.github.com/joepie91/db580d0742b7281456e5fa72dba31358 [12:24] ah, missed it [12:24] nice!! [12:25] That's going to be super handy when archiving iso's [12:27] * Shakespea revives [12:28] arkiver: Did you comment in the EU consultation on copyright reform? [12:28] (Apparently there were some groups lobbying for archives to have greater freedom to pre-cache stuff.) [12:30] no [12:31] hmm, this is weird. I'm not sure whether this is a bug in my code or just a really weird ISO: https://i.imgur.com/gwfY2Sc.png [12:31] one directory entry per 2KB sector is a bit... weird [12:32] joepie91: Copy protection? [12:32] that would be both ineffective and inefficient [12:32] :P [12:32] anyway, time to investigate [12:32] this is why I installed a hex editor beforehand, heh [12:33] Speaking of copy protection, I have an OLD CD I can';t know run because the copy protection is Windows only [12:33] (9x). Do archive team people support efforts to regain access to legally purchased content? XD [12:34] joepie91: I will also note some Dorling Kindersley CD's , had a LOT of duplicated directory structure for performance reasons [12:36] * Shakespea goes back to idling [12:37] Shakespea: so it seems like it's... both [12:37] it's a really weird ISO in that it does one sector per directory [12:37] and a directory sometimes really does have one file [12:37] ... but my code also has a bug :P [12:37] ref https://i.imgur.com/QxnAnb4.png [12:43] *** yeoldetoa has quit IRC (Quit: Lost terminal) [12:43] I don't think this is using a standard format... [12:46] Shakespea: archivebot job completed [12:50] *** PurpleSym sets mode: +o arkiver [12:53] ahhh I'm a moron [12:55] *** RichardG_ has joined #archiveteam-bs [12:59] *** RichardG has quit IRC (Read error: Operation timed out) [13:01] *** GLaDOS has quit IRC (Quit: Oh crap, I died.) [13:01] *** GLaDOS has joined #archiveteam-bs [13:55] *** trs80 has joined #archiveteam-bs [14:17] *** GE has quit IRC (Quit: zzz) [14:24] *** Shakespea has quit IRC (Quit: ChatZilla 0.9.92 [Firefox 49.0.1/20160922113459]) [14:28] *** RichardG_ has quit IRC (Read error: Operation timed out) [14:32] *** Start has quit IRC (Quit: Disconnected.) [14:46] *** BartoCH has joined #archiveteam-bs [14:47] *** Boppen has quit IRC (Ping timeout: 194 seconds) [14:47] *** Boppen has joined #archiveteam-bs [14:48] arkiver: luckcolor: success! https://gist.githubusercontent.com/joepie91/4dba508979b4207db49c7361a3b5740e/raw/b284bc056a68bd5bc05178066c77787755ed4125/.txt [14:48] I can now index ISOs on IA without ever fully downloading them [14:48] :P [15:00] luckcolor: arkiver: work so far: https://git.cryto.net/joepie91/iso-spider (ISO parsing stuff in lib/iso9660) [15:11] *** JesseW has joined #archiveteam-bs [15:45] *** brayden has quit IRC (Read error: Operation timed out) [15:56] sweeeeet [16:13] *** brayden has joined #archiveteam-bs [16:13] *** swebb sets mode: +o brayden [16:40] *** GE has joined #archiveteam-bs [17:12] *** JesseW has quit IRC (Ping timeout: 370 seconds) [17:30] *** JW_work1 has joined #archiveteam-bs [17:38] *** JW_work has quit IRC (Read error: Operation timed out) [17:42] amazing work! :P [17:42] joepie91: [17:49] *** ravetcofx has joined #archiveteam-bs [18:09] *** bwn has quit IRC (Ping timeout: 244 seconds) [18:17] *** bwn has joined #archiveteam-bs [18:24] *** Aranje has joined #archiveteam-bs [18:58] *** JW_work1 has quit IRC (Read error: Operation timed out) [19:08] *** JW_work has joined #archiveteam-bs [19:13] *** JW_work1 has joined #archiveteam-bs [19:13] *** JW_work has quit IRC (Read error: Connection reset by peer) [19:14] *** JW_work1 has quit IRC (Client Quit) [19:39] *** JW_work has joined #archiveteam-bs [19:42] *** JW_work1 has joined #archiveteam-bs [19:42] *** JW_work has quit IRC (Write error: Broken pipe) [19:43] *** JW_work has joined #archiveteam-bs [19:43] *** JW_work1 has quit IRC (Read error: Connection reset by peer) [20:48] *** ravetcofx has quit IRC (Quit: Leaving) [20:52] *** RichardG has joined #archiveteam-bs [20:59] *** schbirid has quit IRC (Quit: Leaving) [21:03] *** BartoCH has quit IRC (Quit: WeeChat 1.6) [21:04] *** robink has quit IRC (Ping timeout: 506 seconds) [21:38] *** robink has joined #archiveteam-bs [21:39] *** JW_work has quit IRC (Read error: Operation timed out) [22:09] *** JW_work has joined #archiveteam-bs [22:12] *** Kksmkrn has left [22:15] *** JW_work has quit IRC (Read error: Operation timed out) [22:21] *** JW_work has joined #archiveteam-bs [22:33] *** SN4T14 has quit IRC (Ping timeout: 260 seconds) [22:34] *** alfiepate has quit IRC (Ping timeout: 244 seconds) [22:44] *** SN4T14 has joined #archiveteam-bs [22:45] *** alfie has joined #archiveteam-bs [22:45] *** BartoCH has joined #archiveteam-bs [22:56] *** bsmith093 has quit IRC (Quit: Leaving.) [23:11] *** Start has joined #archiveteam-bs [23:24] *** GE has quit IRC (Quit: zzz)