[00:04] *** odemg has joined #archiveteam-bs [00:14] *** pnJay has quit IRC (Leaving) [00:33] One moment, off to destroy my systems [00:33] *** SketchCow has quit IRC (Quit: leaving) [00:48] *** SketchCow has joined #archiveteam-bs [00:48] *** swebb sets mode: +o SketchCow [01:10] *** GE has quit IRC (Remote host closed the connection) [02:18] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [02:26] *** BartoCH has joined #archiveteam-bs [02:40] *** pizzaiolo has quit IRC (Remote host closed the connection) [02:46] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [03:03] *** BlueMaxim has quit IRC (Quit: Leaving) [03:05] *** ndiddy has quit IRC () [03:16] *** BlueMaxim has joined #archiveteam-bs [03:19] *** VADemon has quit IRC (Quit: left4dead) [03:24] *** Stilett0 has quit IRC (Read error: Connection reset by peer) [03:32] *** squires has quit IRC (Ping timeout (120 seconds)) [03:38] *** BlueMaxim has quit IRC (Read error: Operation timed out) [04:01] *** Stilett0 has joined #archiveteam-bs [04:17] *** odemg2 has joined #archiveteam-bs [04:20] *** odemg has quit IRC (Read error: Operation timed out) [04:36] *** odemg has joined #archiveteam-bs [04:39] *** Stiletto has joined #archiveteam-bs [04:39] *** odemg2 has quit IRC (Read error: Operation timed out) [04:40] *** Stilett0 has quit IRC (Ping timeout: 244 seconds) [04:41] *** odemg2 has joined #archiveteam-bs [04:42] *** odemg has quit IRC (Read error: Operation timed out) [04:43] *** inittux has quit IRC (Read error: Operation timed out) [04:51] *** inittux has joined #archiveteam-bs [04:56] *** BlueMaxim has joined #archiveteam-bs [05:43] *** Sk1d has joined #archiveteam-bs [06:05] *** rocode has quit IRC (Ping timeout: 246 seconds) [06:05] *** luckcolor has quit IRC (Ping timeout: 245 seconds) [06:06] *** luckcolor has joined #archiveteam-bs [06:07] *** rocode has joined #archiveteam-bs [06:24] *** brayden has quit IRC (Read error: Connection reset by peer) [06:25] *** brayden has joined #archiveteam-bs [06:25] *** swebb sets mode: +o brayden [06:47] *** inittux has quit IRC (Read error: Operation timed out) [06:48] *** inittux has joined #archiveteam-bs [06:49] *** Stiletto has quit IRC (Read error: Operation timed out) [06:49] *** Stilett0 has joined #archiveteam-bs [07:08] *** arbin_ has quit IRC (Read error: Connection reset by peer) [07:35] *** odemg2 has quit IRC (Remote host closed the connection) [07:37] *** vitzli has joined #archiveteam-bs [07:44] SketchCow, downloading, editing and uploading _scandata.xml files works for a simple user, item's bookreader got updated immediately, thumbnail - some time later (after the derive was done) [07:55] *** w0rp has quit IRC (Read error: Connection reset by peer) [07:55] *** w0rp has joined #archiveteam-bs [07:56] *** JAA has joined #archiveteam-bs [07:58] Sanqui, SketchCow: I would recommend simp_le over Certbot. Although the latter is probably a bit easier to use (as in: just run a command, set up a cron job, and forget about it), it must be run as root and modifies the web server's configuration files. [07:59] It's also a very complex program, meaning it's a very painful task to verify that it's doing what it claims it's doing. [08:00] also an option. Personally I trust LE and EFF. [08:00] simp_le is a little bit more complicated to set up, but it's still only a few steps. It can run as any user, which needs to have sudo privileges to reload the web server. Otherwise, it can be run entirely isolated. [08:08] Yeah, I don't think that LE or EFF are doing anything funky, but I prefer having control over the process and not unnecessarily running stuff as root. [08:10] Note, the original simp_le by koba is broken and unmaintained. Here's an active fork: https://github.com/zenhack/simp_le [08:18] *** bwn has quit IRC (Read error: Operation timed out) [08:22] *** bwn has joined #archiveteam-bs [09:24] *** Jonison has joined #archiveteam-bs [09:51] *** GE has joined #archiveteam-bs [11:16] *** GE has quit IRC (Remote host closed the connection) [11:58] *** BlueMaxim has quit IRC (Read error: Operation timed out) [12:05] *** pizzaiolo has joined #archiveteam-bs [12:10] *** Stilett0 has quit IRC (Read error: Connection reset by peer) [12:39] *** bwn has quit IRC (Ping timeout: 244 seconds) [12:44] *** Stilett0 has joined #archiveteam-bs [12:45] *** Stilett0 is now known as Stiletto [12:48] *** BartoCH has joined #archiveteam-bs [12:49] *** bwn has joined #archiveteam-bs [12:57] *** GE has joined #archiveteam-bs [13:23] *** kristian_ has joined #archiveteam-bs [13:39] vitzli: I'm surprised to hear it but happy it is the case. [13:41] *** JAA has quit IRC (Ping timeout: 268 seconds) [13:42] *** JAA has joined #archiveteam-bs [14:05] *** Dahnak has quit IRC (Quit: Dahnak Quit) [14:11] *** Dahnak has joined #archiveteam-bs [14:20] *** Dahnak has quit IRC (Quit: Dahnak Quit) [14:21] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [14:24] *** Dahnak has joined #archiveteam-bs [14:58] *** Petri152 has quit IRC (Read error: Operation timed out) [15:05] *** kristian_ has quit IRC (Quit: Leaving) [15:10] *** Petri152 has joined #archiveteam-bs [15:10] *** VADemon has joined #archiveteam-bs [15:22] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [15:40] joepie91: the drupal soap is real [15:52] SketchCow: your getting a special Toys R Us catalog [15:52] from japan in 1998 [15:54] https://archive.org/details/Toys-R-Us-Japan-1998-Holiday-Catalog [16:02] FYI: Sixxs shutting down [16:02] https://www.sixxs.net/sunset/ [16:13] SketchCow: i'm still interested in any scandata.xml docs you can drop on me, btw [16:15] *** JAA has quit IRC (Quit: Page closed) [16:20] *** vitzli has quit IRC (Quit: Leaving) [16:22] *** bwn has quit IRC (Ping timeout: 960 seconds) [16:48] *** RichardG has joined #archiveteam-bs [16:57] Do we have a sanctioned way of archiving youtube channels? I continuously archive several for my own personal use with youtube-sync, but that only stores the videos, no meta-data besides title and or no comments. [16:57] Re: JAAs comment in #archiveteam about SourceFed shutting down. [17:04] Wrt youtube: What happened to videobot? [17:21] videobot supports twitter and periscope [17:21] not yet youtube [17:21] I really need to get on with adding youtube [17:21] #videobot [17:21] can archive single twitter videos, full twitter accounts, periscope videos [17:22] also hashtags [17:22] all videos will be uploaded as individual video items to the videobot collection on IA [17:29] *** JAA has joined #archiveteam-bs [18:11] *** bwn has joined #archiveteam-bs [18:16] JAA, it looks like mininova changed since I last visited it. How much data are we talking here if we grab the stuff that they are single seeder on? [18:17] *** bwn has quit IRC (Read error: Operation timed out) [18:24] *** bwn has joined #archiveteam-bs [18:29] rocode: here comes a rough estimate... [18:30] Of the ~13k music torrents, ~2k have 2+ seeders. For the Games > Windows category, a bit less than ~5k of ~43k have 2+ seeders. [18:30] As an upper estimate, let's say that 10% are seeded sufficiently, i.e. 90% would need to be archived. [18:31] The median size for Music torrents from a random page (200 torrents) is 55 MiB. [18:31] The games are much smaller it seems. [18:31] Let's say 40 MiB on average. [18:32] That would be 90% * 72k torrents * 40 MiB/torrent = 2.6 TiB [18:33] Which actually doesn't seem that big. Not sure how I ended up with the two-digit TB estimate earlier. [18:34] If 90% is single-seeded anyway, might as well grab everything for 2.9 TiB total. [18:37] *** GE has quit IRC (Remote host closed the connection) [18:38] Average size for games seems to be on the order of 3-5 MiB. [18:55] *** pnJay has joined #archiveteam-bs [18:57] *** Dark_Star has quit IRC (Ping timeout: 633 seconds) [18:58] *** Dark_Star has joined #archiveteam-bs [20:01] *** tammy_ has joined #archiveteam-bs [20:10] *** odemg has joined #archiveteam-bs [20:15] *** GE has joined #archiveteam-bs [20:33] Mininova status so far: INFO Duration: 23:24:44. Speed: 11.1 KiB/s. INFO Downloaded: 55196 files, 746.4 MiB. [20:33] Probably not going to finish in time at this rate, decreasing --wait a bit again [20:47] window merge [20:50] *** sep332 has quit IRC (Quit: konversation out) [20:54] Shit, I forgot --warc-append. :-( [20:59] *** odemg has quit IRC (Remote host closed the connection) [21:00] *** odemg has joined #archiveteam-bs [21:01] *** GE_ has joined #archiveteam-bs [21:02] *** GE has quit IRC (Ping timeout: 255 seconds) [21:02] *** GE_ is now known as GE [21:10] *** odemg has quit IRC (Remote host closed the connection) [21:10] *** odemg has joined #archiveteam-bs [21:23] *** sep332 has joined #archiveteam-bs [21:30] *** Stiletto has quit IRC (Ping timeout: 250 seconds) [21:34] *** godane has quit IRC (Read error: Operation timed out) [21:46] *** godane has joined #archiveteam-bs [22:01] *** odemg has quit IRC (Remote host closed the connection) [22:05] *** Stilett0 has joined #archiveteam-bs [22:13] *** JAA has quit IRC (Quit: Page closed) [22:31] so i think this close to what IA wants for the internet: https://github.com/lbryio/lbry [22:33] SketchCow criticized it briefly but I'd like to hear more on why they're scummy [22:33] i'm just found out about it again [22:34] i don't remember seeing it before [22:34] main website: https://lbry.io/ [22:38] ipfs does it better. [22:39] some words from a friend: "Just because blockchains are the in thing right now does not make them suited to everything." "The transfer model is rather crude - non-resumable, single-source downloads. No chunking." "It's luring people in with 'make money by publishing stuff.'" [22:42] *** odemg has joined #archiveteam-bs [22:44] *** BlueMaxim has joined #archiveteam-bs [23:06] Sanqui: obligatory: https://gist.github.com/joepie91/e49d2bdc9dfec4adc9da8a8434fd029b [23:06] also, no amount of blockchainery is going to give you assurances about data integrity [23:12] joepie91: nice, thanks [23:14] *** Dark_Star has quit IRC (Ping timeout: 245 seconds) [23:14] *** Jonison has quit IRC (Read error: Connection reset by peer) [23:15] *** BartoCH has joined #archiveteam-bs [23:17] *** GE has quit IRC (Remote host closed the connection) [23:19] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [23:26] *** Dark_Star has joined #archiveteam-bs [23:29] *** ndiddy has joined #archiveteam-bs [23:59] *** antiufo_ has joined #archiveteam-bs