[00:05] *** RichardG has joined #archiveteam-bs [00:33] *** JesseW has joined #archiveteam-bs [00:50] *** wednesday has joined #archiveteam-bs [01:02] !ao https://github.com/Xyl2k/TSA-Travel-Sentry-master-keys [01:02] Oh, looks like I lost my voice. [01:03] wrong channel anomie [01:04] Oops. [01:04] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [01:04] Do we have a way to archive git repositories? [01:05] *** zenguy_pc has joined #archiveteam-bs [01:05] git clone --mirror https://github.com/username/repo [01:06] issues and pull requests can be done with !ao < http://somepastebin/listofurls.txt [01:08] garyrh: So, I can just do the git clone in the channel? [01:08] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [01:08] no [01:08] *** zenguy_pc has joined #archiveteam-bs [01:11] You can clone on your end and upload it to the archive in a zip/tar file [01:13] a git bundle is a good option too [01:24] so i found the New America Foundation youtube channel as over 2000+ videos [01:25] Sounds fun. [01:25] Do we have a script for youtube stuff? [01:26] youtube-dl [01:27] i'm doing a slow grab of it by year or by year-month [01:27] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [01:27] Yeah I know, but I mean to get it into archive.org? [01:27] that way i can upload those videos as one item [01:28] i have my scripts [01:28] everyone else here i think uses a python internetarchive script [01:28] *** zenguy_pc has joined #archiveteam-bs [01:28] All right. [01:28] I'll go look for it. [01:30] i think this one: https://pypi.python.org/pypi/internetarchive [01:35] Thanks. [01:59] *** JesseW has quit IRC (Leaving.) [02:02] *** SimpBrain has quit IRC (Ping timeout: 369 seconds) [02:04] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [02:06] *** zenguy_pc has joined #archiveteam-bs [02:14] *** SimpBrain has joined #archiveteam-bs [02:19] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [02:20] *** zenguy_pc has joined #archiveteam-bs [02:24] *** S[h]O[r]T has quit IRC (Read error: Operation timed out) [02:24] *** yakfish has quit IRC (Read error: Operation timed out) [02:24] *** JesseW has joined #archiveteam-bs [02:25] *** S[h]O[r]T has joined #archiveteam-bs [02:26] *** primus104 has quit IRC (Leaving.) [02:27] Is there a offline feed reader that will combine multiple feeds into one chronological list? This seems like an obvious feature, but is missing from all the tools I've looked at. (I know this is OT, but, OTOH, this *is* the -bs channel) [02:27] *** yakfish has joined #archiveteam-bs [02:36] *** zenguy_pc has quit IRC (Read error: Operation timed out) [02:37] SketchCow: i have no access to archiveteam-fire collection again [02:41] *** zenguy_pc has joined #archiveteam-bs [02:50] *** vitzli has joined #archiveteam-bs [02:54] *** tsp_ has quit IRC () [03:54] *** JesseW has left [03:54] *** JesseW has joined #archiveteam-bs [03:57] *** vitzli has quit IRC (Quit: Leaving) [03:58] *** aaaaaaaaa has quit IRC (Leaving) [04:37] *** aschmitz has joined #archiveteam-bs [04:44] *** wednesday has quit IRC (Read error: Connection reset by peer) [04:45] *** wednesday has joined #archiveteam-bs [04:46] *** yakfish has quit IRC (Read error: Operation timed out) [04:47] *** toad1 has quit IRC (Read error: Operation timed out) [04:49] *** achip has quit IRC (Read error: Operation timed out) [04:50] *** sep332 has quit IRC (Read error: Operation timed out) [04:52] *** Gfy has quit IRC (Ping timeout: 364 seconds) [04:53] *** phuzion has quit IRC (Read error: Connection reset by peer) [04:54] *** useretai- has quit IRC (Ping timeout: 600 seconds) [04:55] *** phuzion has joined #archiveteam-bs [04:55] *** achip has joined #archiveteam-bs [04:55] *** yakfish has joined #archiveteam-bs [04:56] *** kvieta has quit IRC (Ping timeout: 600 seconds) [04:56] *** kvieta has joined #archiveteam-bs [04:56] *** toad1 has joined #archiveteam-bs [04:56] *** sep332 has joined #archiveteam-bs [04:56] *** useretail has joined #archiveteam-bs [05:00] *** vitzli has joined #archiveteam-bs [05:02] *** vitzli has quit IRC (Client Quit) [05:02] *** Gfy has joined #archiveteam-bs [05:03] *** vitzli has joined #archiveteam-bs [05:14] 311 'ERROR 410' errors in 2015-07-17 sitemap dump [05:26] *** wyatt8740 has quit IRC (Remote host closed the connection) [05:28] *** wyatt8740 has joined #archiveteam-bs [05:28] *** wyatt8740 has quit IRC (Remote host closed the connection) [06:37] *** JesseW has quit IRC (Read error: Operation timed out) [06:56] *** wp494 has quit IRC (Ping timeout: 483 seconds) [06:59] *** wp494 has joined #archiveteam-bs [07:05] *** i0npulse_ has quit IRC (leaving) [07:06] *** wyatt8740 has joined #archiveteam-bs [07:10] *** i0npulse has joined #archiveteam-bs [07:46] *** schbirid has joined #archiveteam-bs [07:52] *** primus104 has joined #archiveteam-bs [07:58] *** Ctrl-S has quit IRC (Ping timeout: 252 seconds) [07:58] *** JSharp has quit IRC (Ping timeout: 252 seconds) [07:58] *** _desu_ has quit IRC (Ping timeout: 252 seconds) [07:59] *** Ctrl-S has joined #archiveteam-bs [07:59] *** _desu_ has joined #archiveteam-bs [08:00] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [08:00] *** JSharp has joined #archiveteam-bs [08:05] *** GLaDOS has joined #archiveteam-bs [08:05] *** midas sets mode: +o GLaDOS [08:28] *** SimpBrain has quit IRC (Quit: Leaving) [08:33] *** BlueMaxim has quit IRC (Quit: Leaving) [08:38] *** primus104 has quit IRC (Leaving.) [08:57] *** DFJustin has quit IRC (Ping timeout: 624 seconds) [09:04] *** vitzli has quit IRC (Quit: Leaving) [09:07] *** dashcloud has quit IRC (Read error: Operation timed out) [09:10] *** dashcloud has joined #archiveteam-bs [09:10] *** ohhdemgir has quit IRC (Remote host closed the connection) [09:13] *** SilSte has quit IRC (Remote host closed the connection) [09:27] *** SilSte has joined #archiveteam-bs [10:18] *** primus104 has joined #archiveteam-bs [10:19] *** ohhdemgir has joined #archiveteam-bs [10:39] *** wednesday has quit IRC (Ping timeout: 483 seconds) [10:54] *** vitzli has joined #archiveteam-bs [11:18] will archivebot sensibly grab github urls yet? [11:18] https://github.com/Xyl2k/TSA-Travel-Sentry-master-keys [11:23] what's wrong with git clone? [11:25] I don't want a copy [11:25] lol [11:25] I think the likelyhood of take down requests or other rubbish is high. [11:29] sure, but it's possible to make a copy and upload it to IA directly, without .warc and html files [11:42] Smiley, https://archive.org/details/TSATravelSentryMasterKeys.7z [12:04] k cool [12:07] *** PurpleSym has joined #archiveteam-bs [12:50] *** wednesday has joined #archiveteam-bs [12:59] *** primus104 has quit IRC (Leaving.) [13:34] I would like to upload TV documentary to IA - what is the best way to do it? stuff all of it into one item (I doubt that there will be new episodes) or do 1 item per 1 episode? [13:35] 1 per ep [13:35] if you provide diff qualitys then shove the same ones in one item [13:35] * Smiley guesses [13:35] if you provide a list once your done, someone might move them into a collection or something - how many is there? [13:36] 42 episodes [13:38] use some tag to identify them all [13:47] *** SimpBrain has joined #archiveteam-bs [13:50] *** PurpleSym has quit IRC (Remote host closed the connection) [13:51] *** Start has quit IRC (Quit: Disconnected.) [14:09] *** DFJustin has joined #archiveteam-bs [14:09] *** swebb sets mode: +o DFJustin [14:28] *** PurpleSym has joined #archiveteam-bs [14:47] *** robink has quit IRC (Ping timeout: 492 seconds) [15:15] *** SilSte has quit IRC (Read error: Connection reset by peer) [15:16] *** SilSte has joined #archiveteam-bs [15:21] so looks there are no sitemaps past 2015-07-27 [15:21] for medium.com [15:22] all well [15:24] If any of you are looking for a good read, I could recommend: https://subterraneanpress.com/magazine/fall_2013/the_truth_of_fact_the_truth_of_feeling_by_ted_chiang [15:25] It's a bit longer, but I'd say it's a thought provoking piece [15:26] *** primus104 has joined #archiveteam-bs [15:28] godane: what do you mean? It looks like there are some at https://medium.com/static/posts/2015.xml [15:32] ok then [15:32] my url grabs worked with urls like this: https://medium.com/static/posts/posts-2015-07-30.xml [15:33] but now its this: https://medium.com/static/posts/2015/posts-2015-07-30.xml [15:33] Ah, that would explain it [15:34] They probably changed it because that folder was getting too bit [15:34] *big [15:36] good news is posts for 2015-07-27 is the same number of urls for both [15:39] *** primus104 has quit IRC (Leaving.) [15:41] i'm getting the urls for 2015-07-28 to 2015-07-31 now [15:41] thanks [15:44] 379 'ERROR 410' errors in 2015-07-27 grab [15:58] *** JesseW has joined #archiveteam-bs [16:08] *** vitzli has quit IRC (Quit: Leaving) [16:12] *** Aranje has quit IRC (Read error: Connection reset by peer) [16:12] *** Aranje has joined #archiveteam-bs [16:16] *** Boltsie has joined #archiveteam-bs [16:24] *** JesseW has quit IRC (Read error: Operation timed out) [16:27] Boop [16:28] arkiver: It's hilarious you're asking this question, considering how many times we've been pants-punched by a place closing off [17:00] *** Aranje has quit IRC (Read error: Connection reset by peer) [17:00] *** Aranje has joined #archiveteam-bs [17:00] https://twitter.com/ChihiroDev [17:08] SketchCow: thanks for fixing my problem with archiveteam-fire collection [17:39] *** aaaaaaaaa has joined #archiveteam-bs [17:39] *** swebb sets mode: +o aaaaaaaaa [18:03] *** primus104 has joined #archiveteam-bs [18:06] *** robink has joined #archiveteam-bs [19:22] *** PurpleSym has quit IRC (Ping timeout: 483 seconds) [19:40] *** PurpleSym has joined #archiveteam-bs [19:48] *** aaaaaaaa_ has joined #archiveteam-bs [19:48] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [19:48] *** swebb sets mode: +o aaaaaaaa_ [19:53] 309 'ERROR 410' errors in 2015-08-01 grab [19:55] *** aaaaaaaa_ is now known as aaaaaaaaa [20:01] *** Start has joined #archiveteam-bs [20:02] *** SimpBrai1 has joined #archiveteam-bs [20:05] *** SimpBrain has quit IRC (Ping timeout: 258 seconds) [20:08] *** Start has quit IRC (Read error: Connection reset by peer) [20:29] *** wyatt8740 has quit IRC (Remote host closed the connection) [20:31] *** wyatt8740 has joined #archiveteam-bs [20:44] *** schbirid has quit IRC (Quit: Leaving) [20:52] *** PurpleSym has quit IRC (Remote host closed the connection) [21:36] *** aaaaaaaa_ has joined #archiveteam-bs [21:36] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [21:36] *** swebb sets mode: +o aaaaaaaa_ [21:37] *** aaaaaaaa_ is now known as aaaaaaaaa [22:26] *** SN4T14_ is now known as SN4T14 [22:39] *** chfoo has quit IRC (Quit: chfoo) [22:45] *** chfoo has joined #archiveteam-bs [23:02] *** anomie has quit IRC (Read error: Connection reset by peer) [23:06] *** dashcloud has quit IRC (Read error: Operation timed out) [23:06] *** anomie has joined #archiveteam-bs [23:09] *** dashcloud has joined #archiveteam-bs [23:09] *** Aranje has quit IRC (Read error: Connection reset by peer) [23:10] *** Aranje has joined #archiveteam-bs [23:41] *** lag3 has joined #archiveteam-bs [23:44] *** SimpBrai1 has quit IRC (Ping timeout: 258 seconds)