[00:03] Is there a reason something would have a different checksum every time that I download it? [00:08] Yes. [00:47] *** atrocity has quit IRC () [00:47] *** wrathsoff has joined #archiveteam-bs [01:40] so i think i have a 120 minutes block from november 1990 [02:15] *** WubTheCap has quit IRC (Read error: Connection reset by peer) [02:15] so that was a incomplete block [02:16] this tape maybe uploaded as a full a MTV MultiRecording 120 Minutes or something for November 1990 [02:17] these tapes a really random with recordings and alot of no full blocks [02:29] *** ItsYoda has quit IRC (Ping timeout: 260 seconds) [02:44] so tape 5 is done [02:45] is over 4 hours and is going be named : MTV Music Videos MultiRecording 1990-11 Tape [02:57] Excellent [03:02] *** ItsYoda has joined #archiveteam-bs [04:04] so this is interesting [04:04] a abc news report that was talking about video pirates in moscow [04:04] problem is i can't find it in vanderbilt tv archive [04:05] * i got the abc news report about video pirates in moscow from tape 5 [04:06] best i can say is Rick Inderfurth is in the report [04:07] there was a video pirate report with him on 1991-07-13 but it was complete different then what i found one tape [04:07] even the guy hosting the evening news was different [04:13] the guy hosting the abc evening news that night: https://imgur.com/a/pNd1V [04:39] so tape 6 is weird too [04:40] 4 minutes of tlc, then sonic on abc from 1994, now headline news [04:40] thats first 22 minutes of tape [04:42] we have a date now [04:42] its the week of march 20, 1995 [04:43] cause there was talk about the tokyo subway sarin attack [04:44] now here is hoping there is a MST3K block and not just random parts of it [04:44] cause thats what happened after headline news segment [04:46] *** qw3rty114 has joined #archiveteam-bs [04:50] *** qw3rty113 has quit IRC (Read error: Operation timed out) [05:18] *** ndiddy_ has joined #archiveteam-bs [05:19] *** ndiddy has quit IRC (Ping timeout: 252 seconds) [05:56] *** wrathsoff has quit IRC (Quit: Connection closed for inactivity) [06:04] *** RichardG has quit IRC (Ping timeout: 245 seconds) [06:06] *** RichardG has joined #archiveteam-bs [06:26] *** ranma has joined #archiveteam-bs [06:26] did this get archived? http://www.businessinsider.com/alexei-navalny-russia-corruption-video-banned-by-instagram-2018-2?r=UK&IR=T [07:38] *** dashcloud has quit IRC (Read error: Operation timed out) [08:47] *** BlueMaxim has joined #archiveteam-bs [08:53] *** BlueMax has quit IRC (Read error: Operation timed out) [09:04] *** BlueMaxim has quit IRC (Leaving) [09:28] *** mabynogy has joined #archiveteam-bs [09:31] *** mabynogy has quit IRC (Remote host closed the connection) [09:33] *** mabynogy has joined #archiveteam-bs [09:34] *** schbirid has joined #archiveteam-bs [09:41] oh little torrent tracker power goblins... i applied for the "archive team" on apollo who would get freeleech on flac in exchange for seeding them [09:41] now i am supposed to have an interview including "To prepare for the interview please have screenshots of all private trackers you are a member of currently. We will treat that information confidentially." [10:47] yea they're all retards [10:47] what's killer is that the audio tracker admins are totally inept in that field [11:04] *** schbirid has quit IRC (Quit: Leaving) [12:03] .oO( private tracker screenshots as a service ) [12:41] *** schbirid has joined #archiveteam-bs [13:05] *** godane has quit IRC (Quit: Leaving.) [13:06] *** ola_norsk has joined #archiveteam-bs [13:07] anyone know of a clever way to set the metadata:description from a textfile by using ia tool? [13:08] from e.g a README.txt etc.. [13:10] i have an item that takes forever to open the 'manage' page, so was hoping it could be done with ia [13:23] *** godane has joined #archiveteam-bs [13:26] *** ranavalon has joined #archiveteam-bs [13:32] *** Kagee has quit IRC (WeeChat 2.0.1) [13:39] *** Kagee has joined #archiveteam-bs [15:29] so i'm now at 28k items this month [15:30] ^-- Archivist Hulk [15:32] * ola_norsk sends a virtual Indiana Jones hat to godane [15:40] (i couldn't think of something more archivy at the moment) [15:40] so i'm ripping tape 7 [15:40] of 31 [15:41] this tape should be done in the next 80 minutes [15:41] its at the 4:54 mark so [15:41] most 6 hours tapes go is maybe 6:13 mark [15:45] *** atrocity has joined #archiveteam-bs [15:47] *** Specular has joined #archiveteam-bs [15:47] *** Specular has quit IRC (Client Quit) [16:39] *** zhongfu has quit IRC (Remote host closed the connection) [16:39] *** zhongfu has joined #archiveteam-bs [18:24] *** RichardG has quit IRC (Ping timeout: 250 seconds) [18:53] *** RichardG_ has joined #archiveteam-bs [19:39] *** mabynogy has quit IRC (Quit: dpt.slasheva.com) [19:40] *** RichardG_ has quit IRC (Ping timeout: 255 seconds) [19:40] *** RichardG has joined #archiveteam-bs [20:07] plue: your the one who talked yesterday about making a wikipage on how to archive youtube channels right? (good god i need to get irssi to remember things for me) [20:09] both ia and youtuble-dl is python, so there must be some smarty way to connect them [20:23] There is a tool. I think it's called tubeup. [20:23] I've never used it though. [20:25] so far i've did a shit shell command that worked kind of : youtube-dl --restrict-filenames --sleep-interval 5 --write-thumbnail --write-sub --convert-subs srt --write-info-json --write-description -f 'bestvideo[height<=768]+bestaudio/best[height<=768]' -o "%(upload_date)s-%(uploader)s-%(title)s-%(id)s-%(resolution)s.%(ext)s" --exec "ia upload PsychedSubstance_YouTube_Videos_Archive_20180216 {} [20:25] && echo '{}' >> ~/PsychedFilesDone.log && rm {}" "https://www.youtube.com/watch?v=nZ8HmFQYaYk&list=UUn8V3KNSgDr1Dai77_y8JrQ" [20:25] omg.. [20:26] * ola_norsk apologizes for breaking IRC [20:26] Nothing broke. :-) [20:26] Yeah, that works as well. [20:27] i'm sure it caused someone in Chile to recieve their email in russian [20:28] ola_norsk: yeah i remember conv from yesterday [20:29] it would've been nicer is ytdl 's {} didn't include ' ''s [20:30] i had to manually upload the thumbnails info.json and description files [20:30] *** Mateon1 has quit IRC (Ping timeout: 245 seconds) [20:30] *** Mateon1 has joined #archiveteam-bs [20:32] e.g "ia upload {}.jpg {}.info.json" didn't seem to work because of it [20:35] Did you try quoting? --exec "ia upload identifier '{}' && ..." [20:35] That would break again when there are single quotes in the filenames though. [20:36] yes i think so, problem is {} includes ' ' [20:36] Yes, but if you wrap it in quotes, that shouldn't be a problem. [20:36] Also --restrict-filenames should produce filenames without spaces. [20:37] According to the README, anyway. [20:37] so i got another tape thats just random clips of tv [20:37] aye, i had to add that because some videos had ( in them, that broke the command [20:37] video names* [20:38] Well, with proper quoting, it should really be impossible to break it. [20:39] i think i tried both ' and "'s [20:39] one sec..i'll find example [20:41] ola_norsk: What OS are you using? [20:42] linux [20:42] ia would upload it..but then rm would complain [20:42] Ok, good. There are several bug reports against youtube-dl about quoting on Windows. [20:42] That's interesting. [20:43] The echo worked? [20:43] what i noticed is that ytdl add ' ' [20:43] i think so [20:43] the problem was rm only i think [20:44] at that step, sh/bash would complain there syntax error unexpeced "(" [20:44] I don't see how it's possible that ia works but rm doesn't in the command you gave above. [20:44] The filename isn't quoted in either command. [20:46] Just checked the youtube-dl source code: it escapes the filename and wraps it in single quotes. [20:46] Then it replaces each occurrence of {} with that string. [20:47] So --exec "ia upload identifier {} && echo {} >> logfile && rm {}" should work. [20:49] Here's the relevant code, by the way: https://github.com/rg3/youtube-dl/blob/7355d55808b1a49d570f2d1f24766c5b244c5885/youtube_dl/postprocessor/execafterdownload.py#L13 [20:56] JAA: you're right, it was my shitty "echo '{}' >>" that cause it ..doh https://pastebin.com/raw/rDP0Tewc [20:56] ty [20:57] it cause a ''{}'' .. [20:57] withouth that, it seemed to work fine :/ [20:59] * ola_norsk puts egg on his face lol [21:00] To be fair, it's not documented very well as far as I can see. I had to dive into the code to figure out what was actually going on. [21:00] i was looking at all kinds of ways to get rid of it lol :D [21:01] PEBCAK error [21:07] *** ranma has quit IRC () [21:11] JAA: might the exec line be improved to handle accompanying extensions? [21:12] e.g *.description *.info.json etc [21:14] i simply did a "ia upload *" once i saw the videos were done [21:23] *** schbirid has quit IRC (Quit: Leaving) [21:29] *** BlueMax has joined #archiveteam-bs [21:29] *** ranavalon has quit IRC (Quit: Leaving) [21:30] So, regarding closed.pizza (see #archiveteam): Posts can be accessed through /posts/ID. 20 comments are included on that page, others are loaded from /posts/ID/comments, but that request needs a X-Requested-With: XMLHttpRequest header. [21:31] Similar for all sorts of other requests, it seems. [21:32] Just in case someone wants to archive this properly at some point. [21:32] I'll prepare a list of some URLs and throw it into ArchiveBot. [21:35] ola_norsk: By the way, another detail regarding --exec documentation: youtube-dl refers to find's -exec, but that replaces {} with an unescaped filename. So it's not just poor documentation but wrong. [21:35] No idea regarding those files. [21:37] ill check that tubeup thingy https://www.archiveteam.org/index.php?title=YouTube#.28Automatic.29_tubeup.py_-_Youtube_Video_IA_Archiver [21:56] *** goncalomb has joined #archiveteam-bs [21:57] *** goncalomb has quit IRC (Client Quit) [22:10] *** ranma has joined #archiveteam-bs [22:38] *** ola_norsk has quit IRC (they've all broken internet .. #MakeGopherGreatAgain https://youtu.be/3VNUyjRRjxM)