[00:00] *** Jens has quit IRC (Remote host closed the connection) [00:09] *** Jens has joined #archiveteam-bs [00:18] *** m_alencar has joined #archiveteam-bs [00:21] *** marceloal has quit IRC (Ping timeout: 255 seconds) [00:31] *** Mateon1 has quit IRC (Ping timeout: 250 seconds) [00:31] *** Mateon1 has joined #archiveteam-bs [00:37] *** Jens has quit IRC (Remote host closed the connection) [00:46] *** Jens has joined #archiveteam-bs [00:49] *** alencar has joined #archiveteam-bs [00:51] *** m_alencar has quit IRC (Ping timeout: 258 seconds) [00:54] *** m_alencar has joined #archiveteam-bs [00:57] *** Jens has quit IRC (Remote host closed the connection) [00:57] *** Jens has joined #archiveteam-bs [00:59] *** alencar has quit IRC (Ping timeout: 360 seconds) [01:43] *** rsznick has joined #archiveteam-bs [01:46] *** rsznik has quit IRC (Ping timeout: 252 seconds) [01:47] godane: I will instruct you how to tell the Fedex person how to address them [01:47] You don't need to fill anything out. [01:50] *** rsznik has joined #archiveteam-bs [01:50] *** rsznick has quit IRC (Ping timeout: 252 seconds) [01:53] *** BlueMax has joined #archiveteam-bs [02:01] ok [02:25] *** octothorp has joined #archiveteam-bs [02:34] *** zyphlar has joined #archiveteam-bs [02:38] *** zyphlar has quit IRC (Remote host closed the connection) [02:39] *** ItsYoda has quit IRC (Ping timeout: 260 seconds) [02:40] *** zyphlar has joined #archiveteam-bs [02:47] *** zyphlar has quit IRC (Remote host closed the connection) [02:49] *** zyphlar has joined #archiveteam-bs [03:15] *** Pixi has quit IRC (Quit: Pixi) [03:17] *** ld1 has quit IRC (Quit: ld1) [03:19] *** ItsYoda has joined #archiveteam-bs [03:20] *** Pixi has joined #archiveteam-bs [03:22] *** ld1 has joined #archiveteam-bs [03:30] *** icedice has joined #archiveteam-bs [03:31] *** icedice has quit IRC (Remote host closed the connection) [04:16] *** mabynogy has joined #archiveteam-bs [04:20] *** mabynogy has quit IRC (Read error: Connection reset by peer) [04:21] *** mabynogy has joined #archiveteam-bs [04:25] *** ItsYoda has quit IRC (Ping timeout: 260 seconds) [04:27] *** mabynogy has quit IRC (Remote host closed the connection) [04:30] *** mabynogy has joined #archiveteam-bs [04:46] *** qw3rty113 has joined #archiveteam-bs [04:47] *** ItsYoda has joined #archiveteam-bs [04:53] *** qw3rty112 has quit IRC (Read error: Operation timed out) [05:09] *** BlueMax has quit IRC (Leaving) [05:24] *** ivan has quit IRC (Ping timeout: 246 seconds) [05:35] *** ivan has joined #archiveteam-bs [05:53] *** BlueMax has joined #archiveteam-bs [05:55] *** m_alencar has quit IRC (Quit: Leaving) [06:17] *** phirephly has quit IRC (Read error: Operation timed out) [06:47] *** dan- has joined #archiveteam-bs [06:50] *** phirephly has joined #archiveteam-bs [07:59] *** octothorp has quit IRC (Remote host closed the connection) [08:01] *** octothorp has joined #archiveteam-bs [08:10] *** mabynogy has quit IRC (Quit: dpt.slasheva.com) [08:15] *** schbirid has joined #archiveteam-bs [09:40] *** BlueMax has quit IRC (Read error: Connection reset by peer) [09:58] *** BlueMax has joined #archiveteam-bs [10:34] *** REiN^ has quit IRC (Read error: Operation timed out) [11:27] *** REiN^ has joined #archiveteam-bs [11:57] *** BlueMax has quit IRC (Leaving) [13:19] *** mabynogy has joined #archiveteam-bs [13:34] *** arbin has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Atom-- has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** chazchaz has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Soni has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** slyphic has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** zino has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** unlobito has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** twigfoot has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** astrid has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** ranma_ has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** yipdw has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** mistym has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Soulflare has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** superkuh has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** odemg has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** kvieta has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Laverne has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Darkstar has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** namespace has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Yurume has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Coderjo has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** swebb has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** atlogbot has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** dxrt has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** MrRadar has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** dcmorton has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** eprillios has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Somebody2 has quit IRC (hub.efnet.us irc.servercentral.net) [13:34] *** Cameron_D has quit IRC (hub.efnet.us irc.servercentral.net) [13:38] *** Boppen has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** nyany has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Kagee has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** altlabel has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Xibalba has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** klondike has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Mateon1 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Stilett0 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Sk1d has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** antomatic has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** robogoat has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** SN4T14 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Rai-chan has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Aoede has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Gfy has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** svchfoo1 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** tsr has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** nightpool has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Dimtree has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Valentine has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** midas has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Jusque has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** yuitimoth has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** wacky has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** atomicthu has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Ing3b0rg has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** closure has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** chazchaz_ has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** REiN^ has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** qw3rty113 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** bwn has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** sep332 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** robink has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Fusl has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** c4rc4s has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** PotcFdk has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** Mayonaise has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** squires has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** PoorHomie has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** rolfoid has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** C4K3 has quit IRC (hub.efnet.us ny.us.hub) [13:38] *** beardicus has quit IRC (hub.efnet.us ny.us.hub) [13:42] *** arbin has joined #archiveteam-bs [13:42] *** Atom-- has joined #archiveteam-bs [13:42] *** chazchaz has joined #archiveteam-bs [13:42] *** Soni has joined #archiveteam-bs [13:42] *** slyphic has joined #archiveteam-bs [13:42] *** zino has joined #archiveteam-bs [13:42] *** unlobito has joined #archiveteam-bs [13:42] *** twigfoot has joined #archiveteam-bs [13:42] *** astrid has joined #archiveteam-bs [13:42] *** ranma_ has joined #archiveteam-bs [13:42] *** yipdw has joined #archiveteam-bs [13:42] *** mistym has joined #archiveteam-bs [13:42] *** Soulflare has joined #archiveteam-bs [13:42] *** superkuh has joined #archiveteam-bs [13:42] *** odemg has joined #archiveteam-bs [13:42] *** kvieta has joined #archiveteam-bs [13:42] *** Laverne has joined #archiveteam-bs [13:42] *** Darkstar has joined #archiveteam-bs [13:42] *** namespace has joined #archiveteam-bs [13:42] *** Yurume has joined #archiveteam-bs [13:42] *** Coderjo has joined #archiveteam-bs [13:42] *** atlogbot has joined #archiveteam-bs [13:42] *** swebb has joined #archiveteam-bs [13:42] *** dxrt has joined #archiveteam-bs [13:42] *** irc.servercentral.net sets mode: +ovoo astrid atlogbot swebb dxrt [13:42] *** MrRadar has joined #archiveteam-bs [13:42] *** dcmorton has joined #archiveteam-bs [13:42] *** eprillios has joined #archiveteam-bs [13:42] *** Somebody2 has joined #archiveteam-bs [13:42] *** Cameron_D has joined #archiveteam-bs [13:42] *** irc.servercentral.net sets mode: +o Somebody2 [13:42] *** Frogging sets mode: +o yipdw [13:42] *** swebb sets mode: +o brayden [13:42] *** swebb sets mode: +o SketchCow [13:42] *** swebb sets mode: +o balrog [13:42] *** swebb sets mode: +o JAA [13:42] *** swebb sets mode: +o DFJustin [13:42] *** swebb sets mode: +o Jonimus [13:50] *** Harzilein has joined #archiveteam-bs [13:50] hi [13:55] *** REiN^ has joined #archiveteam-bs [13:55] *** qw3rty113 has joined #archiveteam-bs [13:55] *** Mateon1 has joined #archiveteam-bs [13:55] *** bwn has joined #archiveteam-bs [13:55] *** sep332 has joined #archiveteam-bs [13:55] *** Dimtree has joined #archiveteam-bs [13:55] *** Valentine has joined #archiveteam-bs [13:55] *** Stilett0 has joined #archiveteam-bs [13:55] *** robink has joined #archiveteam-bs [13:55] *** Fusl has joined #archiveteam-bs [13:55] *** midas has joined #archiveteam-bs [13:55] *** c4rc4s has joined #archiveteam-bs [13:55] *** PotcFdk has joined #archiveteam-bs [13:55] *** Mayonaise has joined #archiveteam-bs [13:55] *** squires has joined #archiveteam-bs [13:55] *** PoorHomie has joined #archiveteam-bs [13:55] *** rolfoid has joined #archiveteam-bs [13:55] *** C4K3 has joined #archiveteam-bs [13:55] *** beardicus has joined #archiveteam-bs [13:55] *** Jusque has joined #archiveteam-bs [13:55] *** Boppen has joined #archiveteam-bs [13:55] *** Sk1d has joined #archiveteam-bs [13:55] *** nightpool has joined #archiveteam-bs [13:55] *** tsr has joined #archiveteam-bs [13:55] *** svchfoo1 has joined #archiveteam-bs [13:55] *** Xibalba has joined #archiveteam-bs [13:55] *** Gfy has joined #archiveteam-bs [13:55] *** Aoede has joined #archiveteam-bs [13:55] *** Rai-chan has joined #archiveteam-bs [13:55] *** altlabel has joined #archiveteam-bs [13:55] *** Kagee has joined #archiveteam-bs [13:55] *** SN4T14 has joined #archiveteam-bs [13:55] *** klondike has joined #archiveteam-bs [13:55] *** nyany has joined #archiveteam-bs [13:55] *** robogoat has joined #archiveteam-bs [13:55] *** antomatic has joined #archiveteam-bs [13:55] *** yuitimoth has joined #archiveteam-bs [13:55] *** chazchaz_ has joined #archiveteam-bs [13:55] *** closure has joined #archiveteam-bs [13:55] *** Ing3b0rg has joined #archiveteam-bs [13:55] *** atomicthu has joined #archiveteam-bs [13:55] *** wacky has joined #archiveteam-bs [13:55] *** ny.us.hub sets mode: +ooo svchfoo1 antomatic closure [13:55] *** swebb sets mode: +o antomatic [14:02] *** K4k has quit IRC (Read error: Connection reset by peer) [14:08] *** Stilett0 has quit IRC (Ping timeout: 250 seconds) [14:18] *** ranma has quit IRC (ZNC - http://znc.in) [14:18] *** ranma_ has quit IRC (Quit: Bye!) [14:46] *** Stilett0 has joined #archiveteam-bs [15:02] *** RichardG has joined #archiveteam-bs [15:58] so one tape has at least 5 hours of random VH1 recordings from maybe june 1990 [15:59] the VH1 part is going be most likely put up as one big blog [15:59] *block [15:59] before that i have about 40ish minutes of CNBC from around 1990 too [16:22] *** RichardG has quit IRC (Read error: Connection reset by peer) [16:23] *** RichardG has joined #archiveteam-bs [16:33] *** jtn2 has quit IRC (Read error: Operation timed out) [16:33] *** jtn2 has joined #archiveteam-bs [17:38] *** atrocity has joined #archiveteam-bs [18:12] *** ola_norsk has joined #archiveteam-bs [18:13] hi. Is there some common procedure to archive Youtube channels that are in imediate danger of becoming removed by 'mass-flagging' ? [18:14] i'm currently doing the (up to 720p) of 'PsychEdSubstance' videos https://archive.org/details/PsychedSubstance_YouTube_Videos_Archive_20180216 [18:17] from what i understand, the guy's already recieved 2 strikes, and a third would remove the channel. Meanwhile, by his words YouTube is not providing much help or understanding of what's going on. [18:25] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [18:27] I'm gonna take his "save me!" quite literal, since i don't personally care what he means by that. [18:27] *** schbirid has quit IRC (Ping timeout: 255 seconds) [18:28] *** K4k has joined #archiveteam-bs [18:37] *** RichardG has quit IRC (Read error: Connection reset by peer) [18:39] *** RichardG has joined #archiveteam-bs [18:40] i don't know if such a list exists, but please post youtube accounts/channels here or maybe create a page in the wiki. there should be enough ppl with some storage here to save the channels. [18:45] plue: good idea. btw, here's my shitty solution of how i'm doing at the moment https://pastebin.com/jeZ948N2 [18:45] doing it* [19:01] so i'm 23k items [19:01] i'm also digitizing tape 4 from jasons boxes [19:03] after tape 2 being fuzzy MST3K that got capture at 10k bitrate thru the full tape [19:03] geezer [19:04] i'm capturing the rest of the tapes at 6000k for video [19:05] wouldn't it be cool if there was a "record button" award? :D [19:07] similar to youtube's 'play button', and perhaps also a 'Internet Archive Yearbook' (pdf or physical) in the same manner :) [19:09] ^ [19:10] wheter or not if the awards were made out of cardboard, it would be cool i think [19:11] "Archivist of " ..etc [19:14] i did upload 449,998 items one year: https://archive.org/details/@chris85?and[]=addeddate:2016 [19:14] "Internet Archive, Most User Friendly Company of " ..etc [19:15] that company award might even be an incentive for companies to give a shit about user data.. [19:17] i'm still working on the archivebox project [19:18] what is it? [19:18] godane: i gave you a 'favorite' for your efforts :) [19:19] its meant to be a rpi box hosting kiwix wikipedia + piratebox [19:21] right now kiwix as a problem with 4gb index that crashes kiwix-serve [19:22] the hope is that it get fix in the next month then zim files can be rebuild [19:22] interesting [19:23] one of my archiving related ideas is a software nas [19:24] i got this for the start kit to build it: https://www.amazon.com/CanaKit-Raspberry-Complete-Starter-Kit/dp/B01C6Q2GSY [19:25] that case was alot better then anything else i got so far [19:25] every other case was going fall apart on me for some reason [19:30] so, interesting situation. I was reviewing my recent uploads and I think something I archived is just outright copyvio. https://archive.org/details/MSPFA_50_201802 It's basically a copy of the Sesame Street book with a few minor edits and a replaced ending. [19:32] to anyone who's using webrecorder, there's an issue that causes broken WARCS https://github.com/webrecorder/webrecorder/issues/456 [19:34] if i'm not mistaken, this issue caused my https://archive.org/details/WARC_www_ronmiscavigebook_com item to be currently broken [19:34] fuuuu. "wow, this one has a lot of youtube videos. i wonder why" (open up on live site) bwe.png bwe.png bwe.png fuck you photobucket [19:35] good to see that my 503 Slow Down handling is working though [19:47] Okay i'm going to ask again - when doing S3 uploads, how do I not make it queue a task for every single uploaded file? [19:48] there's a magic recipe for this, 1sec [19:49] from the doc: https://archive.org/help/abouts3.txt [19:49] x-archive-queue-derive:0 [19:51] i'm talking about the archive.php jobs though? [19:52] does queue-derive not make those? [19:52] queue-derive-0 rather [19:53] i'll take a screenshot of catalog.php... [19:53] what's your issue with archive.php jobs [19:54] they're properly "S3 snowballing" but my account currently has like 800 queued [19:54] i still fail to see the issue [19:54] computer will do its thing, relax [19:55] have some tea and look at trees maybe [19:57] clearly, the proper solution is to have the upload script check the task queue and tell itself to slow down, rather than waiting for a SlowDown error [19:59] i still don't understand what the issue is [19:59] snowballing is by design [19:59] It feels like I'm being a "noisy neighbor", clogging up the task queue for everyone else [19:59] nah [20:00] s3 queues an archive.php task for every PUT regardless [20:00] if an archive.php task finishes its work and sees more work waiting, it'll do that too [20:00] then the next archive.php to come along will walk in, look around, see nothing waiting for it to do, and leave [20:00] so they'll all evaporate real quick [20:01] i've had thousands of queued tasks also [20:01] i like to treat it like a game [20:01] trust the Brewster! https://ia800109.us.archive.org/10/items/bkahle_past_present_orwellian/bkahle_present.png [20:01] computer race! [20:02] Oh, well it's not really fair because my script is doing concurrent uploads instead of one file at a time. [20:02] archive.php is absolutely necessary ... i think it takes the files off the s3 server and puts them into the petabox thingy [20:03] Yeah I was thinking, could I upload multiple files, then have one archive.php job do all of them at the start [20:03] but whatever :) [20:03] computer will do computer things. it's designed to deal with your shit [20:05] I tried torrent uploads at one point but the files all get marked as derived (not original) and also I moved to a net connection that blocks torrents [20:06] I guess I'm kinda a perfectionist. the script checks for already uploaded files, but then checks that both the size and md5 match [20:07] and then reuses that md5 calculation for the Content-MD5: header [20:07] yeah the "torrent uploads are derivations" thing bugs me too [20:07] ah good, checksums <3 [20:10] btw if someone has a service-worker JS script that can serve files out of a WARC, I could be using that instead of uploading every image as its own file [20:18] and... i wouldn't even need to do url rewriting i think? and i could catch CSS stylesheet assets without writing a recursive parse across @import ? [20:19] wait no i would still need the recursive parse i just wouldn't need to rewrite the stylesheets. [20:26] *** BartoCH has joined #archiveteam-bs [20:31] *** mabynogy has quit IRC (Quit: dpt.slasheva.com) [20:58] *** ablabiX has joined #archiveteam-bs [21:00] *** Xibalba has quit IRC (Ping timeout: 480 seconds) [21:00] *** ablabiX is now known as Xibalba [21:01] *** RichardG has quit IRC (Ping timeout: 245 seconds) [21:27] *** C4K3 has quit IRC (leaving) [21:27] *** C4K3 has joined #archiveteam-bs [21:40] *** mabynogy has joined #archiveteam-bs [21:40] *** mabynogy has quit IRC (Client Quit) [21:45] *** dashcloud has joined #archiveteam-bs [21:51] *** Ravenloft has joined #archiveteam-bs [21:52] *** BlueMax has joined #archiveteam-bs [22:32] *** Mateon1 has quit IRC (Ping timeout: 250 seconds) [22:32] *** Mateon1 has joined #archiveteam-bs [22:59] SketchCow: so i'm on tape 5 now [23:15] *** RichardG has joined #archiveteam-bs [23:18] *** ola_norsk has quit IRC (I's in not shape for internat for tnight.. https://youtu.be/8MnF6tonFY4)