[00:08] https://twitter.com/textfiles/status/971900134593241088 [00:08] ha HA ha [00:08] *** antomatic has quit IRC (Ping timeout: 260 seconds) [00:11] *** antomatic has joined #archiveteam-bs [00:56] *** icedice has quit IRC (Quit: Leaving) [01:08] very nice [01:11] http://money.cnn.com/1997/04/15/technology/netscape_netcaster/ [02:34] *** Mateon1 has quit IRC (Ping timeout: 250 seconds) [02:34] *** Mateon1 has joined #archiveteam-bs [02:36] *** BlueMax has joined #archiveteam-bs [02:57] *** dogsrcool has quit IRC (Quit: Ping timeout (120 seconds)) [02:58] *** dogsrcool has joined #archiveteam-bs [02:58] *** mr_archiv has quit IRC (Quit: WeeChat 1.6) [03:04] *** Ctrl-S___ has joined #archiveteam-bs [03:07] *** dogsrcool has quit IRC (Quit: Ping timeout (120 seconds)) [03:08] *** dogsrcool has joined #archiveteam-bs [03:13] *** dogsrcool has quit IRC (Client Quit) [03:14] *** dogsrcool has joined #archiveteam-bs [03:23] *** JAA sets mode: -b *!*BnARobin@*.bnaboyz.nl [03:32] *** dogsrcool has quit IRC (Quit: Ping timeout (120 seconds)) [03:33] *** dogsrcool has joined #archiveteam-bs [03:36] *** dogsrcool has quit IRC (Client Quit) [03:38] *** dogsrcool has joined #archiveteam-bs [04:08] *** qw3rty117 has joined #archiveteam-bs [04:08] *** qw3rty116 has quit IRC (Read error: Connection reset by peer) [04:12] *** dogsrcool has quit IRC (Quit: Ping timeout (120 seconds)) [04:19] *** dogsrcool has joined #archiveteam-bs [04:19] *** dogsrcool has quit IRC (Remote host closed the connection) [04:20] *** dogsrcool has joined #archiveteam-bs [04:24] *** dogsrcool has quit IRC (Client Quit) [04:24] *** dogsrcool has joined #archiveteam-bs [08:54] *** schbirid has joined #archiveteam-bs [08:54] *** odemg has quit IRC (Read error: Connection reset by peer) [09:05] *** odemg has joined #archiveteam-bs [09:11] *** schbirid has quit IRC (Leaving) [09:17] *** BlueMax has quit IRC (Read error: Connection reset by peer) [09:27] *** BlueMax has joined #archiveteam-bs [09:56] !a http://lunduke.com/ --igset blogs [09:56] oops [09:58] The "apps" section of the chrome webstore kinda shut down not too long ago, however you can still access it from chromeos devices for now. [10:15] Interesting. Is this in any way related to the upcoming shutdown of Firefox OS's Marketplace? [10:15] I don't think so [10:16] I think Mozilla is shutting down Firefox OS's Marketplace because they pretty much stopped marketing Firefox OS and probably aren't supporting it anymore. [10:21] Right. I remember some rumors about Chrome OS being discontinued/merged with Android from a few years ago, but apparently that was bullshit, and the "apps" shutdown is unrelated to that anyway. Nevermind. [10:24] By the way, if anyone wants to investigate Firefox Marketplace (it's tricky to archive), there was some discussion about that in #archivebot yesterday and I left a few related links there. [10:24] I want to look into it in more detail this weekend. [10:28] *** BlueMax has quit IRC (Quit: Leaving) [10:29] JAA: Did you see https://twitter.com/textfiles/status/971900134593241088 ? [10:31] dxrt: I did not. Sweet, thanks! [10:31] :) [11:09] *** schbirid has joined #archiveteam-bs [11:23] *** qw3rty117 has quit IRC (Ping timeout: 600 seconds) [11:27] *** qw3rty117 has joined #archiveteam-bs [14:21] *** Jonimus has joined #archiveteam-bs [15:18] *** RichardG_ has quit IRC (Read error: Connection reset by peer) [15:19] *** RichardG has joined #archiveteam-bs [16:58] *** omglolbah has quit IRC (Ping timeout: 260 seconds) [17:13] Having more stalls than usual today when uploading to the archive [17:18] *** odemg has quit IRC (Read error: Connection reset by peer) [17:34] *** Pixi` has joined #archiveteam-bs [17:34] *** Pixi has quit IRC (Ping timeout: 255 seconds) [17:39] *** odemg has joined #archiveteam-bs [19:47] *** odemg has quit IRC (Ping timeout: 252 seconds) [19:48] bithippo: If there's 720p60 and 480p available, which one will tubeup grab? [19:48] youtube-dl default for youtube is to grab the best rendition of audio and video and merge [19:48] (usually into an mkv container) [19:50] But 720p60 is only better in some senses, since it's only 60fps. [19:54] I can extend tubeup to support all renditions with an option [19:55] Would need to pass through to youtube-dl [19:57] I'm confused. what do you mean all renditions? [19:59] bithippo: also, I'm in Shkreli's Discord chat, (not for reasons people would probably assume), if that could help with anything let me know. [19:59] Thank you! [19:59] *** odemg has joined #archiveteam-bs [20:03] He apparantly hasn't said anything in it since September. [20:08] bithippo, hook54321: youtube-dl will only grab the best video and audio if ffmpeg is installed because it's otherwise unable to mux them together. If it can't find ffmpeg, it'll fall back to the best combination of video and audio already muxed together available from YouTube's servers (usually 720p, I think). [20:08] *** jschwart has joined #archiveteam-bs [20:09] 720p and 720p60 are different though [20:09] And I think it should refuse the download if you give it an explicit option for which video to grab if that requires muxing and it can't find ffmpeg. [20:09] Yep [20:09] which video/audio combination to grab* [20:10] so like, 480p might be better when looking at FPS, but 720p60 might be better when looking at resolution. [20:12] I'm pretty sure that the 480p one won't be 60 fps. Maybe 30, maybe even less (25 or 24 or 23.976 or whatever). [20:12] But yeah, generally you should go for highest resolution *and* highest framerate. [20:19] There's also the matter of mp4 vs. webm. I haven't compared the files offered by YouTube, so I don't know which is better in this case. In general, VP9 tends to perform better than AVC at the same bitrate I believe. [20:37] *** BlueMax has joined #archiveteam-bs [20:39] *** icedice has joined #archiveteam-bs [21:11] *** ranav has quit IRC (Read error: Connection reset by peer) [21:11] *** ranav has joined #archiveteam-bs [21:26] i'm starting to upload Alfajr News Newspaper [21:38] toysrusin.com servers are just weird. [21:38] Feels like they're throttling me, but the content is coming through just fine. [21:46] bithippo: Do you mean toysrusinc.com? We're grabbing that through ArchiveBot (which isn't banned on that domain, interestingly). [21:47] "[04:56:37] <@JAA> hook54321, bithippo: The Toys'R'Us jobs didn't work very well due to bans. It seems that they banned virtually all server IPs somehow." [21:47] So I started a grab locally [21:47] If it turns out not to be needed, no worries. [21:49] Right. Looks like the job for toysrusinc.com was started a few hours before I said that, and I probably missed it or something. I was mainly talking about toysrus.com and subdomains, I think. [21:49] Probably doesn't hurt to grab it twice, to be honest. Something's fishy with the grabs through ArchiveBot, so I don't fully trust those archives being clean. [21:49] the Toys 'R' Us grabs* [21:50] Cool cool. [22:14] *** RichardG has quit IRC (Read error: Connection reset by peer) [22:16] *** RichardG has joined #archiveteam-bs [22:18] *** odemg has quit IRC (Ping timeout: 255 seconds) [22:25] *** schbirid has quit IRC (Remote host closed the connection) [22:40] *** odemg has joined #archiveteam-bs [22:44] This is an error I don't see every day. [22:44] We encountered an internal error. Please try again. - nonzero exit: Catalog::get_s3_use_status('FMf5G29xCVBcx1ix','youtube-I0lnaK3aB8U'): "\nFatal error: Uncaught exception 'Exception' with message 'ERROR: failed fetch from Redis cache' in /var/cache/petabox/petabox/www/common/Catalog.inc:1411\nStack trace:\n#0 Command line code(1): Catalog::get_s3_use_status('FMf5G29xCVBcx1i...', 'youtube-I0lnaK3...')\n#1 {main}\n thrown in /var/cache/petabox/ [22:44] petabox/www/common/Catalog.inc on line 1411\n" None [23:16] *** jschwart has quit IRC (Quit: Konversation terminated!) [23:19] I've been getting a lot of Internal Server Errors from IA lately. [23:19] You're not the only one. [23:19] I'm talking like an average of 5 per day. [23:19] Was just thinking about flipping my behavior of tubeup [23:20] Instead of having it upload each file in an item separately (which there can be many, one for each subtitle language, etc). [23:20] Have tubeup create a torrent locally of all files for an item, and then make one call to IA with the torrent as the file. [23:20] My understanding is that IA will ingest the torrent lazily then [23:24] Wouldn't be a big deal, but the internetarchive python package doesn't handle 500s gracefully :/ [23:27] bithippo: I was under the impression it's generally preferred to have them in separate items. [23:27] Per item torrents. [23:28] oh [23:28] json, annotations, master rendition, subtitles, create torrent, submit torrent for item creation [23:29] http://archive.org/about/faqs.php#321 [23:30] Probably won't scale based on: "This capability is not intended as an alternative to our uploader. It merely enables the Archive to capture material already being distributed via BitTorrent." [23:56] yeah uploading via torrent is kind of a kludge and the files come in as derivatives and not proper files on the item