#archiveteam-bs 2020-08-01,Sat

↑back Search

Time Nickname Message
00:07 🔗 trc_ has joined #archiveteam-bs
00:07 🔗 Arcorann has joined #archiveteam-bs
00:07 🔗 trc has quit IRC (Read error: Connection reset by peer)
00:08 🔗 trc__ has joined #archiveteam-bs
00:10 🔗 trc_ has quit IRC (Read error: Connection reset by peer)
02:32 🔗 Raccoon has quit IRC (Ping timeout: 265 seconds)
03:14 🔗 Meli has quit IRC (Ping timeout: 272 seconds)
03:14 🔗 sHATNER has quit IRC (Ping timeout: 272 seconds)
03:15 🔗 Meli has joined #archiveteam-bs
03:15 🔗 actually_ has quit IRC (Ping timeout: 272 seconds)
03:15 🔗 obskyr has joined #archiveteam-bs
03:16 🔗 brayden has quit IRC (Ping timeout: 272 seconds)
03:16 🔗 Laverne has quit IRC (Ping timeout: 272 seconds)
03:17 🔗 Terbium has quit IRC (Ping timeout: 272 seconds)
03:17 🔗 Terbium has joined #archiveteam-bs
03:40 🔗 HP_Archiv has joined #archiveteam-bs
03:41 🔗 qw3rty__ has joined #archiveteam-bs
03:42 🔗 ephemer0l has quit IRC (Read error: Connection reset by peer)
03:48 🔗 qw3rty_ has quit IRC (Read error: Operation timed out)
03:48 🔗 HP_Archiv has quit IRC (Quit: Leaving)
04:13 🔗 sHATNER has joined #archiveteam-bs
04:15 🔗 lennier1 Donald Trump says he's banning TikTok in the USA. From what I've read, some people doubt he has the authority to do this, so I'd expect a court battle if he follows through with an executive order. https://www.cnn.com/2020/07/31/tech/tiktok-trump-bytedance-sale/index.html
04:19 🔗 Laverne has joined #archiveteam-bs
04:19 🔗 brayden has joined #archiveteam-bs
04:55 🔗 superkuh Dictator envy.
05:45 🔗 ephemer0l has joined #archiveteam-bs
06:08 🔗 Raccoon has joined #archiveteam-bs
08:14 🔗 jshoard has joined #archiveteam-bs
08:28 🔗 Craigle has quit IRC (Quit: The Lounge - https://thelounge.chat)
08:44 🔗 BlueMaxim has joined #archiveteam-bs
08:44 🔗 BlueMax has quit IRC (Read error: Connection reset by peer)
08:45 🔗 DLoader_ has joined #archiveteam-bs
08:47 🔗 jshoard_ has joined #archiveteam-bs
08:47 🔗 jshoard has quit IRC (Read error: Connection reset by peer)
08:56 🔗 DLoader has quit IRC (Ping timeout: 745 seconds)
08:56 🔗 DLoader_ is now known as DLoader
09:02 🔗 LowLevelM From what I understand now, he is doing it for the same reason he banned huawei. To prevent the Chinese from spying on us citizens.
09:18 🔗 Craigle has joined #archiveteam-bs
10:07 🔗 endrift that's the cover story at least
10:08 🔗 endrift whether or not that's ACTUALLY why he's doing it...
10:08 🔗 endrift that's a different matter
10:11 🔗 jshoard__ has joined #archiveteam-bs
10:11 🔗 jshoard_ has quit IRC (Read error: Connection reset by peer)
10:14 🔗 LowLevelM hopefully archiveteam is not full of lefties, because if that's true, I may leave
10:15 🔗 jshoard has joined #archiveteam-bs
10:19 🔗 jshoard__ has quit IRC (Read error: Operation timed out)
10:25 🔗 jshoard has quit IRC (Read error: Operation timed out)
10:43 🔗 Kaz is that like
10:43 🔗 Kaz a threat ot?
10:52 🔗 Tugboat LowLevelM: don't worry, everyone is basically a communist
11:09 🔗 endrift Offended that I implied your fuehrer-wannabe might be lying about yet another thing?
11:10 🔗 endrift If that is a thorn enough in your thin skin to get you to leave, then that's fine by me
11:28 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
12:40 🔗 kiska has joined #archiveteam-bs
12:40 🔗 kiska2 has joined #archiveteam-bs
12:40 🔗 kiska2 has quit IRC (Client Quit)
12:40 🔗 kiska has quit IRC (Client Quit)
12:41 🔗 kiska has joined #archiveteam-bs
12:41 🔗 kiska2 has joined #archiveteam-bs
12:48 🔗 LowLevelM has quit IRC (The Lounge - https://thelounge.chat)
13:39 🔗 trc_ has joined #archiveteam-bs
13:40 🔗 trc__ has quit IRC (Read error: Connection reset by peer)
13:43 🔗 Nikchemny has joined #archiveteam-bs
13:50 🔗 Nikchemny has quit IRC (Ping timeout: 252 seconds)
14:21 🔗 systwi_ has joined #archiveteam-bs
14:21 🔗 Nikchemny has joined #archiveteam-bs
14:25 🔗 Nikchemny nico_32_: Is there a progress?
14:29 🔗 systwi has quit IRC (Ping timeout: 622 seconds)
14:55 🔗 Nikchemny OpenWayback by the Library of Congress isn'y ok: https://webarchive.loc.gov/all/*/lib.ru
15:02 🔗 VADemon has joined #archiveteam-bs
15:13 🔗 Arcorann has quit IRC (Read error: Connection reset by peer)
15:40 🔗 kiska has quit IRC (The Lounge - https://thelounge.chat)
15:40 🔗 kiska has joined #archiveteam-bs
16:17 🔗 Nikchemny has quit IRC (Quit: Page closed)
16:56 🔗 trc_ has quit IRC (Quit: Goodbye)
17:01 🔗 Nikchemny has joined #archiveteam-bs
17:10 🔗 wyatt8740 has quit IRC (Read error: Operation timed out)
17:11 🔗 wyatt8740 has joined #archiveteam-bs
17:25 🔗 Larsenv has quit IRC (Quit: ZNC 1.8.0 - https://znc.in)
17:27 🔗 Nikchemny nico_32_: http://wiki.laser.ru/index.php/%D0%9A%D0%B0%D1%82%D0%B0%D0%BB%D0%BE%D0%B3_wiki-%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2 - another list of Russian wikis
17:35 🔗 Larsenv has joined #archiveteam-bs
17:36 🔗 jshoard has joined #archiveteam-bs
17:47 🔗 Nikchemny has quit IRC (Quit: Page closed)
17:58 🔗 Aoede has quit IRC (Quit: ZNC - https://znc.in)
18:06 🔗 Aoede has joined #archiveteam-bs
18:41 🔗 balrog has quit IRC (Bye)
18:41 🔗 balrog has joined #archiveteam-bs
19:09 🔗 slyphic has joined #archiveteam-bs
20:10 🔗 ephemer0l has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.)
20:13 🔗 ephemer0l has joined #archiveteam-bs
21:11 🔗 SketchCow 06:14 < LowLevelM> hopefully archiveteam is not full of lefties, because if that's true, I may leave
21:11 🔗 SketchCow <smiles in marx>
21:15 🔗 SketchCow https://twitter.com/textfiles/status/1289670466399948800
21:25 🔗 jshoard_ has joined #archiveteam-bs
21:30 🔗 jshoard has quit IRC (Read error: Operation timed out)
21:44 🔗 JAA lol
21:48 🔗 SketchCow JAA you sent me a huge "we should do a thing" letter
21:48 🔗 SketchCow And I am actually at an impasse with it
21:48 🔗 SketchCow Because my standard procedure is to throw these sorts of requests at JAA
21:49 🔗 jshoard_ has quit IRC (Read error: Operation timed out)
21:50 🔗 JAA SketchCow: Hm? I don't remember sending you anything recently.
21:52 🔗 JAA On another note, Clutch is the third major(ish) game clip hosting site to shut down within less than a year after Plays.tv and Mixer. What's going on there?
21:52 🔗 JAA SketchCow: Oh, are you confusing me with jrwr again?
21:53 🔗 SketchCow This was about Tigris
21:53 🔗 JAA Ah, that.
21:53 🔗 SketchCow Not THIS time!
21:53 🔗 JAA Heh :-)
21:53 🔗 SketchCow Anyway, it's easier now
21:53 🔗 SketchCow jrwr is the one with the hat
21:54 🔗 JAA I mean... https://commons.wikimedia.org/wiki/File:Jason_Scott_(2017_Portrait).jpg
21:54 🔗 SketchCow Anyway, I never knew what to do there
21:54 🔗 SketchCow I mean identification for MY purposes
21:54 🔗 SketchCow https://i1.wp.com/www.safer-computing.com/wp-content/uploads/2019/03/hatchan.jpg
21:57 🔗 lennier1 Now that game streaming is such a big business, I guess it's not surprising a bunch of companies would try--and mostly fail--to compete with Twitch.
21:58 🔗 JAA Yeah, I didn't really know either to be honest. I guess I thought you might know some people (since CollabNet/SVN is quite well-known) or launch a Twitter shitstorm or something else to somehow get them to reconsider their early shutdown. In the end though, the site did return for a few days after the original shutdown date for some reason, and I believe I got virtually everything from it.
21:58 🔗 JAA Ah yes, that hat. :-)
22:01 🔗 wyatt8740 has quit IRC (Read error: Operation timed out)
22:02 🔗 JAA lennier1: Yeah, true. Plays.TV and Mixer launched in 2015/16, Clutch is apparently more recent. Just a bit strange that they fail so shortly after each other. Probably just a coincidence though.
22:02 🔗 wyatt8740 has joined #archiveteam-bs
22:02 🔗 lennier1 FWIW, fourzerofour estimated that clutch.win is only about 1TB of video. https://www.reddit.com/r/Archiveteam/comments/i1wep6/clutchwin_gameplay_videos_is_shutting_down_august/
22:04 🔗 JAA That's surprisingly small.
22:05 🔗 JAA The videos seem to be on Fastly, so that should be fast.
22:06 🔗 lennier1 Yeah, not bad at all assuming the math is right.
22:07 🔗 Jake4 That seems to be wrong? "about 180K videos" the front page "games" with clip numbers seems to add up to over 3,168,000
22:09 🔗 JAA Yeah, that seems way more realistic.
22:09 🔗 JAA Fortnite alone has 2.1M clips.
22:10 🔗 Jake4 (More around 3.8-4M based on the more games tab. with his estimate of 5mb per clip, something much bigger than a few TB)
22:11 🔗 JAA Yeah, assuming 4M clips and their numbers otherwise, that suggests ~20 TB.
22:12 🔗 JAA Still not too bad actually.
22:12 🔗 Jake4 Agreed, not too bad.
22:14 🔗 DopefishJ has quit IRC (Remote host closed the connection)
22:25 🔗 SketchCow I got a lovely contact from a group of people who did a big console save
22:25 🔗 SketchCow And they're using wayback for some of it and felt bad
22:25 🔗 SketchCow I said not to feel bad
22:38 🔗 ndiddy has joined #archiveteam-bs
22:41 🔗 DFJustin has joined #archiveteam-bs
22:52 🔗 JAA According to the API, there are 4026695 clips on Clutch currently.
22:53 🔗 Jake4 20 something TB if the original 5mb per clip is correct then?
22:54 🔗 JAA Somewhere around that, yeah.
22:55 🔗 JAA I'll gather all the clip slugs through the API.
22:56 🔗 JAA Or rather, they call them "posts".
23:09 🔗 OrIdow6 JAA: Looks like the API is fairly rich in metadata (e.g. durations and video URLs, obviously useful for estimates), so maybe get the full thing if you can
23:10 🔗 OrIdow6 Unless you're using a less detailed one than the popular list
23:11 🔗 lennier1 Is every post a video?
23:11 🔗 JAA OrIdow6: Nope, that's the API I'm using, though not the popular one.
23:11 🔗 JAA Going after recent, games list, etc.
23:11 🔗 JAA And yes, I'm getting the "entire" API, more or less.
23:12 🔗 JAA lennier1: Yeah, "post" is just the internal name for clips.
23:13 🔗 lennier1 Cool. The reddit post said there were a lot of non-video pages as well. Not sure what those are. Images? Text?
23:15 🔗 JAA Huh
23:16 🔗 JAA I haven't seen anything non-video so far at least, but I haven't gone very deep yet.
23:18 🔗 Ryz Welp, the ArchiveBot job https://clutch.win/ ( bxf3kqpjaozbxf92xsvfegjs6 ) has videos accessible and being downloaded Oo;
23:19 🔗 OrIdow6 JAA: Good
23:20 🔗 JAA Ryz: Yeah, I expected that. The video URLs are in a JSON blob in the page.
23:26 🔗 JAA Clips are available in three versions apparently: high resolution, high resolution with watermark (= "Clutch" + username), and low resolution.
23:27 🔗 JAA They call these high_quality_video_url, watermark_video_url, and video_url, respectively.
23:28 🔗 OrIdow6 For a video site, this has a very clean structure; wouldn't be surprised if it played back alright
23:30 🔗 Ryz !ig dow85s79nfu00rlg6tozid6sm ^https?://www\.start\.co\.il\:6789/
23:30 🔗 Ryz Oops
23:31 🔗 JAA Uhm... Their Fastly thing is actually an S3 bucket, and it's publicly listable. lol
23:33 🔗 OrIdow6 How did you figure that out?
23:34 🔗 JAA <magic.gif>
23:34 🔗 OrIdow6 Headers on https://ftw.global.ssl.fastly.net/media/videos/uploads/78/78b5/78b5e970f6cc3a2a73abb1081a179f454c8990f3.mp4 look like Google Cloud storage through Fastly
23:34 🔗 JAA Well yeah, maybe not AWS S3, but something S3-like.
23:35 🔗 OrIdow6 Oh
23:35 🔗 JAA https://ftw.global.ssl.fastly.net/
23:36 🔗 JAA Listing that now.
23:37 🔗 JAA Can't get the post slugs or IDs from that, I think, but at least it gives us a very good size estimate.
23:40 🔗 OrIdow6 Doesn't look like it, unless there's a databse dump or something like that hidden there
23:40 🔗 OrIdow6 Video names are just sha1 of content
23:44 🔗 JAA Right, and the internal DB IDs don't use the hash sadly.
23:44 🔗 Gallifrey has quit IRC (Read error: Connection reset by peer)
23:45 🔗 JAA Also, apparently the watermark_video_url is only added a bit after the upload.
23:45 🔗 HP_Archiv has joined #archiveteam-bs
23:46 🔗 acridAxid has joined #archiveteam-bs
23:50 🔗 Gallifrey has joined #archiveteam-bs
23:51 🔗 Gallifrey has quit IRC (Read error: Connection reset by peer)
23:51 🔗 chirlu has joined #archiveteam-bs
23:53 🔗 BlueMax has joined #archiveteam-bs
23:55 🔗 Gallifrey has joined #archiveteam-bs
23:58 🔗 JAA This will need some more work, I'll continue tomorrow.
23:59 🔗 Gallifrey has quit IRC (Read error: Connection reset by peer)

irclogger-viewer