#archiveteam-bs 2018-09-04,Tue

↑back Search

Time Nickname Message
00:22 🔗 BlueMax has joined #archiveteam-bs
00:27 🔗 Silas has joined #archiveteam-bs
00:40 🔗 bsmith093 has quit IRC (Read error: Connection reset by peer)
00:41 🔗 bsmith093 has joined #archiveteam-bs
00:55 🔗 Silas What is the best way to download and upload youtube videos? Tubeup with youtube-dl seems to be the most convenient, but youtube-dl doesn't seem to offer support for WARCs. Wget is my preferred tool for stuff like this, but it would be more of a hassle to download and upload videos neatly. Is there any way to have youtube-dl output WARCs or tubeup to use wget?
00:58 🔗 Flashfire No clue
00:58 🔗 Flashfire That is all
01:18 🔗 moufu you could use youtube-dl with warcprox for warc output, but I don't know if it would be replayable
01:18 🔗 moufu probably better to just use tubeup
01:30 🔗 ndiddy_ has quit IRC ()
01:45 🔗 Silas Ok, thank you!
02:42 🔗 Silas has quit IRC (Quit: http://www.mibbit.com ajax IRC Client)
03:38 🔗 w0rmhole has joined #archiveteam-bs
03:41 🔗 odemg has quit IRC (Ping timeout: 260 seconds)
03:42 🔗 RichardG has joined #archiveteam-bs
03:43 🔗 RichardG_ has quit IRC (Read error: Connection reset by peer)
03:53 🔗 odemg has joined #archiveteam-bs
07:26 🔗 Sk1d has quit IRC (Read error: Operation timed out)
07:26 🔗 Sk2d has joined #archiveteam-bs
07:26 🔗 Sk2d is now known as Sk1d
08:19 🔗 schbirid has joined #archiveteam-bs
08:55 🔗 second has quit IRC (Read error: Operation timed out)
09:34 🔗 jut has quit IRC (Read error: Operation timed out)
09:42 🔗 jut has joined #archiveteam-bs
10:00 🔗 Soni has quit IRC (Ping timeout: 258 seconds)
11:29 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
12:04 🔗 Mateon1 has joined #archiveteam-bs
12:55 🔗 BlueMax has quit IRC (Quit: Leaving)
13:42 🔗 bitBaron has joined #archiveteam-bs
14:30 🔗 Vito` Does WARC even make sense for HLS/DASH/reassembled YouTube videos? Most of the time youtube-dl picks streams it has to use FFMPEG to reassemble, so even though the WARC might have a record of the download, it's not representative of the file that was generated at the end, and you wouldn't be able to assemble it from the WARC information alone, you'd still need to know whatever ffmpeg was doing.
14:42 🔗 zhongfu has quit IRC (Ping timeout: 260 seconds)
14:44 🔗 Mateon1 has quit IRC (Ping timeout: 252 seconds)
14:45 🔗 zhongfu has joined #archiveteam-bs
14:45 🔗 bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…)
14:49 🔗 Meroje Vito` you can reassemble the final file from the manifest and the parts
14:51 🔗 Mateon1 has joined #archiveteam-bs
14:58 🔗 Vito` Meroje: ffmpeg isn't further analyzing anything, it's just going on the m3u8 or whatever?
15:06 🔗 Vito` I see pywb is editing the manifest so it's just the streams you downloaded
15:09 🔗 jmtd can I ask someone to throw something into the crawler pls? https://blogs.ncl.ac.uk/compscisupport/ likely to be deleted
15:17 🔗 RichardG_ has joined #archiveteam-bs
15:18 🔗 RichardG has quit IRC (Read error: Connection reset by peer)
15:23 🔗 jmtd is now known as Jon
15:24 🔗 TC04 has joined #archiveteam-bs
15:25 🔗 TC01 has quit IRC (Ping timeout: 268 seconds)
15:38 🔗 bitBaron has joined #archiveteam-bs
15:59 🔗 fenn it would be nice to have WARCs for browsing youtube descriptions and comments in the wayback machine for an entire channel or playlist
15:59 🔗 fenn (not even downloading the video)
16:10 🔗 bitBaron has quit IRC (Quit: Bye.)
16:39 🔗 SketchCow Hi, where's ohdemgirls
17:03 🔗 wp494 has quit IRC (Ping timeout: 268 seconds)
17:04 🔗 wp494 has joined #archiveteam-bs
17:14 🔗 ndiddy has joined #archiveteam-bs
17:25 🔗 PhrackD has joined #archiveteam-bs
17:30 🔗 PhrackD Thanks, JAA. It's not clear from https://www.archiveteam.org/index.php?title=The_WARC_Ecosystem what is working and what isn't.
17:32 🔗 godane so this fixed wifi on rpi3 using wlan0 : https://www.raspberrypi.org/forums/viewtopic.php?t=177629#p1132992
17:40 🔗 JAA PhrackD: wpull and pywb work reasonably well for grabbing and displaying the archives, respectively. For wpull, you'll want either version 1.2.3 or a fork (FalconK's or mine); 2.0.1 is very unstable and hardly usable.
17:41 🔗 JAA wget works also, but it's not very customisable. With wpull, you can always write a hook script for modifying its behaviour, e.g. adding URLs manually, filtering, etc.
17:42 🔗 caff has joined #archiveteam-bs
17:45 🔗 PhrackD JAA: I did notice you had a fork that was far ahead of chfoo's.
18:17 🔗 JAA PhrackD: Not that far actually, just one commit in addition to FalconK's fixes from early last year. I have a version which has a lot of additional stuff, but it's not on GitHub (or anywhere else except for my machines) yet.
18:19 🔗 JAA I should work on that again sometime.
18:23 🔗 Pixi has quit IRC (Quit: Pixi)
18:28 🔗 Pixi has joined #archiveteam-bs
18:50 🔗 sep332 has joined #archiveteam-bs
19:15 🔗 Dark_Star has quit IRC (Ping timeout: 492 seconds)
19:15 🔗 Dark_Star has joined #archiveteam-bs
19:19 🔗 chferfa has joined #archiveteam-bs
20:46 🔗 chferfa has quit IRC ()
22:34 🔗 second has joined #archiveteam-bs
23:30 🔗 BlueMax has joined #archiveteam-bs

irclogger-viewer