[00:02] *** bwn has quit IRC (Read error: Operation timed out) [00:07] *** Stiletto has joined #archiveteam [00:14] *** bwn has joined #archiveteam [00:45] *** JesseW has joined #archiveteam [00:47] *** Stiletto has quit IRC (Read error: Operation timed out) [01:17] *** Boppen has quit IRC (Ping timeout: 194 seconds) [01:22] *** Stiletto has joined #archiveteam [01:27] *** matthusb- has quit IRC (ZNC - http://znc.in) [01:40] *** philpem has quit IRC (Ping timeout: 260 seconds) [01:41] *** mutoso has quit IRC (Read error: Operation timed out) [01:46] *** Boppen has joined #archiveteam [01:59] *** Emcy_ has joined #archiveteam [02:03] *** Emcy_ has quit IRC (Read error: Connection reset by peer) [02:12] *** Emcy has quit IRC (Read error: Operation timed out) [02:26] *** Fake-Name has quit IRC (Read error: Operation timed out) [02:27] *** Fake-Name has joined #archiveteam [02:29] *** Boppen has quit IRC (Ping timeout: 194 seconds) [02:29] *** Emcy has joined #archiveteam [02:36] *** vitzli has joined #archiveteam [02:52] *** Boppen has joined #archiveteam [03:03] *** zino has quit IRC (Read error: Operation timed out) [03:05] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [03:06] *** godane1 has joined #archiveteam [03:11] *** godane has quit IRC (Read error: Operation timed out) [03:29] *** Boppen has quit IRC (Read error: Connection reset by peer) [03:42] Spacedog_: I think so- ccextractor might be what you're looking for [03:52] ccextractor doesn't decode the closed captions from a video stream itself -- because it's not in the portion that's digitized as video. [03:55] ccextractor decodes them from a field in the MPEG stream dedicated for representing closed captions. Some capture devices will take the analog CC data and put it in there, but some won't. [03:59] *** Boppen has joined #archiveteam [04:04] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [04:11] *** BartoCH has joined #archiveteam [04:18] tnx [04:19] seems like any tapes that'd have the info would be hard to find even now [04:19] you could probably pick up cheap pro quality VHS equipment though [04:20] it's a strange one, as it requires a combination of 1980s analogue video skills and modern signal extraction/data processing [04:21] and even then the source material is illusive [04:21] teletext was updated several times per day in it's height [04:23] there were even some real time systems connected to the phone line (secured only with a 3 digit page number) [04:24] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:35] *** Sk1d has joined #archiveteam [04:37] *** Boppen has quit IRC (Ping timeout: 194 seconds) [04:46] *** zino has joined #archiveteam [04:51] *** PaulFert1 has quit IRC (Ping timeout: 506 seconds) [05:06] *** Boppen has joined #archiveteam [05:58] Spacedog_: there was somebody doing exactly this [05:59] https://www.transdiffusion.org/2016/01/07/teletext-time-travel [06:22] "Okay, sorry for saying this, but......FUCK YOU!" who doesn't want to run a video hosting site with users like that [06:29] *** godane1 has quit IRC (Leaving.) [06:29] *** godane has joined #archiveteam [06:30] *** tfgbd_znc has joined #archiveteam [06:43] *** tfgbd_znc has quit IRC (Ping timeout: 633 seconds) [06:46] *** WinterFox has joined #archiveteam [06:56] here's a scrapped list of all the videos on zippcast: https://gist.githubusercontent.com/PressStartandSelect/b535bd22ab2ae25fd0000c9dc27da523/raw/b48b47e549b303cf6e2f38777cf39c4ce3e5b702/zippcast-scraped-videos.txt [06:56] and users: https://gist.githubusercontent.com/PressStartandSelect/0c1fe3e3513a716cfc60c331a2fb8165/raw/c4c0af88b72d3dcc446a8fc72d22c9aba8b8af8e/zippcast-scraped-users.txt [06:56] i'm going to bed now [07:00] youtube-dl can’t handle the site unfortunately. [07:03] Start i'm already archivebotting it [07:03] Can archivebot get the videos too? [07:05] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:05] No but my idea us to parse the warc meta [07:06] And get the video list [07:06] And then to feed that to archivebot again wit youtube-dl [07:06] That should work, but we’ll need a lot of concurrency to finish the grab in three days. [07:06] I already setted the concurrency to 5 [07:07] If you think i should add more let me know [07:07] I don’t know what the average video size is, unfortunately. [07:08] Dunno [07:08] Start’s list contains 80k videos. [07:08] We can Split the lists on multiple pipelines [07:09] Like 20 or 10k each [07:09] I can run 20k on my pipeline i suppose [07:09] That’s what the warrior was built for. [07:10] Yeah [07:11] I don't know if we can get someone in time to create the project [07:11] arkiver: ^ [07:12] Yeah [07:12] :p [07:14] Hm, is there a youtube-dl that creates WARCs? [07:16] youtube-dl with --external-downloader wget --external-downloader-args warc-flags-here I think? [07:21] *** arkiver3 has joined #archiveteam [07:27] *** schbirid has joined #archiveteam [07:56] *** Boppen has quit IRC (Read error: Connection reset by peer) [07:58] *** bwn has quit IRC (Read error: Operation timed out) [07:58] *** d_rebel has quit IRC (Remote host closed the connection) [07:58] *** ivan has quit IRC (Remote host closed the connection) [07:58] *** voltagex has quit IRC (Remote host closed the connection) [07:58] *** davidar_ has quit IRC (Remote host closed the connection) [07:58] *** HCross2 has quit IRC (Remote host closed the connection) [07:58] *** deathy has quit IRC (Write error: Broken pipe) [08:00] *** jch has quit IRC (Read error: Operation timed out) [08:01] *** arkiver3 has quit IRC (Ping timeout: 244 seconds) [08:13] *** bwn has joined #archiveteam [08:27] *** Boppen has joined #archiveteam [08:28] *** Piet0r has quit IRC (Ping timeout: 244 seconds) [08:30] *** Piet0r has joined #archiveteam [08:40] *** Gfy has quit IRC (Ping timeout: 250 seconds) [08:40] *** kcaj has quit IRC (Ping timeout: 250 seconds) [08:40] *** Stiletto has quit IRC (Ping timeout: 250 seconds) [08:40] *** espes__ has quit IRC (Ping timeout: 250 seconds) [08:40] *** Jon has quit IRC (Ping timeout: 250 seconds) [08:40] *** midas has quit IRC (Ping timeout: 250 seconds) [08:40] *** xhdr has quit IRC (Ping timeout: 250 seconds) [08:40] *** Deewiant has quit IRC (Ping timeout: 250 seconds) [08:40] *** TC01_ has quit IRC (Ping timeout: 250 seconds) [08:40] *** luckcolor has quit IRC (Ping timeout: 250 seconds) [08:40] *** HCross has quit IRC (Ping timeout: 250 seconds) [08:40] *** Fletcher_ has quit IRC (Ping timeout: 250 seconds) [08:40] *** kcaj has joined #archiveteam [08:40] *** Stilett0 has joined #archiveteam [08:40] *** hawc145 has joined #archiveteam [08:40] *** Deewiant has joined #archiveteam [08:40] *** luckcolor has joined #archiveteam [08:40] *** Boppen has quit IRC (hub.se irc.du.se) [08:40] *** Sk1d has quit IRC (hub.se irc.du.se) [08:40] *** Zinob has quit IRC (hub.se irc.du.se) [08:40] *** Fletcher_ has joined #archiveteam [08:40] *** jmtd has joined #archiveteam [08:40] *** midas has joined #archiveteam [08:40] *** swebb sets mode: +o midas [08:41] *** TC01 has joined #archiveteam [08:41] *** xhdr has joined #archiveteam [08:41] *** xhdr has quit IRC (Excess Flood) [08:43] *** Gfy has joined #archiveteam [08:45] *** jonty has joined #archiveteam [08:47] *** hawc145 is now known as HCross [08:47] *** xhdr has joined #archiveteam [08:47] *** xhdr has quit IRC (Excess Flood) [08:48] *** ivan has joined #archiveteam [08:48] *** johtso has joined #archiveteam [08:51] *** deathy has joined #archiveteam [08:51] *** ariscop has quit IRC (Read error: Operation timed out) [08:52] *** TheKiwi has joined #archiveteam [08:53] pikhq: Doesn’t seem to work. youtube-dl calls ffmpeg for these videos. [08:54] *** xhdr has joined #archiveteam [08:54] *** xhdr has quit IRC (Excess Flood) [08:58] *** davidar_ has joined #archiveteam [08:59] I think you have to disable the mkv creation [09:00] (you will still need to do that for the archive.org video items though) [09:00] *** xhdr has joined #archiveteam [09:00] *** xhdr has quit IRC (Excess Flood) [09:01] (i mean to create the mkv) [09:01] *** dxrt- sets mode: +o dxrt [09:01] *** espes__ has joined #archiveteam [09:01] *** xhdr has joined #archiveteam [09:01] *** Sk1d has joined #archiveteam [09:04] *** Zinob has joined #archiveteam [09:06] *** abartov__ has joined #archiveteam [09:07] It doesn’t create a mkv. The problem seems to be related to HLS. [09:08] Can’t use an external downloader for HLS streams. [09:09] *** xhdr- has joined #archiveteam [09:09] *** xhdr- has quit IRC (Excess Flood) [09:10] *** HCross2 has joined #archiveteam [09:12] *** Sk1d has quit IRC (hub.se irc.du.se) [09:12] *** Zinob has quit IRC (hub.se irc.du.se) [09:12] *** xhdr has quit IRC (hub.se irc.du.se) [09:15] *** voltagex has joined #archiveteam [09:15] *** xhdr- has joined #archiveteam [09:15] *** xhdr- has quit IRC (Excess Flood) [09:21] *** d_rebel has joined #archiveteam [09:24] *** xhdr- has joined #archiveteam [09:24] *** xhdr- has quit IRC (Excess Flood) [09:30] *** xhdr has joined #archiveteam [09:30] *** xhdr has quit IRC (Excess Flood) [09:33] *** ariscop has joined #archiveteam [09:34] *** Boppen has joined #archiveteam [09:35] *** xhdr has joined #archiveteam [09:35] *** xhdr has quit IRC (Excess Flood) [09:35] *** Zinob has joined #archiveteam [09:36] *** xhdr has joined #archiveteam [09:36] *** xhdr has quit IRC (Excess Flood) [09:36] *** xhdr has joined #archiveteam [09:36] *** Sk1d has joined #archiveteam [09:41] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [09:41] *** Boppen has quit IRC (Ping timeout: 194 seconds) [09:41] *** Zinob has quit IRC (Ping timeout: 194 seconds) [09:41] *** xhdr has quit IRC (Ping timeout: 194 seconds) [09:46] *** xhdr has joined #archiveteam [09:46] *** xhdr has quit IRC (Excess Flood) [09:52] *** xhdr has joined #archiveteam [09:52] *** xhdr has quit IRC (Excess Flood) [09:59] *** xhdr has joined #archiveteam [09:59] *** xhdr has quit IRC (Excess Flood) [10:02] *** jonty has quit IRC (Remote host closed the connection) [10:02] *** deathy has quit IRC (Remote host closed the connection) [10:02] *** d_rebel has quit IRC (Remote host closed the connection) [10:02] *** voltagex has quit IRC (Remote host closed the connection) [10:02] *** ivan has quit IRC (Remote host closed the connection) [10:02] *** davidar_ has quit IRC (Remote host closed the connection) [10:02] *** HCross2 has quit IRC (Remote host closed the connection) [10:02] *** TheKiwi has quit IRC (Remote host closed the connection) [10:02] *** johtso has quit IRC (Remote host closed the connection) [10:02] *** abartov__ has quit IRC (Remote host closed the connection) [10:02] *** Atluxity has quit IRC (Ping timeout: 260 seconds) [10:04] *** Famicoman has quit IRC (Ping timeout: 260 seconds) [10:05] *** xhdr has joined #archiveteam [10:05] *** xhdr has quit IRC (Excess Flood) [10:05] *** PotcFdk has quit IRC (Ping timeout: 506 seconds) [10:08] *** jonty has joined #archiveteam [10:08] *** ivan has joined #archiveteam [10:09] *** johtso has joined #archiveteam [10:11] *** deathy has joined #archiveteam [10:12] *** TheKiwi has joined #archiveteam [10:14] *** xhdr has joined #archiveteam [10:14] *** xhdr has quit IRC (Excess Flood) [10:19] *** PotcFdk has joined #archiveteam [10:21] *** davidar_ has joined #archiveteam [10:22] *** xhdr has joined #archiveteam [10:22] *** xhdr has quit IRC (Excess Flood) [10:23] *** Atluxity has joined #archiveteam [10:23] *** swebb sets mode: +o Atluxity [10:30] *** abartov__ has joined #archiveteam [10:31] *** xhdr has joined #archiveteam [10:31] *** xhdr has quit IRC (Excess Flood) [10:34] *** HCross2 has joined #archiveteam [10:37] *** xhdr has joined #archiveteam [10:37] *** xhdr has quit IRC (Excess Flood) [10:39] *** voltagex has joined #archiveteam [10:40] *** jch has joined #archiveteam [10:41] *** Zinob has joined #archiveteam [10:42] *** xhdr has joined #archiveteam [10:42] PurlpleSym: i made a tool once wich download all the hls pieces to disk [10:42] *** Boppen has joined #archiveteam [10:42] And then you can simply play them using the m3u8 playlist [10:45] Actually i could instead of wgetting the parts [10:45] I can find the parts list to grab-site [10:47] *** r3c0d3x has quit IRC (Ping timeout: 260 seconds) [10:50] *** r3c0d3x has joined #archiveteam [10:52] *** Boppen has quit IRC (hub.se irc.du.se) [10:52] *** xhdr has quit IRC (hub.se irc.du.se) [10:52] *** Zinob has quit IRC (hub.se irc.du.se) [10:53] *I can feed [10:54] Going back to zipcast grab [10:55] i think archivebot even without youtube-dl is getting the videos [10:56] eg: http://www.zippcast.com/dash/manifest.m3u8?global=local&node=node6&uuid=1527&video=9b669df67f05ae4adde&qlimit=720p&sysv=2 [10:56] *** d_rebel has joined #archiveteam [10:59] (ofc not the dash ones) [11:12] *** xhdr has joined #archiveteam [11:12] *** xhdr has quit IRC (Excess Flood) [11:12] *** ndiddy has quit IRC (Read error: Connection reset by peer) [11:15] *** xhdr has joined #archiveteam [11:15] *** Sk1d has joined #archiveteam [11:15] *** Zinob has joined #archiveteam [11:15] *** Boppen has joined #archiveteam [11:19] *** Boppen has quit IRC (Ping timeout: 194 seconds) [11:20] *** Zinob has quit IRC (Ping timeout: 194 seconds) [11:20] *** xhdr has quit IRC (Ping timeout: 194 seconds) [11:28] *** Sk1d has quit IRC (hub.se irc.du.se) [11:38] *** VADemon has joined #archiveteam [11:45] *** arkiver3 has joined #archiveteam [11:50] *** arkiver3 has quit IRC (Ping timeout: 244 seconds) [11:59] *** closure has quit IRC (Ping timeout: 260 seconds) [12:03] *** arkiver3 has joined #archiveteam [12:05] *** xhdr has joined #archiveteam [12:05] *** xhdr has quit IRC (Excess Flood) [12:09] *** arkiver3 has quit IRC (Ping timeout: 244 seconds) [12:10] *** xhdr has joined #archiveteam [12:10] *** xhdr has quit IRC (Excess Flood) [12:10] *** arkiver3 has joined #archiveteam [12:14] *** xhdr has joined #archiveteam [12:14] *** xhdr has quit IRC (Excess Flood) [12:17] arkiver3, did you look at the grab-site issue from last night? [12:19] *** xhdr has joined #archiveteam [12:19] *** xhdr has quit IRC (Excess Flood) [12:21] *** arkiver3 has quit IRC (Ping timeout: 244 seconds) [12:22] *** xhdr has joined #archiveteam [12:22] *** xhdr has quit IRC (Excess Flood) [12:22] *** xhdr has joined #archiveteam [12:22] *** xhdr has quit IRC (Excess Flood) [12:29] *** xhdr has joined #archiveteam [12:29] *** xhdr has quit IRC (Excess Flood) [12:31] *** VADemon has quit IRC (Read error: Connection reset by peer) [12:33] *** xhdr has joined #archiveteam [12:33] *** xhdr has quit IRC (Excess Flood) [12:38] *** xhdr has joined #archiveteam [12:38] *** xhdr has quit IRC (Excess Flood) [12:42] *** xhdr has joined #archiveteam [12:42] *** xhdr has quit IRC (Excess Flood) [12:49] *** xhdr has joined #archiveteam [12:49] *** xhdr has quit IRC (Excess Flood) [12:53] *** xhdr has joined #archiveteam [12:53] *** xhdr has quit IRC (Excess Flood) [12:57] *** Sk1d has joined #archiveteam [12:58] *** xhdr has joined #archiveteam [12:58] *** xhdr has quit IRC (Excess Flood) [13:02] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [13:04] *** xhdr has joined #archiveteam [13:04] *** xhdr has quit IRC (Excess Flood) [13:09] *** xhdr has joined #archiveteam [13:09] *** xhdr has quit IRC (Excess Flood) [13:13] *** xhdr has joined #archiveteam [13:13] *** xhdr has quit IRC (Excess Flood) [13:18] *** xhdr has joined #archiveteam [13:18] *** xhdr has quit IRC (Excess Flood) [13:18] *** tfgbd_znc has joined #archiveteam [13:19] *** tfgbd_znc has quit IRC (Client Quit) [13:20] *** tfgbd_znc has joined #archiveteam [13:22] *** xhdr has joined #archiveteam [13:22] *** xhdr has quit IRC (Excess Flood) [13:28] *** Boppen has joined #archiveteam [13:29] *** xhdr has joined #archiveteam [13:29] *** xhdr has quit IRC (Excess Flood) [13:33] *** xhdr has joined #archiveteam [13:33] *** xhdr has quit IRC (Excess Flood) [13:33] *** Boppen has quit IRC (Ping timeout: 194 seconds) [13:38] *** xhdr has joined #archiveteam [13:38] *** xhdr has quit IRC (Excess Flood) [13:39] New project! [13:39] oof, zippcast is shutting down by 06/05/2016 [13:39] we won't use youtube-dl [13:39] HCross: not yet, zippcast is highest priority at the moment [13:40] *** vitzli has quit IRC (Quit: Leaving) [13:41] Start: thanks! [13:42] *** xhdr has joined #archiveteam [13:42] *** xhdr has quit IRC (Excess Flood) [13:45] arkiver: zippcast is currently getting archivebotted too [13:45] Anything we can help you with, arkiver ? [13:45] yeah :P [13:46] is archivebot saving the videos correctly? [13:46] no [13:46] ok [13:46] it saves only a few [13:46] We'll get the videos [13:46] probably the ones it can figure out a link [13:46] like mp4 [13:46] for instance dash manifest and so on aren relly getting downloaded [13:47] *** xhdr has joined #archiveteam [13:47] *** xhdr has quit IRC (Excess Flood) [13:47] also i settede concurrency 7 on that job an it seems like it only has 3 [13:47] *setted [13:49] Do you have an example of a zippcast video with mp4 video? [13:51] chfoo: can you please create a target on FOS for zippcast? [13:51] so i have the dash manifest one here: [13:51] ihttp://www.zippcast.com/dash/manifest.m3u8?global=local&node=node6&uuid=1527&video=9b669df67f05ae4adde&qlimit=720p&sysv=2 [13:52] i'll look the logs [13:52] http://node6.zippcast.com/files_flv/user29740/a0b468d059da3ff8114/mobile/a0b468d059da3ff8114.mp4 [13:52] yeah, I know [13:52] (about the m3u8) [13:52] ok [13:52] so look at the second link [13:52] yes [13:53] video aren't too hard to grab [13:53] Will have a grab running soon [13:53] ok [13:53] will get as much concurrency :P [13:53] *** xhdr has joined #archiveteam [13:53] *** xhdr has quit IRC (Excess Flood) [13:54] this site is doing a horrible job of streaming the videos [13:55] looks like a loop, same videoparts are downloaded over an over again [13:57] that's probably also why it's closing [13:57] i suppose [14:00] *** xhdr has joined #archiveteam [14:00] *** xhdr has quit IRC (Excess Flood) [14:02] *** Boppen has joined #archiveteam [14:02] *** xhdr has joined #archiveteam [14:07] *** BlueMaxim has quit IRC (Quit: Leaving) [14:07] *** xhdr- has joined #archiveteam [14:07] *** xhdr- has quit IRC (Excess Flood) [14:13] *** xhdr has quit IRC (hub.se irc.du.se) [14:13] *** Boppen has quit IRC (hub.se irc.du.se) [14:14] *** WinterFox has quit IRC (Remote host closed the connection) [14:14] *** xhdr- has joined #archiveteam [14:14] *** xhdr- has quit IRC (Excess Flood) [14:20] *** xhdr- has joined #archiveteam [14:20] *** xhdr- has quit IRC (Excess Flood) [14:23] *** Famicoman has joined #archiveteam [14:27] *** xhdr- has joined #archiveteam [14:27] *** xhdr- has quit IRC (Excess Flood) [14:28] *** philpem has joined #archiveteam [14:33] *** xhdr has joined #archiveteam [14:33] *** xhdr has quit IRC (Excess Flood) [14:37] *** Boppen has joined #archiveteam [14:37] *** Start has quit IRC (Quit: Disconnected.) [14:38] *** xhdr has joined #archiveteam [14:38] *** xhdr has quit IRC (Excess Flood) [14:38] *** Start has joined #archiveteam [14:44] *** xhdr has joined #archiveteam [14:45] *** Boppen has quit IRC (Ping timeout: 194 seconds) [14:48] *** Start has quit IRC (Quit: Disconnected.) [15:08] *** Boppen has joined #archiveteam [15:08] *** Sk1d has joined #archiveteam [15:20] *** Sk1d has quit IRC (hub.se irc.du.se) [15:20] *** Boppen has quit IRC (hub.se irc.du.se) [15:22] *** JesseW has joined #archiveteam [15:38] arkiver, ok done [15:48] *** JesseW has quit IRC (Ping timeout: 370 seconds) [15:59] arkiver: I meant wget-lua, so I can't run any scripts manually until its sorted [16:05] HCross: do you have problems compiling wget-lua? [16:05] I had to manually do that [16:06] wiki-grab is downloading LATEST but expecting the previous version [16:06] wget-lua should totally get into some apt repo [16:06] as an official package [16:07] with official i mean no PPA :) [16:07] atleast debian an ubuntu [16:07] *and [16:09] apparently grabs are using different versions because there is differences [16:10] really? [16:10] i always use latest [16:11] I was advised to not modify the grab to force the use of latest [16:12] yeah [16:13] i haven't yet encountered a problem by using latest soo [16:13] * luckcolor still package entry on debian / ubuntu apt would be amazin [16:13] chfoo: can you look in the matter of doing that if you have time? [16:22] *** hive-mind has quit IRC (Ping timeout: 260 seconds) [16:28] *** hive-mind has joined #archiveteam [16:31] *** schbirid has quit IRC (Read error: Connection refused) [16:40] *** karissa__ has joined #archiveteam [16:40] *** JSharp___ has joined #archiveteam [16:40] *** sigkell_ has joined #archiveteam [16:40] *** _desu___ has joined #archiveteam [16:40] *** antonizoo has joined #archiveteam [16:40] *** Boltsie has joined #archiveteam [16:45] *** schbirid has joined #archiveteam [16:49] *** Boppen has joined #archiveteam [16:58] *** Boppen has quit IRC (Ping timeout: 194 seconds) [18:01] *** philpem has quit IRC (Ping timeout: 260 seconds) [18:13] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [18:20] *** BartoCH has joined #archiveteam [18:48] *** dashcloud has quit IRC (Read error: Operation timed out) [18:52] *** dashcloud has joined #archiveteam [18:54] has someone got the url for the zippcast github [18:55] also what channel is zippcast grab using [19:01] There’s no channel yet, signius. [19:02] ok thanks [19:03] is there any code yet ? [19:03] i cannot find it on the normal github [19:03] arkiver was onto it, but I haven’t seen script yet. [19:04] ok cheers......i will check back again in a while [19:06] *** Tomcat_ has joined #archiveteam [19:36] *** Sk1d has joined #archiveteam [19:44] *** dashcloud has quit IRC (Read error: Operation timed out) [19:47] *** dashcloud has joined #archiveteam [19:47] *** Sk1d has quit IRC (hub.se irc.du.se) [20:12] *** Sk1d has joined #archiveteam [20:20] *** ivan has quit IRC () [20:21] *** Start has joined #archiveteam [20:21] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [20:39] *** Tomcat_ has quit IRC (Remote host closed the connection) [20:43] *** Boppen has joined #archiveteam [20:44] *** Sk1d has joined #archiveteam [20:52] *** Boppen has quit IRC (Ping timeout: 194 seconds) [20:52] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [21:13] *** tfgbd_znc has quit IRC (Read error: Connection reset by peer) [21:15] *** Boppen has joined #archiveteam [21:17] *** Sk1d has joined #archiveteam [21:27] *** Sk1d has quit IRC (hub.se irc.du.se) [21:27] *** Boppen has quit IRC (hub.se irc.du.se) [21:28] *** ndiddy has joined #archiveteam [21:33] *** philpem has joined #archiveteam [21:41] *** n00b673 has joined #archiveteam [21:42] *** n00b673 has quit IRC (Client Quit) [22:13] the .mp4 videos for zippcast don't always work [22:18] HCross: a new version to bayimg is online [22:18] can you try it ut and see if the problems from yesterday are fixed? [22:19] Will do [22:19] should support the new version now [22:19] thanks [22:22] arkiver: any advice on the rsync problems I was having earlier? [22:23] Where the directory to upload was missing? [22:23] no idea at the moment [22:23] I need to take a better look at that in the weekend [22:24] OK [22:24] Thanks [22:24] I've left bayimg stopped for now [22:24] And I haven't seen the issue with any other grabs on this machine (at least that I can remember) [22:24] ok, good [22:24] arkiver, worked [22:25] might be an issue with the discovery part of the scripts [22:25] HCross: awesome. [22:27] arkiver, rsync: chgrp "/bayimg/.bayimg-16pictures_jaecfaad-20160603-222454_data.txt.rAfkoZ" (in dev) failed: Operation not permitted (1) [22:28] everything is failing [22:28] on rsync [22:28] im still getting tasks [22:35] Does someone have some rsync space for the bayimg discovery files? [22:35] It really shouldn't take too much space [22:35] its mainly LOTS of small files [22:42] bayimg is paused until we have a new target for the discovery files. [22:47] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [22:53] *** nertzy2 has quit IRC (Read error: Connection reset by peer) [22:54] *** nertzy2 has joined #archiveteam [22:54] scripts for zippcast are online! [22:54] *** BartoCH has joined #archiveteam [22:54] I'd rather not start the grab now, but wait for tomorrow, since I haven't tested this yet with a lot of items. [22:54] But since this is shuttind down within 48 hours I'm going to start it now [22:55] I guess we'll see if something goes wrong [22:55] but it should work [22:59] zippcast is started! [23:00] Please get some concurrent running as soon as possible and report any errors or weird things you see to me [23:00] We have 1 or 2 days left to get 72000 videos [23:10] scripts for zippcast are updated. [23:10] *** nertzy2 has quit IRC (Read error: Connection reset by peer) [23:10] Turns out not every videos is played using m3u8, some have f4m, will add support for that tomorrow. For now any videos that aren't streamed using m3u8 are aborted. [23:14] *** ndiddy has quit IRC (Read error: Connection reset by peer) [23:15] *** ndiddy has joined #archiveteam [23:17] *** nertzy has joined #archiveteam [23:17] *** tomwsmf-a has joined #archiveteam [23:20] I'm off for the night. If you can, please start some concurrent for zippcast. We need to do 72000+ videos within 24 to 48 hours. Scripts are at https://github.com/ArchiveTeam/zippcast-grab [23:22] should i restart zipcast with the latest scripts or let these jobs finish up? [23:22] I'd say restart it [23:22] ok [23:22] thank you :) [23:23] I requeued your items [23:24] zippcast is now the default project [23:26] *** ndiddy has quit IRC (Read error: Connection reset by peer) [23:27] woo [23:30] *** tomwsmf-a has quit IRC (Ping timeout: 258 seconds) [23:30] Concurrent being warmed up [23:32] *** Sk1d has joined #archiveteam [23:36] *** ndiddy has joined #archiveteam [23:37] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [23:56] *** tomwsmf-a has joined #archiveteam [23:57] *** jmtd has quit IRC (Read error: Operation timed out)