#archiveteam 2016-06-03,Fri

↑back Search

Time Nickname Message
00:02 πŸ”— bwn has quit IRC (Read error: Operation timed out)
00:07 πŸ”— Stiletto has joined #archiveteam
00:14 πŸ”— bwn has joined #archiveteam
00:45 πŸ”— JesseW has joined #archiveteam
00:47 πŸ”— Stiletto has quit IRC (Read error: Operation timed out)
01:17 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
01:22 πŸ”— Stiletto has joined #archiveteam
01:27 πŸ”— matthusb- has quit IRC (ZNC - http://znc.in)
01:40 πŸ”— philpem has quit IRC (Ping timeout: 260 seconds)
01:41 πŸ”— mutoso has quit IRC (Read error: Operation timed out)
01:46 πŸ”— Boppen has joined #archiveteam
01:59 πŸ”— Emcy_ has joined #archiveteam
02:03 πŸ”— Emcy_ has quit IRC (Read error: Connection reset by peer)
02:12 πŸ”— Emcy has quit IRC (Read error: Operation timed out)
02:26 πŸ”— Fake-Name has quit IRC (Read error: Operation timed out)
02:27 πŸ”— Fake-Name has joined #archiveteam
02:29 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
02:29 πŸ”— Emcy has joined #archiveteam
02:36 πŸ”— vitzli has joined #archiveteam
02:52 πŸ”— Boppen has joined #archiveteam
03:03 πŸ”— zino has quit IRC (Read error: Operation timed out)
03:05 πŸ”— tomwsmf-a has quit IRC (Read error: Operation timed out)
03:06 πŸ”— godane1 has joined #archiveteam
03:11 πŸ”— godane has quit IRC (Read error: Operation timed out)
03:29 πŸ”— Boppen has quit IRC (Read error: Connection reset by peer)
03:42 πŸ”— dashcloud Spacedog_: I think so- ccextractor might be what you're looking for
03:52 πŸ”— pikhq ccextractor doesn't decode the closed captions from a video stream itself -- because it's not in the portion that's digitized as video.
03:55 πŸ”— pikhq ccextractor decodes them from a field in the MPEG stream dedicated for representing closed captions. Some capture devices will take the analog CC data and put it in there, but some won't.
03:59 πŸ”— Boppen has joined #archiveteam
04:04 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
04:11 πŸ”— BartoCH has joined #archiveteam
04:18 πŸ”— Spacedog_ tnx
04:19 πŸ”— Spacedog_ seems like any tapes that'd have the info would be hard to find even now
04:19 πŸ”— Spacedog_ you could probably pick up cheap pro quality VHS equipment though
04:20 πŸ”— Spacedog_ it's a strange one, as it requires a combination of 1980s analogue video skills and modern signal extraction/data processing
04:21 πŸ”— Spacedog_ and even then the source material is illusive
04:21 πŸ”— Spacedog_ teletext was updated several times per day in it's height
04:23 πŸ”— Spacedog_ there were even some real time systems connected to the phone line (secured only with a 3 digit page number)
04:24 πŸ”— Sk1d has quit IRC (Ping timeout: 250 seconds)
04:35 πŸ”— Sk1d has joined #archiveteam
04:37 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
04:46 πŸ”— zino has joined #archiveteam
04:51 πŸ”— PaulFert1 has quit IRC (Ping timeout: 506 seconds)
05:06 πŸ”— Boppen has joined #archiveteam
05:58 πŸ”— DFJustin Spacedog_: there was somebody doing exactly this
05:59 πŸ”— DFJustin https://www.transdiffusion.org/2016/01/07/teletext-time-travel
06:22 πŸ”— ivan "Okay, sorry for saying this, but......FUCK YOU!" who doesn't want to run a video hosting site with users like that
06:29 πŸ”— godane1 has quit IRC (Leaving.)
06:29 πŸ”— godane has joined #archiveteam
06:30 πŸ”— tfgbd_znc has joined #archiveteam
06:43 πŸ”— tfgbd_znc has quit IRC (Ping timeout: 633 seconds)
06:46 πŸ”— WinterFox has joined #archiveteam
06:56 πŸ”— Start here's a scrapped list of all the videos on zippcast: https://gist.githubusercontent.com/PressStartandSelect/b535bd22ab2ae25fd0000c9dc27da523/raw/b48b47e549b303cf6e2f38777cf39c4ce3e5b702/zippcast-scraped-videos.txt
06:56 πŸ”— Start and users: https://gist.githubusercontent.com/PressStartandSelect/0c1fe3e3513a716cfc60c331a2fb8165/raw/c4c0af88b72d3dcc446a8fc72d22c9aba8b8af8e/zippcast-scraped-users.txt
06:56 πŸ”— Start i'm going to bed now
07:00 πŸ”— PurpleSym youtube-dl can’t handle the site unfortunately.
07:03 πŸ”— luckcolor Start i'm already archivebotting it
07:03 πŸ”— PurpleSym Can archivebot get the videos too?
07:05 πŸ”— JesseW has quit IRC (Ping timeout: 370 seconds)
07:05 πŸ”— luckcolor No but my idea us to parse the warc meta
07:06 πŸ”— luckcolor And get the video list
07:06 πŸ”— luckcolor And then to feed that to archivebot again wit youtube-dl
07:06 πŸ”— PurpleSym That should work, but we’ll need a lot of concurrency to finish the grab in three days.
07:06 πŸ”— luckcolor I already setted the concurrency to 5
07:07 πŸ”— luckcolor If you think i should add more let me know
07:07 πŸ”— PurpleSym I don’t know what the average video size is, unfortunately.
07:08 πŸ”— luckcolor Dunno
07:08 πŸ”— PurpleSym Start’s list contains 80k videos.
07:08 πŸ”— luckcolor We can Split the lists on multiple pipelines
07:09 πŸ”— luckcolor Like 20 or 10k each
07:09 πŸ”— luckcolor I can run 20k on my pipeline i suppose
07:09 πŸ”— PurpleSym That’s what the warrior was built for.
07:10 πŸ”— luckcolor Yeah
07:11 πŸ”— luckcolor I don't know if we can get someone in time to create the project
07:11 πŸ”— PurpleSym arkiver: ^
07:12 πŸ”— luckcolor Yeah
07:12 πŸ”— luckcolor :p
07:14 πŸ”— PurpleSym Hm, is there a youtube-dl that creates WARCs?
07:16 πŸ”— pikhq youtube-dl with --external-downloader wget --external-downloader-args warc-flags-here I think?
07:21 πŸ”— arkiver3 has joined #archiveteam
07:27 πŸ”— schbirid has joined #archiveteam
07:56 πŸ”— Boppen has quit IRC (Read error: Connection reset by peer)
07:58 πŸ”— bwn has quit IRC (Read error: Operation timed out)
07:58 πŸ”— d_rebel has quit IRC (Remote host closed the connection)
07:58 πŸ”— ivan has quit IRC (Remote host closed the connection)
07:58 πŸ”— voltagex has quit IRC (Remote host closed the connection)
07:58 πŸ”— davidar_ has quit IRC (Remote host closed the connection)
07:58 πŸ”— HCross2 has quit IRC (Remote host closed the connection)
07:58 πŸ”— deathy has quit IRC (Write error: Broken pipe)
08:00 πŸ”— jch has quit IRC (Read error: Operation timed out)
08:01 πŸ”— arkiver3 has quit IRC (Ping timeout: 244 seconds)
08:13 πŸ”— bwn has joined #archiveteam
08:27 πŸ”— Boppen has joined #archiveteam
08:28 πŸ”— Piet0r has quit IRC (Ping timeout: 244 seconds)
08:30 πŸ”— Piet0r has joined #archiveteam
08:40 πŸ”— Gfy has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— kcaj has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— Stiletto has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— espes__ has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— Jon has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— midas has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— xhdr has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— Deewiant has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— TC01_ has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— luckcolor has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— HCross has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— Fletcher_ has quit IRC (Ping timeout: 250 seconds)
08:40 πŸ”— kcaj has joined #archiveteam
08:40 πŸ”— Stilett0 has joined #archiveteam
08:40 πŸ”— hawc145 has joined #archiveteam
08:40 πŸ”— Deewiant has joined #archiveteam
08:40 πŸ”— luckcolor has joined #archiveteam
08:40 πŸ”— Boppen has quit IRC (hub.se irc.du.se)
08:40 πŸ”— Sk1d has quit IRC (hub.se irc.du.se)
08:40 πŸ”— Zinob has quit IRC (hub.se irc.du.se)
08:40 πŸ”— Fletcher_ has joined #archiveteam
08:40 πŸ”— jmtd has joined #archiveteam
08:40 πŸ”— midas has joined #archiveteam
08:40 πŸ”— swebb sets mode: +o midas
08:41 πŸ”— TC01 has joined #archiveteam
08:41 πŸ”— xhdr has joined #archiveteam
08:41 πŸ”— xhdr has quit IRC (Excess Flood)
08:43 πŸ”— Gfy has joined #archiveteam
08:45 πŸ”— jonty has joined #archiveteam
08:47 πŸ”— hawc145 is now known as HCross
08:47 πŸ”— xhdr has joined #archiveteam
08:47 πŸ”— xhdr has quit IRC (Excess Flood)
08:48 πŸ”— ivan has joined #archiveteam
08:48 πŸ”— johtso has joined #archiveteam
08:51 πŸ”— deathy has joined #archiveteam
08:51 πŸ”— ariscop has quit IRC (Read error: Operation timed out)
08:52 πŸ”— TheKiwi has joined #archiveteam
08:53 πŸ”— PurpleSym pikhq: Doesn’t seem to work. youtube-dl calls ffmpeg for these videos.
08:54 πŸ”— xhdr has joined #archiveteam
08:54 πŸ”— xhdr has quit IRC (Excess Flood)
08:58 πŸ”— davidar_ has joined #archiveteam
08:59 πŸ”— luckcolor I think you have to disable the mkv creation
09:00 πŸ”— luckcolor (you will still need to do that for the archive.org video items though)
09:00 πŸ”— xhdr has joined #archiveteam
09:00 πŸ”— xhdr has quit IRC (Excess Flood)
09:01 πŸ”— luckcolor (i mean to create the mkv)
09:01 πŸ”— dxrt- sets mode: +o dxrt
09:01 πŸ”— espes__ has joined #archiveteam
09:01 πŸ”— xhdr has joined #archiveteam
09:01 πŸ”— Sk1d has joined #archiveteam
09:04 πŸ”— Zinob has joined #archiveteam
09:06 πŸ”— abartov__ has joined #archiveteam
09:07 πŸ”— PurpleSym It doesn’t create a mkv. The problem seems to be related to HLS.
09:08 πŸ”— PurpleSym Can’t use an external downloader for HLS streams.
09:09 πŸ”— xhdr- has joined #archiveteam
09:09 πŸ”— xhdr- has quit IRC (Excess Flood)
09:10 πŸ”— HCross2 has joined #archiveteam
09:12 πŸ”— Sk1d has quit IRC (hub.se irc.du.se)
09:12 πŸ”— Zinob has quit IRC (hub.se irc.du.se)
09:12 πŸ”— xhdr has quit IRC (hub.se irc.du.se)
09:15 πŸ”— voltagex has joined #archiveteam
09:15 πŸ”— xhdr- has joined #archiveteam
09:15 πŸ”— xhdr- has quit IRC (Excess Flood)
09:21 πŸ”— d_rebel has joined #archiveteam
09:24 πŸ”— xhdr- has joined #archiveteam
09:24 πŸ”— xhdr- has quit IRC (Excess Flood)
09:30 πŸ”— xhdr has joined #archiveteam
09:30 πŸ”— xhdr has quit IRC (Excess Flood)
09:33 πŸ”— ariscop has joined #archiveteam
09:34 πŸ”— Boppen has joined #archiveteam
09:35 πŸ”— xhdr has joined #archiveteam
09:35 πŸ”— xhdr has quit IRC (Excess Flood)
09:35 πŸ”— Zinob has joined #archiveteam
09:36 πŸ”— xhdr has joined #archiveteam
09:36 πŸ”— xhdr has quit IRC (Excess Flood)
09:36 πŸ”— xhdr has joined #archiveteam
09:36 πŸ”— Sk1d has joined #archiveteam
09:41 πŸ”— Sk1d has quit IRC (Ping timeout: 194 seconds)
09:41 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
09:41 πŸ”— Zinob has quit IRC (Ping timeout: 194 seconds)
09:41 πŸ”— xhdr has quit IRC (Ping timeout: 194 seconds)
09:46 πŸ”— xhdr has joined #archiveteam
09:46 πŸ”— xhdr has quit IRC (Excess Flood)
09:52 πŸ”— xhdr has joined #archiveteam
09:52 πŸ”— xhdr has quit IRC (Excess Flood)
09:59 πŸ”— xhdr has joined #archiveteam
09:59 πŸ”— xhdr has quit IRC (Excess Flood)
10:02 πŸ”— jonty has quit IRC (Remote host closed the connection)
10:02 πŸ”— deathy has quit IRC (Remote host closed the connection)
10:02 πŸ”— d_rebel has quit IRC (Remote host closed the connection)
10:02 πŸ”— voltagex has quit IRC (Remote host closed the connection)
10:02 πŸ”— ivan has quit IRC (Remote host closed the connection)
10:02 πŸ”— davidar_ has quit IRC (Remote host closed the connection)
10:02 πŸ”— HCross2 has quit IRC (Remote host closed the connection)
10:02 πŸ”— TheKiwi has quit IRC (Remote host closed the connection)
10:02 πŸ”— johtso has quit IRC (Remote host closed the connection)
10:02 πŸ”— abartov__ has quit IRC (Remote host closed the connection)
10:02 πŸ”— Atluxity has quit IRC (Ping timeout: 260 seconds)
10:04 πŸ”— Famicoman has quit IRC (Ping timeout: 260 seconds)
10:05 πŸ”— xhdr has joined #archiveteam
10:05 πŸ”— xhdr has quit IRC (Excess Flood)
10:05 πŸ”— PotcFdk has quit IRC (Ping timeout: 506 seconds)
10:08 πŸ”— jonty has joined #archiveteam
10:08 πŸ”— ivan has joined #archiveteam
10:09 πŸ”— johtso has joined #archiveteam
10:11 πŸ”— deathy has joined #archiveteam
10:12 πŸ”— TheKiwi has joined #archiveteam
10:14 πŸ”— xhdr has joined #archiveteam
10:14 πŸ”— xhdr has quit IRC (Excess Flood)
10:19 πŸ”— PotcFdk has joined #archiveteam
10:21 πŸ”— davidar_ has joined #archiveteam
10:22 πŸ”— xhdr has joined #archiveteam
10:22 πŸ”— xhdr has quit IRC (Excess Flood)
10:23 πŸ”— Atluxity has joined #archiveteam
10:23 πŸ”— swebb sets mode: +o Atluxity
10:30 πŸ”— abartov__ has joined #archiveteam
10:31 πŸ”— xhdr has joined #archiveteam
10:31 πŸ”— xhdr has quit IRC (Excess Flood)
10:34 πŸ”— HCross2 has joined #archiveteam
10:37 πŸ”— xhdr has joined #archiveteam
10:37 πŸ”— xhdr has quit IRC (Excess Flood)
10:39 πŸ”— voltagex has joined #archiveteam
10:40 πŸ”— jch has joined #archiveteam
10:41 πŸ”— Zinob has joined #archiveteam
10:42 πŸ”— xhdr has joined #archiveteam
10:42 πŸ”— luckcolor PurlpleSym: i made a tool once wich download all the hls pieces to disk
10:42 πŸ”— Boppen has joined #archiveteam
10:42 πŸ”— luckcolor And then you can simply play them using the m3u8 playlist
10:45 πŸ”— luckcolor Actually i could instead of wgetting the parts
10:45 πŸ”— luckcolor I can find the parts list to grab-site
10:47 πŸ”— r3c0d3x has quit IRC (Ping timeout: 260 seconds)
10:50 πŸ”— r3c0d3x has joined #archiveteam
10:52 πŸ”— Boppen has quit IRC (hub.se irc.du.se)
10:52 πŸ”— xhdr has quit IRC (hub.se irc.du.se)
10:52 πŸ”— Zinob has quit IRC (hub.se irc.du.se)
10:53 πŸ”— luckcolor *I can feed
10:54 πŸ”— luckcolor Going back to zipcast grab
10:55 πŸ”— luckcolor i think archivebot even without youtube-dl is getting the videos
10:56 πŸ”— luckcolor eg: http://www.zippcast.com/dash/manifest.m3u8?global=local&node=node6&uuid=1527&video=9b669df67f05ae4adde&qlimit=720p&sysv=2
10:56 πŸ”— d_rebel has joined #archiveteam
10:59 πŸ”— luckcolor (ofc not the dash ones)
11:12 πŸ”— xhdr has joined #archiveteam
11:12 πŸ”— xhdr has quit IRC (Excess Flood)
11:12 πŸ”— ndiddy has quit IRC (Read error: Connection reset by peer)
11:15 πŸ”— xhdr has joined #archiveteam
11:15 πŸ”— Sk1d has joined #archiveteam
11:15 πŸ”— Zinob has joined #archiveteam
11:15 πŸ”— Boppen has joined #archiveteam
11:19 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
11:20 πŸ”— Zinob has quit IRC (Ping timeout: 194 seconds)
11:20 πŸ”— xhdr has quit IRC (Ping timeout: 194 seconds)
11:28 πŸ”— Sk1d has quit IRC (hub.se irc.du.se)
11:38 πŸ”— VADemon has joined #archiveteam
11:45 πŸ”— arkiver3 has joined #archiveteam
11:50 πŸ”— arkiver3 has quit IRC (Ping timeout: 244 seconds)
11:59 πŸ”— closure has quit IRC (Ping timeout: 260 seconds)
12:03 πŸ”— arkiver3 has joined #archiveteam
12:05 πŸ”— xhdr has joined #archiveteam
12:05 πŸ”— xhdr has quit IRC (Excess Flood)
12:09 πŸ”— arkiver3 has quit IRC (Ping timeout: 244 seconds)
12:10 πŸ”— xhdr has joined #archiveteam
12:10 πŸ”— xhdr has quit IRC (Excess Flood)
12:10 πŸ”— arkiver3 has joined #archiveteam
12:14 πŸ”— xhdr has joined #archiveteam
12:14 πŸ”— xhdr has quit IRC (Excess Flood)
12:17 πŸ”— HCross arkiver3, did you look at the grab-site issue from last night?
12:19 πŸ”— xhdr has joined #archiveteam
12:19 πŸ”— xhdr has quit IRC (Excess Flood)
12:21 πŸ”— arkiver3 has quit IRC (Ping timeout: 244 seconds)
12:22 πŸ”— xhdr has joined #archiveteam
12:22 πŸ”— xhdr has quit IRC (Excess Flood)
12:22 πŸ”— xhdr has joined #archiveteam
12:22 πŸ”— xhdr has quit IRC (Excess Flood)
12:29 πŸ”— xhdr has joined #archiveteam
12:29 πŸ”— xhdr has quit IRC (Excess Flood)
12:31 πŸ”— VADemon has quit IRC (Read error: Connection reset by peer)
12:33 πŸ”— xhdr has joined #archiveteam
12:33 πŸ”— xhdr has quit IRC (Excess Flood)
12:38 πŸ”— xhdr has joined #archiveteam
12:38 πŸ”— xhdr has quit IRC (Excess Flood)
12:42 πŸ”— xhdr has joined #archiveteam
12:42 πŸ”— xhdr has quit IRC (Excess Flood)
12:49 πŸ”— xhdr has joined #archiveteam
12:49 πŸ”— xhdr has quit IRC (Excess Flood)
12:53 πŸ”— xhdr has joined #archiveteam
12:53 πŸ”— xhdr has quit IRC (Excess Flood)
12:57 πŸ”— Sk1d has joined #archiveteam
12:58 πŸ”— xhdr has joined #archiveteam
12:58 πŸ”— xhdr has quit IRC (Excess Flood)
13:02 πŸ”— Sk1d has quit IRC (Ping timeout: 194 seconds)
13:04 πŸ”— xhdr has joined #archiveteam
13:04 πŸ”— xhdr has quit IRC (Excess Flood)
13:09 πŸ”— xhdr has joined #archiveteam
13:09 πŸ”— xhdr has quit IRC (Excess Flood)
13:13 πŸ”— xhdr has joined #archiveteam
13:13 πŸ”— xhdr has quit IRC (Excess Flood)
13:18 πŸ”— xhdr has joined #archiveteam
13:18 πŸ”— xhdr has quit IRC (Excess Flood)
13:18 πŸ”— tfgbd_znc has joined #archiveteam
13:19 πŸ”— tfgbd_znc has quit IRC (Client Quit)
13:20 πŸ”— tfgbd_znc has joined #archiveteam
13:22 πŸ”— xhdr has joined #archiveteam
13:22 πŸ”— xhdr has quit IRC (Excess Flood)
13:28 πŸ”— Boppen has joined #archiveteam
13:29 πŸ”— xhdr has joined #archiveteam
13:29 πŸ”— xhdr has quit IRC (Excess Flood)
13:33 πŸ”— xhdr has joined #archiveteam
13:33 πŸ”— xhdr has quit IRC (Excess Flood)
13:33 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
13:38 πŸ”— xhdr has joined #archiveteam
13:38 πŸ”— xhdr has quit IRC (Excess Flood)
13:39 πŸ”— arkiver New project!
13:39 πŸ”— arkiver oof, zippcast is shutting down by 06/05/2016
13:39 πŸ”— arkiver we won't use youtube-dl
13:39 πŸ”— arkiver HCross: not yet, zippcast is highest priority at the moment
13:40 πŸ”— vitzli has quit IRC (Quit: Leaving)
13:41 πŸ”— arkiver Start: thanks!
13:42 πŸ”— xhdr has joined #archiveteam
13:42 πŸ”— xhdr has quit IRC (Excess Flood)
13:45 πŸ”— luckcolor arkiver: zippcast is currently getting archivebotted too
13:45 πŸ”— PurpleSym Anything we can help you with, arkiver ?
13:45 πŸ”— luckcolor yeah :P
13:46 πŸ”— arkiver is archivebot saving the videos correctly?
13:46 πŸ”— luckcolor no
13:46 πŸ”— arkiver ok
13:46 πŸ”— luckcolor it saves only a few
13:46 πŸ”— arkiver We'll get the videos
13:46 πŸ”— luckcolor probably the ones it can figure out a link
13:46 πŸ”— luckcolor like mp4
13:46 πŸ”— luckcolor for instance dash manifest and so on aren relly getting downloaded
13:47 πŸ”— xhdr has joined #archiveteam
13:47 πŸ”— xhdr has quit IRC (Excess Flood)
13:47 πŸ”— luckcolor also i settede concurrency 7 on that job an it seems like it only has 3
13:47 πŸ”— luckcolor *setted
13:49 πŸ”— arkiver Do you have an example of a zippcast video with mp4 video?
13:51 πŸ”— arkiver chfoo: can you please create a target on FOS for zippcast?
13:51 πŸ”— luckcolor so i have the dash manifest one here:
13:51 πŸ”— luckcolor ihttp://www.zippcast.com/dash/manifest.m3u8?global=local&node=node6&uuid=1527&video=9b669df67f05ae4adde&qlimit=720p&sysv=2
13:52 πŸ”— luckcolor i'll look the logs
13:52 πŸ”— luckcolor http://node6.zippcast.com/files_flv/user29740/a0b468d059da3ff8114/mobile/a0b468d059da3ff8114.mp4
13:52 πŸ”— arkiver yeah, I know
13:52 πŸ”— arkiver (about the m3u8)
13:52 πŸ”— luckcolor ok
13:52 πŸ”— luckcolor so look at the second link
13:52 πŸ”— arkiver yes
13:53 πŸ”— arkiver video aren't too hard to grab
13:53 πŸ”— arkiver Will have a grab running soon
13:53 πŸ”— luckcolor ok
13:53 πŸ”— luckcolor will get as much concurrency :P
13:53 πŸ”— xhdr has joined #archiveteam
13:53 πŸ”— xhdr has quit IRC (Excess Flood)
13:54 πŸ”— arkiver this site is doing a horrible job of streaming the videos
13:55 πŸ”— arkiver looks like a loop, same videoparts are downloaded over an over again
13:57 πŸ”— luckcolor that's probably also why it's closing
13:57 πŸ”— luckcolor i suppose
14:00 πŸ”— xhdr has joined #archiveteam
14:00 πŸ”— xhdr has quit IRC (Excess Flood)
14:02 πŸ”— Boppen has joined #archiveteam
14:02 πŸ”— xhdr has joined #archiveteam
14:07 πŸ”— BlueMaxim has quit IRC (Quit: Leaving)
14:07 πŸ”— xhdr- has joined #archiveteam
14:07 πŸ”— xhdr- has quit IRC (Excess Flood)
14:13 πŸ”— xhdr has quit IRC (hub.se irc.du.se)
14:13 πŸ”— Boppen has quit IRC (hub.se irc.du.se)
14:14 πŸ”— WinterFox has quit IRC (Remote host closed the connection)
14:14 πŸ”— xhdr- has joined #archiveteam
14:14 πŸ”— xhdr- has quit IRC (Excess Flood)
14:20 πŸ”— xhdr- has joined #archiveteam
14:20 πŸ”— xhdr- has quit IRC (Excess Flood)
14:23 πŸ”— Famicoman has joined #archiveteam
14:27 πŸ”— xhdr- has joined #archiveteam
14:27 πŸ”— xhdr- has quit IRC (Excess Flood)
14:28 πŸ”— philpem has joined #archiveteam
14:33 πŸ”— xhdr has joined #archiveteam
14:33 πŸ”— xhdr has quit IRC (Excess Flood)
14:37 πŸ”— Boppen has joined #archiveteam
14:37 πŸ”— Start has quit IRC (Quit: Disconnected.)
14:38 πŸ”— xhdr has joined #archiveteam
14:38 πŸ”— xhdr has quit IRC (Excess Flood)
14:38 πŸ”— Start has joined #archiveteam
14:44 πŸ”— xhdr has joined #archiveteam
14:45 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
14:48 πŸ”— Start has quit IRC (Quit: Disconnected.)
15:08 πŸ”— Boppen has joined #archiveteam
15:08 πŸ”— Sk1d has joined #archiveteam
15:20 πŸ”— Sk1d has quit IRC (hub.se irc.du.se)
15:20 πŸ”— Boppen has quit IRC (hub.se irc.du.se)
15:22 πŸ”— JesseW has joined #archiveteam
15:38 πŸ”— chfoo arkiver, ok done
15:48 πŸ”— JesseW has quit IRC (Ping timeout: 370 seconds)
15:59 πŸ”— HCross2 arkiver: I meant wget-lua, so I can't run any scripts manually until its sorted
16:05 πŸ”— luckcolor HCross: do you have problems compiling wget-lua?
16:05 πŸ”— luckcolor I had to manually do that
16:06 πŸ”— Meroje wiki-grab is downloading LATEST but expecting the previous version
16:06 πŸ”— luckcolor wget-lua should totally get into some apt repo
16:06 πŸ”— luckcolor as an official package
16:07 πŸ”— luckcolor with official i mean no PPA :)
16:07 πŸ”— luckcolor atleast debian an ubuntu
16:07 πŸ”— luckcolor *and
16:09 πŸ”— Meroje apparently grabs are using different versions because there is differences
16:10 πŸ”— luckcolor really?
16:10 πŸ”— luckcolor i always use latest
16:11 πŸ”— Meroje I was advised to not modify the grab to force the use of latest
16:12 πŸ”— luckcolor yeah
16:13 πŸ”— luckcolor i haven't yet encountered a problem by using latest soo
16:13 πŸ”— * luckcolor still package entry on debian / ubuntu apt would be amazin
16:13 πŸ”— luckcolor chfoo: can you look in the matter of doing that if you have time?
16:22 πŸ”— hive-mind has quit IRC (Ping timeout: 260 seconds)
16:28 πŸ”— hive-mind has joined #archiveteam
16:31 πŸ”— schbirid has quit IRC (Read error: Connection refused)
16:40 πŸ”— karissa__ has joined #archiveteam
16:40 πŸ”— JSharp___ has joined #archiveteam
16:40 πŸ”— sigkell_ has joined #archiveteam
16:40 πŸ”— _desu___ has joined #archiveteam
16:40 πŸ”— antonizoo has joined #archiveteam
16:40 πŸ”— Boltsie has joined #archiveteam
16:45 πŸ”— schbirid has joined #archiveteam
16:49 πŸ”— Boppen has joined #archiveteam
16:58 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
18:01 πŸ”— philpem has quit IRC (Ping timeout: 260 seconds)
18:13 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
18:20 πŸ”— BartoCH has joined #archiveteam
18:48 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
18:52 πŸ”— dashcloud has joined #archiveteam
18:54 πŸ”— signius has someone got the url for the zippcast github
18:55 πŸ”— signius also what channel is zippcast grab using
19:01 πŸ”— PurpleSym There’s no channel yet, signius.
19:02 πŸ”— signius ok thanks
19:03 πŸ”— signius is there any code yet ?
19:03 πŸ”— signius i cannot find it on the normal github
19:03 πŸ”— PurpleSym arkiver was onto it, but I haven’t seen script yet.
19:04 πŸ”— signius ok cheers......i will check back again in a while
19:06 πŸ”— Tomcat_ has joined #archiveteam
19:36 πŸ”— Sk1d has joined #archiveteam
19:44 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
19:47 πŸ”— dashcloud has joined #archiveteam
19:47 πŸ”— Sk1d has quit IRC (hub.se irc.du.se)
20:12 πŸ”— Sk1d has joined #archiveteam
20:20 πŸ”— ivan has quit IRC ()
20:21 πŸ”— Start has joined #archiveteam
20:21 πŸ”— Sk1d has quit IRC (Ping timeout: 194 seconds)
20:39 πŸ”— Tomcat_ has quit IRC (Remote host closed the connection)
20:43 πŸ”— Boppen has joined #archiveteam
20:44 πŸ”— Sk1d has joined #archiveteam
20:52 πŸ”— Boppen has quit IRC (Ping timeout: 194 seconds)
20:52 πŸ”— Sk1d has quit IRC (Ping timeout: 194 seconds)
21:13 πŸ”— tfgbd_znc has quit IRC (Read error: Connection reset by peer)
21:15 πŸ”— Boppen has joined #archiveteam
21:17 πŸ”— Sk1d has joined #archiveteam
21:27 πŸ”— Sk1d has quit IRC (hub.se irc.du.se)
21:27 πŸ”— Boppen has quit IRC (hub.se irc.du.se)
21:28 πŸ”— ndiddy has joined #archiveteam
21:33 πŸ”— philpem has joined #archiveteam
21:41 πŸ”— n00b673 has joined #archiveteam
21:42 πŸ”— n00b673 has quit IRC (Client Quit)
22:13 πŸ”— arkiver the .mp4 videos for zippcast don't always work
22:18 πŸ”— arkiver HCross: a new version to bayimg is online
22:18 πŸ”— arkiver can you try it ut and see if the problems from yesterday are fixed?
22:19 πŸ”— HCross Will do
22:19 πŸ”— arkiver should support the new version now
22:19 πŸ”— arkiver thanks
22:22 πŸ”— MrRadar arkiver: any advice on the rsync problems I was having earlier?
22:23 πŸ”— MrRadar Where the directory to upload was missing?
22:23 πŸ”— arkiver no idea at the moment
22:23 πŸ”— arkiver I need to take a better look at that in the weekend
22:24 πŸ”— MrRadar OK
22:24 πŸ”— MrRadar Thanks
22:24 πŸ”— MrRadar I've left bayimg stopped for now
22:24 πŸ”— MrRadar And I haven't seen the issue with any other grabs on this machine (at least that I can remember)
22:24 πŸ”— arkiver ok, good
22:24 πŸ”— HCross arkiver, worked
22:25 πŸ”— arkiver might be an issue with the discovery part of the scripts
22:25 πŸ”— arkiver HCross: awesome.
22:27 πŸ”— HCross arkiver, rsync: chgrp "/bayimg/.bayimg-16pictures_jaecfaad-20160603-222454_data.txt.rAfkoZ" (in dev) failed: Operation not permitted (1)
22:28 πŸ”— HCross everything is failing
22:28 πŸ”— HCross on rsync
22:28 πŸ”— HCross im still getting tasks
22:35 πŸ”— arkiver Does someone have some rsync space for the bayimg discovery files?
22:35 πŸ”— arkiver It really shouldn't take too much space
22:35 πŸ”— HCross its mainly LOTS of small files
22:42 πŸ”— arkiver bayimg is paused until we have a new target for the discovery files.
22:47 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
22:53 πŸ”— nertzy2 has quit IRC (Read error: Connection reset by peer)
22:54 πŸ”— nertzy2 has joined #archiveteam
22:54 πŸ”— arkiver scripts for zippcast are online!
22:54 πŸ”— BartoCH has joined #archiveteam
22:54 πŸ”— arkiver I'd rather not start the grab now, but wait for tomorrow, since I haven't tested this yet with a lot of items.
22:54 πŸ”— arkiver But since this is shuttind down within 48 hours I'm going to start it now
22:55 πŸ”— arkiver I guess we'll see if something goes wrong
22:55 πŸ”— arkiver but it should work
22:59 πŸ”— arkiver zippcast is started!
23:00 πŸ”— arkiver Please get some concurrent running as soon as possible and report any errors or weird things you see to me
23:00 πŸ”— arkiver We have 1 or 2 days left to get 72000 videos
23:10 πŸ”— arkiver scripts for zippcast are updated.
23:10 πŸ”— nertzy2 has quit IRC (Read error: Connection reset by peer)
23:10 πŸ”— arkiver Turns out not every videos is played using m3u8, some have f4m, will add support for that tomorrow. For now any videos that aren't streamed using m3u8 are aborted.
23:14 πŸ”— ndiddy has quit IRC (Read error: Connection reset by peer)
23:15 πŸ”— ndiddy has joined #archiveteam
23:17 πŸ”— nertzy has joined #archiveteam
23:17 πŸ”— tomwsmf-a has joined #archiveteam
23:20 πŸ”— arkiver I'm off for the night. If you can, please start some concurrent for zippcast. We need to do 72000+ videos within 24 to 48 hours. Scripts are at https://github.com/ArchiveTeam/zippcast-grab
23:22 πŸ”— bwn should i restart zipcast with the latest scripts or let these jobs finish up?
23:22 πŸ”— arkiver I'd say restart it
23:22 πŸ”— bwn ok
23:22 πŸ”— arkiver thank you :)
23:23 πŸ”— arkiver I requeued your items
23:24 πŸ”— arkiver zippcast is now the default project
23:26 πŸ”— ndiddy has quit IRC (Read error: Connection reset by peer)
23:27 πŸ”— Frogging woo
23:30 πŸ”— tomwsmf-a has quit IRC (Ping timeout: 258 seconds)
23:30 πŸ”— HCross Concurrent being warmed up
23:32 πŸ”— Sk1d has joined #archiveteam
23:36 πŸ”— ndiddy has joined #archiveteam
23:37 πŸ”— Sk1d has quit IRC (Ping timeout: 194 seconds)
23:56 πŸ”— tomwsmf-a has joined #archiveteam
23:57 πŸ”— jmtd has quit IRC (Read error: Operation timed out)

irclogger-viewer