| Time |
Nickname |
Message |
|
00:02
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
00:07
🔗
|
|
Stiletto has joined #archiveteam |
|
00:14
🔗
|
|
bwn has joined #archiveteam |
|
00:45
🔗
|
|
JesseW has joined #archiveteam |
|
00:47
🔗
|
|
Stiletto has quit IRC (Read error: Operation timed out) |
|
01:17
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
01:22
🔗
|
|
Stiletto has joined #archiveteam |
|
01:27
🔗
|
|
matthusb- has quit IRC (ZNC - http://znc.in) |
|
01:40
🔗
|
|
philpem has quit IRC (Ping timeout: 260 seconds) |
|
01:41
🔗
|
|
mutoso has quit IRC (Read error: Operation timed out) |
|
01:46
🔗
|
|
Boppen has joined #archiveteam |
|
01:59
🔗
|
|
Emcy_ has joined #archiveteam |
|
02:03
🔗
|
|
Emcy_ has quit IRC (Read error: Connection reset by peer) |
|
02:12
🔗
|
|
Emcy has quit IRC (Read error: Operation timed out) |
|
02:26
🔗
|
|
Fake-Name has quit IRC (Read error: Operation timed out) |
|
02:27
🔗
|
|
Fake-Name has joined #archiveteam |
|
02:29
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
02:29
🔗
|
|
Emcy has joined #archiveteam |
|
02:36
🔗
|
|
vitzli has joined #archiveteam |
|
02:52
🔗
|
|
Boppen has joined #archiveteam |
|
03:03
🔗
|
|
zino has quit IRC (Read error: Operation timed out) |
|
03:05
🔗
|
|
tomwsmf-a has quit IRC (Read error: Operation timed out) |
|
03:06
🔗
|
|
godane1 has joined #archiveteam |
|
03:11
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
03:29
🔗
|
|
Boppen has quit IRC (Read error: Connection reset by peer) |
|
03:42
🔗
|
dashcloud |
Spacedog_: I think so- ccextractor might be what you're looking for |
|
03:52
🔗
|
pikhq |
ccextractor doesn't decode the closed captions from a video stream itself -- because it's not in the portion that's digitized as video. |
|
03:55
🔗
|
pikhq |
ccextractor decodes them from a field in the MPEG stream dedicated for representing closed captions. Some capture devices will take the analog CC data and put it in there, but some won't. |
|
03:59
🔗
|
|
Boppen has joined #archiveteam |
|
04:04
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
04:11
🔗
|
|
BartoCH has joined #archiveteam |
|
04:18
🔗
|
Spacedog_ |
tnx |
|
04:19
🔗
|
Spacedog_ |
seems like any tapes that'd have the info would be hard to find even now |
|
04:19
🔗
|
Spacedog_ |
you could probably pick up cheap pro quality VHS equipment though |
|
04:20
🔗
|
Spacedog_ |
it's a strange one, as it requires a combination of 1980s analogue video skills and modern signal extraction/data processing |
|
04:21
🔗
|
Spacedog_ |
and even then the source material is illusive |
|
04:21
🔗
|
Spacedog_ |
teletext was updated several times per day in it's height |
|
04:23
🔗
|
Spacedog_ |
there were even some real time systems connected to the phone line (secured only with a 3 digit page number) |
|
04:24
🔗
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
|
04:35
🔗
|
|
Sk1d has joined #archiveteam |
|
04:37
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
04:46
🔗
|
|
zino has joined #archiveteam |
|
04:51
🔗
|
|
PaulFert1 has quit IRC (Ping timeout: 506 seconds) |
|
05:06
🔗
|
|
Boppen has joined #archiveteam |
|
05:58
🔗
|
DFJustin |
Spacedog_: there was somebody doing exactly this |
|
05:59
🔗
|
DFJustin |
https://www.transdiffusion.org/2016/01/07/teletext-time-travel |
|
06:22
🔗
|
ivan |
"Okay, sorry for saying this, but......FUCK YOU!" who doesn't want to run a video hosting site with users like that |
|
06:29
🔗
|
|
godane1 has quit IRC (Leaving.) |
|
06:29
🔗
|
|
godane has joined #archiveteam |
|
06:30
🔗
|
|
tfgbd_znc has joined #archiveteam |
|
06:43
🔗
|
|
tfgbd_znc has quit IRC (Ping timeout: 633 seconds) |
|
06:46
🔗
|
|
WinterFox has joined #archiveteam |
|
06:56
🔗
|
Start |
here's a scrapped list of all the videos on zippcast: https://gist.githubusercontent.com/PressStartandSelect/b535bd22ab2ae25fd0000c9dc27da523/raw/b48b47e549b303cf6e2f38777cf39c4ce3e5b702/zippcast-scraped-videos.txt |
|
06:56
🔗
|
Start |
and users: https://gist.githubusercontent.com/PressStartandSelect/0c1fe3e3513a716cfc60c331a2fb8165/raw/c4c0af88b72d3dcc446a8fc72d22c9aba8b8af8e/zippcast-scraped-users.txt |
|
06:56
🔗
|
Start |
i'm going to bed now |
|
07:00
🔗
|
PurpleSym |
youtube-dl can’t handle the site unfortunately. |
|
07:03
🔗
|
luckcolor |
Start i'm already archivebotting it |
|
07:03
🔗
|
PurpleSym |
Can archivebot get the videos too? |
|
07:05
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
07:05
🔗
|
luckcolor |
No but my idea us to parse the warc meta |
|
07:06
🔗
|
luckcolor |
And get the video list |
|
07:06
🔗
|
luckcolor |
And then to feed that to archivebot again wit youtube-dl |
|
07:06
🔗
|
PurpleSym |
That should work, but we’ll need a lot of concurrency to finish the grab in three days. |
|
07:06
🔗
|
luckcolor |
I already setted the concurrency to 5 |
|
07:07
🔗
|
luckcolor |
If you think i should add more let me know |
|
07:07
🔗
|
PurpleSym |
I don’t know what the average video size is, unfortunately. |
|
07:08
🔗
|
luckcolor |
Dunno |
|
07:08
🔗
|
PurpleSym |
Start’s list contains 80k videos. |
|
07:08
🔗
|
luckcolor |
We can Split the lists on multiple pipelines |
|
07:09
🔗
|
luckcolor |
Like 20 or 10k each |
|
07:09
🔗
|
luckcolor |
I can run 20k on my pipeline i suppose |
|
07:09
🔗
|
PurpleSym |
That’s what the warrior was built for. |
|
07:10
🔗
|
luckcolor |
Yeah |
|
07:11
🔗
|
luckcolor |
I don't know if we can get someone in time to create the project |
|
07:11
🔗
|
PurpleSym |
arkiver: ^ |
|
07:12
🔗
|
luckcolor |
Yeah |
|
07:12
🔗
|
luckcolor |
:p |
|
07:14
🔗
|
PurpleSym |
Hm, is there a youtube-dl that creates WARCs? |
|
07:16
🔗
|
pikhq |
youtube-dl with --external-downloader wget --external-downloader-args warc-flags-here I think? |
|
07:21
🔗
|
|
arkiver3 has joined #archiveteam |
|
07:27
🔗
|
|
schbirid has joined #archiveteam |
|
07:56
🔗
|
|
Boppen has quit IRC (Read error: Connection reset by peer) |
|
07:58
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
07:58
🔗
|
|
d_rebel has quit IRC (Remote host closed the connection) |
|
07:58
🔗
|
|
ivan has quit IRC (Remote host closed the connection) |
|
07:58
🔗
|
|
voltagex has quit IRC (Remote host closed the connection) |
|
07:58
🔗
|
|
davidar_ has quit IRC (Remote host closed the connection) |
|
07:58
🔗
|
|
HCross2 has quit IRC (Remote host closed the connection) |
|
07:58
🔗
|
|
deathy has quit IRC (Write error: Broken pipe) |
|
08:00
🔗
|
|
jch has quit IRC (Read error: Operation timed out) |
|
08:01
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 244 seconds) |
|
08:13
🔗
|
|
bwn has joined #archiveteam |
|
08:27
🔗
|
|
Boppen has joined #archiveteam |
|
08:28
🔗
|
|
Piet0r has quit IRC (Ping timeout: 244 seconds) |
|
08:30
🔗
|
|
Piet0r has joined #archiveteam |
|
08:40
🔗
|
|
Gfy has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
kcaj has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
Stiletto has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
espes__ has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
Jon has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
midas has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
xhdr has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
Deewiant has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
TC01_ has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
luckcolor has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
HCross has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
Fletcher_ has quit IRC (Ping timeout: 250 seconds) |
|
08:40
🔗
|
|
kcaj has joined #archiveteam |
|
08:40
🔗
|
|
Stilett0 has joined #archiveteam |
|
08:40
🔗
|
|
hawc145 has joined #archiveteam |
|
08:40
🔗
|
|
Deewiant has joined #archiveteam |
|
08:40
🔗
|
|
luckcolor has joined #archiveteam |
|
08:40
🔗
|
|
Boppen has quit IRC (hub.se irc.du.se) |
|
08:40
🔗
|
|
Sk1d has quit IRC (hub.se irc.du.se) |
|
08:40
🔗
|
|
Zinob has quit IRC (hub.se irc.du.se) |
|
08:40
🔗
|
|
Fletcher_ has joined #archiveteam |
|
08:40
🔗
|
|
jmtd has joined #archiveteam |
|
08:40
🔗
|
|
midas has joined #archiveteam |
|
08:40
🔗
|
|
swebb sets mode: +o midas |
|
08:41
🔗
|
|
TC01 has joined #archiveteam |
|
08:41
🔗
|
|
xhdr has joined #archiveteam |
|
08:41
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
08:43
🔗
|
|
Gfy has joined #archiveteam |
|
08:45
🔗
|
|
jonty has joined #archiveteam |
|
08:47
🔗
|
|
hawc145 is now known as HCross |
|
08:47
🔗
|
|
xhdr has joined #archiveteam |
|
08:47
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
08:48
🔗
|
|
ivan has joined #archiveteam |
|
08:48
🔗
|
|
johtso has joined #archiveteam |
|
08:51
🔗
|
|
deathy has joined #archiveteam |
|
08:51
🔗
|
|
ariscop has quit IRC (Read error: Operation timed out) |
|
08:52
🔗
|
|
TheKiwi has joined #archiveteam |
|
08:53
🔗
|
PurpleSym |
pikhq: Doesn’t seem to work. youtube-dl calls ffmpeg for these videos. |
|
08:54
🔗
|
|
xhdr has joined #archiveteam |
|
08:54
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
08:58
🔗
|
|
davidar_ has joined #archiveteam |
|
08:59
🔗
|
luckcolor |
I think you have to disable the mkv creation |
|
09:00
🔗
|
luckcolor |
(you will still need to do that for the archive.org video items though) |
|
09:00
🔗
|
|
xhdr has joined #archiveteam |
|
09:00
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
09:01
🔗
|
luckcolor |
(i mean to create the mkv) |
|
09:01
🔗
|
|
dxrt- sets mode: +o dxrt |
|
09:01
🔗
|
|
espes__ has joined #archiveteam |
|
09:01
🔗
|
|
xhdr has joined #archiveteam |
|
09:01
🔗
|
|
Sk1d has joined #archiveteam |
|
09:04
🔗
|
|
Zinob has joined #archiveteam |
|
09:06
🔗
|
|
abartov__ has joined #archiveteam |
|
09:07
🔗
|
PurpleSym |
It doesn’t create a mkv. The problem seems to be related to HLS. |
|
09:08
🔗
|
PurpleSym |
Can’t use an external downloader for HLS streams. |
|
09:09
🔗
|
|
xhdr- has joined #archiveteam |
|
09:09
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
09:10
🔗
|
|
HCross2 has joined #archiveteam |
|
09:12
🔗
|
|
Sk1d has quit IRC (hub.se irc.du.se) |
|
09:12
🔗
|
|
Zinob has quit IRC (hub.se irc.du.se) |
|
09:12
🔗
|
|
xhdr has quit IRC (hub.se irc.du.se) |
|
09:15
🔗
|
|
voltagex has joined #archiveteam |
|
09:15
🔗
|
|
xhdr- has joined #archiveteam |
|
09:15
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
09:21
🔗
|
|
d_rebel has joined #archiveteam |
|
09:24
🔗
|
|
xhdr- has joined #archiveteam |
|
09:24
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
09:30
🔗
|
|
xhdr has joined #archiveteam |
|
09:30
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
09:33
🔗
|
|
ariscop has joined #archiveteam |
|
09:34
🔗
|
|
Boppen has joined #archiveteam |
|
09:35
🔗
|
|
xhdr has joined #archiveteam |
|
09:35
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
09:35
🔗
|
|
Zinob has joined #archiveteam |
|
09:36
🔗
|
|
xhdr has joined #archiveteam |
|
09:36
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
09:36
🔗
|
|
xhdr has joined #archiveteam |
|
09:36
🔗
|
|
Sk1d has joined #archiveteam |
|
09:41
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
09:41
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
09:41
🔗
|
|
Zinob has quit IRC (Ping timeout: 194 seconds) |
|
09:41
🔗
|
|
xhdr has quit IRC (Ping timeout: 194 seconds) |
|
09:46
🔗
|
|
xhdr has joined #archiveteam |
|
09:46
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
09:52
🔗
|
|
xhdr has joined #archiveteam |
|
09:52
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
09:59
🔗
|
|
xhdr has joined #archiveteam |
|
09:59
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
10:02
🔗
|
|
jonty has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
deathy has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
d_rebel has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
voltagex has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
ivan has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
davidar_ has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
HCross2 has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
TheKiwi has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
johtso has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
abartov__ has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
Atluxity has quit IRC (Ping timeout: 260 seconds) |
|
10:04
🔗
|
|
Famicoman has quit IRC (Ping timeout: 260 seconds) |
|
10:05
🔗
|
|
xhdr has joined #archiveteam |
|
10:05
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
10:05
🔗
|
|
PotcFdk has quit IRC (Ping timeout: 506 seconds) |
|
10:08
🔗
|
|
jonty has joined #archiveteam |
|
10:08
🔗
|
|
ivan has joined #archiveteam |
|
10:09
🔗
|
|
johtso has joined #archiveteam |
|
10:11
🔗
|
|
deathy has joined #archiveteam |
|
10:12
🔗
|
|
TheKiwi has joined #archiveteam |
|
10:14
🔗
|
|
xhdr has joined #archiveteam |
|
10:14
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
10:19
🔗
|
|
PotcFdk has joined #archiveteam |
|
10:21
🔗
|
|
davidar_ has joined #archiveteam |
|
10:22
🔗
|
|
xhdr has joined #archiveteam |
|
10:22
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
10:23
🔗
|
|
Atluxity has joined #archiveteam |
|
10:23
🔗
|
|
swebb sets mode: +o Atluxity |
|
10:30
🔗
|
|
abartov__ has joined #archiveteam |
|
10:31
🔗
|
|
xhdr has joined #archiveteam |
|
10:31
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
10:34
🔗
|
|
HCross2 has joined #archiveteam |
|
10:37
🔗
|
|
xhdr has joined #archiveteam |
|
10:37
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
10:39
🔗
|
|
voltagex has joined #archiveteam |
|
10:40
🔗
|
|
jch has joined #archiveteam |
|
10:41
🔗
|
|
Zinob has joined #archiveteam |
|
10:42
🔗
|
|
xhdr has joined #archiveteam |
|
10:42
🔗
|
luckcolor |
PurlpleSym: i made a tool once wich download all the hls pieces to disk |
|
10:42
🔗
|
|
Boppen has joined #archiveteam |
|
10:42
🔗
|
luckcolor |
And then you can simply play them using the m3u8 playlist |
|
10:45
🔗
|
luckcolor |
Actually i could instead of wgetting the parts |
|
10:45
🔗
|
luckcolor |
I can find the parts list to grab-site |
|
10:47
🔗
|
|
r3c0d3x has quit IRC (Ping timeout: 260 seconds) |
|
10:50
🔗
|
|
r3c0d3x has joined #archiveteam |
|
10:52
🔗
|
|
Boppen has quit IRC (hub.se irc.du.se) |
|
10:52
🔗
|
|
xhdr has quit IRC (hub.se irc.du.se) |
|
10:52
🔗
|
|
Zinob has quit IRC (hub.se irc.du.se) |
|
10:53
🔗
|
luckcolor |
*I can feed |
|
10:54
🔗
|
luckcolor |
Going back to zipcast grab |
|
10:55
🔗
|
luckcolor |
i think archivebot even without youtube-dl is getting the videos |
|
10:56
🔗
|
luckcolor |
eg: http://www.zippcast.com/dash/manifest.m3u8?global=local&node=node6&uuid=1527&video=9b669df67f05ae4adde&qlimit=720p&sysv=2 |
|
10:56
🔗
|
|
d_rebel has joined #archiveteam |
|
10:59
🔗
|
luckcolor |
(ofc not the dash ones) |
|
11:12
🔗
|
|
xhdr has joined #archiveteam |
|
11:12
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
11:12
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
11:15
🔗
|
|
xhdr has joined #archiveteam |
|
11:15
🔗
|
|
Sk1d has joined #archiveteam |
|
11:15
🔗
|
|
Zinob has joined #archiveteam |
|
11:15
🔗
|
|
Boppen has joined #archiveteam |
|
11:19
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
11:20
🔗
|
|
Zinob has quit IRC (Ping timeout: 194 seconds) |
|
11:20
🔗
|
|
xhdr has quit IRC (Ping timeout: 194 seconds) |
|
11:28
🔗
|
|
Sk1d has quit IRC (hub.se irc.du.se) |
|
11:38
🔗
|
|
VADemon has joined #archiveteam |
|
11:45
🔗
|
|
arkiver3 has joined #archiveteam |
|
11:50
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 244 seconds) |
|
11:59
🔗
|
|
closure has quit IRC (Ping timeout: 260 seconds) |
|
12:03
🔗
|
|
arkiver3 has joined #archiveteam |
|
12:05
🔗
|
|
xhdr has joined #archiveteam |
|
12:05
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:09
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 244 seconds) |
|
12:10
🔗
|
|
xhdr has joined #archiveteam |
|
12:10
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:10
🔗
|
|
arkiver3 has joined #archiveteam |
|
12:14
🔗
|
|
xhdr has joined #archiveteam |
|
12:14
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:17
🔗
|
HCross |
arkiver3, did you look at the grab-site issue from last night? |
|
12:19
🔗
|
|
xhdr has joined #archiveteam |
|
12:19
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:21
🔗
|
|
arkiver3 has quit IRC (Ping timeout: 244 seconds) |
|
12:22
🔗
|
|
xhdr has joined #archiveteam |
|
12:22
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:22
🔗
|
|
xhdr has joined #archiveteam |
|
12:22
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:29
🔗
|
|
xhdr has joined #archiveteam |
|
12:29
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:31
🔗
|
|
VADemon has quit IRC (Read error: Connection reset by peer) |
|
12:33
🔗
|
|
xhdr has joined #archiveteam |
|
12:33
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:38
🔗
|
|
xhdr has joined #archiveteam |
|
12:38
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:42
🔗
|
|
xhdr has joined #archiveteam |
|
12:42
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:49
🔗
|
|
xhdr has joined #archiveteam |
|
12:49
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:53
🔗
|
|
xhdr has joined #archiveteam |
|
12:53
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
12:57
🔗
|
|
Sk1d has joined #archiveteam |
|
12:58
🔗
|
|
xhdr has joined #archiveteam |
|
12:58
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:02
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
13:04
🔗
|
|
xhdr has joined #archiveteam |
|
13:04
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:09
🔗
|
|
xhdr has joined #archiveteam |
|
13:09
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:13
🔗
|
|
xhdr has joined #archiveteam |
|
13:13
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:18
🔗
|
|
xhdr has joined #archiveteam |
|
13:18
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:18
🔗
|
|
tfgbd_znc has joined #archiveteam |
|
13:19
🔗
|
|
tfgbd_znc has quit IRC (Client Quit) |
|
13:20
🔗
|
|
tfgbd_znc has joined #archiveteam |
|
13:22
🔗
|
|
xhdr has joined #archiveteam |
|
13:22
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:28
🔗
|
|
Boppen has joined #archiveteam |
|
13:29
🔗
|
|
xhdr has joined #archiveteam |
|
13:29
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:33
🔗
|
|
xhdr has joined #archiveteam |
|
13:33
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:33
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
13:38
🔗
|
|
xhdr has joined #archiveteam |
|
13:38
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:39
🔗
|
arkiver |
New project! |
|
13:39
🔗
|
arkiver |
oof, zippcast is shutting down by 06/05/2016 |
|
13:39
🔗
|
arkiver |
we won't use youtube-dl |
|
13:39
🔗
|
arkiver |
HCross: not yet, zippcast is highest priority at the moment |
|
13:40
🔗
|
|
vitzli has quit IRC (Quit: Leaving) |
|
13:41
🔗
|
arkiver |
Start: thanks! |
|
13:42
🔗
|
|
xhdr has joined #archiveteam |
|
13:42
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:45
🔗
|
luckcolor |
arkiver: zippcast is currently getting archivebotted too |
|
13:45
🔗
|
PurpleSym |
Anything we can help you with, arkiver ? |
|
13:45
🔗
|
luckcolor |
yeah :P |
|
13:46
🔗
|
arkiver |
is archivebot saving the videos correctly? |
|
13:46
🔗
|
luckcolor |
no |
|
13:46
🔗
|
arkiver |
ok |
|
13:46
🔗
|
luckcolor |
it saves only a few |
|
13:46
🔗
|
arkiver |
We'll get the videos |
|
13:46
🔗
|
luckcolor |
probably the ones it can figure out a link |
|
13:46
🔗
|
luckcolor |
like mp4 |
|
13:46
🔗
|
luckcolor |
for instance dash manifest and so on aren relly getting downloaded |
|
13:47
🔗
|
|
xhdr has joined #archiveteam |
|
13:47
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:47
🔗
|
luckcolor |
also i settede concurrency 7 on that job an it seems like it only has 3 |
|
13:47
🔗
|
luckcolor |
*setted |
|
13:49
🔗
|
arkiver |
Do you have an example of a zippcast video with mp4 video? |
|
13:51
🔗
|
arkiver |
chfoo: can you please create a target on FOS for zippcast? |
|
13:51
🔗
|
luckcolor |
so i have the dash manifest one here: |
|
13:51
🔗
|
luckcolor |
ihttp://www.zippcast.com/dash/manifest.m3u8?global=local&node=node6&uuid=1527&video=9b669df67f05ae4adde&qlimit=720p&sysv=2 |
|
13:52
🔗
|
luckcolor |
i'll look the logs |
|
13:52
🔗
|
luckcolor |
http://node6.zippcast.com/files_flv/user29740/a0b468d059da3ff8114/mobile/a0b468d059da3ff8114.mp4 |
|
13:52
🔗
|
arkiver |
yeah, I know |
|
13:52
🔗
|
arkiver |
(about the m3u8) |
|
13:52
🔗
|
luckcolor |
ok |
|
13:52
🔗
|
luckcolor |
so look at the second link |
|
13:52
🔗
|
arkiver |
yes |
|
13:53
🔗
|
arkiver |
video aren't too hard to grab |
|
13:53
🔗
|
arkiver |
Will have a grab running soon |
|
13:53
🔗
|
luckcolor |
ok |
|
13:53
🔗
|
luckcolor |
will get as much concurrency :P |
|
13:53
🔗
|
|
xhdr has joined #archiveteam |
|
13:53
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
13:54
🔗
|
arkiver |
this site is doing a horrible job of streaming the videos |
|
13:55
🔗
|
arkiver |
looks like a loop, same videoparts are downloaded over an over again |
|
13:57
🔗
|
luckcolor |
that's probably also why it's closing |
|
13:57
🔗
|
luckcolor |
i suppose |
|
14:00
🔗
|
|
xhdr has joined #archiveteam |
|
14:00
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
14:02
🔗
|
|
Boppen has joined #archiveteam |
|
14:02
🔗
|
|
xhdr has joined #archiveteam |
|
14:07
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
14:07
🔗
|
|
xhdr- has joined #archiveteam |
|
14:07
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
14:13
🔗
|
|
xhdr has quit IRC (hub.se irc.du.se) |
|
14:13
🔗
|
|
Boppen has quit IRC (hub.se irc.du.se) |
|
14:14
🔗
|
|
WinterFox has quit IRC (Remote host closed the connection) |
|
14:14
🔗
|
|
xhdr- has joined #archiveteam |
|
14:14
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
14:20
🔗
|
|
xhdr- has joined #archiveteam |
|
14:20
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
14:23
🔗
|
|
Famicoman has joined #archiveteam |
|
14:27
🔗
|
|
xhdr- has joined #archiveteam |
|
14:27
🔗
|
|
xhdr- has quit IRC (Excess Flood) |
|
14:28
🔗
|
|
philpem has joined #archiveteam |
|
14:33
🔗
|
|
xhdr has joined #archiveteam |
|
14:33
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
14:37
🔗
|
|
Boppen has joined #archiveteam |
|
14:37
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
14:38
🔗
|
|
xhdr has joined #archiveteam |
|
14:38
🔗
|
|
xhdr has quit IRC (Excess Flood) |
|
14:38
🔗
|
|
Start has joined #archiveteam |
|
14:44
🔗
|
|
xhdr has joined #archiveteam |
|
14:45
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
14:48
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
15:08
🔗
|
|
Boppen has joined #archiveteam |
|
15:08
🔗
|
|
Sk1d has joined #archiveteam |
|
15:20
🔗
|
|
Sk1d has quit IRC (hub.se irc.du.se) |
|
15:20
🔗
|
|
Boppen has quit IRC (hub.se irc.du.se) |
|
15:22
🔗
|
|
JesseW has joined #archiveteam |
|
15:38
🔗
|
chfoo |
arkiver, ok done |
|
15:48
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
15:59
🔗
|
HCross2 |
arkiver: I meant wget-lua, so I can't run any scripts manually until its sorted |
|
16:05
🔗
|
luckcolor |
HCross: do you have problems compiling wget-lua? |
|
16:05
🔗
|
luckcolor |
I had to manually do that |
|
16:06
🔗
|
Meroje |
wiki-grab is downloading LATEST but expecting the previous version |
|
16:06
🔗
|
luckcolor |
wget-lua should totally get into some apt repo |
|
16:06
🔗
|
luckcolor |
as an official package |
|
16:07
🔗
|
luckcolor |
with official i mean no PPA :) |
|
16:07
🔗
|
luckcolor |
atleast debian an ubuntu |
|
16:07
🔗
|
luckcolor |
*and |
|
16:09
🔗
|
Meroje |
apparently grabs are using different versions because there is differences |
|
16:10
🔗
|
luckcolor |
really? |
|
16:10
🔗
|
luckcolor |
i always use latest |
|
16:11
🔗
|
Meroje |
I was advised to not modify the grab to force the use of latest |
|
16:12
🔗
|
luckcolor |
yeah |
|
16:13
🔗
|
luckcolor |
i haven't yet encountered a problem by using latest soo |
|
16:13
🔗
|
* |
luckcolor still package entry on debian / ubuntu apt would be amazin |
|
16:13
🔗
|
luckcolor |
chfoo: can you look in the matter of doing that if you have time? |
|
16:22
🔗
|
|
hive-mind has quit IRC (Ping timeout: 260 seconds) |
|
16:28
🔗
|
|
hive-mind has joined #archiveteam |
|
16:31
🔗
|
|
schbirid has quit IRC (Read error: Connection refused) |
|
16:40
🔗
|
|
karissa__ has joined #archiveteam |
|
16:40
🔗
|
|
JSharp___ has joined #archiveteam |
|
16:40
🔗
|
|
sigkell_ has joined #archiveteam |
|
16:40
🔗
|
|
_desu___ has joined #archiveteam |
|
16:40
🔗
|
|
antonizoo has joined #archiveteam |
|
16:40
🔗
|
|
Boltsie has joined #archiveteam |
|
16:45
🔗
|
|
schbirid has joined #archiveteam |
|
16:49
🔗
|
|
Boppen has joined #archiveteam |
|
16:58
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
18:01
🔗
|
|
philpem has quit IRC (Ping timeout: 260 seconds) |
|
18:13
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
18:20
🔗
|
|
BartoCH has joined #archiveteam |
|
18:48
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
|
18:52
🔗
|
|
dashcloud has joined #archiveteam |
|
18:54
🔗
|
signius |
has someone got the url for the zippcast github |
|
18:55
🔗
|
signius |
also what channel is zippcast grab using |
|
19:01
🔗
|
PurpleSym |
There’s no channel yet, signius. |
|
19:02
🔗
|
signius |
ok thanks |
|
19:03
🔗
|
signius |
is there any code yet ? |
|
19:03
🔗
|
signius |
i cannot find it on the normal github |
|
19:03
🔗
|
PurpleSym |
arkiver was onto it, but I haven’t seen script yet. |
|
19:04
🔗
|
signius |
ok cheers......i will check back again in a while |
|
19:06
🔗
|
|
Tomcat_ has joined #archiveteam |
|
19:36
🔗
|
|
Sk1d has joined #archiveteam |
|
19:44
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
|
19:47
🔗
|
|
dashcloud has joined #archiveteam |
|
19:47
🔗
|
|
Sk1d has quit IRC (hub.se irc.du.se) |
|
20:12
🔗
|
|
Sk1d has joined #archiveteam |
|
20:20
🔗
|
|
ivan has quit IRC () |
|
20:21
🔗
|
|
Start has joined #archiveteam |
|
20:21
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
20:39
🔗
|
|
Tomcat_ has quit IRC (Remote host closed the connection) |
|
20:43
🔗
|
|
Boppen has joined #archiveteam |
|
20:44
🔗
|
|
Sk1d has joined #archiveteam |
|
20:52
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
20:52
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
21:13
🔗
|
|
tfgbd_znc has quit IRC (Read error: Connection reset by peer) |
|
21:15
🔗
|
|
Boppen has joined #archiveteam |
|
21:17
🔗
|
|
Sk1d has joined #archiveteam |
|
21:27
🔗
|
|
Sk1d has quit IRC (hub.se irc.du.se) |
|
21:27
🔗
|
|
Boppen has quit IRC (hub.se irc.du.se) |
|
21:28
🔗
|
|
ndiddy has joined #archiveteam |
|
21:33
🔗
|
|
philpem has joined #archiveteam |
|
21:41
🔗
|
|
n00b673 has joined #archiveteam |
|
21:42
🔗
|
|
n00b673 has quit IRC (Client Quit) |
|
22:13
🔗
|
arkiver |
the .mp4 videos for zippcast don't always work |
|
22:18
🔗
|
arkiver |
HCross: a new version to bayimg is online |
|
22:18
🔗
|
arkiver |
can you try it ut and see if the problems from yesterday are fixed? |
|
22:19
🔗
|
HCross |
Will do |
|
22:19
🔗
|
arkiver |
should support the new version now |
|
22:19
🔗
|
arkiver |
thanks |
|
22:22
🔗
|
MrRadar |
arkiver: any advice on the rsync problems I was having earlier? |
|
22:23
🔗
|
MrRadar |
Where the directory to upload was missing? |
|
22:23
🔗
|
arkiver |
no idea at the moment |
|
22:23
🔗
|
arkiver |
I need to take a better look at that in the weekend |
|
22:24
🔗
|
MrRadar |
OK |
|
22:24
🔗
|
MrRadar |
Thanks |
|
22:24
🔗
|
MrRadar |
I've left bayimg stopped for now |
|
22:24
🔗
|
MrRadar |
And I haven't seen the issue with any other grabs on this machine (at least that I can remember) |
|
22:24
🔗
|
arkiver |
ok, good |
|
22:24
🔗
|
HCross |
arkiver, worked |
|
22:25
🔗
|
arkiver |
might be an issue with the discovery part of the scripts |
|
22:25
🔗
|
arkiver |
HCross: awesome. |
|
22:27
🔗
|
HCross |
arkiver, rsync: chgrp "/bayimg/.bayimg-16pictures_jaecfaad-20160603-222454_data.txt.rAfkoZ" (in dev) failed: Operation not permitted (1) |
|
22:28
🔗
|
HCross |
everything is failing |
|
22:28
🔗
|
HCross |
on rsync |
|
22:28
🔗
|
HCross |
im still getting tasks |
|
22:35
🔗
|
arkiver |
Does someone have some rsync space for the bayimg discovery files? |
|
22:35
🔗
|
arkiver |
It really shouldn't take too much space |
|
22:35
🔗
|
HCross |
its mainly LOTS of small files |
|
22:42
🔗
|
arkiver |
bayimg is paused until we have a new target for the discovery files. |
|
22:47
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
22:53
🔗
|
|
nertzy2 has quit IRC (Read error: Connection reset by peer) |
|
22:54
🔗
|
|
nertzy2 has joined #archiveteam |
|
22:54
🔗
|
arkiver |
scripts for zippcast are online! |
|
22:54
🔗
|
|
BartoCH has joined #archiveteam |
|
22:54
🔗
|
arkiver |
I'd rather not start the grab now, but wait for tomorrow, since I haven't tested this yet with a lot of items. |
|
22:54
🔗
|
arkiver |
But since this is shuttind down within 48 hours I'm going to start it now |
|
22:55
🔗
|
arkiver |
I guess we'll see if something goes wrong |
|
22:55
🔗
|
arkiver |
but it should work |
|
22:59
🔗
|
arkiver |
zippcast is started! |
|
23:00
🔗
|
arkiver |
Please get some concurrent running as soon as possible and report any errors or weird things you see to me |
|
23:00
🔗
|
arkiver |
We have 1 or 2 days left to get 72000 videos |
|
23:10
🔗
|
arkiver |
scripts for zippcast are updated. |
|
23:10
🔗
|
|
nertzy2 has quit IRC (Read error: Connection reset by peer) |
|
23:10
🔗
|
arkiver |
Turns out not every videos is played using m3u8, some have f4m, will add support for that tomorrow. For now any videos that aren't streamed using m3u8 are aborted. |
|
23:14
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
23:15
🔗
|
|
ndiddy has joined #archiveteam |
|
23:17
🔗
|
|
nertzy has joined #archiveteam |
|
23:17
🔗
|
|
tomwsmf-a has joined #archiveteam |
|
23:20
🔗
|
arkiver |
I'm off for the night. If you can, please start some concurrent for zippcast. We need to do 72000+ videos within 24 to 48 hours. Scripts are at https://github.com/ArchiveTeam/zippcast-grab |
|
23:22
🔗
|
bwn |
should i restart zipcast with the latest scripts or let these jobs finish up? |
|
23:22
🔗
|
arkiver |
I'd say restart it |
|
23:22
🔗
|
bwn |
ok |
|
23:22
🔗
|
arkiver |
thank you :) |
|
23:23
🔗
|
arkiver |
I requeued your items |
|
23:24
🔗
|
arkiver |
zippcast is now the default project |
|
23:26
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
23:27
🔗
|
Frogging |
woo |
|
23:30
🔗
|
|
tomwsmf-a has quit IRC (Ping timeout: 258 seconds) |
|
23:30
🔗
|
HCross |
Concurrent being warmed up |
|
23:32
🔗
|
|
Sk1d has joined #archiveteam |
|
23:36
🔗
|
|
ndiddy has joined #archiveteam |
|
23:37
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
23:56
🔗
|
|
tomwsmf-a has joined #archiveteam |
|
23:57
🔗
|
|
jmtd has quit IRC (Read error: Operation timed out) |