#archiveteam-bs 2018-09-05,Wed

↑back Search

Time Nickname Message
00:53 πŸ”— zhongfu has quit IRC (Ping timeout: 260 seconds)
00:55 πŸ”— schbirid has quit IRC (Remote host closed the connection)
01:01 πŸ”— zhongfu has joined #archiveteam-bs
01:05 πŸ”— zhongfu has quit IRC (Remote host closed the connection)
01:07 πŸ”— zhongfu has joined #archiveteam-bs
01:15 πŸ”— zhongfu has quit IRC (Remote host closed the connection)
01:16 πŸ”— second has quit IRC (Quit: ZNC 1.6.5 - http://znc.in)
01:25 πŸ”— zhongfu has joined #archiveteam-bs
01:36 πŸ”— second has joined #archiveteam-bs
01:41 πŸ”— medowar has joined #archiveteam-bs
03:00 πŸ”— ndiddy has quit IRC (Ping timeout: 264 seconds)
03:39 πŸ”— Flashfire w0rmhole over here
03:39 πŸ”— Flashfire There are several WARC creation chrome apps
03:39 πŸ”— Flashfire extensions sorry
03:39 πŸ”— w0rmhole i dont use chrome tho
03:40 πŸ”— w0rmhole i was hoping for something more like a cli tool
03:40 πŸ”— Flashfire There are other tools but the chrome one is the easiest
03:40 πŸ”— w0rmhole or i guess i could just do that
03:40 πŸ”— w0rmhole know if there are ones for firefox?
03:41 πŸ”— odemg has quit IRC (Ping timeout: 260 seconds)
03:41 πŸ”— Flashfire I can check soon but not right now
03:41 πŸ”— w0rmhole jmtd: you could ask over in #archivebot if you haven't already
03:41 πŸ”— w0rmhole no worries
03:42 πŸ”— w0rmhole do you use any in particular?
03:42 πŸ”— Flashfire I already put it through
03:42 πŸ”— w0rmhole oh cool
03:42 πŸ”— Flashfire I try and use safari at school chrome at home on my laptop and firefox on my desktop
03:43 πŸ”— w0rmhole sorry i meant warc extensions
03:53 πŸ”— odemg has joined #archiveteam-bs
04:01 πŸ”— zhongfu has quit IRC (Remote host closed the connection)
04:02 πŸ”— medowar has quit IRC (Ping timeout: 252 seconds)
04:12 πŸ”— zhongfu has joined #archiveteam-bs
04:13 πŸ”— atluxity has quit IRC (Ping timeout: 492 seconds)
04:17 πŸ”— medowar has joined #archiveteam-bs
04:27 πŸ”— atluxity has joined #archiveteam-bs
06:27 πŸ”— bsmith093 has quit IRC (Read error: Operation timed out)
06:38 πŸ”— bsmith093 has joined #archiveteam-bs
07:48 πŸ”— zhongfu has quit IRC (Ping timeout: 260 seconds)
07:49 πŸ”— adinbied has quit IRC (ny.us.hub west.us.hub)
07:49 πŸ”— chirlu has quit IRC (ny.us.hub west.us.hub)
07:49 πŸ”— moufu has quit IRC (ny.us.hub west.us.hub)
07:49 πŸ”— mundus201 has quit IRC (ny.us.hub west.us.hub)
07:49 πŸ”— phirephly has quit IRC (ny.us.hub west.us.hub)
07:49 πŸ”— achip has quit IRC (ny.us.hub west.us.hub)
08:07 πŸ”— BlueMaxim has joined #archiveteam-bs
08:07 πŸ”— SilSte has quit IRC (Read error: Connection reset by peer)
08:08 πŸ”— Mateon1 has quit IRC (Read error: Operation timed out)
08:09 πŸ”— Mateon1 has joined #archiveteam-bs
08:10 πŸ”— Sk1d has quit IRC (Ping timeout: 633 seconds)
08:10 πŸ”— phuzion has quit IRC (Read error: Connection reset by peer)
08:10 πŸ”— SilSte has joined #archiveteam-bs
08:10 πŸ”— joepie91_ has quit IRC (Excess Flood)
08:11 πŸ”— Atom__ has quit IRC (Read error: Operation timed out)
08:12 πŸ”— Sk1d has joined #archiveteam-bs
08:12 πŸ”— joepie91 has joined #archiveteam-bs
08:12 πŸ”— phuzion has joined #archiveteam-bs
08:15 πŸ”— BlueMax has quit IRC (Ping timeout: 633 seconds)
08:16 πŸ”— schbirid has joined #archiveteam-bs
08:20 πŸ”— godane has quit IRC (Read error: Connection reset by peer)
10:06 πŸ”— Mateon1 has quit IRC (Ping timeout: 268 seconds)
10:06 πŸ”— Mateon1 has joined #archiveteam-bs
10:38 πŸ”— caff has quit IRC (Read error: Connection reset by peer)
10:45 πŸ”— JAA w0rmhole, Flashfire: I can't recommend any "WARC writing extensions". They all rely on Chromium's API, which doesn't expose the raw data sent by the server. Same problem as with chromebot. You can find detailed discussions about that in the logs of this channel and #archivebot.
10:48 πŸ”— JAA w0rmhole: Regarding how to group together records into WARC files, that's a tricky question. One file per page definitely doesn't make sense; the files wouldn't be full snapshots of a page anyway unless you duplicate all stylesheets, scripts, images, etc.
10:48 πŸ”— Stilett0 has quit IRC (Ping timeout: 268 seconds)
10:49 πŸ”— JAA Depending on the site, it might make sense to throw it all into one WARC (or several, split based on the file size) or to split it up into subsections of the site if they're independent.
10:51 πŸ”— JAA To create WARCs, use either a tool like wget/wpull or a WARC-writing MITM proxy like warcprox.
10:52 πŸ”— JAA You can also use WARC-writing libraries like warcio with custom code, but only do that if you know what you're doing.
10:53 πŸ”— odemg has quit IRC (Ping timeout: 260 seconds)
11:03 πŸ”— wp494 has quit IRC (Ping timeout: 268 seconds)
11:04 πŸ”— wp494 has joined #archiveteam-bs
11:07 πŸ”— odemg has joined #archiveteam-bs
12:06 πŸ”— godane has joined #archiveteam-bs
12:06 πŸ”— adinbied has joined #archiveteam-bs
12:06 πŸ”— chirlu has joined #archiveteam-bs
12:06 πŸ”— moufu has joined #archiveteam-bs
12:06 πŸ”— mundus201 has joined #archiveteam-bs
12:06 πŸ”— phirephly has joined #archiveteam-bs
12:06 πŸ”— achip has joined #archiveteam-bs
12:06 πŸ”— svchfoo3 sets mode: +o godane
12:06 πŸ”— altlabel_ has quit IRC (Read error: Operation timed out)
12:13 πŸ”— altlabel_ has joined #archiveteam-bs
12:20 πŸ”— zhongfu has joined #archiveteam-bs
12:32 πŸ”— C4K3 has quit IRC (leaving)
12:33 πŸ”— BlueMaxim has quit IRC (Read error: Connection reset by peer)
12:39 πŸ”— Pixi has quit IRC (Quit: Pixi)
12:40 πŸ”— Pixi has joined #archiveteam-bs
13:06 πŸ”— Atom__ has joined #archiveteam-bs
13:25 πŸ”— medowar has quit IRC (Ping timeout: 252 seconds)
13:56 πŸ”— Dimtree has quit IRC (Quit: Peace)
14:03 πŸ”— ndiddy has joined #archiveteam-bs
14:03 πŸ”— ndiddy has quit IRC (Client Quit)
15:10 πŸ”— Atom-- has joined #archiveteam-bs
15:14 πŸ”— Atom__ has quit IRC (Read error: Operation timed out)
15:23 πŸ”— Dimtree has joined #archiveteam-bs
16:24 πŸ”— C4K3 has joined #archiveteam-bs
16:27 πŸ”— C4K3 has quit IRC (Client Quit)
16:34 πŸ”— zhongfu has quit IRC (Ping timeout: 260 seconds)
16:36 πŸ”— C4K3 has joined #archiveteam-bs
16:53 πŸ”— chferfa has joined #archiveteam-bs
16:59 πŸ”— zhongfu has joined #archiveteam-bs
17:06 πŸ”— godane SketchCow: i'm starting upload some more tapes
17:06 πŸ”— godane some i got from savers and there was some interesting finds there
17:07 πŸ”— godane like : LDRS-XVII High Power Rocketry Launch 1988-08-06-to-09 Tape
17:07 πŸ”— godane or : Experience Canada 1995 Morningstar Entertainment Tape
17:07 πŸ”— godane or : Rue McClanahan The Cat Care Video Guide 1990 Mrs Enterprises Tape
17:09 πŸ”— godane from that cat care video guide : https://i.imgur.com/jC8v9Wh.jpg
17:11 πŸ”— godane SketchCow: btw i would like to be able to digitize the Faces of Japan series that was hosted by Dick Cavett
17:11 πŸ”— godane tapes on ebay are going for crazy money: https://www.ebay.com/sch/i.html?_from=R40&_trksid=m570.l1313&_nkw=faces+of+japan+vhs&_sacat=0
17:59 πŸ”— Stilett0 has joined #archiveteam-bs
18:16 πŸ”— Atom-- has quit IRC (Read error: Operation timed out)
18:18 πŸ”— Atom-- has joined #archiveteam-bs
18:31 πŸ”— PurpleSym JAA: Yeah, you’re right. But we’re far away from paying a developer with that money.
18:34 πŸ”— PurpleSym And same for me: Lack of time is the main issue right now.
18:48 πŸ”— Odd0002_ has joined #archiveteam-bs
18:48 πŸ”— VADemon has joined #archiveteam-bs
18:49 πŸ”— Odd0002 has quit IRC (Ping timeout: 260 seconds)
18:49 πŸ”— Odd0002_ is now known as Odd0002
18:51 πŸ”— Dark_Star has quit IRC (Ping timeout: 492 seconds)
18:56 πŸ”— Darkstar has joined #archiveteam-bs
19:03 πŸ”— PhrackD Is there a list of issues somewhere?
19:13 πŸ”— PurpleSym JAA: ↑?
19:38 πŸ”— Darkstar has quit IRC (Ping timeout: 492 seconds)
19:43 πŸ”— RichardG has joined #archiveteam-bs
19:43 πŸ”— RichardG_ has quit IRC (Read error: Operation timed out)
19:46 πŸ”— JAA PhrackD: Only the issues on the relevant GitHub repositories. I don't know of any compiled list. But you raise a good point; such a list, sorted by importance, would be pretty useful.
19:46 πŸ”— schbirid for wpull the repo issues' are well stacked :)
19:46 πŸ”— schbirid and organised actually!
19:47 πŸ”— JAA Right. I fixed a bunch of those earlier this year. Should probably push my code to GitHub. I don't remember the reason why I didn't at the time.
19:53 πŸ”— Darkstar has joined #archiveteam-bs
20:24 πŸ”— chferfa has quit IRC ()
20:26 πŸ”— Darkstar has quit IRC (Ping timeout: 246 seconds)
20:56 πŸ”— schbirid has quit IRC (Remote host closed the connection)
20:56 πŸ”— Darkstar has joined #archiveteam-bs
21:27 πŸ”— Darkstar has quit IRC (Ping timeout: 246 seconds)
21:45 πŸ”— Darkstar has joined #archiveteam-bs
22:30 πŸ”— Darkstar has quit IRC (Ping timeout: 246 seconds)
22:42 πŸ”— apache2_ is now known as apache2
22:43 πŸ”— Darkstar has joined #archiveteam-bs
23:20 πŸ”— ndiddy has joined #archiveteam-bs

irclogger-viewer