#archiveteam-bs 2019-03-14,Thu

↑back Search

Time Nickname Message
00:24 πŸ”— DarkStar1 has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.)
00:34 πŸ”— kbtoo_ has quit IRC (Read error: Connection reset by peer)
00:36 πŸ”— kbtoo has joined #archiveteam-bs
00:40 πŸ”— Darkstar has joined #archiveteam-bs
00:40 πŸ”— wp494 has quit IRC (Read error: Operation timed out)
00:40 πŸ”— wp494 has joined #archiveteam-bs
00:52 πŸ”— julientm has joined #archiveteam-bs
01:47 πŸ”— Despatche has joined #archiveteam-bs
01:59 πŸ”— Exairnous has quit IRC (Ping timeout: 246 seconds)
02:03 πŸ”— fuzy802 has joined #archiveteam-bs
02:06 πŸ”— fuzzy8021 has quit IRC (Ping timeout: 252 seconds)
02:13 πŸ”— fuzy802 is now known as fuzzy8021
02:14 πŸ”— SimpBrain has quit IRC (Read error: Connection reset by peer)
02:14 πŸ”— SimpBrain has joined #archiveteam-bs
02:28 πŸ”— user3434 has joined #archiveteam-bs
02:32 πŸ”— user3434 has quit IRC (Quit: Page closed)
02:36 πŸ”— PhrackD has quit IRC (Read error: Connection reset by peer)
02:41 πŸ”— PhrackD has joined #archiveteam-bs
02:44 πŸ”— Odd0002_ has joined #archiveteam-bs
02:48 πŸ”— Odd0002 has quit IRC (Ping timeout: 615 seconds)
02:48 πŸ”— Odd0002_ is now known as Odd0002
03:02 πŸ”— SimpBrain has quit IRC (Read error: Connection reset by peer)
03:02 πŸ”— SimpBrain has joined #archiveteam-bs
03:41 πŸ”— julientm has quit IRC (Ping timeout: 615 seconds)
03:42 πŸ”— Despatche has quit IRC (Remote host closed the connection)
04:00 πŸ”— Stiletto has quit IRC (Ping timeout: 360 seconds)
04:00 πŸ”— Stilett0 has joined #archiveteam-bs
04:17 πŸ”— julientm has joined #archiveteam-bs
04:37 πŸ”— qw3rty117 has joined #archiveteam-bs
04:39 πŸ”— robogoat has quit IRC (Read error: Operation timed out)
04:43 πŸ”— qw3rty116 has quit IRC (Read error: Operation timed out)
04:46 πŸ”— robogoat has joined #archiveteam-bs
04:55 πŸ”— odemgi has quit IRC (Ping timeout: 246 seconds)
04:56 πŸ”— ndiddy has quit IRC ()
04:58 πŸ”— odemgi has joined #archiveteam-bs
05:01 πŸ”— odemg has quit IRC (Ping timeout: 615 seconds)
05:08 πŸ”— odemg has joined #archiveteam-bs
05:43 πŸ”— Exairnous has joined #archiveteam-bs
05:53 πŸ”— bsmith093 has quit IRC (Ping timeout: 616 seconds)
05:53 πŸ”— julientm has quit IRC (Remote host closed the connection)
05:55 πŸ”— bsmith093 has joined #archiveteam-bs
05:59 πŸ”— kyonko has quit IRC (Read error: Connection reset by peer)
06:00 πŸ”— kyonko has joined #archiveteam-bs
06:05 πŸ”— SimpBrain has quit IRC (Remote host closed the connection)
06:06 πŸ”— SimpBrain has joined #archiveteam-bs
06:07 πŸ”— bsmith093 has quit IRC (Read error: Operation timed out)
06:10 πŸ”— bsmith093 has joined #archiveteam-bs
06:21 πŸ”— killsushi has quit IRC (Quit: Leaving)
06:25 πŸ”— deevious has joined #archiveteam-bs
06:35 πŸ”— SumTingWo has joined #archiveteam-bs
06:47 πŸ”— SumTingWo has quit IRC (Read error: Connection reset by peer)
06:51 πŸ”— julientm has joined #archiveteam-bs
06:55 πŸ”— julientre has joined #archiveteam-bs
07:08 πŸ”— Exairnous has quit IRC (Ping timeout: 255 seconds)
07:11 πŸ”— S1mpbrain has joined #archiveteam-bs
07:11 πŸ”— SimpBrain has quit IRC (Read error: Connection reset by peer)
07:13 πŸ”— julientre has quit IRC (Quit: Leaving)
07:17 πŸ”— julientm1 has joined #archiveteam-bs
07:24 πŸ”— julientm has quit IRC (Remote host closed the connection)
07:24 πŸ”— julientm1 has quit IRC (Leaving)
07:25 πŸ”— julientm has joined #archiveteam-bs
07:34 πŸ”— deevious has quit IRC (Quit: deevious)
08:11 πŸ”— deevious has joined #archiveteam-bs
08:40 πŸ”— Exairnous has joined #archiveteam-bs
09:33 πŸ”— julientm has quit IRC (Remote host closed the connection)
09:35 πŸ”— julientm1 has joined #archiveteam-bs
09:41 πŸ”— wp494 has quit IRC (Ping timeout: 492 seconds)
09:43 πŸ”— wp494 has joined #archiveteam-bs
09:52 πŸ”— julientm1 is now known as julientm
11:00 πŸ”— julientm has quit IRC (Remote host closed the connection)
11:29 πŸ”— kyonko has quit IRC (Read error: Connection reset by peer)
12:10 πŸ”— julientm has joined #archiveteam-bs
12:15 πŸ”— lenary SketchCow: those pdfs of Spare Rib came back up, so I'm grabbing them now
12:22 πŸ”— julientm has quit IRC (Remote host closed the connection)
12:35 πŸ”— S1mpbrain has quit IRC (Remote host closed the connection)
12:35 πŸ”— S1mpbrain has joined #archiveteam-bs
13:13 πŸ”— deevious has quit IRC (Quit: deevious)
13:35 πŸ”— BlueMax has quit IRC (Read error: Connection reset by peer)
13:50 πŸ”— S1mpbrain has quit IRC (Read error: Operation timed out)
13:57 πŸ”— SimpBrain has joined #archiveteam-bs
14:27 πŸ”— deevious has joined #archiveteam-bs
15:08 πŸ”— ndiddy has joined #archiveteam-bs
15:21 πŸ”— deevious has quit IRC (Ping timeout: 252 seconds)
15:29 πŸ”— deevious has joined #archiveteam-bs
15:54 πŸ”— julientm has joined #archiveteam-bs
15:57 πŸ”— SimpBrain has quit IRC (Read error: Connection reset by peer)
15:58 πŸ”— SimpBrain has joined #archiveteam-bs
16:00 πŸ”— deevious1 has joined #archiveteam-bs
16:01 πŸ”— deevious has quit IRC (Read error: Connection reset by peer)
16:01 πŸ”— deevious1 is now known as deevious
16:09 πŸ”— julientm has quit IRC (Remote host closed the connection)
16:11 πŸ”— Czechball has joined #archiveteam-bs
16:11 πŸ”— Czechball So here I am
16:11 πŸ”— JAA Czechball: Yes, it's possible to run all our projects outside of the warrior as well.
16:11 πŸ”— JAA The instructions for that are normally in the code repository, which is linked on each project's wiki page.
16:11 πŸ”— Czechball yeah I noticed that
16:12 πŸ”— Czechball I thought maybe you have a Warrior distro ready for real hardware
16:12 πŸ”— JAA There is a Docker image.
16:13 πŸ”— Czechball Alright, I'll check that out
16:13 πŸ”— Czechball I could probably even run some scripts on my RaspberryPi
16:24 πŸ”— godane has joined #archiveteam-bs
16:28 πŸ”— bitBaron has joined #archiveteam-bs
16:36 πŸ”— SimpBrain has quit IRC (Read error: Operation timed out)
16:40 πŸ”— SimpBrain has joined #archiveteam-bs
17:02 πŸ”— Stilett0 is now known as Stiletto
17:29 πŸ”— omarroth has joined #archiveteam-bs
17:39 πŸ”— julientm has joined #archiveteam-bs
17:40 πŸ”— Ravenloft has quit IRC (Read error: Connection reset by peer)
17:47 πŸ”— turnkit has joined #archiveteam-bs
17:56 πŸ”— julientm has quit IRC (Remote host closed the connection)
18:01 πŸ”— julientm has joined #archiveteam-bs
18:02 πŸ”— Moder112 has joined #archiveteam-bs
18:04 πŸ”— Moder112 well
18:04 πŸ”— Moder112 I tried splitting the megawarc I mentioned with those tools but unfortunately it resulted in the creation of either thousands of improperly named warc files
18:05 πŸ”— Moder112 or a directory structure exactly the same as the original site but impossible to browse
18:06 πŸ”— Moder112 I got the json metadata file for the archive, is it possible to split it into the files listed in the json?
18:06 πŸ”— Moder112 or do I need to code a program from scratch to do that
18:17 πŸ”— bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴πŸ˜ͺZZZzzz…)
18:33 πŸ”— Moder112 I thought I could use this
18:33 πŸ”— Moder112 https://github.com/alard/megawarc
18:33 πŸ”— Moder112 but the tar file from the specific archive can't be downloaded
18:34 πŸ”— Moder112 or I mean
18:34 πŸ”— Moder112 It can be
18:34 πŸ”— Moder112 but it saves as a 0b file
18:35 πŸ”— Moder112 which I guess would make sense as the tar is for non-warc files
18:36 πŸ”— Moder112 but the script really doesn't like that
18:40 πŸ”— wp494 has quit IRC (Read error: Operation timed out)
18:41 πŸ”— wp494 has joined #archiveteam-bs
18:43 πŸ”— Czechball has quit IRC (Leaving)
19:04 πŸ”— bitBaron has joined #archiveteam-bs
19:08 πŸ”— JAA Moder112: I've never used it, but 'megawarc restore' should split the megawarc back up into the original files. But that'll write out all of the WARCs, not just the one(s) you want.
19:11 πŸ”— JAA Moder112: Oh, forgot to mention, you can also only download the relevant part of the megawarc from IA with a range request.
19:13 πŸ”— Oddly has joined #archiveteam-bs
19:16 πŸ”— JAA For example, to download the third WARC contained in https://archive.org/download/archiveteam_tumblr20181218030723 :
19:16 πŸ”— JAA curl -L -H 'Range: bytes=46559344-46567731' https://archive.org/download/archiveteam_tumblr20181218030723/tumblr_20181218030723.megawarc.warc.gz > tumblr-tumblr-blog_obssesivebloodykisses-20181218-025918.warc.gz
19:17 πŸ”— JAA The numbers in the range header come from the JSON record for that file: "offset":46559344,"size":8388
19:17 πŸ”— JAA The second number is offset + size - 1.
19:20 πŸ”— JAA You could also extract that file from the megawarc using this: tail -c+46559345 tumblr_20181218030723.megawarc.warc.gz | head -c8388 > tumblr-tumblr-blog_obssesivebloodykisses-20181218-025918.warc.gz
19:20 πŸ”— JAA Where the number for tail is the offset + 1 and the one for head is the size.
19:45 πŸ”— Moder112 well
19:46 πŸ”— Moder112 unfortunately I tried using the megawarc program
19:46 πŸ”— Moder112 and it crashes on me
19:48 πŸ”— Moder112 I'm gonna try out the partial download solution tomorrow
19:49 πŸ”— Moder112 I'll come back to say how it went tomorrow
19:49 πŸ”— Moder112 thanks a lot
20:00 πŸ”— omarroth has quit IRC (Ping timeout: 506 seconds)
20:01 πŸ”— Moder112 has quit IRC (Quit: Page closed)
20:01 πŸ”— Stilett0 has joined #archiveteam-bs
20:05 πŸ”— Stiletto has quit IRC (Ping timeout: 615 seconds)
20:22 πŸ”— kiska1 has quit IRC (Read error: Operation timed out)
20:23 πŸ”— kiska1 has joined #archiveteam-bs
20:31 πŸ”— kiska1 has quit IRC (Ping timeout (120 seconds))
20:31 πŸ”— kiska1 has joined #archiveteam-bs
20:40 πŸ”— Despatche has joined #archiveteam-bs
20:54 πŸ”— SketchCow lenary: Excellent.
20:55 πŸ”— lenary SketchCow: how do I get the warcs somewhere safer than my spinning rust?
20:55 πŸ”— SketchCow Just upload into IA's opensource collection, a script puts them in a safe place.
20:55 πŸ”— lenary I haven’t attempted the other ephemera yet. Need to get Helena up and running
20:55 πŸ”— lenary Oh neat
20:59 πŸ”— Oddly has quit IRC (Quit: Leaving)
21:00 πŸ”— BlueMax has joined #archiveteam-bs
21:42 πŸ”— BlueMax has quit IRC (Read error: Connection reset by peer)
21:43 πŸ”— SimpBrain has quit IRC (Remote host closed the connection)
21:47 πŸ”— SimpBrain has joined #archiveteam-bs
21:57 πŸ”— wyatt8740 has joined #archiveteam-bs
22:23 πŸ”— SimpBrain has quit IRC (Remote host closed the connection)
22:26 πŸ”— SimpBrain has joined #archiveteam-bs
23:00 πŸ”— Despatche has quit IRC (Quit: Connection reset by deer)
23:02 πŸ”— fuzzy8021 has quit IRC (Read error: Connection reset by peer)
23:03 πŸ”— fuzzy8021 has joined #archiveteam-bs
23:25 πŸ”— dashcloud godane: I found a Hauppauge PVR-250 & an ASUS PVR-416 in my collection, and both seem to work

irclogger-viewer