| Time |
Nickname |
Message |
|
04:51
π
|
joepie91 |
SketchCow: good news! it looks like my afterhoursdjs archive just quite literally saved afterhoursdjs itself (ref http://www.afterhoursdjs.org/the-future-of-afterhoursdjs-org and http://www.afterhoursdjs.org/archives-found) |
|
04:55
π
|
kyan_ |
joepie91, that's cool! |
|
04:56
π
|
kyan_ |
*very cool |
|
04:56
π
|
joepie91 |
it is :) |
|
04:57
π
|
joepie91 |
quite happy to be able to do so, also |
|
04:57
π
|
* |
joepie91 really doesn't want afterhoursdjs to disappear |
|
06:44
π
|
xmc |
joepie91: rad! |
|
06:45
π
|
xmc |
it was gr8 |
|
07:02
π
|
joepie91 |
https://www.youtube.com/watch?v=dJxj1mou03M |
|
07:32
π
|
joepie91 |
http://www.smh.com.au/digital-life/smartphone-apps/australian-smartphone-camera-app-snappycam-disappears-from-app-store-without-a-trace-20140104-30ahj.html |
|
07:35
π
|
SketchCow |
joepie91: Need the archive to go into ia proper? |
|
07:35
π
|
joepie91 |
SketchCow: how do you mean? |
|
07:36
π
|
SketchCow |
Are they uploaded to the archive? |
|
07:37
π
|
SketchCow |
Or just stored on FOS? |
|
07:37
π
|
SketchCow |
Or something else? |
|
07:37
π
|
joepie91 |
oh |
|
07:37
π
|
joepie91 |
SketchCow: those are the ones already in the afterhoursdjs_livesets collection, and a bunch of ones that I haven't uploaded yet |
|
07:37
π
|
joepie91 |
will get to that soon |
|
07:37
π
|
SketchCow |
OK. |
|
07:38
π
|
SketchCow |
Just making sure I wasn't needed or something for it. |
|
07:38
π
|
joepie91 |
unless you have spare time, in which case http://baguette.cryto.net/ahdjs.zip :P |
|
07:38
π
|
SketchCow |
You have it, that's good. |
|
07:38
π
|
joepie91 |
but I'll eventually get around to it |
|
07:38
π
|
SketchCow |
Right now we have both space and time |
|
07:38
π
|
joepie91 |
it's some... 29 gigs? I think |
|
07:38
π
|
SketchCow |
Pfft |
|
07:38
π
|
joepie91 |
most of it is tagged with metadata, just hadn't tested the upload script yet |
|
08:04
π
|
instence |
How do you verify an archive file (rar,tar.gz,7z, etc) was built properly? One way is to create an sfv file before packaging the data, package it, then extract and re-check the output against the sfv. Is there a better way to do this? |
|
08:11
π
|
SketchCow |
I do a directory of it and see if it complains. |
|
08:12
π
|
SketchCow |
You can often do a verification run on it too |
|
08:16
π
|
instence |
Hmm yea, I am not seeing anything in winrar that allows that. My primary archive package format is RAR, multi-volume at 100,000,000, with recovery record, Normal Compression, or in certain instances Store |
|
08:19
π
|
DFJustin |
Commands->Test Archived Files in WinRAR |
|
08:20
π
|
instence |
Yea but doesn't that test against potential errors that might have afflicted the files "after" its been compressed? I am wondering if its possible for bad data to write during the actual package build process. |
|
08:21
π
|
DFJustin |
I believe that checks the files against the checksums in the RAR file, I'm not sure if it's possible for those to be bad or not |
|
08:22
π
|
DFJustin |
you could checksum the files with an external tool and compare the results |
|
08:22
π
|
instence |
Yea thats what I was thinking before, about creating an SFV file prior to packaging, package the data, re-extract, and then run the SFV file against the re-extracted data. |
|
08:23
π
|
instence |
Man I really need to get a box with 64GB of RAM to handle this type of stuff (RAMDisk Style). Makes data processing like this a breeze. |
|
08:24
π
|
DFJustin |
well I mean run the files through a crc32 tool, then rar them and compare the crc32s visually (or scrounge something that can print the rar header) coupled with running winrar's "test archived files" |
|
08:24
π
|
DFJustin |
then there is no need to re-extract |
|
08:25
π
|
instence |
hmm yea, good idea |
|
08:25
π
|
SketchCow |
https://www.youtube.com/watch?feature=player_embedded&v=31Jg4GaDojo |
|
08:26
π
|
SketchCow |
P E R F E C T I O N |
|
08:27
π
|
instence |
haha |
|
08:27
π
|
instence |
"That man died in mid wir" |
|
08:27
π
|
instence |
air* |
|
08:28
π
|
DFJustin |
haha I was introduced to this channel just recently |
|
08:30
π
|
DFJustin |
he manages to work the word "titties" into every video |
|
08:30
π
|
SketchCow |
I love it as much as I love the dubstep train and farm simulator videos |
|
08:32
π
|
DFJustin |
https://www.youtube.com/watch?v=Iu04U-Yb2qs |
|
09:19
π
|
instence |
Thanks DFJustin for tips on CRC32 comparison. Much appreciated. |
|
09:54
π
|
joepie91 |
SketchCow: I suggested to the afterhoursdjs guy that he maintain a publicly accessible liveset archive; the result is http://archive.afterhoursdjs.org/ :) |
|
09:54
π
|
joepie91 |
cc others |
|
10:32
π
|
joepie91 |
what am I screwing up here? http://sprunge.us/WHVj |
|
10:32
π
|
joepie91 |
(internetarchive python module) |
|
17:03
π
|
godane |
SketchCow: This week in startups is NOT a Revision3 show |
|
17:03
π
|
godane |
but thanks for moving it to computerandtechvideos |
|
17:54
π
|
godane |
http://ollydbg.de/Paperbak/ |
|
17:55
π
|
godane |
looks like there is a way to backup old video games on to paper |
|
17:55
π
|
BiggieJon |
hardcopy playthrus ? |
|
18:29
π
|
godane |
would be interesting if we could make cards with barcodes on that can load a rom into jsmess with that barcode |
|
18:29
π
|
godane |
not some barcode link |
|
18:30
π
|
godane |
but to have the full game on paper |
|
18:36
π
|
Schbirid |
not much fits into one |
|
18:37
π
|
DFJustin |
for 8-bit games it would be ok |
|
18:43
π
|
DFJustin |
https://www.youtube.com/watch?v=ktUguF1TnJk |
|
18:44
π
|
DFJustin |
apparently doesn't work in mess :( |
|
18:47
π
|
SketchCow |
That is a hardware modified pet. |
|
18:48
π
|
SketchCow |
No, wait. |
|
18:48
π
|
SketchCow |
Pet 4032 |
|
18:48
π
|
SketchCow |
The Amiga 3000 of PETs |
|
19:02
π
|
DFJustin |
aw |
|
19:06
π
|
SketchCow |
The PET 4032 was released three years after the original PET 2001. Although it has the same CPU running at the same speed, improved circuitry allows the 4032 to run substantially faster. Other improvements include more memory and a better keyboard. |
|
19:07
π
|
SketchCow |
Yeah, see, this thing is a total redone machine. |
|
19:07
π
|
SketchCow |
So they're conflating the PET 2001 that most people would know with the last revision of business-quality PET. |
|
19:44
π
|
kyan_ |
Is there any way to make sure a WARC is correct for the Wayback machine? I have some that warcvalid likes but I'm extra skeptical about themΓ’ΒΒ¦ |
|
19:47
π
|
SketchCow |
We can upload them and see |
|
19:48
π
|
kyan_ |
Ok, cool. thanks. :) |
|
19:49
π
|
kyan_ |
(I'm worried about them because they're from a version of warcprox that I altered to work on python 2.6, and it has a penchant for barfing errors everywhere) |
|
19:52
π
|
SketchCow |
Do a small upload, see what the machine does. |
|
19:53
π
|
SketchCow |
Don't blow up terabytes and see what happens. |
|
19:53
π
|
kyan_ |
Sounds like a worthy course of action :) |
|
19:55
π
|
kyan_ |
In the FAQ page for archive.org, regarding uploading book scans, it says "at present, there are rather strict requirements for how the files in an image stack are to be named" Γ’ΒΒ is there documentation of those requirements? that's about as much detail as it goes intoΓ’ΒΒ¦ |
|
20:03
π
|
SketchCow |
We have a bin for book scans done by Just People |
|
20:03
π
|
SketchCow |
http://archive.org/details/folkscanomy |
|
20:04
π
|
SketchCow |
Just upload scans. If you did them yourself, preferably, unless you are sure they're unique |
|
20:13
π
|
kyan_ |
Ok! The item in question is a manual for a range of models of "Perfection Vented Gas-Fired Room Heaters", 108282-G1 Rev. 6/86. I can't find it with a Google search, so I think it's probably a first scan. |
|
20:14
π
|
kyan_ |
It's the first time I've tried doing one, also, so it's not quite good looking :( |
|
20:27
π
|
xmc |
a readable scan is better than a scan that doesn't exist! |
|
20:28
π
|
kyan_ |
xmc, Suppose so :) and hopefully I'll get the hang of them if I do some! |
|
20:28
π
|
kyan_ |
the main issues with this one is warped pages |
|
20:29
π
|
kyan_ |
(also insect damage to the original, but I can't really do anything about that) |
|
21:42
π
|
kyan |
Ok I'm uploading the first real one of my warcproxed items now, a band's youtube channel. Fingers crossed that it works :) |
|
21:48
π
|
Schbirid |
this release is insanely good if you like calm nightly paddy minimal techno https://archive.org/details/stasis19 |
|
21:55
π
|
kyan |
Not my current upload but I noticed that this set of WARCs https://archive.org/details/ellogon.big.files.22nov2013a.mn didn't get their CDXs generated correctly for the files over 2Gb. Any thoughts on fixing them? |
|
21:58
π
|
DFJustin |
as far as I can tell there are no specific requirements on book image naming anymore |
|
21:59
π
|
DFJustin |
as long as they're sequential |
|
22:00
π
|
xmc |
yeah, it seems like `find . | sort` |
|
22:01
π
|
kyan |
DFJustin, Oh ok, cool :) |
|
22:02
π
|
kyan |
Actually I just found something else I did with my altered warcprox, https://archive.org/details/WARCPROX20131218193016732Self.Serial12737Elegy8000.warc Unfortunately it looks like something's FUBAR with it since the CDX never showed up for that either. |
|
22:03
π
|
DFJustin |
https://catalogd.archive.org/log/279143884 |
|
22:04
π
|
kyan |
"zlib.error: Error -3 while decompressing: incorrect header check" but then a few lines down ".gz is readable, failure is for some other reason" |
|
22:04
π
|
kyan |
seems to be contradicting itself |
|
22:04
π
|
* |
kyan tries making a cdx by hand |
|
23:05
π
|
kyan |
Ok. There is something wrong with the WARCs, for sure. While warcindex indexes them fine, JWAT cdx writes an empty cdx file. |
|
23:06
π
|
kyan |
I don't know how to fix them though :( |
|
23:07
π
|
DFJustin |
hmm it does seem like there is a need for a warcsalvage or unfuckwarc tool |
|
23:08
π
|
kyan |
DFJustin, second that |
|
23:09
π
|
kyan |
Ok I've uploaded the heater manual as a bunch of tarred TIFFs https://archive.org/details/PERFECTIONVentedGas-FiredRoomHeatersManual108282-G1Rev.686 but I have no idea what to do to make it turn it into everything else |
|
23:13
π
|
DFJustin |
rename it to TIFFStack_images.tar and rederive |
|
23:14
π
|
DFJustin |
rederive by going to Edit item on the left side, change the information, Item Manager, derive button |
|
23:16
π
|
kyan |
DFJustin, it's listing it as "NonSource" https://catalogd.archive.org/log/281106542 |
|
23:18
π
|
DFJustin |
yeah the _images thing is magic |
|
23:19
π
|
DFJustin |
oh I see you reran it after that |
|
23:20
π
|
DFJustin |
go into 'change the information' and change the file type from TAR to 'Generic raw book TAR' |
|
23:20
π
|
DFJustin |
I guess that isn't automatic if it was renamed |
|
23:57
π
|
kyan |
DFJustin, Thanks! :) The derive seems to be rockin and rollin now. |