#archiveteam 2014-10-26,Sun

↑back Search

Time Nickname Message
01:40 🔗 nico hey SketchCow: on http://ascii.textfiles.com/archives/1649
01:40 🔗 nico you linked to http://www.joemanna.com/blog/aol-hometown-images-files-still-available/
01:41 🔗 nico but the owner "Ultimately, I believe that blog posts have a shelf-life and once they get so old that it is no longer relevant to my site or my current perspective, it is appropriate to remove such content."
01:42 🔗 nico yes, it is linked on a post about data deletion
01:42 🔗 nico so https://web.archive.org/web/20100405063147/http://www.joemanna.com/blog/aol-hometown-images-files-still-available ?
02:07 🔗 godane SketchCow: my dream is that you get JSMESS to handle playstation 1 games in the future
02:07 🔗 godane i don't know when that would possible only cause of size of roms
02:08 🔗 godane my thinking is being able to play all the old playstation 1 demo discs
03:23 🔗 SketchCow I think playstation's possible - it's just the size of the images, yes.
03:26 🔗 BlueMaxim if support for ECM was added, maybe? it can make disks surprisingly small
06:55 🔗 Emcy does anyone know who runs archive.today?
10:02 🔗 signius Is the twitpic grab done & dusted now ?
10:03 🔗 signius or will there be a full archive of the read only data from twitter once whatever is happening with that happens
10:08 🔗 antomatic signius: the plan at the moment is to do a full archive of Twitpic. It's not clear at this stage what Twitter will do with it
10:08 🔗 signius ok thanks
10:08 🔗 antomatic We had about 500m images, the not-shutdown gives us the opportunity to get the other 300m, and also to regrab the earlier images in a cleaner more convenient manner.
10:09 🔗 antomatic #quitpic is where it's all being discussed, if you'd like more. :)
10:09 🔗 signius i will keep checking the git repo & doing a pull to see when it restarts then
10:09 🔗 signius cheers
10:09 🔗 antomatic thank you! :)
10:09 🔗 signius I just need to find a project thats working now then to put boxes back to work :)
10:10 🔗 antomatic I think twitpic will start moving again later today.
10:12 🔗 antomatic It might be in a fresh project - best to keep an lookout just in case.
10:16 🔗 signius ok ancestry is working again, but the tracker for it seems not to be
10:17 🔗 antomatic I see your items coming through on the leaderboard, signius
10:17 🔗 antomatic Is http://tracker.archiveteam.org/ancestry/ not working for you?
10:17 🔗 signius ah it is working but it seems like only 1 or 2 people are running the new code for it
10:18 🔗 signius so its all good :) i will run that on some boxes until the twitpic-grab is back up
10:20 🔗 signius antomatic, i have got an issue when trying to run an instance of the scripts on a VM on my local LAN though i get server returned 0 .....sleeping
10:20 🔗 antomatic that might be the server at the other end, rather than any problem with your setup
10:21 🔗 antomatic I believe some of the remaining items on ancestry are misbheaving a little. :)
10:21 🔗 signius this was on twitpic last night it was doing this
10:21 🔗 signius i tried changing the nic from NAT to bridged & it still did the same thing
10:21 🔗 antomatic Do you see it all the time, or just occasionally?
10:22 🔗 antomatic (does it look like ANYTHING is working?)
10:22 🔗 signius let me fire up the VM again update the code for ancestry & see if its doing now on that
10:35 🔗 signius yeah doing exactly the same thing
10:36 🔗 antomatic I think your internet connection must be OK as otherwise it wouldn't even get as far as trying to download an item in the first place
10:36 🔗 signius Server returned 0. Sleeping
10:37 🔗 signius oh the VM has got internet access fine
10:37 🔗 antomatic I believe the current batch of leftover items on ancestry may be more likely to contain 0s though
10:37 🔗 antomatic it does retry for quite a long time
10:37 🔗 signius yeah but if that was the cause it would be doing the same on the other instances i am running & not just this 1 box
10:37 🔗 antomatic mm, true
10:37 🔗 antomatic where is the VM hoested?
10:38 🔗 antomatic *hosted
10:38 🔗 antomatic Twitpic jobs won't run from DigitalOcean, for example
10:38 🔗 antomatic (Twitpic were pretty ban-happy a while ago)
10:38 🔗 signius this is a VM on my local LAN the other instances i am running are on a couple of different providers in different datacenters
10:39 🔗 signius I am surprised at that considering loads of the other crap Digital Ocean allow users to run
10:39 🔗 antomatic If you see the 0s straight away (e.g. on the very first URL, and it gets no further than that) then possibly the site could have banned that IP
10:40 🔗 antomatic Twitpic complained directly to DO about one user, and banned the whole IP range as so many AT archivers tended to use it.
10:40 🔗 antomatic They really did not want their stuff saved.
10:40 🔗 signius basically he wanted to sell the data & if couldnt sell it & make money from it then he wasnt going to let anyone have it
10:42 🔗 signius ok if i fire up an instance of the archive warrior the ancestry stuff works fine
10:42 🔗 signius so its definitely something on the other VM
10:43 🔗 signius Hmm ok i lied now the warrior is returning 0s
10:43 🔗 signius it must be something to do with my network setup on my LAN i wont worry about it too much
10:44 🔗 antomatic could easily be the destination site too - 0s are common on Ancestry. But either way, as you say, don't worry about it too much. The script and/or warrior will make the best of it and work it all out by itself.
10:45 🔗 signius Lua runtime error: ancestry.lua:611: attempt to concatenate local 'genealogyrest' (a nil value).
10:45 🔗 signius ok after that error occurs thats when it stops pulling items & starts returning 0s
10:45 🔗 antomatic I believe that's OK, others have reported seeing the same thing.
10:45 🔗 antomatic arkiver wrote the scripts for that, he says it's nothing to worry about
10:45 🔗 antomatic #ancienthistory is the best channel for any problems with the ancestry grab
10:46 🔗 signius ok cheers
10:46 🔗 signius Hmm yeah i think i may beg to differ that that error is nothing to worry about
10:55 🔗 antomatic The LUA error is definitely fine - I've checked back in #ancienthistory and Arkiver said so on October 19th.
10:55 🔗 antomatic And you would definitely see lots of 0s on that project too.
11:02 🔗 arkiver yes, right now there are a lot of 0s
11:02 🔗 arkiver I'm now just retrying a 0 40 times and then skipping the url
11:03 🔗 arkiver so that's fine
11:03 🔗 arkiver as for the genealogyrest error, fine too, as antomatic said
11:03 🔗 arkiver it would cause that one url to be skipped that gets the error, but if the url that gets the error is not important at all
11:04 🔗 arkiver I can fix it though, but that requires everyone to update
11:14 🔗 signius it just seems odd that its pulling irls fine until i get that error & then after the errors i get Server returned 0. Sleeping errors non stop & does not download any more urls after
11:14 🔗 signius irls = urls
11:14 🔗 signius But like i say it is only happening on this 1 box so i cannot rule out that its something on this network setup here on my LAN causing the issue
11:16 🔗 signius On the other boxes i am running the same script i do get the "Server returned 0" errors but it moves on and quickly gives an "I give up" and then continues to run fine
11:27 🔗 arkiver don't worry about it I'd say
11:27 🔗 arkiver #ancienthistory btw
11:54 🔗 signius Yeah i am going with "dont worry about it" for now :) got too many other bits i need work on
13:15 🔗 * db48x yawns
13:15 🔗 db48x arkiver: hey, how was the sciencing at cern?
14:04 🔗 arkiver was great db48x
14:04 🔗 arkiver thanks!
14:57 🔗 commentat when can we grab again :) ?
15:09 🔗 arkiver you can run ancestry :)
15:30 🔗 db48x arkiver: awesome! learn anything? unlock the secrets of ultimate cosmic power?
21:37 🔗 SketchCow Ops, please.
21:40 🔗 * db48x yawns
21:41 🔗 db48x I need a nap
21:41 🔗 db48x SketchCow: how are things?
21:41 🔗 SketchCow Shit on toast
21:41 🔗 SketchCow But I will make them better.
21:42 🔗 db48x :(
21:53 🔗 db48x hmm
21:53 🔗 db48x I am surprisingly tired
21:55 🔗 db48x anyone else here going to the IA shindig on Tuesday?
22:52 🔗 * Smiley wibbles
22:52 🔗 Smiley yah we need moar ops
23:02 🔗 raylee balrog Cameron_D chronomex Lord_Nigh soultcer underscor
23:02 🔗 raylee (21:39:40) (SketchCow) Ops, please.
23:02 🔗 raylee ...lol
23:02 🔗 raylee I didn't want ops myself... but thanks, I guess
23:02 🔗 raylee I guess I'll keep them until.. well, until my bnc disconnects
23:04 🔗 Smiley lol that works :D
23:07 🔗 arkiver db48x: haha not yet ;)
23:08 🔗 arkiver I did get a lot of usefull information for my research
23:16 🔗 Smiley https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=190a8843ded231638d0e7ae7d8ca6a712472d114 glorius

irclogger-viewer