[01:40] hey SketchCow: on http://ascii.textfiles.com/archives/1649 [01:40] you linked to http://www.joemanna.com/blog/aol-hometown-images-files-still-available/ [01:41] but the owner "Ultimately, I believe that blog posts have a shelf-life and once they get so old that it is no longer relevant to my site or my current perspective, it is appropriate to remove such content." [01:42] yes, it is linked on a post about data deletion [01:42] so https://web.archive.org/web/20100405063147/http://www.joemanna.com/blog/aol-hometown-images-files-still-available ? [02:07] SketchCow: my dream is that you get JSMESS to handle playstation 1 games in the future [02:07] i don't know when that would possible only cause of size of roms [02:08] my thinking is being able to play all the old playstation 1 demo discs [03:23] I think playstation's possible - it's just the size of the images, yes. [03:26] if support for ECM was added, maybe? it can make disks surprisingly small [06:55] does anyone know who runs archive.today? [10:02] Is the twitpic grab done & dusted now ? [10:03] or will there be a full archive of the read only data from twitter once whatever is happening with that happens [10:08] signius: the plan at the moment is to do a full archive of Twitpic. It's not clear at this stage what Twitter will do with it [10:08] ok thanks [10:08] We had about 500m images, the not-shutdown gives us the opportunity to get the other 300m, and also to regrab the earlier images in a cleaner more convenient manner. [10:09] #quitpic is where it's all being discussed, if you'd like more. :) [10:09] i will keep checking the git repo & doing a pull to see when it restarts then [10:09] cheers [10:09] thank you! :) [10:09] I just need to find a project thats working now then to put boxes back to work :) [10:10] I think twitpic will start moving again later today. [10:12] It might be in a fresh project - best to keep an lookout just in case. [10:16] ok ancestry is working again, but the tracker for it seems not to be [10:17] I see your items coming through on the leaderboard, signius [10:17] Is http://tracker.archiveteam.org/ancestry/ not working for you? [10:17] ah it is working but it seems like only 1 or 2 people are running the new code for it [10:18] so its all good :) i will run that on some boxes until the twitpic-grab is back up [10:20] antomatic, i have got an issue when trying to run an instance of the scripts on a VM on my local LAN though i get server returned 0 .....sleeping [10:20] that might be the server at the other end, rather than any problem with your setup [10:21] I believe some of the remaining items on ancestry are misbheaving a little. :) [10:21] this was on twitpic last night it was doing this [10:21] i tried changing the nic from NAT to bridged & it still did the same thing [10:21] Do you see it all the time, or just occasionally? [10:22] (does it look like ANYTHING is working?) [10:22] let me fire up the VM again update the code for ancestry & see if its doing now on that [10:35] yeah doing exactly the same thing [10:36] I think your internet connection must be OK as otherwise it wouldn't even get as far as trying to download an item in the first place [10:36] Server returned 0. Sleeping [10:37] oh the VM has got internet access fine [10:37] I believe the current batch of leftover items on ancestry may be more likely to contain 0s though [10:37] it does retry for quite a long time [10:37] yeah but if that was the cause it would be doing the same on the other instances i am running & not just this 1 box [10:37] mm, true [10:37] where is the VM hoested? [10:38] *hosted [10:38] Twitpic jobs won't run from DigitalOcean, for example [10:38] (Twitpic were pretty ban-happy a while ago) [10:38] this is a VM on my local LAN the other instances i am running are on a couple of different providers in different datacenters [10:39] I am surprised at that considering loads of the other crap Digital Ocean allow users to run [10:39] If you see the 0s straight away (e.g. on the very first URL, and it gets no further than that) then possibly the site could have banned that IP [10:40] Twitpic complained directly to DO about one user, and banned the whole IP range as so many AT archivers tended to use it. [10:40] They really did not want their stuff saved. [10:40] basically he wanted to sell the data & if couldnt sell it & make money from it then he wasnt going to let anyone have it [10:42] ok if i fire up an instance of the archive warrior the ancestry stuff works fine [10:42] so its definitely something on the other VM [10:43] Hmm ok i lied now the warrior is returning 0s [10:43] it must be something to do with my network setup on my LAN i wont worry about it too much [10:44] could easily be the destination site too - 0s are common on Ancestry. But either way, as you say, don't worry about it too much. The script and/or warrior will make the best of it and work it all out by itself. [10:45] Lua runtime error: ancestry.lua:611: attempt to concatenate local 'genealogyrest' (a nil value). [10:45] ok after that error occurs thats when it stops pulling items & starts returning 0s [10:45] I believe that's OK, others have reported seeing the same thing. [10:45] arkiver wrote the scripts for that, he says it's nothing to worry about [10:45] #ancienthistory is the best channel for any problems with the ancestry grab [10:46] ok cheers [10:46] Hmm yeah i think i may beg to differ that that error is nothing to worry about [10:55] The LUA error is definitely fine - I've checked back in #ancienthistory and Arkiver said so on October 19th. [10:55] And you would definitely see lots of 0s on that project too. [11:02] yes, right now there are a lot of 0s [11:02] I'm now just retrying a 0 40 times and then skipping the url [11:03] so that's fine [11:03] as for the genealogyrest error, fine too, as antomatic said [11:03] it would cause that one url to be skipped that gets the error, but if the url that gets the error is not important at all [11:04] I can fix it though, but that requires everyone to update [11:14] it just seems odd that its pulling irls fine until i get that error & then after the errors i get Server returned 0. Sleeping errors non stop & does not download any more urls after [11:14] irls = urls [11:14] But like i say it is only happening on this 1 box so i cannot rule out that its something on this network setup here on my LAN causing the issue [11:16] On the other boxes i am running the same script i do get the "Server returned 0" errors but it moves on and quickly gives an "I give up" and then continues to run fine [11:27] don't worry about it I'd say [11:27] #ancienthistory btw [11:54] Yeah i am going with "dont worry about it" for now :) got too many other bits i need work on [13:15] * db48x yawns [13:15] arkiver: hey, how was the sciencing at cern? [14:04] was great db48x [14:04] thanks! [14:57] when can we grab again :) ? [15:09] you can run ancestry :) [15:30] arkiver: awesome! learn anything? unlock the secrets of ultimate cosmic power? [21:37] Ops, please. [21:40] * db48x yawns [21:41] I need a nap [21:41] SketchCow: how are things? [21:41] Shit on toast [21:41] But I will make them better. [21:42] :( [21:53] hmm [21:53] I am surprisingly tired [21:55] anyone else here going to the IA shindig on Tuesday? [22:52] * Smiley wibbles [22:52] yah we need moar ops [23:02] balrog Cameron_D chronomex Lord_Nigh soultcer underscor [23:02] (21:39:40) (SketchCow) Ops, please. [23:02] ...lol [23:02] I didn't want ops myself... but thanks, I guess [23:02] I guess I'll keep them until.. well, until my bnc disconnects [23:04] lol that works :D [23:07] db48x: haha not yet ;) [23:08] I did get a lot of usefull information for my research [23:16] https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=190a8843ded231638d0e7ae7d8ca6a712472d114 glorius