| Time |
Nickname |
Message |
|
01:40
🔗
|
nico |
hey SketchCow: on http://ascii.textfiles.com/archives/1649 |
|
01:40
🔗
|
nico |
you linked to http://www.joemanna.com/blog/aol-hometown-images-files-still-available/ |
|
01:41
🔗
|
nico |
but the owner "Ultimately, I believe that blog posts have a shelf-life and once they get so old that it is no longer relevant to my site or my current perspective, it is appropriate to remove such content." |
|
01:42
🔗
|
nico |
yes, it is linked on a post about data deletion |
|
01:42
🔗
|
nico |
so https://web.archive.org/web/20100405063147/http://www.joemanna.com/blog/aol-hometown-images-files-still-available ? |
|
02:07
🔗
|
godane |
SketchCow: my dream is that you get JSMESS to handle playstation 1 games in the future |
|
02:07
🔗
|
godane |
i don't know when that would possible only cause of size of roms |
|
02:08
🔗
|
godane |
my thinking is being able to play all the old playstation 1 demo discs |
|
03:23
🔗
|
SketchCow |
I think playstation's possible - it's just the size of the images, yes. |
|
03:26
🔗
|
BlueMaxim |
if support for ECM was added, maybe? it can make disks surprisingly small |
|
06:55
🔗
|
Emcy |
does anyone know who runs archive.today? |
|
10:02
🔗
|
signius |
Is the twitpic grab done & dusted now ? |
|
10:03
🔗
|
signius |
or will there be a full archive of the read only data from twitter once whatever is happening with that happens |
|
10:08
🔗
|
antomatic |
signius: the plan at the moment is to do a full archive of Twitpic. It's not clear at this stage what Twitter will do with it |
|
10:08
🔗
|
signius |
ok thanks |
|
10:08
🔗
|
antomatic |
We had about 500m images, the not-shutdown gives us the opportunity to get the other 300m, and also to regrab the earlier images in a cleaner more convenient manner. |
|
10:09
🔗
|
antomatic |
#quitpic is where it's all being discussed, if you'd like more. :) |
|
10:09
🔗
|
signius |
i will keep checking the git repo & doing a pull to see when it restarts then |
|
10:09
🔗
|
signius |
cheers |
|
10:09
🔗
|
antomatic |
thank you! :) |
|
10:09
🔗
|
signius |
I just need to find a project thats working now then to put boxes back to work :) |
|
10:10
🔗
|
antomatic |
I think twitpic will start moving again later today. |
|
10:12
🔗
|
antomatic |
It might be in a fresh project - best to keep an lookout just in case. |
|
10:16
🔗
|
signius |
ok ancestry is working again, but the tracker for it seems not to be |
|
10:17
🔗
|
antomatic |
I see your items coming through on the leaderboard, signius |
|
10:17
🔗
|
antomatic |
Is http://tracker.archiveteam.org/ancestry/ not working for you? |
|
10:17
🔗
|
signius |
ah it is working but it seems like only 1 or 2 people are running the new code for it |
|
10:18
🔗
|
signius |
so its all good :) i will run that on some boxes until the twitpic-grab is back up |
|
10:20
🔗
|
signius |
antomatic, i have got an issue when trying to run an instance of the scripts on a VM on my local LAN though i get server returned 0 .....sleeping |
|
10:20
🔗
|
antomatic |
that might be the server at the other end, rather than any problem with your setup |
|
10:21
🔗
|
antomatic |
I believe some of the remaining items on ancestry are misbheaving a little. :) |
|
10:21
🔗
|
signius |
this was on twitpic last night it was doing this |
|
10:21
🔗
|
signius |
i tried changing the nic from NAT to bridged & it still did the same thing |
|
10:21
🔗
|
antomatic |
Do you see it all the time, or just occasionally? |
|
10:22
🔗
|
antomatic |
(does it look like ANYTHING is working?) |
|
10:22
🔗
|
signius |
let me fire up the VM again update the code for ancestry & see if its doing now on that |
|
10:35
🔗
|
signius |
yeah doing exactly the same thing |
|
10:36
🔗
|
antomatic |
I think your internet connection must be OK as otherwise it wouldn't even get as far as trying to download an item in the first place |
|
10:36
🔗
|
signius |
Server returned 0. Sleeping |
|
10:37
🔗
|
signius |
oh the VM has got internet access fine |
|
10:37
🔗
|
antomatic |
I believe the current batch of leftover items on ancestry may be more likely to contain 0s though |
|
10:37
🔗
|
antomatic |
it does retry for quite a long time |
|
10:37
🔗
|
signius |
yeah but if that was the cause it would be doing the same on the other instances i am running & not just this 1 box |
|
10:37
🔗
|
antomatic |
mm, true |
|
10:37
🔗
|
antomatic |
where is the VM hoested? |
|
10:38
🔗
|
antomatic |
*hosted |
|
10:38
🔗
|
antomatic |
Twitpic jobs won't run from DigitalOcean, for example |
|
10:38
🔗
|
antomatic |
(Twitpic were pretty ban-happy a while ago) |
|
10:38
🔗
|
signius |
this is a VM on my local LAN the other instances i am running are on a couple of different providers in different datacenters |
|
10:39
🔗
|
signius |
I am surprised at that considering loads of the other crap Digital Ocean allow users to run |
|
10:39
🔗
|
antomatic |
If you see the 0s straight away (e.g. on the very first URL, and it gets no further than that) then possibly the site could have banned that IP |
|
10:40
🔗
|
antomatic |
Twitpic complained directly to DO about one user, and banned the whole IP range as so many AT archivers tended to use it. |
|
10:40
🔗
|
antomatic |
They really did not want their stuff saved. |
|
10:40
🔗
|
signius |
basically he wanted to sell the data & if couldnt sell it & make money from it then he wasnt going to let anyone have it |
|
10:42
🔗
|
signius |
ok if i fire up an instance of the archive warrior the ancestry stuff works fine |
|
10:42
🔗
|
signius |
so its definitely something on the other VM |
|
10:43
🔗
|
signius |
Hmm ok i lied now the warrior is returning 0s |
|
10:43
🔗
|
signius |
it must be something to do with my network setup on my LAN i wont worry about it too much |
|
10:44
🔗
|
antomatic |
could easily be the destination site too - 0s are common on Ancestry. But either way, as you say, don't worry about it too much. The script and/or warrior will make the best of it and work it all out by itself. |
|
10:45
🔗
|
signius |
Lua runtime error: ancestry.lua:611: attempt to concatenate local 'genealogyrest' (a nil value). |
|
10:45
🔗
|
signius |
ok after that error occurs thats when it stops pulling items & starts returning 0s |
|
10:45
🔗
|
antomatic |
I believe that's OK, others have reported seeing the same thing. |
|
10:45
🔗
|
antomatic |
arkiver wrote the scripts for that, he says it's nothing to worry about |
|
10:45
🔗
|
antomatic |
#ancienthistory is the best channel for any problems with the ancestry grab |
|
10:46
🔗
|
signius |
ok cheers |
|
10:46
🔗
|
signius |
Hmm yeah i think i may beg to differ that that error is nothing to worry about |
|
10:55
🔗
|
antomatic |
The LUA error is definitely fine - I've checked back in #ancienthistory and Arkiver said so on October 19th. |
|
10:55
🔗
|
antomatic |
And you would definitely see lots of 0s on that project too. |
|
11:02
🔗
|
arkiver |
yes, right now there are a lot of 0s |
|
11:02
🔗
|
arkiver |
I'm now just retrying a 0 40 times and then skipping the url |
|
11:03
🔗
|
arkiver |
so that's fine |
|
11:03
🔗
|
arkiver |
as for the genealogyrest error, fine too, as antomatic said |
|
11:03
🔗
|
arkiver |
it would cause that one url to be skipped that gets the error, but if the url that gets the error is not important at all |
|
11:04
🔗
|
arkiver |
I can fix it though, but that requires everyone to update |
|
11:14
🔗
|
signius |
it just seems odd that its pulling irls fine until i get that error & then after the errors i get Server returned 0. Sleeping errors non stop & does not download any more urls after |
|
11:14
🔗
|
signius |
irls = urls |
|
11:14
🔗
|
signius |
But like i say it is only happening on this 1 box so i cannot rule out that its something on this network setup here on my LAN causing the issue |
|
11:16
🔗
|
signius |
On the other boxes i am running the same script i do get the "Server returned 0" errors but it moves on and quickly gives an "I give up" and then continues to run fine |
|
11:27
🔗
|
arkiver |
don't worry about it I'd say |
|
11:27
🔗
|
arkiver |
#ancienthistory btw |
|
11:54
🔗
|
signius |
Yeah i am going with "dont worry about it" for now :) got too many other bits i need work on |
|
13:15
🔗
|
* |
db48x yawns |
|
13:15
🔗
|
db48x |
arkiver: hey, how was the sciencing at cern? |
|
14:04
🔗
|
arkiver |
was great db48x |
|
14:04
🔗
|
arkiver |
thanks! |
|
14:57
🔗
|
commentat |
when can we grab again :) ? |
|
15:09
🔗
|
arkiver |
you can run ancestry :) |
|
15:30
🔗
|
db48x |
arkiver: awesome! learn anything? unlock the secrets of ultimate cosmic power? |
|
21:37
🔗
|
SketchCow |
Ops, please. |
|
21:40
🔗
|
* |
db48x yawns |
|
21:41
🔗
|
db48x |
I need a nap |
|
21:41
🔗
|
db48x |
SketchCow: how are things? |
|
21:41
🔗
|
SketchCow |
Shit on toast |
|
21:41
🔗
|
SketchCow |
But I will make them better. |
|
21:42
🔗
|
db48x |
:( |
|
21:53
🔗
|
db48x |
hmm |
|
21:53
🔗
|
db48x |
I am surprisingly tired |
|
21:55
🔗
|
db48x |
anyone else here going to the IA shindig on Tuesday? |
|
22:52
🔗
|
* |
Smiley wibbles |
|
22:52
🔗
|
Smiley |
yah we need moar ops |
|
23:02
🔗
|
raylee |
balrog Cameron_D chronomex Lord_Nigh soultcer underscor |
|
23:02
🔗
|
raylee |
(21:39:40) (SketchCow) Ops, please. |
|
23:02
🔗
|
raylee |
...lol |
|
23:02
🔗
|
raylee |
I didn't want ops myself... but thanks, I guess |
|
23:02
🔗
|
raylee |
I guess I'll keep them until.. well, until my bnc disconnects |
|
23:04
🔗
|
Smiley |
lol that works :D |
|
23:07
🔗
|
arkiver |
db48x: haha not yet ;) |
|
23:08
🔗
|
arkiver |
I did get a lot of usefull information for my research |
|
23:16
🔗
|
Smiley |
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=190a8843ded231638d0e7ae7d8ca6a712472d114 glorius |