For those fortunate enough to retire well ahead of 65, money may not be a worry — but it certainly remains a concern.