About 23% of people over 50 want to delay their retirements over financial readiness and economic worries, a survey found.