You should be worried about outliving retirement money. 500K will only last about 9 years for most people. Assuming it’s invested. That’s not long.