Retirees also have varying amounts of social security that is taxed based upon the amount of their income. In some cases, the difference can vary between and being taxed. Retirees also have varying amounts of social security that is taxed based upon the amount of their income. In some cases, the difference can vary between and being taxed