A lot of people assume Social Security is tax-free.
Sometimes it is.
But for many retirees, Social Security becomes taxable once other income gets added into the picture.
That could include IRA withdrawals, pension income, part-time work, investment income, interest income, or even tax-exempt interest.
This catches people off guard because the tax is not based only on the size of your Social Security check. It is based on a formula that looks at your total income picture.
The Basic Rule
The IRS uses something called combined income to determine whether your Social Security benefits are taxable.
The simple version is:
Adjusted gross income + tax-exempt interest + half of your Social Security benefits
That number determines how much of your Social Security may be included in taxable income.
This does not mean you lose that amount of Social Security.
That is one of the biggest misunderstandings.
When people hear that up to 85% of Social Security can be taxable, they sometimes think the government is taking 85% of their benefit.
That is not what it means.
It means up to 85% of your Social Security benefit may be included as taxable income on your tax return.
When Social Security Becomes Taxable
For individual filers, Social Security may become taxable once combined income is over $25,000.
For married couples filing jointly, Social Security may become taxable once combined income is over $32,000.
At higher income levels, up to 85% of Social Security benefits may be taxable.
For individual filers, that higher level starts once combined income is over $34,000.
For married couples filing jointly, that higher level starts once combined income is over $44,000.
These thresholds surprise a lot of people because they are not very high.
They were also set decades ago and have not been adjusted for inflation. That is one reason so many retirees end up dealing with Social Security taxation today.
A retired couple with Social Security, a pension, and IRA withdrawals can cross these levels very quickly.
A Simple Example
Let’s say a retired couple receives $40,000 per year in Social Security.
They also take $50,000 from an IRA.
For the Social Security formula, half of their Social Security counts toward combined income.
That means $20,000 of their Social Security is added to the $50,000 IRA withdrawal.
Their combined income would be $70,000 before even considering other possible income like interest, dividends, capital gains, or part-time work.
At that level, a portion of their Social Security would likely be taxable.
This is why retirement tax planning matters.
It is not just about how much income you have.
It is about where that income comes from.
Why IRA Withdrawals Matter
Traditional IRA and 401(k) withdrawals are usually taxable income.
That income can push more of your Social Security into the taxable range.
This creates a frustrating situation for many retirees.
They saved money in tax-deferred accounts for decades, which can be a smart strategy. But once retirement comes, every withdrawal may affect more than just the IRA balance.
It can also affect how much of their Social Security is taxable.
Later in retirement, required minimum distributions can make this even more challenging.
By the time RMDs begin, some retirees are forced to take withdrawals whether they need the money or not. Those withdrawals can increase taxable income, impact Social Security taxation, and potentially affect Medicare premiums.
This is where IRMAA can also come into play. IRMAA stands for Income-Related Monthly Adjustment Amount, and it can increase Medicare Part B and Part D premiums when income crosses certain levels.
Why Planning Before Retirement Can Help
One of the best times to plan is before Social Security starts and before required minimum distributions begin.
For many people, there is a window between retirement and their early 70s where taxable income may be lower.
That window may create planning opportunities.
For example, some retirees may consider taking IRA withdrawals earlier, doing Roth conversions, or using taxable accounts strategically before Social Security and RMDs create a higher-income situation later.
This does not mean everyone should do Roth conversions.
It does not mean everyone should delay Social Security.
It means the pieces should be looked at together.
Social Security, IRA withdrawals, pensions, investment income, Roth accounts, Medicare premiums, and taxes all interact.
Looking at each item separately can lead to missed opportunities.
New York Retirees Should Understand the Federal and State Difference
For New York State residents, Social Security is not taxed by New York State.
That is helpful.
But the federal government may still tax a portion of your Social Security depending on your income.
This is where people can get confused.
They hear that New York does not tax Social Security and assume that means Social Security is completely tax-free.
That is not always the case.
The state may not tax it, but the IRS still might.
The Real Issue Is Coordination
The goal is not to avoid every dollar of tax.
That is usually not realistic.
The goal is to avoid unnecessary tax surprises and make better decisions before the year is over.
For retirees, the key questions are:
- When should you start Social Security?
- Which accounts should you withdraw from first?
- Should you take IRA money before required minimum distributions begin?
- Would Roth conversions make sense?
- Could one large withdrawal create a tax problem?
- Will your income affect Medicare premiums?
- Are your tax return, investment plan, and retirement income plan working together?
These are the questions that matter.
Final Thought
Social Security taxation is one of those areas where a little planning can make a big difference.
The mistake is waiting until tax season to find out what happened.
By then, the year is already over.
If you are retired or within a few years of retirement, it is worth understanding how your income sources work together before you start making withdrawals, claiming Social Security, or selling investments.
Retirement income is not just about how much you have saved.
It is also about how you turn that savings into income in a tax-smart way.
If you want to see how your Social Security, IRA withdrawals, pensions, Medicare premiums, and taxes fit together, that is exactly what we help retirees and pre-retirees figure out.
18+ years of experience helping families and business owners make sense of complex tax and financial decisions. Runs Go Beyond Tax (Swiech Consulting LLC) in Lockport, NY, with his wife Donna.
Want someone to actually run your numbers?
The free 30-minute Tax Strategy Session is exactly this kind of analysis applied to your specific situation.
Schedule your session