3 Mistakes to Avoid When Making a Large Portfolio Withdrawal

February 11, 2022
How to manage a large portfolio withdrawal without throwing the rest of your finances out of whack.

Imagine a Colorado Springs–based couple, Jeremy and Irene. They've long dreamed of owning a vacation property in the foothills outside Hailey, Idaho. But after 10 years of diligent saving, Jeremy and Irene realize they have no idea how to manage such a large portfolio withdrawal.

Should they take the money out over time as they search in earnest for their dream home or wait to withdraw it all at once? Which investments should they sell? How will the withdrawal affect their taxes? And what can they do to ensure the transaction doesn't throw the rest of their portfolio off-balance?

"There's plenty of advice out there about how to save for your goals, but for many investors, there's less guidance or clarity regarding how to tap your investments once you reach a goal," says Rob Williams, CFP®, CRPC®, managing director of financial planning, retirement income, and wealth management at the Schwab Center for Financial Research. 

As a result, many investors approach a sizable withdrawal as they would a smaller one—with potentially negative consequences for both their taxes and overall portfolio performance. Here are three of the most common mistakes people make when managing a large portfolio withdrawal—and how to avoid them.

Mistake #1: Withdrawing all at once

Selling substantial assets in a single calendar year—versus staggering the distribution over two or more years—increases your total taxable income and could be enough to bump you into a higher tax bracket.

"Depending on the size of the withdrawal, you might want to split it up over multiple years," says Hayden Adams, CPA, CFP®, director of tax and financial planning at the Schwab Center for Financial Research. "If you don't, you could get hit with a big tax bill." 

To help minimize your tax bill, start by figuring out how much money you'll need and how soon you'll need it, and work backward from there. Then you can look at several strategies, such as tax-gain harvesting or topping off tax brackets, to get the cash you need with the least amount of tax impact.

Here's how topping off a tax bracket could work to save taxes. 

Let's say Jeremy and Irene are both age 62. For 2022, they have $72,000 of income, which means their taxable income would be $46,100 after taking the $25,900 standard deduction for a married couple—putting them in the 12% marginal tax bracket.

They've determined that they can afford a second home, which they plan on purchasing in 2024, and need $50,000 for the down payment. They decide the funds will come from Jeremy's traditional IRA, so the withdrawal will be taxed as ordinary income. 

If Jeremy and Irene withdraw the full amount this year, their total taxable income—including the IRA distribution—would bump some of that withdrawal into the next higher tax bracket of 22%. That means they would need to take out $59,301 to cover the estimated $9,301 in taxes they would owe on that withdrawal to get them the $50,000 down payment they need.1

By splitting the distribution over two years, they can remain in the lower 12% tax bracket (assuming no income or tax changes) and would only need to withdraw about $56,818 over two years, potentially saving them $2,483 in taxes. It would work like this: They could take $37,450 out of Jeremy's IRA this year and owe roughly $4,494 in taxes (at the 12% tax rate) on the withdrawal. Then the next year, they could withdraw $19,368 from his IRA, paying about $2,324 in taxes (at the 12% tax rate)—giving them $50,000 after taxes for the down payment.2

By using the tax strategy of splitting their distributions and topping off the 12% tax bracket, Jeremy and Irene would be able to reduce their overall taxes, thereby minimizing the amount they would need to withdraw from Jeremy's retirement savings. Spreading a large withdrawal across several years—particularly if you're near the upper end of your tax bracket—can often result in a significant savings, Hayden says.

Mistake #2: Avoiding selling at a loss

Investors often have a natural antipathy toward selling investments at a loss. This so-called loss aversion can cause us to overlook our underperforming investments when deciding which assets to sell. "It's hard for many people to stomach losses, but they can actually be a boon, tax-wise, if you hold the investment in a taxable brokerage account," Rob says.

Not all underperforming assets are fit for the chopping block, but those with weak future prospects or that no longer fit your investment strategy are prime candidates. "When you sell an investment for less than you paid, you can use the capital loss to offset capital gains from the sale of other assets in a taxable brokerage account that have appreciated, potentially reducing your tax bill," Hayden explains. This strategy is called tax-loss harvesting and can lower taxes on your investments if done wisely.

What's more, if your capital losses exceed your capital gains from investments held and sold in a taxable brokerage account, you can use those losses to potentially reduce your ordinary taxable income by up to $3,000. Anything above that can be carried over to future tax years.

A large withdrawal is also an ideal opportunity to rebalance your portfolio. As withdrawals and market fluctuations alter the proportions of your portfolio holdings, your asset allocation may stray from its target, causing some positions to be overweight and others underweight. "It's important to keep your portfolio in line with your risk tolerance and time horizon," Rob says.

Cutting your losses can cut your tax bill

Offsetting capital gains with capital losses—a.k.a. tax-loss harvesting—can potentially lower your taxes.

Two hypothetical scenarios: One in which you sell appreciated assets for a gain of $50,000, none at a loss. Your gain is taxed at 20%, and your tax bill is $10,000. Scenario two, you sell appreciated assets for a gain of $50,000, sell depreciated assets for a loss of $10,000, and have a net gain of $40,000 taxed at 20%, resulting in a $8,000 tax bill.

For illustrative purposes only. The long-term capital gains rate of 20% assumes a combined 15% federal rate and 5% state rate. Investors may pay higher or lower long-term capital gains rates based on their income and filing status.

Mistake #3: Neglecting your other goals

Jeremy and Irene are likely saving—and investing—for multiple goals, not only for their vacation home in Idaho. For this and other reasons, it makes sense to diversify your savings by the type of account you invest in, as well as the size—and timing—of your goals. This strategy is called tax diversification. 

"One of the benefits of tax diversification is having different types of accounts—taxable brokerage, traditional IRA and 401(k), Roth IRA and 401(k)—you can choose from to minimize the tax impact of a withdrawal," Hayden notes.

Contributions to Roth 401(k)s and Roth IRAs, for example, are made with after-tax dollars, meaning contributions won't reduce your current taxable income, and you won't owe taxes on appreciation, income, or withdrawals in retirement (provided the account holder is over age 59½ and has held the account for five years or more).

Pre-tax contributions to tax-deferred accounts—which include 401(k)s, 403(b)s, and traditional IRAs—generally reduce your current tax bill and aren't taxed until you withdraw the money. Withdrawals are subject to ordinary income taxes, which can be higher than preferential tax rates on long-term capital gains from the sale of assets in taxable accounts, and, if taken prior to age 59½, may be subject to a 10% federal tax penalty (barring certain exceptions).

Meanwhile, withdrawals from a taxable brokerage account may be subject to capital gains rates of 0% to 20%—plus an additional 3.8% Net Income Investment Tax for single filers with a modified adjusted gross income greater than $200,000 ($250,000 if you're married filing jointly).

Of course, a particularly large withdrawal does not need to come from a single account. Rather, you can pick and choose, based on the overall composition of your portfolio and what makes the most sense for your situation.

When to consider borrowing

If you need access to capital but are hesitant to liquidate part of your portfolio because of tax consequences, such as a down market or other considerations, it might make sense to borrow to fund your goal.

Rob notes that if you were to borrow the funds at an interest rate that’s less than your expected portfolio return, you could come out ahead. Of course, there is no guarantee your portfolio will achieve its stated objective, and you should consider whether you are willing to assume the risk that it won’t.

If you borrow against your home, interest payments may be tax-deductible so long as you use the proceeds to improve your home or purchase a second home3, and your total itemized deduction is larger than your standard deduction. "That can further reduce the cost of borrowing," Rob says, subject to current limitations and caps from the IRS on how much you can deduct.

You could also consider borrowing against the value of your investments with a margin loan from a brokerage firm or with a securities-based line of credit offered by a bank. Both involve risk, and it's important to understand these risks before borrowing.4

Margin loans and bank-offered, security-based lines of credit might make sense for investors with higher wealth or flexibility who have low-volatility assets to borrow against, who are in control of their debt, and for whom the level of risk is appropriate.

Entering into a securities-based line of credit and pledging securities as collateral involves risk if the value of your investments falls. Before you decide to apply for a security-based line of credit, make sure you understand the details, potential benefits, and risks.

If you need access to capital but are hesitant to liquidate part of your portfolio because of tax consequences, such as a down market or other considerations, it might make sense to borrow to fund your goal.

Rob notes that if you were to borrow the funds at an interest rate that’s less than your expected portfolio return, you could come out ahead. Of course, there is no guarantee your portfolio will achieve its stated objective, and you should consider whether you are willing to assume the risk that it won’t.

If you borrow against your home, interest payments may be tax-deductible so long as you use the proceeds to improve your home or purchase a second home3, and your total itemized deduction is larger than your standard deduction. "That can further reduce the cost of borrowing," Rob says, subject to current limitations and caps from the IRS on how much you can deduct.

You could also consider borrowing against the value of your investments with a margin loan from a brokerage firm or with a securities-based line of credit offered by a bank. Both involve risk, and it's important to understand these risks before borrowing.4

Margin loans and bank-offered, security-based lines of credit might make sense for investors with higher wealth or flexibility who have low-volatility assets to borrow against, who are in control of their debt, and for whom the level of risk is appropriate.

Entering into a securities-based line of credit and pledging securities as collateral involves risk if the value of your investments falls. Before you decide to apply for a security-based line of credit, make sure you understand the details, potential benefits, and risks.

Is a security-based line of credit right for you? Learn more about the Schwab Bank Pledged Asset Line®.

1Example assumes that the first $37,450 of distributions would be taxed at 12%, and any withdrawal amount over $37,450 would be taxed at 22%. This means an additional $21,851 withdrawal would be necessary for a total distribution of $59,301. The estimated tax of on this distribution would be $9,301, leaving $50,000 after taxes for the down payment.

2Example assumes a $37,450 distribution in year 1, followed by a $19,368 distribution in year 2, for a total withdrawal of $56,818 over 2 years. The total $56,818 withdrawal would be taxed at 12%, resulting in an estimated tax of $6,818, leaving $50,000 after taxes for the down payment.

3Until it expires in 2026, the Tax Cuts and Jobs Act of 2017 suspends the deduction for interest paid on home equity loans and lines of credit, unless they are used to buy, build, or substantially improve the taxpayer's home that secures the loan.

The law imposes a lower dollar limit on mortgages qualifying for the home mortgage interest deduction. Taxpayers may only deduct interest on $750,000 ($375,000 for a married taxpayer filing a separate return) of qualified residence loans. The limits apply to the combined amount of loans used to buy, build, or substantially improve the taxpayer's main home and second home.

4For a bank-offered, securities-based line of credit, the lending bank will generally require securities used as collateral to be held in a separate, pledged brokerage account held at a broker-dealer, which may be an affiliate of the bank. The bank, in its sole discretion, generally determines the eligible collateral criteria and the loan value of collateral.

Are you on track to reach your goals?

Are You Financially Ready to Weather a Storm?

Can you financially weather a storm—or flood or fire? Here's how to prepare, including packing a financial "go bag."

6 Financial Planning Tips for New Parents

Raising a child is expensive. Here's how to set financial goals for your child's milestones while keeping your retirement savings on track.

Suddenly Alone—Where Can You Turn for Help?

It's hard to focus on finances after losing a spouse. But there are resources to turn to for help and support.

Important Disclosures

Brokerage Products: Not FDIC Insured • No Bank Guarantee • May Lose Value

Important information about borrowing through a securities-based line of credit:

Entering into a securities-based loan and pledging securities as collateral involve a high degree of risk. At any time, including in the event that the loan value of collateral is insufficient to satisfy the minimum loan value of collateral or to support the outstanding loans, the lender may demand immediate payment of all or any portion of the outstanding obligations or require additional cash or securities to be deposited into the associated brokerage account. If a Demand is not addressed, the pledged securities may be immediately liquidated without further notice to you, which may result in tax consequences. Proceeds may not be used to purchase securities or to pay down margin loans; proceeds may not be deposited into a Schwab brokerage account.

This offer is subject to change or withdrawal at any time and without notice. Nothing herein is or should be interpreted as an obligation to lend. Loans are subject to credit and collateral approval. Other conditions and restrictions may apply.

The information provided here is for general informational purposes only and should not be considered an individualized recommendation or personalized investment advice. The investment strategies mentioned here may not be suitable for everyone. Each investor needs to review an investment strategy for his or her own particular situation before making any investment decision.

All expressions of opinion are subject to change without notice in reaction to shifting market conditions. Data contained herein from third-party providers is obtained from what are considered reliable sources. However, its accuracy, completeness, or reliability cannot be guaranteed.

The above scenarios are illustrative only. They do not necessarily represent the experiences of other clients, nor do they indicate what you may experience.

Diversification and rebalancing strategies do not ensure a profit and do not protect against losses in declining markets. Rebalancing may cause investors to incur transaction costs and, when rebalancing a non-retirement account, taxable events can be created that may affect your tax liability.

This information does not constitute and is not intended to be a substitute for specific individualized tax, legal, or investment planning advice. Where specific advice is necessary or appropriate, Schwab recommends consultation with a qualified tax advisor, CPA, financial planner, or investment manager.

Investing involves risk including loss of principal.

When considering a margin loan, you should determine how the use of margin fits your own investment philosophy. Because of the risks involved, it is important that you fully understand the rules and requirements involved in trading securities on margin. Margin trading increases your level of market risk. Your downside is not limited to the collateral value in your margin account. Schwab may initiate the sale of any securities in your account, without contacting you, to meet a margin call. Schwab may increase its "house" maintenance margin requirements at any time and is not required to provide you with advance written notice. You are not entitled to an extension of time on a margin call.

Charles Schwab Bank, SSB and Charles Schwab & Co., Inc. are separate but affiliated companies and subsidiaries of The Charles Schwab Corporation. Brokerage products, including the Pledged (Asset) Account, are offered by Charles Schwab & Co., Inc., Member SIPC, are not insured by the FDIC, are not deposits or obligations of Charles Schwab Bank, SSB and are subject to investment risk, including possible loss of the principal invested. Deposit and lending products, including the Pledged Asset Line, are offered by Charles Schwab Bank, SSB, Member FDIC. Charles Schwab Bank, SSB is not acting or registered as a securities broker-dealer or investment advisor. 

The Schwab Center for Financial Research is a division of Charles Schwab & Co., Inc.

0222-2GYY