Answers › Refinancing & Home Equity
Should I refinance my first mortgage or take a second mortgage?
Answered by Rajiv Verma, Mortgage Broker · Reviewed 13 August 2026 · About a 4 minute read
The direct answer
It comes down to one question: is your existing rate worth protecting? Refinancing replaces your first mortgage — which can mean a penalty, and losing a rate you’d never get back. A second mortgage leaves the first completely untouched: no break, no penalty, and the existing rate preserved. A second mortgage costs more on the money you borrow, but if it saves you from breaking a low-rate first, it’s often the cheaper answer overall.
THE SHORT VERSION
- Refinance = replace the first mortgage. Possible penalty.
- Second mortgage = add behind it. Nothing is broken.
- The penalty is the number that usually decides it — fixed mortgages use IRD, which can be large
- A second mortgage has a higher rate on the new money only, not on everything
- Compare total dollars, not rates. A lower rate on a bigger balance can cost more.
Why this question matters more now than it used to
A lot of people are holding mortgages at rates they simply couldn’t get today.
That existing rate is an asset. Refinancing hands it back. And once it’s gone, it’s gone — you can’t undo the decision if rates move against you.
So the arithmetic isn’t “which rate is lower.” It’s “what does it cost me to give up the mortgage I already have?”
The penalty is usually the deciding number
Variable mortgages: the penalty is typically around three months’ interest. Usually manageable, and often not enough to rule out refinancing.
Fixed mortgages: the penalty is the interest rate differential (IRD). That can be a very large number — and it is the single most common unpleasant surprise in a refinance.
Get the exact figure before deciding anything. Your lender will tell you the current payout penalty on request. Don’t estimate it, and don’t let anyone plan around an estimate. It’s the number the whole decision turns on.
Side by side
| Refinance | Second mortgage | |
|---|---|---|
| Your first mortgage | Replaced | Untouched |
| Penalty | Possible — IRD on fixed | None |
| Rate on new money | Lower | Higher |
| Rate on existing balance | Re-priced at today’s rates | Unchanged |
| Term | Full new term | Usually short — 1 to 2 years |
| Qualifying | Full assessment on the whole amount | Often more flexible |
| Speed | Slower | Faster |
The mistake almost everyone makes
Comparing the two rates. A second mortgage rate looks alarming next to a first mortgage rate, so people rule it out immediately.
But the higher rate applies only to the new money. The refinance re-prices everything — including the balance you’re already carrying at a rate you like.
On a large first mortgage and a modest amount of new borrowing, the second mortgage frequently wins on total dollars, even though its rate is far higher. Always compare the total cost over the same period, in dollars.
When refinancing is the better answer
When your existing rate isn’t worth protecting. If your current rate is at or above today’s market, there’s nothing to preserve.
When you’re near renewal. At maturity there’s no penalty, so the whole calculation changes. If you’re within a few months, waiting may be the right move.
When you need a lot of money. Large borrowing at a second-mortgage rate gets expensive quickly.
When you want one payment and a long term. A refinance is a settled arrangement. A second mortgage is a shorter-term step that will need dealing with again.
When a second mortgage is the better answer
When you’re holding a low rate. This is the big one, and it’s why the question comes up so often now.
When the IRD penalty is punishing. Sometimes the penalty alone exceeds the entire cost of the second mortgage.
When you wouldn’t qualify for a full refinance. Refinancing means re-qualifying on the whole amount. If income or credit has changed, that door may be closed while a second-position lender still says yes.
When you need it quickly. Second and private mortgages move faster.
When the need is temporary. If this solves a problem that resolves within a year or two, don’t restructure a twenty-five year mortgage around it.
When neither is right
When the payment doesn’t work either way. Adding borrowing to a position that’s already tight makes it worse, not better.
When you’re within months of renewal. Waiting costs nothing and removes the penalty entirely.
When the underlying problem isn’t a money problem. If the debt rebuilds, you’ll be back in twelve months with less equity.
What to check before you decide
- The exact penalty to break your first mortgage — from your lender, in writing
- Your current rate against today’s rates
- How long until renewal
- The total dollar cost of each option over the same period — including all fees
- Whether you’d still qualify for a full refinance
- Whether the need is temporary or permanent
What to do next
Send me three things: your current balance and rate, your renewal date, and what you’re trying to do. I’ll run both options in dollars and show you which is actually cheaper.
Often it’s not the one people expect.
Related questions
- How much equity can I actually borrow against my home?
- I owe the CRA. Can a second mortgage clear my tax arrears?
- Will a second mortgage hurt my credit score?
Answered by Rajiv Verma, Mortgage Broker · Mortgage Architects — FSRA Brokerage Licence #12728 · Licensed in Ontario · Office 289.505.0631 · Direct 647.291.7116
General information about Ontario mortgages — not financial, legal or mortgage advice. Penalties are set by your existing lender and by the terms of your own mortgage. Every file is reviewed individually.