TFSA: you pay standard income tax up front, but no income tax on investment earnings. Annual contribution room is added. You can withdraw anytime and get the contribution room back.
FHSA: you do not pay income tax up front, you do not pay income tax on investment earnings. But you can only withdraw for a first home purchase (or convert into RRSP), and there's yearly and lifetime limits on contributions.
Non-registered investment account: you pay standard income tax up front. Investment earnings as capital gains are 50% of standard income tax. Withdraw anytime, no limits obviously.
With RRSPs: you do not pay income tax up front, but you pay standard income tax when you withdraw, and pay standard income tax on investment earnings (no capital gains rate). You cannot withdraw until retirement age.
Those are effectively your only four options here. When they're broken down that way.. does it make more sense?