The biggest downside risk is that of default in paying this loan off and losing your house as a result. In debt consolidation, you are trading an unsecured debt (your credit cards) for a secured debt (your house). If you default on that payment, you could lose your house to foreclosure.