If you make withdrawals from a retirement plan before you reach age 59½, the IRS assesses a 10% penalty on the amount you withdraw. Some retirement plans allow you to pay taxes now on contributions, instead of when you retire.