In case you are one of the unlucky people who were unable to pay off their taxes, there could be severely damaging consequences. First, you will receive a bevy of notices from the IRS to remind you that your debts need to be repaid.