The cost of debt is usually lower than the cost of equity. The reason firms don't use only debt financing is:

as the use of debt increases, so does the cost of equity. as the use of debt increases, so does the tax rebate that the firm receives. as the use of debt increases, the cost of debt decreases until no debt financing is available. as the use of debt increases, government regulation increases.