How does us debt work?

Why is the government worried about high rates/yields? I get that they need to refinance their debt, but who are they actually paying? Debt ceilings are always lifted, anyhow.

So, why would the government care?

Honest question.