Interest costs have continued to rise for two main reasons. The first is the increase in interest rates and the effective rate the government has to pay on its stock of debt. The other reason is the increase in the size of the debt itself. Whenever there is a deficit incurred in a fiscal year, it generally adds to the debt.
To the extent that the deficit is lower than it used to be during the pandemic, one could say that the government has taken steps to reduce not the debt but the speed at which it increases. Conversely, one could say that, given there are still deficits, the government is not reducing the size of the debt.
There's no clear answer to your question without getting into a political debate.