Is there a way to renumber invoices?

Yes. Go to the Invoices screen and click on the row action menu to select Change Invoice Number. You can set up and change the invoice numbering format from the Settings and Projects screen too.