Setting the opening balance for a project creates a manual invoice in CORE. If you want to delete the opening balance, you can delete the corresponding invoice from the Invoices screen. Check CORE Help Center for details.
CORE Help Center