If you are unable to delete a retainer in CORE, the reason could be that you already used a part of the retainer toward a payment of an invoice. If you have to delete that retainer completely, you must delete the payment made using that retainer first and then delete the retainer.
CORE Help Center