If you are unable to delete a retainer in Core, the reason could be that you already used a part of the retainer toward a payment of an invoice. If you have to delete that retainer completely, you must delete the payment made using that retainer first and then delete the retainer.