Can I delete activities that have time associated with them?

No. You can delete activity items as long as you have not referenced or used them for time entry in CORE. If you have used them for entering time, you can instead make them 'inactive'. They won't show up on screens and drop-down lists.