You can delete the vendors by selecting them in the list view of Vendors screen and clicking Actions > Delete. However, you cannot delete the vendors that have transactions (say vendor bills or expenses) associated will them. You can also check out this article: Deleting employee records.