How can I log vendor bills for internal office expenses?

You can either create a vendor bill using the Items tab against the overhead project or create it using the Accounts tab using the internal account for overheads. Check CORE Help Center for details.