Yes, the Project ID and project name can appear on the invoices, depending on the invoice template you selected. Most standard templates include these fields by default. Additionally, the way this information is displayed also depends on the Project Display As setting under Settings > Projects > General.
You can update the template from the Invoices screen or under Settings > Billing & Invoices > Invoice Templates.