Can I specify the project's address on invoices?

No, you can specify only the client or client contact address on invoices.