Can we set Overhead Multiplier per project?

No. It can only be set at the employee level, not at the project level. Check CORE Help for details.