Is this also true if I only use -fwhole-program and not --combine?

Not that I know of, the buggy switch is --combine.
I put -fwhole-program and --combine together because that's what yields the best optimization, but -fwhole-program alone is a safe(r) choice