You also don't get the physical effects,the g forces,the positive and negative,the being thrown around,the force of acceleration and deceleration.
I have to go on a simulator at work [not a pilot one, a train driving one every year ] and the biggest complaint we have is the lack of movement [the seat of the pants driving].You can see the simulated scenery going past but there's no "feeling" of moving.