Also find it hard. But I think its pretty realistic.
As someone else mentioned: in BoB pilots said they could one moment be in the thick of it - the next minute you were (ie thought you were) completely alone.
Also in RL its extremely hard to spot other AC:
Sometimes the easiest way is to spot a dot moving against the background.
Could be a white 737 - imagine this was a greenish spitfire: would be impossible to spot it.
But yes, its frustrating loosing sight of an enemy you know is there somewhere.
Been reading books about Dick Bong, Bruce Porter, George Barclay, Douglas Bader etc - and they rarely speak of 1on1 encounters. Guess its because its too hard to spot single AC, and also the usual operation was large groups in formations.
Funny to read how many times they had to return due to oil on the windshield...trying to find the way back...
But good to hear others having the same "problem"
.