After periods of inactivity, Remote acts weird with Front Row

If I don't use Friont Row for a dfay or two, when I come back and hit any button on the Remote - it seems to enter that command twice (Menue, FF, Rew, etc.). Which doesn;t seem like an issue unless you are trying to select a specifc item.

If I restart my MacMini, the problem goes away

Anybody else have this problem or ideas why it might be happening?

Thanks - Dennis