I actually have the same problem, sometimes the red x just doesn't respond (same with the yellow/green buttons) and I need to click somewhere else then click it again.

Tried different mouses and happens with the trackpad (always has happened, figured it was just one of those quirks).