Also try raising the audio buffer in Pro Tools.

They delay might have been caused by the external drive spooling up for the record though 20 seconds seems excessively long - usually it's only 4 or 5 seconds tops. I'm assuming you didn't add a count off for that particular recording session.