browser focus with keyboard shortcut

i'm starting to use the keyboard shortcuts in safari more and more. I really like this as opposed to always switching back and forth btwn the mouse. only thing though is if I switch to the address bar (command-L) or the google search area but don't go to another site (basically change my mind), how do i then get back to the main browser area so I can scroll again with the arrow keys. You know, like you can use the mouse and click on a blank area and that refocuses on that particular window. How can i do that w/o using the mouse?

Use the down arrow once URL box has ben highlighted. Are you using Tabbed browsing as well -Safari/Perferences/Tabs - that saves time as well.