I just made a quick video to illustrate how to change the battery (type: CR2032 - same as PC BIOS batteries!) in the Apple Remote:
How to change Apple Remote battery - a short video
How to change Apple Remote battery - a short video