Apple Wired Keyboard

I just bought a Apple wire keyboard from the apple store but the delete key doesn't seem to be working. By the delete key I mean the key that is next to the page up/page down keys. Is there any way of enabling the delete key?

Update: Sorry I made a mistake, the delete does work in some cases but not others, for example if i wanted to delete some text in front of the cursor and i pressed delete then it would work as it should, however if I wanted to delete a file or folder from Finder using the delete key then it doesn't.

Is this behavior normal?

thats the way it works on my keyboard, but mine is wireless. I assume its the same principle though