Mac beginner - TextEdit and Preview

Hi,
I've had my mac for some weeks now, but what i've noticed is that say for instance i've used TextEdit to write something, when i've saved and finished by clicking the red 'X' the TextEdit icon stays in the dock with the little blue light underneath it. I have to right click & Quit it to make it disappear from the dock. Is there a way of doing this automatically? As I don't have it pinned to the dock nor do I want it left in the dock.

Likewise with Preview, it does exactly the same thing.

Is this something that bugs just me?

This is how OS X works. Apps remain open when you close the last window (if they are Mac native apps and programmed properly). If you want to quit the application, push Command-Q or File > Quit.

This is one way that OS X is different from Windows. In most cases, clicking the red Close button in a window doesn't quit the application, it only closes the window.

One thing to note is that there are exceptions to this (and even with some Apple applications). This generally only happens though with applications where you only have one window. For instance, if you click the red close dot in System Preferences, the application will close since you can only have one window. On the other hand, applications such as Opera (and any other browser) can have multiple windows. These applications will not quit when you close the last window.

The "solution" to this "problem" is to stop trying to make the Mac behave like Windows and instead do things the correct (for Mac) way, which is to get into the habit of genuinely quitting apps when you are done with them.