Help organize my music folder

So, I use iTunes. My music library is just under 4,000 songs. For the most part, I like iTunes a lot and how it organizes my music. But I have a lot of empty/pointless folders in my music folder that i want to delete. But that isn't the problem. The thing is, I can't just download a utility that deletes empty folders because while there are many empty folders, the majority of the folders won't be considered empty by a utility that is looking for empty folders to delete. For example there are lots of folders that have no music in them, but may have one JPG file or one readme text document that i don't need and i want to delete all the folders like that.

Here is my bottom line question: Is there a way to automatically delete any folder that does not contain audio files? And does anyone have any suggestions to an alternative for getting rid of these useless folders? (besides deleting them each individually...)

You could probably write a small shell/python/perl/ruby script to do this for you. Unfortunately, I'm not good enough in any of those to give you a script that I would have confidence in.