If it's that annoying, get OnyX from
https://www.titanium-software.fr/en/index.html and run the maintenance task with the defaults. (Make sure you get the correct version for your version of macOS.) That will clear all cache. Note: it will clear ALL cache, including the cached pages in your browser, all history for word processor/spreadsheets, etc., all "recent" items lists and pretty much every single cache will be emptied. I think it should also clear the cache for iTunes as well, which will fix your problem, but the "price" to be paid is pretty high as all the other application cache will also be emptied. Your call. To me, it's a bit like using a sledgehammer to kill a fly, but as I said, it's your call.