I'll go one step further than my esteemed fellow forum members and ask you this.....
Is your Mini in any danger of being stolen? Does anyone else have unauthorized access to your machine? If you answered no to both questions, then I have to ask... why are you using FileVault? I highly recommend using FileVault for a portable machine (MacBook, MacBook Pro, etc) but for a desktop machine that remains at home, it's overkill. Of course if your Mini is used in your workplace where others may have access, then yes, use FileVault.