Import Gmail and Yahoo Address Books to Mail?

I really thought Mail would automatically import the address books from my Yahoo and Gmail accounts when I synched them, but it didn't. Why not? Other apps can do that, including the one that came with my Kindle. How do I do this? Is there any easy way or is it going to be a huge pain?

Gmail remembers everyone who has ever contacted me.

I suppose I can continue to just use the accounts themselves on their respective sites, but there are advantages to having a dedicated app to manage email. For one- no ads.

Assuming you're running mavericks, click on System Preferences, Internet Accounts.
Add Gmail if it's not there already. Then select what you want to sync.
And/Or open Contacts. Under the Contacts menu, select Accounts. Add Gmail.

Would be helpful if you would put your Mac specs in your info.
<<< like here.

I'm not. It's an old Macbook running 10.6.8

Open the Address book application - Preferences - Under Accounts you can choose Yahoo and Google accounts to sync with.

The reason mail doesn't do it on it's own is because contact information can be used for various things (birthday reminders, email, postal address lists etc) so they aren't just tied to email.