Do AT&T Gophone plans work with C Apple Peel?

I'm thinking about getting both of these soon. I'm pretty sure the thing itself works with the C Apple peel, but would I be able to get away with using a "Pay as you go" plan (or the 10 cents per minute plan) and not buy a data package? P.S. Please do not stone me for any info I may be missing here, I'm researching this subject and barely know anything so far. Thanks in advanced.

Wow you guys are helpful -_-