No, you don't need an Airport Extreme to use AirPlay.
Right now only audio works with AirPlay on the betas, we have to wait for the GM version to be released in November to find out if the video will transfer over. But its my understanding that any video encoded in h.264 will work with AirPlay.