Oooh, kind of jealous. I love that town. Got to spend a week at The Broadmoor a couple years ago and I was ready to move there.
It's just the right size - not so huge that there is a ton of traffic and crap - but big enough that there are lots of things to do, good restaurants, etc. And of course amazing fishing, skiing and cycling.
I like it here. Like @NKSHawk , my current job would let me live anywhere, however my wife's work is a bit of an anchor. I left ATL as it is just too big, once the kids are gone, I could move to a smaller mountain town, but as it stands have access to all the outdoor activities I enjoy and love the weather.
The locals don't care about football season though. AF isn't much of a draw. The transplants are from all types of schools so its pretty diverse.
I'd be willing to debate the "good restaurants" though. I suppose it is heavily based on where you come from, ATL did have great food options in comparison.