Living in the Ashbury Heights neighborhood is really wonderful. The hilly neighborhood is bookended by Buena Vista Park and Mt. Sutro and, in a city known for its Victorians, has some of the best kept representatives of this type of home. You are close enough to the Haight and the Castro/Mission to fill your days and nights with unadulterated fun, but slightly up and away from the action where you can get some peace and quiet (though not so far away that you won't get some homeless action unfortunately).
Put simply, Ashbury Heights is a great little nook of the city. A great choice if you can afford it.