Where to go to take a few days off?

I know, I know, it's a very open question. My wife will have a free week mid-March for spring break, and my job is flexible, so I can probably take a few days off. We have a 17-month-old that can probably last around 4 hours or so in the car seat. Any recommendations for a chill place? A cute town upstate? Maybe even a different city? Maybe one thing you did that you'd never imagine would be nice but you really enjoyed.

We've never had the chance to travel much, so there's much for us to see.

Thanks in advance!