I grew up in Nelson County, and I really wouldn't say there is a "foodie quality" restaurant out there now, but there are a few places worth checking out.
If you're looking for atmosphere, try the Talbott Tavern. It was rebuilt after a fire a few years ago, but it is still an interesting place. Don't go expecting fabulous cuisine though.
http://www.talbotts.com/Kreso's is probably the best fine dining option:
http://kresosweb.com/.
There's also Dagwood's (haven't been there in years but it was a local favorite back then), Kurtz Restaurant (across from My Old Kentucky Home--more traditional southern food), the Dinner Train (don't go for the food, go for the train ride).
There is also the usual assortment of Mexican places
Word of warning, Bardstown just started redesigning their downtown area (the project is called "Streetscape" and you'll be going through an area where they are digging up 31E right in downtown for water line work. I'm not sure what they will do during the holiday weekend, but it has been down to one lane traffic this past week. This makes parking tricky downtown as you will probably have to park on a side street.
I'd vote for Kreso's. The owners are from Bosnia, and the menu offers some German dishes.
