As a mom of an autism child, I've very well aware of where and when to take him out to eat.
Certain times of the day when places are less crowded are better. And certain places are better. Otherwise, I save my fancy places for when he's with his grandparents or at his dad's house.
It's not that difficult.