We do 1 to 2 dinner shops per week and yes, there are times I want to just leave. Usually it is because in a fairly empty restaurant we are seated next to a table with one or more screaming kids.
The worst was recently when they were putting all customes in one of three sections of a restaurant. There were 3 adults, all on their cell phones throughout the meal, and stairstep kids from toddler to perhaps 9 who didn't stop fighting and arguing while the parents chattered away on their phones and walloping a kid from time to time. They had a headstart on their meal so the servers already had a taste of the chaos before we got there and were seated right next to them. Kids were leaving the table to 'visit' other guests, run to the bathroom, pick up more coloring supplies, throw tantrums in the floor etc. When the toddler grabbed for our very hot appetizer it was tempting to let him pull it off the table and scald himself--though the restaurant would probably have been sued.
Last night's joy was a toddler who had been eating ketchup covered fries and stood up in his seat to bounce, getting ketchup on the upholstery, in my companion's hair and on the back of his shirt.
This stuff appears in casual to upscale casual establishments. Management obviously wants/needs the business. And I guess you can't just automatically isolate families with kids, but there is little excuse to seat childless couples next to the melee in progress.