You might not want to calculate the drive time, but it is TIME spent. So the 20 minutes for the shop is not real time. It's "on site" time.
I get that you want the "freedom" to work when you want to. That is what makes "gig" work so appealing to many.
As far as paying off your house early...if that is a goal you had, that is great you accomplished that. I refinanced 2 houses in April 2020 and took cash out and put it in the stock market and have profited wonderfully with stocks like Carnival Cruise line that went under $10 and Boeing that went under $100. I'll gladly pay 3% interest for 30 years when I can return 10%+ in the market year after year. I get that my parents generation goal was to pay off a house because loans were 8%-15% interest. That makes sense. Not when the rates were sub 4%.