A startup's job is to grow big enough to provide a return to investors. A lifestyle business's job is to provide a great quality of life to its owners.
The real question to me is, what do you want from your business, both in the short- and long-term?
It's worth adding that you're allowed to change what you want throughout your life. Be sure to re-examine the question regularly to make sure you're not chasing life goals that you no longer care about.