I've been through a few jobs in the last few years, and I keep looking back at them thinking "What an idiot I was for doing X" (for many, many values of X). But then I realized that I hadn't really defined myself, my views on software and development, business, etc. I was like someone who could run, jump, do jumping jacks, etc, who went around saying "I want to do sports for a living". I had basic tools and skills, but no direction. It sounds a little embarrassing to say, but how else was I supposed to gain direction without going through different experiences?

If you're not sure what you want to do or what really drives you, don't be afraid to take a decent looking (but not necessarily dream-) job offer, stay a year or so, then go to another different type of company. Think of it as a slow, well compensated data collection process that will lead you to a better understanding. Sure it sounds lame when put next to the laser-focused entrepreneurial stories on HN, but so what? Do what's best for you (and your family - important consideration).

PS If you do that, don't forget to code and learn something completely different in your spare time. That push/pull helps you grow a lot faster and benefit both parts of your life. Right now I'm .Net by day, Lisp by night. How much more different can you get?