I knew someone who did that many years ago, his house was great, it took hom over a year and it was hard to still have a regular job too. heck even remodeling is tough.
do you seriously have the time for this sort of project?
you might be better off buying a fixer upper, living in just a part of it while rehabbing. at least you wouldnt have 2 houses to pay for at the same time.
a long ago dream of mine was to build a home, but after a major remodel I decided it just wasnt practical...