You give up customization by joining a family but you gain a support structure along with a ready made social group.
That's the trade off. Either way you go you will still be able to train and learn any skill, raise your attributes to the same level. The min/maxer in me sees very little difference beyond the first couple of days of gameplay.