I make a temporary base until i can make a good mobile one.
Living reasonably close to (or in the outskirts of) a city is required for this, to get enough spare parts and books. No need to worry about fortifications as its a waste of time and resources. Sleep in a basement if needed.
Going mobile, i loot further in order to gain more stuff: Books, spare parts, CBM’s…
No great need for defense again, just camp in intelligent spots or have your solars be destroyed. (keep 'em safe, and have spares 
After that i do make a permanent base: I try to build near lava if possible, as i like the novelty and i try to avoid swamps, slime pits & other unkillable spawning zones. Meaning 10+ map tiles away.
A river for fishing is an asset but a well should eliminate water problems just as well.
By that time i am reasonably strong enough to kill any spawnzones that can be killed (like fungals).
Much like my mobile base, i like planning and building a permanent base from scratch, complete with defenses, underground storage areas and escape tunnels.
It just takes time…