In some backwoods, minimum lot sizes are as large as 20-40 acres. Sometimes you may be able to get a difference and get authorized by the county for shelling out your land in smaller sized lots, however then it normally becomes what they define as a "subdivision". At that point, you need to install roadways, water management systems (ditches), and submit a prepare for your neighborhood and where all the "lots" are situated.

You need to likewise go to the county office and get your subdivision authorized and voted on by the committee and your next-door neighbors. Yes. Your next-door neighbors have a say about your property and what you are permitted to do with it. There need to be a water source on your residential or commercial property. This is for sanitation and health.
Also, there is usually a big fee included with hooking up to city water. I've seen it as high as $15k for some counties. Not everybody has $15k to throw around so it ends up being cost-prohibitive to connect to city energies. Not to point out living off grid is about being self-sufficient and not reliant upon others for the basics of life.
The best recommendations in these cases is to vacate that county if you want your flexibility to choose where you get your water. This kind of goes without stating. Some counties will not enable you to be detached from their utilities. Normally, this occurs in rural areas closer to town.

Some counties enable what's called a grid-tied solar energy system. This is a solar system that allows you to sell surplus power that you create and do not use back to the city. The issue is you're still spending for electrical energy if you do not produce enough to run your house.
It can eliminate your electricity costs entirely, or minimize it enough to make it worth it, but this is not actually off grid living. Generally, the additional you are from the city the better and less restrictive the ordinances and the most likely you will be able to merely power your house or cabin with a solar power system without needing to be connected to the grid.