At least locally here to get a development permit they are quite strict on the access and zoning. Too many folks built structures on goat trails that don't allow for fire engines to respond to fires and/or school busses can't access. So things like road approaches and access road construction they are quite strict on.
In terms of the structures themselves I am allowed some accessory buildings and up to one cabin per property for recreational use (size limited). They make no distinction between temporary structures and permanent in part due to folks trying to pull the "temporary" card too often.
Rules on wells and power vary widely....some allow green field sewage, some don't. Some allow wells but others may have restrictions. Power again varies widely...folks have one parcel with power on it but because it's not a primary residence they are not allowed to set up solar panels (which would sell back to grid) but if it was the house there would be no issues.
Recommendation would be start with a small shed for storage and spend at least the first year trying to figure out the site. What goes where? Where's the drainage? best views or walks? before rushing into building.
Lastly I'd look into some of the woodlot options...by building on raw land it may trigger residential taxes or recreational taxes. A woodlot - the definition of which varies by province and requirements - may allow for the majority of the land to be taxed as agricultural rates. Each province generally has it's own program so I'm not up to speed on them all.