One tends to say that the buildings can be built higher due to gravity being lower but I do not think this will be the case.
Think about wind load. Letís assume there are same wind conditions on Mars as Earth.
This will affect the design greatly. If you build structures too high, the wind load and in turn the moment on the foundation will be higher. Not only that, the structure must still be designed strong enough to transfer those lateral forces.
And what about earthquakes. May be there are stronger earthquakes on Mars, I am not sure. So gravity alone is not the determining factor. Yes, it allows lighter or taller buildings but the earthquake and wind loads must also be considered. Also what about the temperature differences. If the temperature varies too greatly everyday, this will create additional stresses and fatigue.