If taking the rock path towards the top of the Markarth main gate, you notice that you can see through the mesh and look into the city. The corresponding model is
ocsmrkfrontwallmain01new.nif. Looking in NifSkope, it turns out that this part of the mesh has some weird alpha property. Removing this alpha channel fixed the issue for me.