I’d say this is the most likely explanation for this phenomenon.My best guess here was small pieces of wood torn from wood frame structure caused things like debarking. Stone/heavy brick is hard to accelerate into high speed to debark. Also brick/stone walls of masonry structure can serve us a shelter for vegatations nearby.
Damage features that can be seen from wood frame structures like rowing or granulation also seems much harder on masonry structures. These things make the comparsion of intensity between different areas more difficult.