Gait analysis, clothing analysis, eye framing etc... these are all valid points of concern for protecting your identity, but masks are still a golden opportunity to reduce the effectiveness public mass surveillance
There's no on/off switch for privacy. All mitigations are layers which increase combined effectiveness
If you dislike wearing masks, consider that it costs you little in terms of inconvenience and there are other benefits besides health and safety