To be clear I'm not suggesting you never wear a mask.
Masks are likely minimally effective if worn for short periods of time with strict adhereance to not touching your face. Put it on before entering a crowded space, dont touch your face or drink water, take it off and throw it away the moment you leave. Likewise use disinfectant on your hands before taking the mask off or putting it on.
If you do all that it will likely be marginally helpful and is a good idea. It only becomes harmful when you wear it for extended periods of time or otherwise dont follow the strict procedures above.