If you follow that logic, then women should conceal themselves from head to toe. It wasn't all that long ago that it was improper for a woman to expose her ankles in public because it would cause lust in men.Speaking of yoga pants/leggings...
http://veronicapartridge.com/why-i-chose-to-no-longer-wear-leggings/