Q Can a man wear a unisex outfit?

A. The Talmud (Nedarim 49: 2) relates that the wife of Rabi Yehuda fashioned a wool coat that both she and her husband would wear when needed. Poskim (Birkey Yosef 183: 3, Pesach Einaim – Nedarim 49, Divrey Benayahu Y.D. 26, et. al.) therefore permit vestments that are equally worn by men and women. Oholey Yaakov (70) extends this leniency to a garment that was created with the intention to be worn by a specific individual from either gender, yet it is equal to the ones used by the other.
Horav Shlomo Miller’s Shlit”a opinion is similar.

Rabbi A. Bartfeld as revised by Horav Shlomo Miller Shlit”a.