The Gemmorah in Yevamot.65b:
"אָמַר רַבִּי אִילְעָא מִשּׁוּם רַבִּי אֶלְעָזָר בְּרַבִּי שִׁמְעוֹן: אָמַר קְרָא: ״וּמִלְאוּ אֶת הָאָרֶץ וְכִבְשׁוּהָ״. אִישׁ דַּרְכּוֹ לְכַבֵּשׁ, וְאֵין אִשָּׁה דַּרְכָּהּ לְכַבֵּשׁ."
"From where are these matters derived, that a woman is not obligated in the mitzva to be fruitful and multiply? Rabbi Ile’a said in the name of Rabbi Elazar, son of Rabbi Shimon: The verse states: “Be fruitful and multiply, and fill the land and conquer it” (Genesis 1:28). It is the manner of a man to conquer and it is not the manner of a woman to conquer. Consequently, it is evident that the entire command, including the mitzvah to be fruitful and multiply, was given only to men and not to women."
Man is one who forces relations upon woman, not vice versa. Women are considered "קרקע עולם" - "passive ground being plowed", like Ester being taken by Achashverosh. Therefore, it is thought that an exposed man can't provoke a woman to act inappropriately, unlike the opposite situation.
So [unless one is a pop star], hearing him singing will not make married women throw themselves at him.