A possible rationale was provided by R. Aaron Rakeffet in a lecture:
So I have to tell you Aryeh that Aaron Rakeffet danced for joy when he found out that it's the third topic on which I'm in total agreement with the Eidah Chareidit. Number one: they don't wear ties. I agree with them wholeheartedly. Tie is the only article of clothing you wear to be a ba'al ga'aveh. It serves no purpose. At least a belt holds up your pants. What does a tie do? It chokes you.
(My transcription)