According to this article by Rabbi Dr. Ari Z. Zivotofsky (published in the Orthodox UnionUnion's Jewish Action Journal, Summer 2011), such a source does not exist. Apparently, this idea appeared in the late 20th century, and never before then.
Here is the link.