I found a relevant section in the Jewish Encyclopedia:
Josephus ("Ant." viii. 2, § 5) relates:
"I have seen a certain man of my own country, whose name was Eleazar,
releasing people that were demoniacal, in the presence of Vespasian
and his sons and his captains and the whole multitude of his soldiers.
The manner of the cure was this: He put a ring that had a root of one
of those sorts mentioned by Solomon to the nostrils of the demoniac,
after which he drew out the demon through his nostrils; and when the
man fell down, immediately he abjured him to return into him no more,
still making mention of Solomon, and reciting the incantations which
he composed. And when Eleazar would persuade and demonstrate to the
spectators that he had such a power, he set a little way off a cup or
basin full of water, and commanded the demon, as he went out of the
man, to overturn it, and thereby let the spectators know that he had
left the man; and when this was done the skill and wisdom of Solomon
were shown very manifestly." See Ba'aras.
Exorcism in Rabbinical Literature. Rabbi Johanan ben Zakkai, a
contemporary of Josephus, alludes to the practise of exorcism by
saying: "Has an evil spirit never entered into you? Have you never
seen a person into whom an evil spirit had entered? What should be
done with one so affected? Take roots of herbs, burn them under him,
and surround him with water, whereupon the spirit will flee" (Pesik.,
ed. Buber, 40a). R. Akiba (d. 132), in speaking of diseases, uses the
technical terms of exorcism ('Ab. Zarah 55b). Simon ben Yoḥai drove
out the demon Ben Temalion from the daughter of a Roman emperor (Me'i.
17b).