For years I have read the pesukim of Korach 17:20 -25 which describes the episode of the blossoming of Ahron's staff amongst the other tribe leader's staffs. However, if you notice Moshe Rabbeinu himself went in and placed the staffs and the following day retrieved the staffs by himself.
Rashi notes on passuk 21 that he placed Ahron's staff in the middle so people shouldn't think that he placed his near the Divine Presence:
בתוך מטותם: הניח באמצע, שלא יאמרו, מפני שהניחו בצד שכינה פרח (תנחומא אחרי מות)
amidst their staffs: He placed it in the middle so that they should not say that it blossomed because he had placed it close to the Divine Presence. — [Mid. Tanhuma Aharei Moth 8]
We see from Rashi that Moshe anticipated skepticism from some, therefore he preempted their argument and placed it in the middle. However, I would think that their greatest argument would be to say that Moshe Rabbeinu went in himself and maybe he performed a trick and made the middle staff blossomed before he showed the nation of Israel. My question is why didn't Moshe preempt that suspicion and why didn't anyone who was looking for trouble make such a claim?