''ותנא כשמת עלי הכהן חרבה שילה ובאו לנוב' And a tanna taught: When Eli the priest died, Shiloh was destroyed and the Jews arrived at Nov, where they erected the Tabernacle.[zevachim 118b]
it was not completely destroyed there still was some kind of a structure there
אמר רבי חייא בר אבין אמר רבי יהושע בן קרחה סח לי זקן אחד פעם אחת הלכתי לשילה והרחתי
ריח קטורת מבין כותליה''יומא לט ב
Rabbi Ḥiyya bar Avin said that Rabbi Yehoshua ben Korcḥa said: An old man reported to me: One time I went to the ruins of the Tabernacle in Shiloh, and I smelled the smell of the incense from between its walls.