It seems to me that this depends on the next line:
"זכרו כריח הניחוח"
-If the memory of that Shabbaton is like a pleasant scent, you must remember it. I have no source for this at the moment, but I assume that the more pleasant Shabbatonim you attend, your general Shabbat experience will be enhanced. If it's unpleasant, then you are under no such requirement to remember it. Indeed, it's hard to come across a good Shabbaton, but hey, "יגעת ומצאת". And the song teaches us that it's worth trying. But if you really dislike Shabbatonim, perhaps you should be asking yourself why you keep going to them time and again in the first place?