The Rambam in hilchos mamrim chapter 3 defined the basic idea of what a heritic is, but (more relevant here) what a heretic isn't, and it's very clear that someone who grew up in an environment where he/she did not know about what the Torah is etc., even if he later sees other Jews observing it, is not considered a heretic at all, since his views came to him in a way that is totally out of his control.
A person who does not acknowledge validity of the Oral Law is not the rebellious elder mentioned in the Torah. Instead, he is one of the heretics and he should be put to death by any person.
מִי שֶׁאֵינוֹ מוֹדֶה בַּתּוֹרָה שֶׁבְּעַל פֶּה אֵינוֹ זָקֵן מַמְרֵא הָאָמוּר בַּתּוֹרָה. אֶלָּא הֲרֵי זֶה בִּכְלַל הָאֶפִּיקוֹרוֹסִין [וּמִיתָתוֹ בְּכָל אָדָם]:
Since it has become known that such a person denies the Oral Law, he may be pushed into a pit and may not be helped out. He is like all the rest of the heretics who say that the Torah is not Divine in origin, those who inform on their fellow Jews, and the apostates. All of these are not considered as members of the Jewish people. There is no need for witnesses, a warning, or judges for them to be executed. Instead, whoever kills them performs a great mitzvah and removes an obstacle from people at large.
מֵאַחַר שֶׁנִּתְפַּרְסֵם שֶׁהוּא כּוֹפֵר בַּתּוֹרָה שֶׁבְּעַל פֶּה [מוֹרִידִין אוֹתוֹ] וְלֹא מַעֲלִין וַהֲרֵי הוּא כִּשְׁאָר כָּל הָאֶפִּיקוֹרוֹסִין וְהָאוֹמְרִין אֵין תּוֹרָה מִן הַשָּׁמַיִם וְהַמּוֹסְרִין וְהַמּוּמָרִין. שֶׁכָּל אֵלּוּ אֵינָם בִּכְלַל יִשְׂרָאֵל וְאֵין צָרִיךְ לֹא לְעֵדִים וְלֹא הַתְרָאָה וְלֹא דַּיָּנִים [אֶלָּא כָּל הַהוֹרֵג אֶחָד מֵהֶן עָשָׂה מִצְוָה גְּדוֹלָה וְהֵסִיר הַמִּכְשׁוֹל]:
To whom does the above apply? To a person who denied the Oral Law consciously, according to his perception of things. He follows after his frivolous thoughts and his capricious heart and denies the Oral Law first, as did Tzadok and Beitus and those who erred in following them.
The children of these errant people and their grandchildren whose parents led them away and they were born among these Karaities and raised according to their conception, they are considered as a children captured and raised by them. Such a child may not be eager to follow the path of mitzvot, for it is as if he was compelled not to. Even if later, he hears that he is Jewish and saw Jews and their faith, he is still considered as one who was compelled against observance, for he was raised according to their mistaken path. This applies to those who we mentioned who follow the erroneous Karaite path of their ancestors. Therefore it is appropriate to motivate them to repent and draw them to the power of the Torah with words of peace.
בַּמֶּה דְּבָרִים אֲמוּרִים בְּאִישׁ שֶׁכָּפַר בַּתּוֹרָה שֶׁבְּעַל פֶּה בְּמַחֲשַׁבְתּוֹ וּבִדְבָרִים שֶׁנִּרְאוּ לוֹ. וְהָלַךְ אַחַר דַּעְתּוֹ הַקַּלָּה וְאַחַר שְׁרִירוּת לִבּוֹ וְכוֹפֵר בַּתּוֹרָה שֶׁבְּעַל פֶּה תְּחִלָּה כְּצָדוֹק וּבַיְתּוֹס וְכֵן כָּל הַתּוֹעִים אַחֲרָיו. אֲבָל בְּנֵי הַתּוֹעִים הָאֵלֶּה וּבְנֵי בְּנֵיהֶם שֶׁהִדִּיחוּ אוֹתָם אֲבוֹתָם וְנוֹלְדוּ בֵּין הַקָּרָאִים וְגִדְּלוּ אוֹתָם עַל דַּעְתָּם. הֲרֵי הוּא כְּתִינוֹק שֶׁנִּשְׁבָּה בֵּינֵיהֶם וְגִדְּלוּהוּ וְאֵינוֹ זָרִיז לֶאֱחֹז בְּדַרְכֵי הַמִּצְוֹת שֶׁהֲרֵי הוּא כְּאָנוּס וְאַף עַל פִּי שֶׁשָּׁמַע אַחַר כָּךְ [שֶׁהוּא יְהוּדִי וְרָאָה הַיְהוּדִים וְדָתָם הֲרֵי הוּא כְּאָנוּס שֶׁהֲרֵי גִּדְּלוּהוּ עַל טָעוּתָם] כָּךְ אֵלּוּ שֶׁאָמַרְנוּ הָאוֹחֲזִים בְּדַרְכֵי אֲבוֹתָם הַקָּרָאִים שֶׁטָּעוּ. לְפִיכָךְ רָאוּי לְהַחְזִירָן בִּתְשׁוּבָה וּלְמָשְׁכָם בְּדִבְרֵי שָׁלוֹם עַד שֶׁיַּחְזְרוּ לְאֵיתָן הַתּוֹרָה: