The Gemara says in Pesachim 110b
כְּלָלָא דְמִילְּתָא כׇּל דְּקָפֵיד קָפְדִי בַּהֲדֵיהּ וּדְלָא קָפֵיד לָא קָפְדִי בַּהֲדֵיהּ וּמִיהוּ לְמֵיחַשׁ מִיבְּעֵי.
The general rule is that anyone who is particular about them (drinking in pairs), the demons are particular with him, and anyone who is not particular, the demons are not particular with him.
R Moshe Feinstein (Igros Moshe Even Ha'Ezer 3:26) says that the Gemara is applicable in regard to Ayin Hara too.
How would he understand the fact that we pray every day after the morning Brachos
יְהִי רָצון מִלְּפָנֶיךָ ה' אֱלהַי וֵאלהֵי אֲבותַי שֶׁתַּצִּילֵנִי הַיּום וּבְכָל יום מֵעַזֵּי פָנִים וּמֵעַזּוּת פָּנִים. מֵאָדָם רָע. מִיֵּצֶר רָע. וּמֵחָבֵר רָע. וּמִשָּׁכֵן 'רָע. וּמִפֶּגַע רָע. מֵעַיִן הָרָע וכו