HaYom Yom for the 27th of Nissan "The permissible, when done for one's pleasure, is completely evil, as the Alter Rebbe writes in Tanya, Chapter 7, for we are commanded, "sanctify yourself with what is permitted to you." One must introduce sanctity into those matters that are permissible so that they serve the purpose of enhancing one's Torah, mitzvot, fear-of-G-d and good character traits."
Chabad Chassidus in general doesn't speak highly of pleasure for one's self, but doing something L'Shem Shamayim and a side effect is also pleasure is not bad, but the ultimate goal is complete bittul (nullification) to Hashem.
Ger Chassidim have many children but have very strict takanot on interaction with husband and wife. In general outside of the night a women goes to mikveh, Ger Chassidim observe Niddah laws between husband and wife the rest of the time. It is a very high standard that from the outside seems "overboard". These takanos were instituted by the Beis Yisroel in the 70's to battle the sitra achra. Whether or not such a lifestyle is for you, it should be noted that Ger is still one of the largest Chassidic groups today.