This religion is profound

The Prophet, may the peace and blessings of Allah be upon him, used to not let people exhaust  themselves in worship, or fail short to giving the due rights; they do not let their bodies rest, nor give their spouses the right to pleasure because they spend the day fasting and night in prayer, they renounce the lawful pleasures of this life and suffice themselves with the few morsels and a piece of cloth to conceal the body parts that must be covered.

The Prophet, may the peace and blessings of Allah be upon him, called them to be fair with themselves and their spouses, and to follow a moderate course in worship lest they neglect it because of their extravagance. Consequently they will abandon the path that pleases Allah.

Islam is a religion of moderation, both excessiveness and negligence are not accepted in Islam. It is a fair religion that guides to path that is best. It overcome with its easiness and toleration every extravagant  as well as every negligent.

This Hadith is an argument against four categories of people

1. The Jews who were too strict and deprived themselves of what Allah made lawful to them.

2. The Christians who also were too strict, kept themselves in monasticism and abstained from marriage and many of the lawful things.

3. The people of innovation who adopted the way of extremism in religion until they striped Islam of its most important characteristics, which is easiness, moderation, flexibility and the fewness of obligations. 

4. Those who claim to be ascetic and pious yet they follow other than the correct way.

If they were fair they would not have exaggerate nor deprived themselves of the lawful things. However, ignorance of the easiness and leniency of the religion has led them to do so.