In this material world, to stay together is a very difficult task. It is easy for one to stay alone in a cave, but to stay together in an ashram is extremely austere.
The only way to free ourselves from all the temptations and attractions of this material world, one should do the hari naam sankirtan. That is the only way.