When a sadhaka chants with the tongue, the sound vibrations travel through the ears and are meant to reach their destination, the mind. If the mind is absent, the sound vibrations do not reach their destination, and ideal Japa does not occur.
It is the Beauty of the Lord making Himself accessible to everyone. Each one of us can have our very own Lord, and in this form, He can become our cherished property.