Withdraw from the senses.
Even with pranayama the mind is still not quiet ready for the end goal that we are working up to here…samadhi. The senses will still keep the mind distracted with thoughts that come from smells, that lead to taste, visions that distract our minds, etc.
The Yoga Sutras say, “When the mind is withdrawn from the sense objects, the sense organs also withdraw themselves from their respective objects, and thus are said to imitate the mind. If the sense are allowed to see outside, they try to grasp pictures of the outside world. If they are turned inward, they will see the purity of the mind and won’t take the color of the world outside.”