The secret to a perfect Yoshi house

In Super Mario Bros. U, there are 2 types of mushroom houses: Cannon houses and Yoshi houses. In Yoshi houses, have one person per Yoshi color watch the Yoshi you want. When it's time to grab that color Yoshi, they'll tell you which to grab.