Nintendo of Europe's official 1998 German guide for Yoshi's Story depicts White Yoshi as being highly religious. He also states that his constant words of admonition of the other Yoshis' sinful behavior caused them to abandon him.
See Tweet