He, sallallaahu ‘alayhi wa sallam, never thought ill of them and would give them the benefit of doubt:

As a matter of fact, the Prophet of Allah, sallallaahu ‘alayhi wa sallam, forbade men from entering upon their wives at night (when returning from a journey). Jaabir ibn ‘Abdullaah (a Companion) narrated: “The Prophet of Allah, sallallaahu ‘alayhi wa sallam, forbade that a man should enter upon his family at night, doubt them, sneak in on them (to see if they are doing something wrong behind his back) or searching for their mistakes.