We found this lovely Novena on EWTN.
We know Joseph was a man of faith, obedient to whatever God asked of him without knowing the outcome. When the angel came to Joseph in a dream and told him the truth about the child Mary was carrying, Joseph immediately and without question or concern for gossip, took Mary as his wife. When the angel came again to tell him that his family was in danger, he immediately left everything he owned, all his family and friends, and fled to a strange country with his young wife and the baby. He waited in Egypt without question until the angel told him it was safe to go back.