Why do Christians think the 3 wise men visited Jesus in a manger ? Are Nativity seens just plain wrong ?

Matthew 2:11 New International Version
On coming to the house, they saw the child with his mother Mary, and they bowed down and worshiped him. Then they opened their treasures and presented him with gifts of gold, frankincense and myrrh

All bibles say house in Matthew 2:11.
11 answers 11