Harry even wore robes while going trough the third task of the triwizard tournament even though it would probably be more practical to use pants in that kind of in the later books however the wizards are described wearing muggle clothes even in places where they really should be wearing robes
