They were made of tin, or wood, sometimes covered with cloth and even decorated with unit insignia, but more often were left uncovered and strictly utilitarian.

As with most things about the war, the surviving canteens in museums are mostly Union ones. There’s quite a good collection of them here, including a tin one that was split apart to form two plates.