Containers have recently become a hot topic in high-performance and scientific computing. While containers can provide significant advantages, they don't always live up to the hype. In order to help cut through the marketing, we explain what containers are, how they work, and survey some of the popular implementations with an eye toward supporting scientific workloads. Security and other operational concerns will also be covered for cluster administrators considering supporting containerized workloads on their systems.