Bank stocks were also getting beaten down as investors worried that they could suffer if loans to oil and gas companies went bad.