"We have enough regulations on the books. What the administration ought to be doing is their jobs," Boehner said Tuesday at a weekly press conference on Capitol Hill.
While Boehner said that somebody ought to be held accountable for the failure in oversight, the Speaker explained his party was focused on eliminating "cumbersome, over-the-top" regulations that were "costing the American people jobs."
The site's tanks, owned by Freedom Industries, don't fall under an inspection program and the chemicals stored there weren't considered hazardous enough to require permits before they leaked into the Elk River nearby.
West Virginia Gov. Earl Ray Tomblin told CNN he was considering tightening the state's regulations in response to the spill.
"We need to do what we can to see that this kind of incident never happens again. There's no excuse for it," he said.