"I thought it was a bit over the top. I thought it was intended to bully and intimidate," Chaffetz said in an interview with "Kilmeade and Friends" surfaced by CNN's KFILE.
He said that his constituents are "welcome to come yell and scream" but said that he has won his last four elections "by the widest margin of anybody playing at this level."
"They're welcome to come to the meeting, but I thought it was a bit over the — it just — the continuous yelling and screaming and not allowing the dialogue," Chaffetz said. "I went there so I could hear dissent and have a discussion about the issues, but that's not what they were interested in."
Hundreds of people turned up to a town hall event Chaffetz held earlier in February, where the crowd grilled him on investigating President Donald Trump and chanted: "Do your job!"
Outside the town hall, more than 1,000 people waited to be let in and engaged in chants like "Chaffetz is a coward," according to KUTV.
Republican lawmakers home in their districts for the week during the congressional recess faced large crowds and vocal criticism at town halls on Tuesday. Constituents and protesters gathered at public events and outside local appearances by members of Congress.
Chaffetz held a town hall on Tuesday at a local high school, but does not appear to have any other public events scheduled during Congress' recess.