The short meeting occurred as Oregon officials are putting increased pressure on federal authorities to take action against Bundy's group.
On Thursday, Bundy went to the airport in Burns, where the FBI has set up a staging area, and spoke to an FBI negotiator over the phone. They agreed to speak again Friday, but Bundy left the airport shortly after he arrived because the FBI agent he spoke with said federal authorities wanted any conversation to be private.
Bundy wants face-to-face conversations in front of reporters. "I really don't think, at this point, even having another phone conversation here without him would be beneficial," Bundy said before leaving Friday.
He also questioned the FBI's authority. "If you haven't got sanction from the sheriff, there's no reason to be talking to you," Bundy said.
A crowd of reporters watched the brief exchange, while state troopers and armed federal agents looked on.
Bundy's group began occupying the Malheur National Wildlife Refuge in eastern Oregon on Jan. 2. The group plans to open the 300-square-mile refuge for cattle this spring.
The FBI did not immediately comment on Friday's meeting with Bundy, but the agency said in a statement Thursday that the agency's response "has been deliberate and measured as we seek a peaceful resolution."
Oregon Gov. Kate Brown said Wednesday that she was angry because federal authorities have not taken action against Bundy's group. The Democratic governor said the occupation has cost Oregon taxpayers nearly half a million dollars.
Brown sent a letter Thursday to U.S. Attorney General Loretta Lynch and FBI Director James Comey, urging them "to end the unlawful occupation of the Malheur National Wildlife Refuge as safely and as quickly as possible."
In a statement, U.S. Sen. Jeff Merkley said it was "long past time for this illegal occupation to end and for the people of Harney County to get their lives back."
The Oregon Democrat said he hopes authorities could peacefully resolve the situation and hold Bundy's group accountable.
At community meetings, some local residents have asked Bundy and his group to leave.
Harney County Judge Steve Grasty said in a statement Friday that many locals "are incredulous about the federal government's fear of taking action against the lawlessness that we are witnessing on a daily basis."
Bundy has said he believes his group's work is appreciated by locals. He said the armed men have been "helping ranchers," doing maintenance on the refuge because "it's in a bad shape," and taking care of fire hazards in the refuge's firehouse.
Bundy has also asked the FBI to let two ranchers sent to prison for arson go back home.
The Center for Biological Diversity environmentalist group says it plans to hold a rally Saturday afternoon in the refuge to call for Bundy and his supporters to leave.
Associated Press writer Gosia Wozniacka in Portland, Oregon, contributed to this report.
Copyright 2016 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.