Lee followed up: "Should I interpret that as not very well?"
Specter, after another pause: "Ah, I'm late for the squash court."
Sestak defeated Specter in the May Democratic primary, effectively unseating the decades-long senator who has been a critical ally of the Obama White House since he switched parties in 2009.
Sestak, a retired Navy admiral, hasn't been able to move the needle since beating Specter, who was also losing badly in the polls to Republican nominee Sen. Pat Toomey.
The TPM Poll Average of this race has Toomey leading Sestak 46.5%-38.8%.