Ford has also admitted he felt hurt at being dropped by England for the World Cup defeat to Wales which effectively sealed the host nation's World Cup exit.
England head coach Stuart Lancaster was heavily criticised for picking Burgess and has since left his post following his team's failure to get past the group stage.
Ford has revealed he felt let down by Burgess who quit to return to rugby league with South Sydney Rabbitohs, having been one of the Bath players who had tried to help him integrate into rugby union.
He told The Guardian: "The boys here, the staff, the fans... they've committed so much that, to be honest, it was a bit of a kick in the teeth. We felt let down.
"I'm big on loyalty and respect. If you commit to something, to me you give it your all.
"There's a lot of people helping you out and making sacrifices to make you a better player and part of a great team. I'd never feel like I could walk away from that because I'd let a lot of people down.
"People make decisions for their own reasons - everyone's different - but I couldn't do that."
Ford did not make the starting line-up for the 28-25 defeat to Wales and that upset the 22-year-old.
Sam Burgess, pictured, was not central to Stuart Lancaster's England departure, according to Ian Ritchie
Image credit: PA Sport
He said about being dropped: " It will always be something that will drive me because it hurt. It really hurt.
"I was disappointed, there's no two ways about it. I didn't agree with it. I said to the coaches as well.
"When you get dropped and you don't necessarily agree with it you want to go out and prove people wrong even more."