10-man Liverpool recovered from having James Milner sent off for a second booking and losing the opening goal to a Joe Ledley finish on 48 minutes to claim all three points courtesy of Benteke's controverial penalty in the dying seconds.
The Belgium forward went to ground under minimal contact from Damien Delaney in the fourth and final minute of stoppage time and referee Andre Marriner pointed to the spot after consulting with his linesman.
Roberto Firmino had equalised for the 10 men after a mistake by Crystal Palace goalkeeper Alex McCarthy, who was left helpless when Benteke wrong footed him to coolly convert the penalty for a 2-1 win.
Armenian Premier League
Gutierrez's mother considered 'taking own life' over treatment of son
23/03/2016 AT 13:14
“(Frustration with) both of them - (Benteke and the linesman). That touch doesn’t warrant that dive," said Pardew, who was clearly annoyed during an interview with Sky Sports TV.
I feel like we've been robbed a little bit, but again maybe we shot ourselves in the foot a bit. When we went down to 10 men maybe we should have pushed on a little bit.
"(Benteke) is looking for it. Our player is pulling out of it. If the linesman gives it for the touch of the knee in the last minute I think it is harsh. Damien Delaney literally pulls out of it and the follow through of his knee gets it. Blimey, that's tough.
"We didn't get any pressure on them when they went down to 10. Up to that we were good and deserved to be in front. The keeper made a mistake, which cost us and made us edgy from that point and we never lost that edginess for the rest of the game.
"It was a game we should have come away with and we didn't."

Liverpool celebrate Christian Benteke's winning goal against Crystal Palace

Image credit: Reuters

Palace have gone 12 Premier League matches without a win, the ongoing longest winless run in the Premier League, and are 10 games without a clean sheet, conceding 2.3 goals per game on average.
Pardew's side remain nine points clear of the relegation places with nine games remaining, but Pardew has bemoaned losing a point from the visit of Jurgen Klopp's team.
“Everyone’s seen the penalty," said Pardew.
"I think if you’re the ref and you see the centre back pulling out of the challenge you don’t give it.
“If you feel that touch is enough to bring someone down like that..it's an issue that’s worrying in the game
“We’ve had decisions where Wilf gets completely wiped out and it’s not given. And that one? Wow, you’ve got to be sure.
“We’re looking at that in super slow motion and you can then see a knee on the back of the foot.”
Armenian Premier League
Shirt sponsor revenue up 13 percent in top Euro leagues
23/03/2016 AT 00:00
Armenian Premier League
Hart and Sterling out for a month after suffering injuries in City's derby loss to United
20/03/2016 AT 19:41