Alex Neil rues lack of quality in final third as Preston are knocked out of League Cup by Accrington
Ben Richards-Everton gave the hosts a 20th-minute lead with a fine turn and volley, it then taking until 20 minutes from time before Jordan Hugill leveled things up.
A crazy finale then saw Jordan Clark get Stanley back in front in the 86th minut, with more than a hint of a foul in the build-up,only for Hugill to equalise for a second time with a looping header as the game entered stoppage time.
With the game seemingly heading for an extra 30 minutes, Billy Kee flicked home a header from close range to seal victory in the Lancashire derby and cause one of the shocks of the first round.
"We shouldn't have been in a position where we were forcing extra-time," Neil said.
"At 1-1 we looked like the team that were going to win the game.
"The referee's made a really poor decision in the corner for the second goal, I thought it was a blatant free-kick on Andy Boyle but he lets it go.
"We scored the second goal but when we conceded the corner, I thought 'I've seen this situation a million times before' and sure enough we concede from a set piece which is really frustrating.
"If you look at the game we had numerous opportunities, numerous chances, we didn't take them, we didn't make it count and ultimately we got punished at the end of it.
"The amount of times we got to the byline, had shots unopposed from 18 yards out and generally our quality is a lot better than that.
"That side of things was lacking tonight."