Allen came back into the starting line-up, replacing Jordan Henderson, who had undergone wrist surgery earlier in the week.
“Naturally, we’re really disappointed to get knocked out of the cup,” Allen told the club’s official website. “We certainly played well enough to have got a win, never mind a draw, on another day.
“I think there are positives in the sense that we created chances and played some good stuff, but unfortunately we conceded two goals and that’s the end of our cup run.
“If you analyse the game, there are probably not many faults that you could see in our game. It’s disappointing not to have come through; but, of course, at the Emirates against a very good Arsenal team it was never going to be easy.”
But for now Allen says the important thing is to not let heads drop and continue their winning momentum which has seen five wins from seven league games since the turn of the year.
The Welsh international added, “People always talk about the sign of a great team is to bounce back as soon as you do have a disappointment – that will be the case for us now.
“Our focus turns straight to that game and playing at Anfield has been brilliant for us this season. We’re hoping to make sure we play well and get the three points.”
Liverpool vs Swansea gets underway at 1.30pm on Sunday, 23rd January 2014.