United squandered a two goal half time advantage, and a storming second half comeback saw the hosts score three to put them top of the table.
Adkins revealed that he was down after the defeat, but vowed to get himself back up again for the trip to Wolves on Tuesday night.
"I'm feeling it (the pressure) and I'm really down at the moment. But I will get myself back up for Tuesday's game at Wolves.
The boss also admitted that poor marking cost them the game.
"There are a lot of positives from that, but all the three goals we conceded in the second half could have been avoided.
"There was some poor marking at set-pieces. They were bad goals."