Avoidable strikes either side of Simon Gillett's thunderous second half free-kick condemned Town to an early cup exit, a disappointment compounded by the red card received by Seth Nana Twumasi.
After a second home defeat in quick succession, Johnson is looking for more desire and passion from his squad.
“It was disappointing with a couple of mistakes that we made for the goals; we got ourselves back in it but when you're down to 10 men it's a bit of a mountain to climb.
“What I did learn was that I've got five or six out there who are willing to go beyond the call of duty and then I've got some others at the moment who need to catch up and haven't yet. Certainly they've not quite shown that desire and passion to win football matches and I've got to look at that and look at the people making the mistakes.
“We are where we are and we got beat today, it's disappointing we're out of the Capital One Cup but the season is not over.”
Yeovil will face Gillingham again on Saturday in League One at Priestfield Stadium, and a win cannot come soon enough according to Johnson.
“We are the ones that are down about it, we're the challengers now because they picked up the result in the cup. We would've liked to have won them both, I'm sure Peter Taylor wants to win them both but we've got to go there and really show that we want to put our team on the points tally in the second league game of the season.
“The minute we win one the confidence will suddenly come back in a few of the other lads and that's what we need to get very quickly because you can't leave it too long. We get a chance in three or four days time on Saturday to do that.”
Watch the whole interview on our official YouTube Channel by clicking here.