The Glovers have previously hosted Liverpool and Manchester United in third round ties at Huish Park and will hope to have a chance of repeating those type of ties when they travel to Port Vale this weekend in the second round.
Saturday’s clash could provide Olomola his first taste of FA Cup action having missed the first round victory over Southend United through suspension.
The Southampton loanee told iFollow Glovers: “Since I was young I’ve always watched the FA Cup, one of the earliest football memories I’ve got is Steven Gerrard scoring in the final against West Ham.
“The FA Cup is very special for me and it will be special to be a part of.
“It’s the fourth time in five years that the club’s trying to reach the third round so it’s going to be a big game on Saturday and hopefully we can win it.
“We want to have a cup run, we’ve got a good squad with good individual players so hopefully we can do that.”
On Town’s opponents the Valiants, Olomola realised it will be a tough game with only two points separating the sides in the Sky Bet League Two table.
The Glovers drew 1-1 with Vale earlier this season with Otis Khan equalising in the second half after Tom Pope’s opener.
Olomola said: “It was a good game but it was tight. I believe with the qualities we have we can go there and turn them over.
“If we win on Saturday it will be a big confidence boost for everyone in the squad.”