The Royals face two tough league fixtures in the coming week in second-placed Cardiff and leaders QPR, but Gibb insists the Stevenage encounter is currently the most important one and complacency will not be allowed to creep in.
"It's a big occasion. We really value the FA Cup and the players are all really looking forward to it," Gibbs told the club's official website.
"We'll be prepared. They (Stevenage) played on Tuesday night and the manager went to watch them (in a 3-0 win over Rotherham), so we'll do our usual coverage of the opposition, just like any league game.
"It's going to be a tough, tough game. It's a compact pitch, their fans will be right behind them and right on top of us.
"The underdogs always crop up in the FA Cup, it's always the case. We've got to be well prepared for it because we all want to progress to the next round."