"We've got to go out and believe, and if we get a good start to the match then that belief will come," said Gordon.
"We hadn't managed to score a try against England in a long time but we managed to put a try past them. And our defence has improved and we can use that as an attacking weapon.
"We also have to pick the spirits up which have been a bit dented by the three results so far. It's a positive attitude needed in training this week so that we do go into the game with huge mental belief and really do something to get the crowd behind us in the first 20 minutes."
Gordon knows Scotland will need to improve on their poor performance against Italy when they crashed 20-14 in Rome.
"I think the ball that we put back at times wasn't especially good so we have to pick it up on Sunday. We were winning enough setpiece balls but the scrum wasn't as entirely as we would have liked.
"The line-outs were winning balls, the first-phase movement was good but after that we were breaking down. I think if we get those points right against France then we'll give ourselves a chance."