"You can be upset at a person for missing because we are human, but if you're going to bring race into it, then it has no place in football or just in general," Bolt told Reuters on Tuesday in Kingston.
The man winner of the 100m and 200m double the three consecutive Olympics 2008, 2012 and 2016 described the racial abuse directed at the players as horrifying.
"First of all that's horrible to know… for me it's very tough to see these things. As an African and a black person, I can tell it must be rough on them and you can't blame these guys, they don't make the decision of who take the penalties," Bolt reasoned.
The English Football Association in a statement said it was "appalled" by the abuse of the three players.