You are correct.
There are situations where we have to sympathize with the referee for, because with one stroke of his hand, he can determine the result of the game. And it's not easy to do that with the massive amount of pressure on you from all the players and the fans in the stadium. The referee is basically one man against an entire army. So it is very difficult for him. But I believe that the referee has been chosen because the FA believes he can work under that pressure, and he became a referee because he believes he can work under that sort of pressure. Therefore, we can justifiably blame the referee when he makes a blatant mistake, but we should be more lenient with judging the softer ones.
Referees are the worst part of football , especially lately. UCL,UEL,EPL and the other leagues have these ridiculous referees. They have only one job and they ruin football. I admit there are some really good referees but not enough. For example In our League (Turkish league) I dont wanna watch football anymore because of them. What do you think about this?