When we fear the Lord, we'll (eventually) offend someone, but every time we fear mere men, regardless of the reason, we'll offend the Almighty, and also deny Him. When we wholeheartedly embrace the truth of Scripture, we'll care more about what God thinks of us, and how we live our lives, than the opinions and judgments of only mortals. For His judgments are entirely true, fully just and perfectly righteous — and are everlasting in nature. But mere people lack true knowledge, are often skewed in their perspectives and their judgments are fleeting at best (unless one is aligned with God's heart/Spirit and the truth of His word).
Truly, it's better to have many speak evil against us, disapprove of us, or even physically persecute us, but have divine approval from Heaven. For the Day is coming, when what lies in darkness will be manifested clearly, and people will no longer be able to hide who they truly are, and the things they've committed. And God will render to each person according to their deeds — both Christians and unbelievers alike.
So let us follow the Apostle Paul's example, and live entirely to please Him who died for us to be forgiven (2 Corinthians 5:15). For as Christians, our works don't save us, Jesus does, but at His judgment seat, according to our works, we'll be either rewarded or will suffer eternal loss of reward (1 Corinthians 3:11-15):
"We make it our aim, whether present or absent, to be well pleasing to Him. For we must all appear before the judgment seat of Christ, that each one may receive the things done in the body, according to what he has done, whether good or bad. Knowing, therefore, the terror of the Lord, we persuade men" (2 Corinthians 5:9-11a)
The fear of man's thoughts, words and actions will cause us to not walk in God's will and live as cowards. As it is written,
"Fear of man causes a snare, but the confident in the LORD is set on high."(Proverbs 29:25)
Help us to fear You! Amen.