Why is the worship of a man considered okay but worshiping a woman is idolatry?

Its not. In the Bible it says that you can only worship God. God is not a man. He is a spirit creature.