For us to remove fear, we must attack it with perfect love. We need help from God to get the fear (whatever kind it is) completely out of us. If we try to remove fear without God’s help, a piece of that fear will remain in us and likely cause us much harm.
God, too, has a boundary when it comes to getting God’s ear. We see this in (John 9:31): We know that God does not listen to sinners, but if anyone is a worshiper of God and does his will, God listens to him.