In 1834, Edward Mote wrote the lyrics to this hymn sometime after finding his faith in a chapel service in London at age 15. It was not put to music and published until 1863, and appeared in the Devotional and Tune Book the following year.
It speaks to the reality that as Biblical Christians, we need to continue to rely on Christ as the foundation of our faith in the battle over continuing sin.