In 1835, Johnson won election to the Tennessee House of Representatives, where he served a single term. He won election again in 1839. Johnson frequently defended the interests of smaller farmers and mountaineers against the wealthy elite. In 1841, he served as a member in the Tennessee Senate.