Polk won a seat to the Tennessee House of Representatives in 1823 by defeating two-term incumbent William Yancey. He served in the Tennessee legislature until 1825, when he ran for a seat in the U.S. House of Representatives.