James and Sarah never had any children. The two were devoted to each other until James’s death. It has been said that upon Polk’s death, Sarah dressed in mourning for the rest of her life.