As a child, James suffered from poor health. Because he was chronically ill, he did not attend regular school until a relatively advanced age. When he was seventeen, his parents took him to a doctor who performed surgery on James to remove urinary stones. Some speculate that it was this operation that later prevented James Polk and his wife from having children.