Fuller’s father and two grandfathers were both lawyers, so it was a family tradition. His maternal grandfather, Nathan Weston, served on the Maine Supreme Court from 1834 to 1841, while his paternal grandfather, Henry Weld Fuller, was also a successful lawyer and later a judge. Fuller’s father was a judge in Augusta, Maine.