David and Rebecca (Brooks) Harvey moved to Lawrence, Kansas from Van Buren, Arkansas in 1863. They became sharecroppers for Stephen Ogden and, in 1868, the Harveys began buying land for their own, eventually acquiring over 200 acres. The Harveys had four sons: William, Sherman Allen, Frederick Grant, and Edward S. David Harvey died in June 1893 and Rebecca Harvey died in August 1918.

Sherman Allen Harvey was born 6 Oct 1864. He graduated from the University of Kansas with a Bachelor of Arts degree in 1889; he later also earned a law degree from KU. Harvey first taught in the Lawrence public schools and then, during the Spanish-American War, served as Company B Captain, 23rd Kansas Regiment in Cuba.

After earning his law degree, Harvey traveled to the Philippines, where he set up a law practice and where he spent 19 years. After returning to Lawrence, Harvey entered the Leavenworth Veteran's Hospital and, later, the Los Angeles Veteran's Hospital, where he died September 1934.

After graduating from Lawrence High School, Frederick Grant Harvey studied medicine at KU, graduating in 1891, and completed his studies at Mehary Medical College (Nashville, TN) in 1892. He proceeded to practice medicine in Nashville, Brownsville, Texas, Kansas City, Kansas, and Lawrence. Like Sherman Harvey, Grant also served in the 23rd Kansas Regiment's Company B during the Spanish-American War, but as a surgeon. Grant Harvey died 25 May 1923.

Edward S. Harvey was born in 1870 and in 1894, like his brothers, he graduated from KU. After graduation, Harvey worked two years in Washington, D.C. as secretary to Congressman J. D. Bowersock, returning to Lawrence in 1901. There he worked as a farmer and was an active community member. Edward married Maud Henrie in 1912 and the couple had five children: David, Allen, Dean, Helen, and Joyce. Ed Harvey died 16 October 1953.