Douglass Community Center was built in 1939 by the U.S. Army Corps of Engineers and opened in 1940 as a U.S.O. canteen for African American servicemen. In 1945 it was turned over to the City of Manhattan. The Recreation Commission used it occasionally for special activities from 1948 to 1966.

In 1966 the African American community petitioned the city to open the Center for ongoing community and recreational activities. The Douglass Center Advisory Board was created in 1966 under the Human Relations Board. In 1970 the Advisory Board was separated from the Human Relations Board and was given more powers.

The old Douglass Elementary School building was acquired as an annex in 1975. A fire in 1980 did approximately $70,000 worth of damage, necessitating renovation of the Center.

The Center was established as an integrated facility in 1966, but because of its location in the African American community it was rarely used by whites. However, by 1977-78 the Center was becoming truly integrated. By 1980 thirty-five percent of those using the facility were white and in 1984 the figure rose to forty-five percent.