Mount Vernon Square has an ornate, though rather worn, building in its center. The building, clearly a former library, now houses the Historical Society of Washington D.C.