The building that once served as a candy factory, tobacco warehouse, and office space for the Department of Defense will soon become affordable housing for senior citizens.