The building has been torn down to make way for the construction a new $250m (£186m) ballroom at the White House.