The work on New Bridge Close is expected to take several weeks.
The dedication plaque was taken from Swindon's former bus station while it was being demolished.