Commissioners sent the plans for the high-rise tower behind the landmarked Duffield Street houses back to the drawing board at its recent meeting.