When parole is revoked, the remainder of the sentence must be served. The court may further order that the convict serve all or part of the time he spent on parole.