Let's Encrypt response on renewal: Order's status ("valid") is not acceptable for finalization

[casdr]

Sometimes the renewal of a certificate for an existing domain fails with the error below. Fixing this can be done by removing the existing certificate from the filesystem, and then going to the URL again. How can we prevent this from happening?

Request failure: STATUSCODE=403 REQTYPE=post
{
  "type": "urn:ietf:params:acme:error:orderNotReady",
  "detail": "Order's status (\"valid\") is not acceptable for finalization",
  "status": 403
}