Tests: Flakyness `BindException: Address already in use` / `SystemError: Failed to start Crate instance in time`

[amotl]

The root cause for SystemError: Failed to start Crate instance in time. (see #629) is that a previous instance of CrateDB might not have been terminated correctly.

In that case, a subsequent attempt to start it will croak like [1,2]

Caused by: io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use

[1] https://github.com/crate/crate-python/runs/6210165871#step:6:192
[2] https://github.com/crate/crate-python/runs/6540915990#step:5:233

_Originally posted by @amotl in #629

References

• testing: fixed issue that caused the testing layer to hang #225

[amotl]

I have not been able to observe this error recently, so I am closing this.

[amotl]

The error is not gone yet, those are two more data points.

• https://github.com/crate/crate-python/actions/runs/3177362098/jobs/5177712919#step:4:511
• https://github.com/crate/crate-python/actions/runs/3274701823/jobs/5388588426#step:4:486

[amotl]

Another different one from doctests/layer.txt.

File "/Users/runner/work/crate-python/crate-python/src/crate/testing/doctests/layer.txt", line 219, in layer.txt
Failed example:
    num_nodes
Expected:
    2
Got:
    1

-- https://github.com/crate/crate-python/actions/runs/3218694497/jobs/5263181322#step:4:363

[amotl]

This one still occasionally happens.

Caused by: org.elasticsearch.http.BindHttpException: Failed to bind to [44402]
Caused by: io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
SystemError: Failed to start Crate instance in time.

-- https://github.com/crate/crate-python/actions/runs/3700515171/jobs/6269005519#step:4:429
-- https://github.com/crate/crate-python/actions/runs/3700515171/jobs/6269005519#step:4:458
-- https://github.com/crate/crate-python/actions/runs/3757800849/jobs/6385404485#step:4:399

[amotl]

Didn't see this for a while already. Even if, it's just a fluke. Closing this.

[amotl]

Still happening occasionally.

BindException: Address already in use.
SystemError: Failed to start Crate instance in time.

-- https://github.com/crate/crate-python/actions/runs/9562806841/job/26359960751?pr=625#step:4:354

References

• CI: Update from CrateDB 5.4.5 to 5.7.2 #625