TST: Fix benchmark failures #4375

Job	Run time
Check code style issues	40s
Build & verify package	10s
pytest on windows	4m 49s
pytest on 3.7 (crypto-lib: cryptography)	3m 35s
pytest on 3.8 (crypto-lib: cryptography)	3m 49s
pytest on 3.9 (crypto-lib: cryptography)	3m 32s
pytest on 3.10 (crypto-lib: cryptography)	3m 48s
pytest on 3.11 (crypto-lib: cryptography)	3m 18s
pytest on 3.12 (crypto-lib: cryptography)	4m 43s
pytest on 3.7 (crypto-lib: pycryptodome)	3m 46s
pytest on 3.7 (crypto-lib: none)	3m 52s
Combine & check coverage.	20s
	36m 22s

Provide feedback