Our Open-Source https://github.com/synopse/mORMot/blob/master/SynCrypto.pas has almost all that you require.
About performance, it is the only one in the Delphi area using AES-NI and optimized SSE3/SSE4.2 assembly - as far as I know. So it should blow alternatives.
It is cross-compiler (Delphi and FPC) and cross-platform (Windows, Linux, BSD... thanks to FPC).
For elliptical curves, see its sibbling https://github.com/synopse/mORMot/blob/master/SynEcc.pas
It supports only secp256r1 but it is feature complete (e.g. simple CA management) and fast (1 ms to create a key pair, 0.4 ms to sign or verify on x86-64) - also cross-platform and cross-compiler.
See the documentation at https://synopse.info/files/html/Synopse mORMot Framework SAD 1.18.html#TITL_187
Both are highly maintained, and used on production since years.
They don't require any external dll (like OpenSSL) which tends to be a maintenance nightmare on Windows.