# CryptoMB - TLS handshake acceleration for Istio

DevFeed: [CryptoMB - TLS handshake acceleration for Istio](<https://devfeed.tech/articles/cryptomb-tls-handshake-acceleration-for-istio-48747.md>)

Original publisher: [Read original article](<https://istio.io/latest/blog/2022/cryptomb-privatekeyprovider/>)

Author: Ravi kumar Veeramally (Intel), Ismo Puustinen (Intel), Sakari Poussa (Intel)

Published: 2022-06-15T00:00:00Z

Content type: article

Language: en

Sources: [Istio](<https://devfeed.tech/sources/istio-blog.md>)

Topics: [istio](<https://devfeed.tech/topics/istio.md>), [TLS (Transport Layer Security)](<https://devfeed.tech/topics/tls.md>), [TLS handshake](<https://devfeed.tech/topics/tls-handshake.md>), [Cryptography](<https://devfeed.tech/topics/cryptography.md>), [Handshake](<https://devfeed.tech/topics/handshake.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [private key](<https://devfeed.tech/topics/private-key.md>), [ECDSA](<https://devfeed.tech/topics/ecdsa.md>), [intel](<https://devfeed.tech/topics/intel.md>), [Server](<https://devfeed.tech/topics/server.md>), [Pingora](<https://devfeed.tech/topics/pingora.md>), [ChaCha](<https://devfeed.tech/topics/chacha-cipher.md>)

Tags: [cryptography](<https://devfeed.tech/tags/cryptography.md>), [cryptomb](<https://devfeed.tech/tags/cryptomb.md>), [ecdsa](<https://devfeed.tech/tags/ecdsa.md>), [gateways](<https://devfeed.tech/tags/gateways.md>), [handshake](<https://devfeed.tech/tags/handshake.md>), [intel](<https://devfeed.tech/tags/intel.md>), [intel-xeon](<https://devfeed.tech/tags/intel-xeon.md>), [istio](<https://devfeed.tech/tags/istio.md>), [mesh](<https://devfeed.tech/tags/mesh.md>), [microservices](<https://devfeed.tech/tags/microservices.md>), [offloading](<https://devfeed.tech/tags/offloading.md>), [performance](<https://devfeed.tech/tags/performance.md>), [private-key](<https://devfeed.tech/tags/private-key.md>), [server](<https://devfeed.tech/tags/server.md>), [services](<https://devfeed.tech/tags/services.md>), [sidecar](<https://devfeed.tech/tags/sidecar.md>), [tls](<https://devfeed.tech/tags/tls.md>), [tls-handshake](<https://devfeed.tech/tags/tls-handshake.md>)

## AI overview

This article explains how CryptoMB accelerates TLS handshakes in Istio gateways and sidecar proxies. It describes Envoy's private key provider, Intel IPP multi-buffer cryptography, and AVX-512 processing for RSA and ECDSA operations.

## Source excerpt

Cryptographic operations are among the most compute-intensive and critical operations when it comes to secured connections. Istio uses Envoy as the "gateways/sidecar" to handle secure connections and intercept the traffic. Depending upon use cases, when an ingress gateway must handle a large number of incoming TLS and secured service-to-service connections through sidecar proxies, the load on Envoy increases. The potential performance depends on many factors, such as size of the cpuset on which Envoy is running, incoming traffic patterns, and key size. These factors can impact Envoy serving many new incoming TLS requests. To achieve performance improvements and accelerated handshakes, a new feature was introduced in Envoy 1.20 and Istio 1.14. It can be achieved with 3rd Gen Intel® Xeon® Scalable processors, the Intel® Integrated Performance Primitives (Intel® IPP) crypto library, CryptoMB Private Key Provider Method support in Envoy, and Private Key Provider configuration in Istio using ProxyConfig. CryptoMB The Intel IPP crypto library supports multi-buffer crypto operations. Briefly, multi-buffer cryptography is implemented with Intel® Advanced Vector Extensions 512 (Intel® AVX-512) instructions using a SIMD (single instruction, multiple data) mechanism. Up to eight RSA or ECDSA operations are gathered into a buffer and processed at the same time, providing potentially improved performance. Intel AVX-512 instructions are available on recently launched 3rd generation Intel Xeon Scalable processor server processors (Ice Lake server). The idea of Envoy's CryptoMB private key provider is that incoming TLS handshakes' RSA operations are accelerated using Intel AVX-512 multi-buffer instructions. Accelerate Envoy with Intel AVX-512 instructions Envoy uses BoringSSL as the default TLS library. BoringSSL supports setting private key methods for offloading asynchronous private key operations, and Envoy implements a private key provider framework to allow creation of Envoy e