ELASTIC D2.3: Low-latency Orchestration and Monitoring with eBPF/XDP

Network operations, security, and observability constitute fundamental aspects of workload orchestration, as both control and data messages are exchanged over the network between cluster nodes and worker instances. This deliverable presents several advancements over the state-of-the-art in all of these areas, to serve as the technological foundation for ELASTIC’s serverless Function as a Service (FaaS) platform. In the field of data plane acceleration, the document describes advances in network transport mechanisms that deliver significant performance improvements and enhanced security guarantees over the current state-of-the-art. Observability is also treated as a first-class concern within the proposed architecture through the use of eBPF-based monitoring solutions that enable fine-grained workload instrumentation, logging, and resource utilisation analysis.