Visit Azul.com Support

Optimizer Hub Architecture Overview

Table of Contents
Need help?
Schedule a consultation with an Azul performance expert.
Contact Us

Optimizer Hub is shipped as a Helm chart and a set of Docker images to be deployed into a Kubernetes cluster. The Helm chart deploys different components based on the use case.

Architecture Overview

Optimizer Hub offers two deployment options: a full installation of all components or a ReadyNow Orchestrator-only installation.

Full Installation

In a full installation, all Optimizer Hub components are available and gateway, compile-broker, and cache are scaled when needed.

Full installation diagram

Remarks:

  • All services use one pod, except Cache uses two pods by default.

  • The load balancer is either your own solution (recommended), or the optional gw-proxy included in Optimizer Hub. See Configuring Optimizer Hub Host for more info.

ReadyNow Orchestrator Only

When only ReadyNow Orchestrator is needed, a reduced set of the Optimizer Hub components is deployed in the Kubernetes cluster.

ReadyNow Orchestrator only diagram

High Availability of Optimizer Hub

Optimizer Hub is designed with High Availability (HA) as a fundamental architectural principle:

  • The system architecture prioritizes continuous update and service reliability.

  • Built-in redundancy at multiple levels ensures business continuity.

High Availability in Clusters

HA is guaranteed inside and between clusters.

Inside a Cluster

The nodes inside the Optimizer Hub service have failover built-in:

  • Automatic redistribution of workload when a node fails.

  • The system maintains full functionality even if individual nodes crash.

  • A seamless transition between nodes prevents service interruption.

Between Clusters

HA is also integrated in configurations with multiple clusters:

  • Clusters have health check endpoints to declare their readiness to accept traffic.

  • You can add a DNS-based load balancer or service mesh to route the requests to the nearest available cluster.

  • Custers can sync important information.

High Availability Configuration

Follow these recommendations to ensure High Availability (HA) of Optimizer Hub.

  • Install multiple instances of the Optimizer Hub service, for example, one per region of availability zone.

  • Front the Optimizer Hub service with either:

  • Let the clients connect to the load balancer or service mesh.

  • Use the health check APIs to only route requests to instances that are ready to handle traffic.

  • Route the requests to the Optimizer Hub service that is nearest to the JVMs.

  • Set-up synchronization of ReadyNow profiles.

Note
 Cloud Native Compiler artifacts are not synced. They can be easily regenerated without compromising application performance.