Load balancing ​

Jitar has out-of-the-box load balancing support. It's provided by the gateway service, so that needs to be added to your environment in order to use it.

The load balancing system operates on function level. If a function is available on multiple nodes, the gateway will automatically balance the requests round robin over the nodes. The function's fully qualified name (FQN) is used to uniquely identify the functions.

When a node registers itself at the gateway, the node will provide the FQNs of the functions it contains. The gateway creates a balancer per FQN and uses the next node per request. When a node contains FQNs that are already registered by the gateway, it will add the node to the balancer.