Hardware Sizing (Standalone Install)
Small Tier - 16 Core, 128G RAM (r5.4xlarge / E16s v3)
Component | RAM | Cores |
Owl Web | 2G | 2 |
Owl Database | 2G | 2 |
Owl Spark (10) Workers (10G, 1 core each) | 100G | 10 |
Overhead | 10G | 2 |
Medium Tier - 32 Core, 256G RAM (r5.8xlarge / E32s v3)
Component | RAM | Cores |
Owl Web | 2G | 2 |
Owl Database | 2G | 2 |
Owl Spark (13) Workers (20G, 2 cores each) | 250G | 26 |
Overhead | 10G | 2 |
Large Tier - 64 Core, 512G RAM (r5.16xlarge / E64s v3)
Component | RAM | Cores |
Owl Web | 4G | 3 |
Owl Database | 4G | 3 |
Owl Spark (27) Workers (18G, 2 cores each) | 486G | 54 |
Overhead | 18G | 4 |
Cluster
If your program requires more horsepower or (spark) workers than the example tiers above which is fairly common in Fortune 500 companies than you should consider the horizontal and ephemeral scale of a cluster. Common examples are Amazon EMR, Cloudera CDP etc... OwlDQ is built to scale up horizontally and can scale to hundreds of nodes.
Last updated