Koch Industries — Ranking & Prediction at Billion-Calculation Scale
The ranking engine here had to push data-science math models through feature sets of up to 200K features — hundreds of millions to billions of calculations. I didn’t start on EKS; I started with a RabbitMQ + minikube POC on my own machine, proved the sharding worked, then moved to KEDA on AWS EKS only after benchmarking it against an Anyscale/Ray prototype of the same job. The prediction side was an LSTM algorithm in PyTorch on Ray.io for parallelism — I designed it sitting with the data scientists, and I wrapped the whole thing in unit and integration tests before it went anywhere near production.
See the full engagement history