I just watched the presentation from post url and I really liked the tool Roy talked about at 19:00-22:40.
Also he answered a question (34:07-35:23) about which algorithm they use to actually tune thresholds by saying that he was sure it would be open-sourced at some point.
So I searched through the entire list of public repositories on https://github.com/Netflix?sort=stargazers and didn't find anything relatively similar to what Roy described.
Does anyone know: 1. What is the name of the metrics tuning system? 2. Is it open-source? 3. Is it actively supported or is it deprecated?
Thanks.