Running thousands of Spark applications without losing your cool

I explain how to troubleshoot and detect problematic Spark applications at scale as well as show how this can be used to reduce your costs.