S2:E8

Azure Log Analytics Costs Are Out of Control - Here's How We Cut Them by 60%

Data Platform
26 min

Host

Jonny DaenenJonny Daenen

Guest

Niels ClaeysNiels Claeys

Azure Log Analytics costs often take up 20% or more of a cloud bill, even though most teams only check logs when something breaks.

Azure's default analytics logs are powerful, but they're also expensive and often unnecessary for day-to-day log inspection. Switching application logs to Basic Logs can reduce Log Analytics costs by up to 60%.

In this episode, Niels walks us through a real customer case where logging costs dropped by thousands per year. They explain the difference between Analytics, Basic, and Auxiliary logs, show when Basic Logs are sufficient, and discuss practical setups using Azure Container Insights and FluentBit. This includes building a custom FluentBit plugin in Go as well as real-world gotchas like missing short-lived pods and why dynamic credentials matter.

Read transcript →

Chapters

  1. 00:00Intro: why optimize Azure log costs?
  2. 03:10What kind of logs are we dealing with?
  3. 06:13Plan types & the cost difference
  4. 09:59FluentBit vs Azure Container Insights
  5. 13:33How FluentBit works in K8S
  6. 16:41Can you lose log data?
  7. 17:36A custom plugin for Azure Workload Identity
  8. 21:05Why not use Azure Container Insights?
  9. 22:35Do all clients benefit?
  10. 23:41Summary & takeaways

Tags

AzureFluentBitLog OptimizationLog CostsCloud CostsLogging StrategiesKubernetesLog AnalyticsCost ManagementFinOpsDevOps