Teads processes Terabytes of data every day with Stack Data that reflects our engineering culture: pragmatic. Like many software systems, it’s a mix of state-of-the-art components, technical debt, and bits of strings.
I’ll walk you through the real journey of Teads data: ingestion and streaming processing of billions of analytic events per day (Kafka, Flink), Data Lake and batch processing (S3, Spark, EMR), data warehouse, transformations and BI (BigQuery, Redshift, dbt, Looker)