Open in app
Home
Notifications
Lists
Stories

Write
Santhosh Kumar M
Santhosh Kumar M

Home

Sep 16, 2021

Testing dynamically generated dags in Airflow

In my daily life of writing airflow dags, one day I encountered an use case where the dags have to be dynamically generated based on a json config. I stumbled upon the internet and found the astronomer blog on creating dynamic dags. The first step in the blog was a…

Apache Airflow

2 min read


Dec 27, 2020

Building a trustworthy data(team)— Part 2

In the previous blog post, we established some data practises for establishing trust in a data team. But there are some tradeoffs which on the other side, can break the trust if not communicated properly. The elements involved in the tradeoffs are as follows. Completeness Latency and Cost 1. Completeness Some might…

Data Team

3 min read

Building a trustworthy data(team)— Part 2
Building a trustworthy data(team)— Part 2

Dec 27, 2020

Building a trustworthy data(team) — Part 1

Data driven business have become a necessity in the modern age because of the insights it can generate and the ROI it generates. The crucial part of the data team in how you would engineer the data for analyst or data scientists or top level executives. Slowly this has built…

Data Team

3 min read

Building a trustworthy data(team) — Part 1
Building a trustworthy data(team) — Part 1
Santhosh Kumar M

Santhosh Kumar M

Following
  • Synced

    Synced

  • Ben Rogojan

    Ben Rogojan

  • AirbnbEng

    AirbnbEng

  • Pranay Dave

    Pranay Dave

  • Barr Moses

    Barr Moses

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Knowable