Before Data as a Service (DaaS) was introduced in 2016, data engineers had to go through a manual process of connecting cloud storages (Amazon S3, Google Cloud Storage, MinIO, etc) with Spark and...
Why create a single DAG based scheduler for databases?
When we set out to design Kaldea, including its single DAG based scheduler, we interviewed 100+ data scientists, data analysts, and data...
This is the fourth and final article in Kaldea’s culture guide. It covers being the customer.
When was the last time that we saw a product announcement for ‘data analysis’? Instead, we’ve seen a lot of advancement in data storage, pipeline, ETL, metric stores, governance, dashboards. The last...
This is the third in a series of four articles, publishing our full culture guide. It covers inclusivity and performing as a Kaldean.
Over the past couple of decades, the use of data and data management tools have evolved dramatically, and are continuing to evolve. We’ll tell the history of Big Data and data management tools,...
This is the second in a series of four articles, publishing our full culture guide. It covers transparency and contributing to Kaldea’s goals and mission.
Understanding “What is data vs metadata?” is a simple enough question, but it has more implications for data analysis than you might think. The scope and flexibility of the definition of data and...
