Cloud Services for Data Engineers: A Handy Cheat Sheet

As a data engineer or an aspiring one, it's essential to get comfortable with at least one cloud provider, especially services related to data engineering, such as storage, computing, streaming and so on.

Your choice may depend on the job market in your country, but always keep in min…

Data ingestion with dlt and Dagster: An end-to-end pipeline tutorial

This post provides a step-by-step tutorial on using dlt for an end-to-end data ingestion pipeline, covering the following steps:

• Ingesting data from the Bluesky API.

• Storing data in S3 as Parquet files.

Data Warehousing with Snowflake for Data Engineering Interviews

Snowflake is widely used by companies especially enterprises to power their data warehouses and analytics workloads. Big names like Canva, Adobe, Allianz, Afterpay, and Xero leverage Snowflake, and you may come across roles that require Snowflake expertise in your data engine…