Just completed the Data Ingestion workshop as part of datatalks.club’s Data Engineering zoomcamp. In this workshop I learned about using generators for loading data in a more memory efficient way. I was also introduced to dlt (Data Load Tool) dlthub.com a nifty tool for streamlining data loading.