Go deep into data ingestion from a business, product and technology point of view.
Product
From raw data to analysis In this article we look into the different stages of data journey.
Data integration with applications Trying to fetch data from a third party system? Read this article to understand the prerequisites for data integration.
How to fetch data from an application API, Email, SFTP, Databases - How to fetch data from an application and understand the pros and cons of the data fetch options.
API Authentication methods Understand the different ways in which APIs are authenticated and which mechanism should be preferred.
Data organization in ELT Data Understand how the data is organized in ELT Data and what are the advantages/disadvantages of it.
Business
Cost of running data reporting Understand the true cost of running data reporting.
Data pipelines from SaaS application providers Why SaaS providers might or might not provide the data pipelines out of box.
Technology
Schema evolution and tracking Understand how ELT Data handles schema detection and evolution.
Historical loads, concurrency and checkpoints Understand in depth about historical loads, concurrency and error recovery mechanisms usng checkpoints.