Skip to main content

Introduction

ELT Data is a SaaS application to automate the ingestion of data from your business applications to your warehouse.

Along with data ingestion ELT Data makes the following available:

  • Data Security: The data pipeline execution and the storage happens in user's cloud. The data never leaves user's cloud. Pipelines are managed from the ELT Data UI.

  • Data Sources: ELT Data generates the data pipelines dynamically from the API documentation, emails and SFTP folders.

  • Data Schema Detection: ELT Data automatically defines the schema of your source by looking at the API response or the CSV files.

  • Data Schema Evolution: ELT Data automatically adjusts your data to changing data schema and keeps a track of the schema evolution.

How it works​

The data pipelines are orchestrated using ELT Data but the execution and the processing happens within user's cloud. The following schematic represents a high level view of ELT Data.

How it works

Supported Sources​

ELT Data supports integration with APIs, email reports and SFTP folder.

  • APIs - ELT Data generates data pipelines from the API documentation. Few of the integrations running of ELT Data include - SAP S4 HANA, Netsuite, Tempworks, Ringcentral, Intermedia, ServiceTitan and others.

  • Emails, SFTP - For apps not providing API integration we provide provision of writing data pipelines from email attachments and SFTP.

Supported Destinations​

  • AWS S3 / Azure Blob / Google Storage - By default all the outputs are written to the cloud storage. Data is written in Delta format.

  • Postgres / Azure SQL / MySQL / Snowflake - The data written to the blob is copied to any of the SQL Alchemy supported databases.

Data Transformations​

The only transformations supported by ELT Data are the dedupe and the flattening of the data. Dedupe strategies can be full refresh or incremental.

Reporting, AI or other downstream use cases​

ELT Data stops at making the data available to the users. We have partners to help you with the next leg of your data requirements .

Data Security​

ELT Data by architecture makes sure that the data processing happens within your cloud.

  • Data policies - Since the data resides in customer's environment, the data is governed by customer's data policies.

  • Data sovereignty - Customers can run the pipelines in any cloud and in any region of their choice.

  • Data retention - Defined by customers.

  • Data encryption - Defined by customers.