Benefits of using the Standard Data Ingestion API
The Standard Data Ingestion API ensures a seamless integration into your existing IT landscape. This includes:
- Full control over the data you send to Celonis: The Standard Data Ingestion API focuses on push based integration scenarios to give you full control over what data you're pushing.
- Reuse your existing data applications: Celonis is just another consumer on top of your existing data architecture and doesn’t require any client to be installed.
- Use multiple source systems: As the Standard Data Ingestion API can be used with tools like Informatica and Talend, you can efficiently integrate data from multiple source systems.
Using the Standard Data Ingestion API also has the following benefits:
- Increased data integration options: The Standard Data Ingestion API is built on top of an Amazon S3 API such that existing applications and software libraries can interact with it out of the box.
- Faster data transfer: The Standard Data Ingestion API significantly accelerates the speed at which data can be integrated into Celonis compared to previous methods.
- Infrastructure built for scale: The Standard Data Ingestion API is built on top of cloud native object storages to scale for massive data volumes.
- Support for nested data, e.g. nested JSON arrays: Nested data such as JSON is unnested automatically on the fly so it can directly be consumed in a columnar format.
- UI integration: The Standard Data Ingestion API is embedded into the UI so you can configure your desired table schema (column names, primary keys, etc.)
- Automatic schema evolution: In case of schema changes, the schema automatically evolves and has no impact on the existing pipeline. This means that if a new column is part of the pushed data, it will automatically be added to the target table in Celonis. This also applies when a column was initially defined as VARCHAR(80) but then a new record, which exceeds the 80 characters gets pushed. In this case, the target table this will automatically extend the target column to the required VARCHAR length to not cut of any record.