Data ingestion

Data ingestion is the process of bringing data from various sources into Zenskar's platform. Zenskar supports multiple methods to ingest your data, ensuring flexibility and compatibility with your existing systems. Regardless of the ingestion method, all data is stored in Zenskar's robust relational database management system (RDBMS) tables, organized in a standardized row-and-column format for efficient processing and analysis.

Data ingestion methods

Data source connectors

Zenskar provides built-in connectors to pull data directly from your existing data sources.

How it works: Zenskar's connectors establish a direct link to your databases or data warehouses. This allows Zenskar to automatically pull relevant data at scheduled intervals or on demand.
Benefits: This method is ideal for continuous, automated data transfer from structured data environments, reducing manual effort and ensuring data freshness.
Examples: Connectors can be configured for popular databases, data lakes, and data warehouses, allowing seamless integration with your analytics infrastructure.

APIs

You can push data to Zenskar using custom-created APIs, offering a high degree of control and real-time ingestion capabilities.

How it works: Your systems can send data directly to Zenskar's API endpoints. This requires development effort to integrate your applications with Zenskar's API.
Benefits: APIs enable real-time or near real-time data ingestion, making them suitable for dynamic data updates, event-driven data, or custom integration scenarios.
Use Cases: Perfect for applications that generate billing events, usage metrics, or customer updates requiring immediate synchronization with Zenskar.

CSV uploads

For batch data ingestion or one-time imports, Zenskar supports uploading Zenskar-compatible CSV (Comma Separated Values) files directly through the dashboard.

How it works: Users can prepare data in a CSV format that adheres to Zenskar's specified structure. These files are then uploaded via the Zenskar dashboard.
Benefits: This method is straightforward for importing historical data, performing bulk updates, or for scenarios where direct API integration or connectors are not feasible.
Considerations: Ensure your CSV files are correctly formatted to avoid ingestion errors. Zenskar provides guidelines for CSV structure.

Dashboard (manual entry)

For individual entries or small-scale data input, Zenskar provides a web form for manual data entry via the dashboard.

How it works: Users can directly input data into pre-defined fields within the Zenskar web interface.
Benefits: Ideal for managing individual customer records, making quick adjustments, or entering data that is not generated through automated systems.
Accessibility: Offers an intuitive, user-friendly way to manage data without requiring technical integration knowledge.

How-to guides

How to set up a data sync connector

Zenskar connects with your data source, such as a database, data warehouse, comma-separated-value file, or spreadsheet.

How to set up a remote query connector

Zenskar allows you to derive billable metrics by running queries directly on your production databases or data warehouses—without transferring or storing any raw usage events within Zenskar.

How to set up a data ingestion API

Zenskar lets you push usage events or pre-aggregated data via REST APIs into its ingestion layer. This integration enables real-time ingestion for billing, metrics, and reporting.

How to upload a CSV

Zenskar lets you upload usage data in CSV format directly from the Zenskar dashboard. This method is designed for bulk ingestion and one-time imports without writing code.

How to add usage events from the Zenskar dashboard

Use Zenskar’s web form to enter individual usage events when you need to record one-off or low-volume data.