Data Nadhi is an open-source platform that helps you manage the flow of data starting from your application logs all the way to your desired destinations — databases, APIs, or alerting systems.
Direct. Transform. Deliver.
Flow your logs, trigger your pipelines.
Data Nadhi provides a unified platform to ingest, transform, and deliver data — powered by Temporal, MongoDB, Redis, and MinIO.
It connects easily with your applications using the Data Nadhi SDK, and gives you full control over how data moves across your system.
- Direct – Collect logs and data from your applications or external sources.
- Transform – Use Temporal workflows to apply filters, enrichments, or custom transformations.
- Deliver – Send the final processed data to any configured destination — all handled reliably and asynchronously.
Data Nadhi is designed to be modular, developer-friendly, and ready for production.
The platform is built from multiple services and tools working together:
| Component | Description |
|---|---|
| data-nadhi-server | Handles incoming requests from the SDK and passes them to Temporal. |
| data-nadhi-internal-server | Internal service for managing entities, pipelines, and configurations. |
| data-nadhi-temporal-worker | Executes workflow logic and handles transformations and delivery. |
| data-nadhi-sdk | Python SDK for logging and sending data from applications. |
| data-nadhi-dev | Local environment setup using Docker Compose for databases and Temporal. |
| data-nadhi-documentation | Documentation site built with Docusaurus (you’re here now). |
All components are connected through a shared Docker network, making local setup and development simple.
- 🧩 Unified Pipeline – Move data seamlessly from logs to destinations
- ⚙️ Custom Transformations – Define your own transformations using Temporal
- 🔄 Reliable Delivery – Retries, fault tolerance, and monitoring built in
- 🧠 Easy Integration – Simple SDK-based setup for applications
- 💡 Developer Focused – Dev containers and Docker-first setup for consistency
Built using Docusaurus, this site includes:
- Architecture Documentation – A detailed breakdown of all components and their interactions
- Setup Guides – Step-by-step instructions to get Data Nadhi running locally
- API References – Documentation for the various services and endpoints
- Integration Guides – Instructions to connect Data Nadhi with your existing applications
This repository hosts the official documentation for the entire Data Nadhi ecosystem.
- Node.js >= 20.0
- npm or yarn
npm installStart the dev server:
npm startThis starts a local server and opens a browser window. Most changes will show up live without needing to restart.
Build the static site for production:
npm run build- Main Website: https://datanadhi.com
- Documentation: https://docs.datanadhi.com
- GitHub Organization: Data-ARENA-Space
This project is open source and available under the GNU Affero General Public License v3.0.
- GitHub Discussions: [Coming soon]
- Discord: Data Nadhi Community
- Issues: GitHub Issues