From eb027e845f5eb77d9b4ccb4cf012bbbe6f9b1bf6 Mon Sep 17 00:00:00 2001 From: Harish Kesava Rao Date: Mon, 16 Feb 2026 10:23:28 +0530 Subject: [PATCH 1/4] Ecosystem page for Apache Burr --- docs/ecosystem.rst | 130 +++++ reference_ecosystem.html | 1072 ++++++++++++++++++++++++++++++++++++++ 2 files changed, 1202 insertions(+) create mode 100644 docs/ecosystem.rst create mode 100644 reference_ecosystem.html diff --git a/docs/ecosystem.rst b/docs/ecosystem.rst new file mode 100644 index 000000000..3e75cd293 --- /dev/null +++ b/docs/ecosystem.rst @@ -0,0 +1,130 @@ +.. + Licensed to the Apache Software Foundation (ASF) under one + or more contributor license agreements. See the NOTICE file + distributed with this work for additional information + regarding copyright ownership. The ASF licenses this file + to you under the Apache License, Version 2.0 (the + "License"); you may not use this file except in compliance + with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, + software distributed under the License is distributed on an + "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + KIND, either express or implied. See the License for the + specific language governing permissions and limitations + under the License. + +========= +Ecosystem +========= + +Welcome to the Apache Burr Ecosystem page! This page showcases integrations, examples, and resources to help you build better applications with Burr. + +.. note:: + This page is a work in progress. If you have an integration or example you'd like to share, please `open a PR `_! + +--------------------- +🚀 Interactive Tutorials +--------------------- + +* `Burr Examples `_ + Explore a wide range of examples demonstrating Burr's capabilities, from simple chatbots to complex multi-agent systems. + +--------------------- +Built-in Integrations +--------------------- + +Burr integrates deeply with the Python data and AI ecosystem. Here are some of the key integrations available in our `examples` directory. + +LLM & AI Frameworks +------------------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Example + * - **OpenAI** + - Build agents using OpenAI's powerful models. + - `OpenAI Examples `_ + * - **LlamaIndex** + - Connect your custom data to LLMs. + - `LlamaIndex Integration `_ + * - **Haystack** + - Build end-to-end NLP pipelines. + - `Haystack Integration `_ + * - **Instructor** + - Structured outputs for LLMs. + - `Instructor Examples `_ + * - **Google Gemini** + - specific examples using Google's Gemini models. + - `Gemini Examples `_ + +Orchestration & Data +-------------------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Example + * - **Hamilton** + - Define dataflows for modular, testable applications. + - `Hamilton Integration `_ + * - **Ray** + - Scale your Burr applications with distributed computing. + - `Ray Examples `_ + +Web & API +--------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Example + * - **FastAPI** + - Serve your Burr agents as high-performance APIs. + - `FastAPI Streaming `_ + * - **Streamlit** + - Build interactive web apps for your agents. + - `Streamlit Examples `_ + +Databases & Vector Stores +------------------------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Example + * - **LanceDB** + - Serverless vector database for RAG applications. + - `RAG with LanceDB `_ + * - **Qdrant** + - Vector similarity search engine. + - `Qdrant Examples `_ + +Observability +------------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Example + * - **OpenTelemetry** + - Instrument your applications for observability. + - `OpenTelemetry Integration `_ diff --git a/reference_ecosystem.html b/reference_ecosystem.html new file mode 100644 index 000000000..53aa1e3d6 --- /dev/null +++ b/reference_ecosystem.html @@ -0,0 +1,1072 @@ + + + + + + + + + + Ecosystem - Hamilton + + + + + + + + + + + + + + + + + + + Contents + + + + + + Menu + + + + + + + + Expand + + + + + + Light mode + + + + + + + + + + + + + + Dark mode + + + + + + + Auto light/dark, in light mode + + + + + + + + + + + + + + + Auto light/dark, in dark mode + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ +
+ +
+
+
+ +
+
+
Hamilton
 +
+
+
+ +
+ +
+
+ +
+
+
+ + + + + Back to top + +
+
+ + + + +
+ + + + +
+ +
+ +
+
+ +
+

Ecosystem

+

Welcome to the Apache Hamilton Ecosystem page! This page showcases the integrations, plugins, and external resources available for Apache Hamilton users.

+
+
+

🚀 Interactive Tutorials

+

tryhamilton.dev

+

Learn Apache Hamilton concepts through interactive, browser-based tutorials.

+
+
+
+

Built-in Integrations

+

Apache Hamilton provides first-class support for many popular data science and engineering tools through built-in plugins and adapters. These integrations are maintained by the Apache Hamilton community and included in the core project.

+
+

Data Frameworks

+

Apache Hamilton integrates seamlessly with popular data manipulation libraries:

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

pandas

DataFrame operations and transformations

Examples | ResultBuilder

Polars

High-performance DataFrame library

Examples | ResultBuilder

PySpark

Distributed data processing with Spark

Examples | GraphAdapter

Dask

Parallel computing and distributed arrays

Examples | GraphAdapter

Ray

Distributed computing framework

Examples | GraphAdapter

Ibis

Portable DataFrame API across backends

Integration Guide

Vaex

Out-of-core DataFrame library

Examples

Narwhals

DataFrame-agnostic interface

Examples | Lifecycle Hook

NumPy

Numerical computing arrays

ResultBuilder

PyArrow

Columnar in-memory data

ResultBuilder

+
+
+
+

Machine Learning & Data Science

+

Build and deploy ML workflows with Apache Hamilton:

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

MLflow

Experiment tracking and model registry

Examples | Lifecycle Hook

scikit-learn

Machine learning algorithms

Examples

XGBoost

Gradient boosting framework

IO Adapters

LightGBM

Gradient boosting framework

IO Adapters

Hugging Face

Transformers and NLP models

IO Adapters

Pandera

DataFrame validation

Examples

Pydantic

Data validation and settings

Decorator

+
+
+
+

Orchestration & Workflow Systems

+

Use Apache Hamilton within your existing orchestration infrastructure:

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

Airflow

Workflow orchestration platform

Examples

Dagster

Data orchestrator

Examples

Prefect

Workflow orchestration

Examples

Kedro

Data science pipelines

Examples

Metaflow

ML infrastructure

Integration

dbt

Data transformation tool

Integration Guide

+
+
+
+

Data Engineering & ETL

+

Tools for building robust data pipelines:

+
+ + + + + + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

dlt

Data loading and transformation

Integration Guide

Feast

Feature store

Examples

FastAPI

Web service framework

Integration Guide

Streamlit

Interactive web applications

Integration Guide

+
+
+
+

Observability & Monitoring

+

Track and monitor your Apache Hamilton dataflows:

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

Datadog

Monitoring and analytics

Lifecycle Hook

OpenTelemetry

Observability framework

Examples

OpenLineage

Data lineage tracking

Examples | Lifecycle Hook

Hamilton UI

Built-in execution tracking

UI Guide

Experiment Manager

Lightweight experiment tracking

Examples

+
+
+
+

Visualization

+

Create visualizations from your dataflows:

+
+ + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

Plotly

Interactive plotting

Examples

Matplotlib

Static plotting

IO Adapters

Rich

Terminal formatting and progress

Lifecycle Hook

+
+
+
+

Developer Tools

+

Improve your development workflow:

+
+ + + + + + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

Jupyter

Notebook magic commands

Examples

VS Code

Language server and extension

VS Code Guide

Claude Code

AI assistant plugin for Hamilton development

Plugin Guide

tqdm

Progress bars

Lifecycle Hook

+
+
+
+

Cloud Providers & Infrastructure

+

Deploy Apache Hamilton to the cloud:

+
+ + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

AWS

Amazon Web Services

Examples

Google Cloud

Google Cloud Platform

Scale-up Guide

Modal

Serverless cloud functions

Scale-up Guide

+
+
+
+

Storage & Caching

+

Persist and cache your data:

+
+ + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

DiskCache

Disk-based caching

Examples

File-based caching

Local file caching

Caching Guide

+
+
+
+

Other Utilities

+
+ + + + + + + + + + + + + + + + + + + + + +

Integration

Description

Documentation

Slack

Notifications and integrations

Examples | Lifecycle Hook

GeoPandas

Geospatial data analysis

Type extension for GeoDataFrame support

YAML

Configuration management

IO Adapters

+
+
+
+
+
+

External Resources

+

The following resources and services are provided by third parties and the broader Apache Hamilton community.

+

⚠️ Important Notice:

+

These resources and services are not maintained, nor endorsed by the Apache Hamilton Community and Apache Hamilton project (maintained by the Committers and the Apache Hamilton PMC). Use them at your sole discretion. The community does not verify the licenses nor validity of these tools, so it’s your responsibility to verify them.

+
+

Community Resources

+
+

📚 Dataflow Hub

+

hub.dagworks.io

+

A repository of reusable Apache Hamilton dataflows contributed by the community. Browse and download pre-built dataflows for common use cases.

+

Note: It’s WIP to move the domain to be under Apache. DAGWorks Inc., which donated Hamilton, is not an operating entity anymore.

+
+
+

📝 Blog & Tutorials

+

blog.dagworks.io

+

Articles covering Apache Hamilton use cases, design patterns, reference architectures, and best practices.

+

Note: It’s WIP to move the contents to be under Apache. DAGWorks Inc., which donated Hamilton, is not an operating entity anymore.

+
+
+

🎥 Video Content

+

YouTube @DAGWorks-Inc

+

Video tutorials, talks, and meetup recordings about Apache Hamilton.

+

Note: It’s WIP to move the contents to be under Apache. DAGWorks Inc., which donated Hamilton, is not an operating entity anymore.

+
+
+
+
+
+

Contributing to the Ecosystem

+
+

Adding a New Integration

+

If you’ve created a plugin or integration for Apache Hamilton, we’d love to include it in our ecosystem!

+

For Built-in Integrations (maintained by the Apache Hamilton project):

+
    +

  1. Create a plugin in the hamilton/plugins/ directory

    2. +

  2. Add documentation and examples

    3. +

  3. Submit a pull request to the Apache Hamilton repository

    4. +

  4. Follow the contribution guidelines

    5. +
+

For External Resources (maintained by third parties):

+
    +

  1. Submit a pull request to add your resource to this page under “External Resources”

    2. +

  2. Include a clear description and link

    3. +

  3. Ensure your resource is relevant to Apache Hamilton users

    4. +

  4. Your resource must be properly licensed and actively maintained

    5. +
+
+
+

Support & Questions

+ +
+
+
+
+

Stay Updated

+ +
+
+
+
+ +
+
+ +
+ +
+
+ + + + + \ No newline at end of file From 69e9e086c1e06eda525de75975c0567a45b09b8a Mon Sep 17 00:00:00 2001 From: Harish Kesava Rao Date: Wed, 18 Mar 2026 18:30:54 +0530 Subject: [PATCH 2/4] Removed broken links, this is a work in progress --- docs/ecosystem.rst | 6 ------ 1 file changed, 6 deletions(-) diff --git a/docs/ecosystem.rst b/docs/ecosystem.rst index 3e75cd293..31f27c0ef 100644 --- a/docs/ecosystem.rst +++ b/docs/ecosystem.rst @@ -51,18 +51,12 @@ LLM & AI Frameworks * - **OpenAI** - Build agents using OpenAI's powerful models. - `OpenAI Examples `_ - * - **LlamaIndex** - - Connect your custom data to LLMs. - - `LlamaIndex Integration `_ * - **Haystack** - Build end-to-end NLP pipelines. - `Haystack Integration `_ * - **Instructor** - Structured outputs for LLMs. - `Instructor Examples `_ - * - **Google Gemini** - - specific examples using Google's Gemini models. - - `Gemini Examples `_ Orchestration & Data -------------------- From a308db02e4b2a9e8578254435313111fe977575b Mon Sep 17 00:00:00 2001 From: Harish Kesava Rao Date: Sat, 21 Mar 2026 21:47:20 +0530 Subject: [PATCH 3/4] more integrations, examples, docs --- docs/ecosystem.rst | 180 +++++++++++++++++++++++++++++++++------------ 1 file changed, 132 insertions(+), 48 deletions(-) diff --git a/docs/ecosystem.rst b/docs/ecosystem.rst index 31f27c0ef..fa8e334fa 100644 --- a/docs/ecosystem.rst +++ b/docs/ecosystem.rst @@ -20,26 +20,15 @@ Ecosystem ========= -Welcome to the Apache Burr Ecosystem page! This page showcases integrations, examples, and resources to help you build better applications with Burr. +Welcome to the Apache Burr Ecosystem page. This page lists all available integrations with documentation and example links. .. note:: This page is a work in progress. If you have an integration or example you'd like to share, please `open a PR `_! ---------------------- -🚀 Interactive Tutorials ---------------------- - -* `Burr Examples `_ - Explore a wide range of examples demonstrating Burr's capabilities, from simple chatbots to complex multi-agent systems. - ---------------------- -Built-in Integrations ---------------------- - -Burr integrates deeply with the Python data and AI ecosystem. Here are some of the key integrations available in our `examples` directory. +---- LLM & AI Frameworks -------------------- +-------------------- .. list-table:: :widths: 20 40 40 @@ -47,19 +36,27 @@ LLM & AI Frameworks * - Integration - Description - - Example + - Documentation * - **OpenAI** - - Build agents using OpenAI's powerful models. - - `OpenAI Examples `_ + - Use OpenAI models (and any OpenAI API-compatible server) inside Burr actions. + - `Example `__ + * - **LangChain / LCEL** + - Use LangChain chains and runnables as Burr actions. Includes a custom serialization plugin to persist LangChain objects in state. + - :doc:`Reference ` | + `Multi-agent example `__ | + `Custom serde example `__ * - **Haystack** - - Build end-to-end NLP pipelines. - - `Haystack Integration `_ + - Wrap Haystack ``Component`` objects as Burr ``Action`` using ``HaystackAction``, or convert an entire Haystack pipeline to a Burr graph. + - :doc:`Reference ` | + `Example `__ * - **Instructor** - - Structured outputs for LLMs. - - `Instructor Examples `_ + - Get structured outputs from LLMs via the Instructor library inside Burr actions. + - `Example `__ -Orchestration & Data --------------------- +---- + +Orchestration & Dataflows +-------------------------- .. list-table:: :widths: 20 40 40 @@ -67,16 +64,17 @@ Orchestration & Data * - Integration - Description - - Example + - Documentation * - **Hamilton** - - Define dataflows for modular, testable applications. - - `Hamilton Integration `_ - * - **Ray** - - Scale your Burr applications with distributed computing. - - `Ray Examples `_ + - Embed Hamilton dataflows as Burr actions using the ``Hamilton`` action construct and helper functions ``from_state``, ``from_value``, ``update_state``, and ``append_state``. + - :doc:`Reference ` | + `Example `__ | + `Multi-agent example `__ -Web & API ---------- +---- + +Distributed Computing +--------------------- .. list-table:: :widths: 20 40 40 @@ -84,16 +82,44 @@ Web & API * - Integration - Description - - Example - * - **FastAPI** - - Serve your Burr agents as high-performance APIs. - - `FastAPI Streaming `_ - * - **Streamlit** - - Build interactive web apps for your agents. - - `Streamlit Examples `_ + - Documentation + * - **Ray** + - Run parallel Burr sub-applications on a Ray cluster using ``RayExecutor``. + - :doc:`Reference ` | + `Example `__ + +---- + +State Persistence +----------------- + +Burr provides pluggable state persisters so your application state survives restarts and scales across services. +See :doc:`reference/persister` for the full API reference. + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 -Databases & Vector Stores -------------------------- + * - Integration + - Description + - Documentation + * - **SQLite** + - Lightweight file-based persistence. Ships with Burr (no extra install). Sync and async variants available. + - :doc:`Reference ` + * - **PostgreSQL** + - Production-grade relational database persistence via ``psycopg2`` (sync) and ``asyncpg`` (async). + - :doc:`Reference ` + * - **Redis** + - In-memory key-value store persistence. Sync and async variants available. + - :doc:`Reference ` + * - **MongoDB** + - Document-store persistence via ``pymongo``. + - :doc:`Reference ` + +---- + +Vector Stores +------------- .. list-table:: :widths: 20 40 40 @@ -101,13 +127,15 @@ Databases & Vector Stores * - Integration - Description - - Example + - Documentation * - **LanceDB** - - Serverless vector database for RAG applications. - - `RAG with LanceDB `_ + - Serverless, embedded vector database. Ideal for local or cloud RAG pipelines. + - `RAG example `__ * - **Qdrant** - - Vector similarity search engine. - - `Qdrant Examples `_ + - Scalable vector similarity search engine for conversational RAG. + - `Conversational RAG example `__ + +---- Observability ------------- @@ -118,7 +146,63 @@ Observability * - Integration - Description - - Example + - Documentation * - **OpenTelemetry** - - Instrument your applications for observability. - - `OpenTelemetry Integration `_ + - Export Burr traces to any OpenTelemetry-compatible backend. Burr can also capture traces emitted *within* an action and forward them. + - :doc:`Reference ` | + `Example `__ | + `Blog post `__ + * - **Traceloop / OpenLLMetry** + - AI-focused OpenTelemetry vendor. Use Traceloop's ``openllmetry`` library together with Burr's OpenTelemetry bridge for LLM-aware tracing. + - :doc:`Reference ` | + `Example `__ | + `Blog post `__ + +---- + +Data Validation & Serialization +-------------------------------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Documentation + * - **Pydantic** + - Type-check Burr state fields with Pydantic models, and serialize/deserialize state using Pydantic's serde support. + - :doc:`Reference ` | + :doc:`State typing docs ` | + :doc:`Serde docs ` + * - **LangChain serde** + - Custom serialization plugin to persist LangChain objects (messages, chains, etc.) in Burr state. + - :doc:`Serde docs ` | + `Example `__ + * - **Pandas serde** + - Custom serialization plugin to persist Pandas ``DataFrame`` objects in Burr state. + - :doc:`Serde docs ` + * - **Pickle serde** + - Fallback serialization plugin using Python's built-in ``pickle`` for arbitrary objects. + - :doc:`Serde docs ` + +---- + +Web & API +--------- + +.. list-table:: + :widths: 20 40 40 + :header-rows: 1 + + * - Integration + - Description + - Documentation + * - **FastAPI** + - Serve Burr applications over HTTP with streaming support via FastAPI and server-sent events (SSE). + - `Streaming FastAPI example `__ | + `Web server example `__ + * - **Streamlit** + - Debug and visualize Burr state machines interactively in Streamlit apps using utility functions such as ``render_state_machine`` and ``render_explorer``. + - :doc:`Reference ` | + `Example `__ From 001c24de235b87d3523d7e8d6fd2edd9bbb18480 Mon Sep 17 00:00:00 2001 From: Harish Kesava Rao Date: Sat, 21 Mar 2026 21:50:48 +0530 Subject: [PATCH 4/4] remove extra file --- reference_ecosystem.html | 1072 -------------------------------------- 1 file changed, 1072 deletions(-) delete mode 100644 reference_ecosystem.html diff --git a/reference_ecosystem.html b/reference_ecosystem.html deleted file mode 100644 index 53aa1e3d6..000000000 --- a/reference_ecosystem.html +++ /dev/null @@ -1,1072 +0,0 @@ - - - - - - - - - - Ecosystem - Hamilton - - - - - - - - - - - - - - - - - - - Contents - - - - - - Menu - - - - - - - - Expand - - - - - - Light mode - - - - - - - - - - - - - - Dark mode - - - - - - - Auto light/dark, in light mode - - - - - - - - - - - - - - - Auto light/dark, in dark mode - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
- -
- -
-
-
- -
-
-
Hamilton
 -
-
-
- -
- -
-
- -
-
-
- - - - - Back to top - -
-
- - - - -
- - - - -
- -
- -
-
- -
-

Ecosystem

-

Welcome to the Apache Hamilton Ecosystem page! This page showcases the integrations, plugins, and external resources available for Apache Hamilton users.

-
-
-

🚀 Interactive Tutorials

-

tryhamilton.dev

-

Learn Apache Hamilton concepts through interactive, browser-based tutorials.

-
-
-
-

Built-in Integrations

-

Apache Hamilton provides first-class support for many popular data science and engineering tools through built-in plugins and adapters. These integrations are maintained by the Apache Hamilton community and included in the core project.

-
-

Data Frameworks

-

Apache Hamilton integrates seamlessly with popular data manipulation libraries:

-
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

pandas

DataFrame operations and transformations

Examples | ResultBuilder

Polars

High-performance DataFrame library

Examples | ResultBuilder

PySpark

Distributed data processing with Spark

Examples | GraphAdapter

Dask

Parallel computing and distributed arrays

Examples | GraphAdapter

Ray

Distributed computing framework

Examples | GraphAdapter

Ibis

Portable DataFrame API across backends

Integration Guide

Vaex

Out-of-core DataFrame library

Examples

Narwhals

DataFrame-agnostic interface

Examples | Lifecycle Hook

NumPy

Numerical computing arrays

ResultBuilder

PyArrow

Columnar in-memory data

ResultBuilder

-
-
-
-

Machine Learning & Data Science

-

Build and deploy ML workflows with Apache Hamilton:

-
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

MLflow

Experiment tracking and model registry

Examples | Lifecycle Hook

scikit-learn

Machine learning algorithms

Examples

XGBoost

Gradient boosting framework

IO Adapters

LightGBM

Gradient boosting framework

IO Adapters

Hugging Face

Transformers and NLP models

IO Adapters

Pandera

DataFrame validation

Examples

Pydantic

Data validation and settings

Decorator

-
-
-
-

Orchestration & Workflow Systems

-

Use Apache Hamilton within your existing orchestration infrastructure:

-
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

Airflow

Workflow orchestration platform

Examples

Dagster

Data orchestrator

Examples

Prefect

Workflow orchestration

Examples

Kedro

Data science pipelines

Examples

Metaflow

ML infrastructure

Integration

dbt

Data transformation tool

Integration Guide

-
-
-
-

Data Engineering & ETL

-

Tools for building robust data pipelines:

-
- - - - - - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

dlt

Data loading and transformation

Integration Guide

Feast

Feature store

Examples

FastAPI

Web service framework

Integration Guide

Streamlit

Interactive web applications

Integration Guide

-
-
-
-

Observability & Monitoring

-

Track and monitor your Apache Hamilton dataflows:

-
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

Datadog

Monitoring and analytics

Lifecycle Hook

OpenTelemetry

Observability framework

Examples

OpenLineage

Data lineage tracking

Examples | Lifecycle Hook

Hamilton UI

Built-in execution tracking

UI Guide

Experiment Manager

Lightweight experiment tracking

Examples

-
-
-
-

Visualization

-

Create visualizations from your dataflows:

-
- - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

Plotly

Interactive plotting

Examples

Matplotlib

Static plotting

IO Adapters

Rich

Terminal formatting and progress

Lifecycle Hook

-
-
-
-

Developer Tools

-

Improve your development workflow:

-
- - - - - - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

Jupyter

Notebook magic commands

Examples

VS Code

Language server and extension

VS Code Guide

Claude Code

AI assistant plugin for Hamilton development

Plugin Guide

tqdm

Progress bars

Lifecycle Hook

-
-
-
-

Cloud Providers & Infrastructure

-

Deploy Apache Hamilton to the cloud:

-
- - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

AWS

Amazon Web Services

Examples

Google Cloud

Google Cloud Platform

Scale-up Guide

Modal

Serverless cloud functions

Scale-up Guide

-
-
-
-

Storage & Caching

-

Persist and cache your data:

-
- - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

DiskCache

Disk-based caching

Examples

File-based caching

Local file caching

Caching Guide

-
-
-
-

Other Utilities

-
- - - - - - - - - - - - - - - - - - - - - -

Integration

Description

Documentation

Slack

Notifications and integrations

Examples | Lifecycle Hook

GeoPandas

Geospatial data analysis

Type extension for GeoDataFrame support

YAML

Configuration management

IO Adapters

-
-
-
-
-
-

External Resources

-

The following resources and services are provided by third parties and the broader Apache Hamilton community.

-

⚠️ Important Notice:

-

These resources and services are not maintained, nor endorsed by the Apache Hamilton Community and Apache Hamilton project (maintained by the Committers and the Apache Hamilton PMC). Use them at your sole discretion. The community does not verify the licenses nor validity of these tools, so it’s your responsibility to verify them.

-
-

Community Resources

-
-

📚 Dataflow Hub

-

hub.dagworks.io

-

A repository of reusable Apache Hamilton dataflows contributed by the community. Browse and download pre-built dataflows for common use cases.

-

Note: It’s WIP to move the domain to be under Apache. DAGWorks Inc., which donated Hamilton, is not an operating entity anymore.

-
-
-

📝 Blog & Tutorials

-

blog.dagworks.io

-

Articles covering Apache Hamilton use cases, design patterns, reference architectures, and best practices.

-

Note: It’s WIP to move the contents to be under Apache. DAGWorks Inc., which donated Hamilton, is not an operating entity anymore.

-
-
-

🎥 Video Content

-

YouTube @DAGWorks-Inc

-

Video tutorials, talks, and meetup recordings about Apache Hamilton.

-

Note: It’s WIP to move the contents to be under Apache. DAGWorks Inc., which donated Hamilton, is not an operating entity anymore.

-
-
-
-
-
-

Contributing to the Ecosystem

-
-

Adding a New Integration

-

If you’ve created a plugin or integration for Apache Hamilton, we’d love to include it in our ecosystem!

-

For Built-in Integrations (maintained by the Apache Hamilton project):

-
    -

  1. Create a plugin in the hamilton/plugins/ directory

    2. -

  2. Add documentation and examples

    3. -

  3. Submit a pull request to the Apache Hamilton repository

    4. -

  4. Follow the contribution guidelines

    5. -
-

For External Resources (maintained by third parties):

-
    -

  1. Submit a pull request to add your resource to this page under “External Resources”

    2. -

  2. Include a clear description and link

    3. -

  3. Ensure your resource is relevant to Apache Hamilton users

    4. -

  4. Your resource must be properly licensed and actively maintained

    5. -
-
-
-

Support & Questions

- -
-
-
-
-

Stay Updated

- -
-
-
-
- -
-
- -
- -
-
- - - - - \ No newline at end of file