Pipelines (ETL, feature engineering, ML)
- Portable dataflows with Ibis and Hamilton (Ibis, Hamilton, duckdb)
- Slack summary pipeline with dlt, Ibis, and Hamilton (dlt, Hamilton, Ibis)
- Featurization: Integration Hamilton with Feast (Feast, Hamilton)
- Hamilton & Kedro for modular data pipelines (Kedro, Hamilton)
- Tracking Pipelines with MLFlow & Hamilton (Hamilton, MLFlow)
Data science
- Building a lightweight experiment manager (Hamilton, FastUI, Pydantic, FastAPI)
- Writing good data analysis code efficiently with Hamilton (Hamilton)
- Tools can multiply or divide productivity
- The graduation problem: avoid frameworks getting in the way
- Feature release: Caching (Hamilton)
Orchestration
- Declarative data orchestration: Dagster & Hamilton (Hamilton, Dagster, Airflow)
- Simplify Airflow DAG creation and maintenance with Hamilton (Hamilton, Airflow)
- Simplify Prefect Workflow creation and maintenace with Hamilton
LLMs and Agents
- Flashcard generator with Instructor + Burr (Instructor, Burr, OpenAI)
- From blog to bot: build a RAG app to chat with your favorite blogs (dlt, LanceDB, Burr, OpenTelemetry, OpenLLMetry)
- LLMOps: Production prompt engineering patterns with Hamilton (Hamilton)
- Build LLM agents faster with Haystack + Burr! (Burr, Haystack)
- Containerized PDF Summarizer with FastAPI and Hamilton (Hamilton, FastAPI, Docker, Streamlit)
- Retrieval augmented generation (RAG) with Streamlit, FastAPI, Weaviate, and Hamilton! (Hamilton, FastAPI, Docker, Streamlit, Weaviate)
Development practices & tooling
- Custom pre-commit hooks for safer code changes (pre-commit)
- Using IPython Jupyter Magic commands to improve the notebook experience (Jupyter, IPython)