Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
📢 Announcing the Hamilton Meetup Group. Sign up to attend events! 📢
Hamilton
Hamilton

USER GUIDE

  • Get Started
    • Why use Apache Hamilton?
    • Install
    • Your First Dataflow
    • Learning Resources
    • Contributing
    • License
  • Concepts
    • Glossary
    • Functions, nodes & dataflow
    • Driver
    • Visualization
    • Materialization
    • Function modifiers
    • Builder
    • Caching
    • Function modifiers (Advanced)
    • Dynamic DAGs/Parallel Execution
    • UI Overview
    • Local Mode
    • Docker/Deployed Mode
    • Get started
    • Features
    • SDK Configuration
    • Best Practices
      • Function Naming
      • Migrating to Apache Hamilton
      • Code Organization
      • Common Indices
      • Output Immutability
      • Using within your ETL System
      • Loading Data
  • User Guide
    • Jupyter notebooks
    • Loading data
    • Caching
    • Feature engineering
    • Model training
    • LLM workflows
    • Data quality
    • Lineage + Apache Hamilton
    • Scaling computation
    • Microservice
    • Extension autoloading
    • Wrapping the Driver
    • Command line interface
    • pre-commit hooks
  • Apache Hamilton UI
    • UI Overview
    • Local Mode
    • Docker/Deployed Mode
    • Get started
    • Features
    • SDK Configuration
  • IDE extension
    • Apache Hamilton VSCode
    • Language Server
  • Integrations
    • dlt
    • FastAPI
    • Ibis
    • Streamlit
    • dbt
    • MLFlow
    • Airflow
    • Amazon Web Services
    • Burr
    • Dagster
    • Dask
    • Feast
    • Metaflow
    • Pandera
    • Plotly
    • Polars
    • Prefect
    • Ray
    • Slack
    • Spark
    • Vaex
    • Narwhals
    • OpenLineage
  • Code Comparisons
    • Kedro
    • Dagster
    • LangChain
    • Airflow

PDF

  • PDF

Community

  • Meet-ups
  • Slack

REFERENCE

  • Decorators
    • check_output*
    • config.when*
    • dataloader
    • datasaver
    • does
    • unpack_fields
    • extract_columns
    • extract_fields
    • inject
    • load_from
    • parameterize
    • parameterize_extract_columns
    • parameterize_frame
    • parameterize_sources
    • parameterized_subdag
    • parameterize_values
    • pipe family
    • resolve
    • save_to
    • subdag
    • schema
    • tag*
    • with_columns
  • Drivers
    • Builder
    • Driver
    • DefaultGraphExecutor
    • TaskBasedGraphExecutor
    • AsyncDriver
    • Custom Driver
  • Caching
    • Caching logic
    • Data versioning
    • Stores
  • GraphAdapters
    • SimplePythonDataFrameGraphAdapter
    • SimplePythonGraphAdapter
    • HamiltonGraphAdapter
    • h_async.AsyncGraphAdapter
    • h_threadpool.FutureAdapter
    • CachingGraphAdapter
    • h_dask.DaskGraphAdapter
    • h_spark.PySparkUDFGraphAdapter
    • h_ray.RayGraphAdapter
    • h_ray.RayWorkflowGraphAdapter
    • h_spark.SparkKoalasGraphAdapter
  • Lifecycle Adapters
    • lifecycle.ResultBuilder
    • lifecycle.LegacyResultMixin
    • lifecycle.api.GraphAdapter
    • lifecycle.NodeExecutionHook
    • lifecycle.api.GraphExecutionHook
    • lifecycle.api.EdgeConnectionHook
    • lifecycle.api.NodeExecutionMethod
    • lifecycle.api.StaticValidator
    • lifecycle.api.GraphConstructionHook
    • lifecycle.api.TaskSubmissionHook
    • lifecycle.api.TaskReturnHook
    • lifecycle.api.TaskExecutionHook
    • lifecycle.api.TaskGroupingHook
    • lifecycle.PDBDebugger
    • lifecycle.PrintLn
    • plugins.h_tqdm.ProgressBar
    • plugins.h_rich.RichProgressBar
    • plugins.h_ddog.DDOGTracer
    • lifecycle.FunctionInputOutputTypeChecker
    • plugins.h_slack.SlackNotifier
    • lifecycle.GracefulErrorAdapter
    • plugins.h_spark.SparkInputValidator
    • plugins.h_narhwals.NarwhalsAdapter
    • plugins.h_narhwals.NarwhalsDataFrameResultBuilder
    • plugins.h_mlflow.MLFlowTracker
    • lifecycle.NoEdgeAndInputTypeChecking
    • plugins.h_openlineage.OpenLineageAdapter
  • ResultBuilders
    • Generic
    • Numpy
    • Pandas
    • Polars
    • Dask
    • Custom ResultBuilder
  • I/O
    • Using Data Adapters
    • Data Loaders
    • Data Savers
    • Data Adapters
  • Dataflows
    • clear_storage()
    • copy()
    • find()
    • import_module()
    • inspect()
    • inspect_module()
    • install_dependencies_string()
    • latest_commit()
    • list()
    • pull_module()
  • Telemetry

ASF

  • ASF
    • Apache Software Foundation
    • License
    • Events
    • Privacy
    • Security
    • Sponsorship
    • Thanks
    • Code of Conduct

EXTERNAL RESOURCES

  • GitHub
  • tryhamilton.dev
  • Dataflow Hub
  • Blog
Back to top
View this page
Edit this page

ASF¶

Apache Software Foundation links.

  • Foundation

  • License

  • Events

  • Privacy

  • Security

  • Sponsorship

  • Thanks

  • Code of Conduct

Previous
Telemetry
Copyright © The Apache Software Foundation, Licensed under the Apache License, Version 2.0.
Made with Sphinx and @pradyunsg's Furo
Apache Incubator Logo

Apache Hamilton is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Apache, the names of Apache projects, and the feather logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.