dag-ml

dag-ml is the Rust execution coordinator for leakage-safe, reproducible ML pipelines. It owns graph compilation, phases, folds, OOF joins, controller dispatch, lineage, artifact/cache contracts and deterministic scheduling. Data storage and feature-buffer ownership live in the companion dag-ml-data repo.

This site is the contributor and integration entry point for the producer-side contracts used by future nirs4all and nirs4all-core integrations. It does not wire nirs4all directly.

Start Here

Need

Page

Build and validate locally

Installation

Understand runtime boundaries

Architecture

Integrate over C ABI

C ABI

Check the supported release surface

Supported surface

Map aggregation across dag-ml-data

Aggregation interop

Run release performance probes

Performance probes

Map nirs4all parity capabilities

Capability matrix

Inspect shared contracts

Contract manifests

Review accepted decisions

Architecture decisions

Pick an example by audience

examples/README.md

API References

The nirs4all ecosystem

dag-ml-data

Typed sample-aligned multi-source data contracts — the data layer dag-ml consumes (shared, JSON-identical contracts).

https://dag-ml-data.readthedocs.io/en/latest/
nirs4all

Main Python modelling library — pipelines, SpectroDataset, predictions.

https://nirs4all.readthedocs.io/en/latest/
nirs4all-methods

Portable C-ABI PLS/NIRS engine (libn4m) + bindings.

https://nirs4all-methods.readthedocs.io/en/latest/
nirs4all-formats

Rust readers for ~58 NIRS/spectroscopy file formats.

https://nirs4all-formats.readthedocs.io/en/latest/
nirs4all-io

Dataset-assembly bridge → SpectroDataset.

https://nirs4all-io.readthedocs.io/en/latest/
nirs4all-datasets

Curated DOI-pinned NIRS dataset catalog (n4a-datasets).

https://nirs4all-datasets.readthedocs.io/en/latest/
nirs4all-core

Canonical portable aggregate distribution (Rust, Python, R, WASM, MATLAB/Octave).

https://nirs4all-core.readthedocs.io/en/latest/