Skip to content

Commit 2cd4f35

Browse files
authored
Update index.md
1 parent 07a1b2a commit 2cd4f35

1 file changed

Lines changed: 17 additions & 39 deletions

File tree

docs/index.md

Lines changed: 17 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -1,44 +1,22 @@
1-
# Physics-Learning AI Datamodel
1+
# PLAID — Physics Learning AI Data Model
2+
**The missing data layer between physics simulations and scientific ML.**
23

3-
<!-- <p style="text-align:center;">
4-
<img src="../assets/images/plaid_logo2.png" alt="logo" title="Logo" style="width:40%;"/>
5-
</p> -->
4+
PLAID is an open framework for representing, sharing, and learning from datasets of complex physics simulations. It defines a common standard for simulation data and ships a Python library to create, explore, store, and stream them.
65

7-
## Introduction
6+
## Why another data model?
87

9-
### PLAID (Physics-Learning AI Datamodel): the missing layer for Scientific ML
8+
Mainstream ML stacks (Hugging Face, PyTorch, TensorFlow) assume data is regular, homogeneous, and columnar. Real simulation data is not: it is **hierarchical and multi-zone**, with **heterogeneous fields, shapes, and metadata**, often governed by **implicit, solver-specific conventions**. Flattening or padding it into tabular form is error-prone, memory-hungry, and erases the physical structure the model should learn from.
109

11-
Keep your simulation data intact, query it intuitively, and transform it seamlessly for deep learning.
10+
## What PLAID provides
1211

13-
PLAID is an open framework that makes it easy to represent and share datasets from complex physics simulations. It introduces a common standard for describing simulation data and comes with a library to create, explore, and manipulate complex datasets of physics similations. PLAID was first developed at SafranTech, the research and innovation center of [Safran Group](https://www.safran-group.com/).
14-
15-
16-
### Why another data model?
17-
18-
In machine learning, datasets are often treated as flat tables, sequences, or images. Standard frameworks (Hugging Face, PyTorch, TensorFlow) assume your data is already regular, homogeneous, and columnar. But in scientific and industrial applications, this assumption rarely holds:
19-
20-
- Simulations produce hierarchical, multi-zone data.
21-
- Fields have heterogeneous shapes, types, and metadata.
22-
- Implicit conventions may vary from one simulation to another.
23-
24-
Traditional ML datasets are not designed to handle this complexity efficiently. Flattening, padding, or converting these structures into a standard tabular format can be error-prone, memory-intensive, and slow, and it often destroys critical information about the underlying physical structure.
25-
26-
PLAID fills this gap by sitting *upstream* in the ML pipeline, bridging raw scientific data and ML-ready formats, including graph-based ones like PyTorch Geometric (PyG):
27-
28-
1. Capture the full structure: PLAID preserves hierarchical, multi-field, multi-zone data, including metadata.
29-
2. Simplify access: intuitive APIs let you query fields, arrays, and derived quantities without flattening or rewriting your trees.
30-
3. Prepare for ML: PLAID can generate PyTorch datasets, Hugging Face datasets, or PyG graph objects, so batching and training pipelines work seamlessly, while keeping memory and computation efficient.
31-
32-
In short: PLAID is not “just another dataset format.” It is a scientific data management layer, designed for the complex, heterogeneous, high-dimensional world of physics-based simulations, where preparing your data for ML (whether columnar or graph-structured) is as important as the model itself.
33-
34-
## Open source
35-
36-
The open source project is hosted on GitHub under the [PLAID-lib](https://github.com/PLAID-lib) organization. The project currently contains three librairies:
37-
38-
- [PLAID](https://github.com/PLAID-lib/plaid) is the core library of the PLAID project.
39-
- [PLAID-bridges](https://github.com/PLAID-lib/plaid-bridges): provides integrations into machine learning frameworks such as PyTorch Geometric.
40-
- [PLAID-ops](https://github.com/PLAID-lib/plaid-ops): a collection of standardized operations on PLAID samples and datasets, including advanced treatments on meshes (some requiring a finite-element engine) powered by [muscat](https://gitlab.com/drti/muscat).
41-
42-
## Paper
43-
44-
Check out the [PLAID preprint](https://arxiv.org/abs/2505.02974) recently submitted to arXiv!
12+
- **Fidelity** — Keep all the complexity of your simulation data — meshes, fields, tags, time, and
13+
multiphysics structure — and exploit it directly in ML pipelines.
14+
- **Out-of-core datasets** — Datasets are accessed sample by sample, so full datasets do not need to be loaded
15+
into memory.
16+
- **Parallel I/O**`save_to_disk` can shard sample IDs across multiple processes for fast dataset
17+
generation and writing.
18+
- **Multiple storage backends** — Use **CGNS**, **Hugging Face Datasets**, or **Zarr** through a unified API for
19+
local disk, Hub download, and streaming workflows.
20+
- **Selective reading** — Request only the features you need and, when necessary, only selected indices within large variable arrays.
21+
- **Interactive viewer** — Launch `plaid-viewer` to browse local or streamed datasets, inspect samples in 3D,
22+
select features, and visualize fields.

0 commit comments

Comments
 (0)