PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations
Holzschuh et al. · ICML 2025 · Transformers
What it does
A diffusion-transformer backbone adapted to large physics simulations on grids.
Why it matters
Pretrained once, it fine-tunes better than training from scratch: a step toward physics foundation models.