neuraloperator

Summary

We are excited to release this new version of the neuraloperator library! It brings many improvements, including new architectures (SFNO, GNO, GINO), many improvements to existing ones, out-of-the-box super resolution, super-evaluation and incremental training.

All models can now be easily saved and loaded and we provide a lightweight trainer compatible with all our neuraloperators. Head to the examples for some sample code, and to the API for a full documentation!

What's Changed

• Refactor MLP config by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/143
• Adds super-resolution to FNO by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/147
• Adds ADA_IN norm by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/148
• Adds SFNO by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/150
• Fix missing parameters output_scaling_factor by @sleepyeye in https://github.com/neuraloperator/neuraloperator/pull/159
• Finodev by @ashiq24 in https://github.com/neuraloperator/neuraloperator/pull/152
• quick_avoid by @ashiq24 in https://github.com/neuraloperator/neuraloperator/pull/173
• Add low-precision to TFNO by @crwhite14 in https://github.com/neuraloperator/neuraloperator/pull/172
• fix SFNO example by @crwhite14 in https://github.com/neuraloperator/neuraloperator/pull/177
• fix comma in readme file by @gegewen in https://github.com/neuraloperator/neuraloperator/pull/179
• Liftproj mod to mlp by @btolooshams in https://github.com/neuraloperator/neuraloperator/pull/182
• MLP additional statement to check for scenario where n_layers=1 by @btolooshams in https://github.com/neuraloperator/neuraloperator/pull/183
• marge the update on fno mlp help description by @btolooshams in https://github.com/neuraloperator/neuraloperator/pull/191
• Update guide on Fourier neural operator by @devzhk in https://github.com/neuraloperator/neuraloperator/pull/156
• Spectrum analysis of datasets. by @Robertboy18 in https://github.com/neuraloperator/neuraloperator/pull/193
• adding flag option to only pad the last dim by @btolooshams in https://github.com/neuraloperator/neuraloperator/pull/185
• Minor error in L#602 in fno.py by @ImanLiao in https://github.com/neuraloperator/neuraloperator/pull/194
• gino by @kovachki in https://github.com/neuraloperator/neuraloperator/pull/195
• Fix mlp nonlinearity by @ziqi-ma in https://github.com/neuraloperator/neuraloperator/pull/197
• Reformat layers/ directory with black by @m4e7 in https://github.com/neuraloperator/neuraloperator/pull/199
• Use lifting channels in FNO.lifting if it is passed by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/196
• removed dead lines in FNOGNO by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/203
• Reformat datasets/ directory with black by @m4e7 in https://github.com/neuraloperator/neuraloperator/pull/205
• docstring for FNOGNO by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/202
• Fix Python 3.6 f-string compatibility and condense documentation for FNO classes by @m4e7 in https://github.com/neuraloperator/neuraloperator/pull/209
• Split preactivation from FNOBlock.forward() by @m4e7 in https://github.com/neuraloperator/neuraloperator/pull/214
• Padding correction by @ashiq24 in https://github.com/neuraloperator/neuraloperator/pull/218
• general trainer class for GINO and NO by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/215
• Padding correction by @ashiq24 in https://github.com/neuraloperator/neuraloperator/pull/220
• fix example Trainer API calls by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/219
• Refactor rescaling in skips as transform in the Spectral Conv by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/217
• Further simplification + UNO fix by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/221
• Sht correction by @ashiq24 in https://github.com/neuraloperator/neuraloperator/pull/222
• Fix loss signatures to build doc by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/224
• fix small bug in the WandB logger callback by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/232
• Adding 4D prediction only, no nested fno by @gegewen in https://github.com/neuraloperator/neuraloperator/pull/225
• Revert 4D_FNO changes until they are properly tested by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/235
• Remove torch_scatter and torch_cluster from CI pipeline's dependencies by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/233
• Model checkpointing by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/234
• Updates to documentation and callback docstrings by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/237
• index dropout moduleList by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/239
• fix syntax error and add index.rst by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/240
• Fix typo in checkpoint init by @rybchuk in https://github.com/neuraloperator/neuraloperator/pull/241
• Bug fixes and unit testing for Callbacks by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/242
• Refactors SpectralConv for simpler FNO by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/244
• BaseModel: adds checkpointing, versioning, safeguards by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/257
• Add Burger's dataset and PINO by @crwhite14 in https://github.com/neuraloperator/neuraloperator/pull/256
• Enable transform wrappers by @JeanKossaifi in https://github.com/neuraloperator/neuraloperator/pull/254
• Update tensor_dataset.py by @slanthaler in https://github.com/neuraloperator/neuraloperator/pull/260
• Update to the checkpoint callback and test by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/258
• fix domain_padding to accept list (e.g., [0,0,1]) in addition to sc… by @btolooshams in https://github.com/neuraloperator/neuraloperator/pull/263
• Move to DataProcessor API by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/262
• Fix navier stokes preprocessor bug by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/265
• Fixes to make DataProcessor code doc build by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/266
• Add AutoML via Optuna by @crwhite14 in https://github.com/neuraloperator/neuraloperator/pull/243
• fixing the horizontal_skips_map construction, it was not going through by @btolooshams in https://github.com/neuraloperator/neuraloperator/pull/267
• Updates to saving and loading models by @dhpitt in https://github.com/neuraloperator/neuraloperator/pull/268

New Contributors

• @sleepyeye made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/159
• @crwhite14 made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/172
• @gegewen made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/179
• @btolooshams made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/182
• @devzhk made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/156
• @Robertboy18 made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/193
• @ImanLiao made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/194
• @kovachki made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/195
• @ziqi-ma made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/197
• @m4e7 made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/199
• @dhpitt made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/196
• @rybchuk made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/241
• @slanthaler made their first contribution in https://github.com/neuraloperator/neuraloperator/pull/260

Full Changelog: https://github.com/neuraloperator/neuraloperator/compare/0.2.0...0.3.0