gluonts

Backporting fixes:

• Fix _version location for sdist. #2729 by @jaheba
• Fix version cmdclass handling. #2735 by @jaheba
• Remove usage of glide in tsf-reader. #2737 by @jaheba
• Fix: use non-strict inequality in definition of coverage #2738 by @lostella
• Fix MXNet NOPScaler #2744 by @abdulfatir
• Add scipy requirement #2745 by @abdulfatir
• Fix dataset file discovery. #2777 by @jaheba
• Fix: Loading of nested paths in FileDataset. #2779 by @jaheba
• Prophet: Pass 'item_id' and 'info' to forecast. #2780 by @jaheba
• Test: Set caplog level for shell tests. #2786 by @jaheba

Backporting fixes:

• Fix version cmdclass handling. #2735 by @jaheba
• Remove usage of glide in tsf-reader. #2737 by @jaheba
• Fix: use non-strict inequality in definition of coverage #2738 by @lostella
• Update Available Models #2740 by @abdulfatir
• Fix MXNet NOPScaler #2744 by @abdulfatir
• Add scipy requirement #2745 by @abdulfatir
• Fix dataset file discovery. #2777 by @jaheba
• Fix pandas removed deprecations in tests #2778 by @lostella
• Fix: Loading of nested paths in FileDataset. #2779 by @jaheba
• Prophet: Pass 'item_id' and 'info' to forecast. #2780 by @jaheba

Backporting fixes:

• Allow PyTorch 2.0 #2724 by @lostella
• Improve check for validation loop in lightning modules #2726 by @lostella
• Update CP-Flow fork as extra dependency for MQF2 #2727 by @lostella
• Allow PyTorch Lightning 2.0 #2728 by @lostella
• Fix _version location for sdist. #2729 by @jaheba
• Add warning for "object" features in PandasDataset #2731 by @lostella
• Docs: Add extra requirements. #2732 by @jaheba
• Fix validation loop check for Lightning modules #2733 by @lostella

Backporting fixes:

• Fix ev.seasonal_error #2696 by @lostella
• Docs: minor spelling fix #2701 by @lostella
• Fix Pandas 2.0 compatibility issues #2710 by @lostella
• Relax pandas requirement to include pandas 2.x. #2713 by @jaheba
• Fix DistributionForecast failure on GPU #2714 by @huibinshen

Backporting fixes:

• Delay instantiation of ScipyStudentT object #2660 by @gorold
• Faster index building in PandasDataset #2663 by @huibinshen
• Speed up PandasDataset.from_long_dataframe #2665 by @lostella
• Fix r-forecast doc strings #2669 by @abdulfatir
• Fix DateSplitter when split date is before start #2670 by @gorold
• Remove creation of ragged sequences in MultivariateGrouper #2671 by @abdulfatir

Backporting fixes:

• Faster index building in PandasDataset #2663 by @huibinshen
• Speed up PandasDataset.from_long_dataframe #2665 by @lostella
• Fix DateSplitter when split date is before start #2670 by @gorold
• Remove creation of ragged sequences in MultivariateGrouper #2671 by @abdulfatir

Backporting fixes:

• Fix PyTorch training loop #2643 by @gorold
• Fix norm-freq to consider freq starts. #2645 by @jaheba
• Fix call to extractall #2648 by @lostella

Backporting fixes:

• Fix PyTorch training loop #2643
• Fix norm-freq to consider freq starts. #2645
• Fix call to extractall #2648

Backporting fix:

• Fix call to extractall #2648

Backporting fixes:

• Cap numpy compatibility in mxnet extra requirements #2506
• Add gluonts.util.safe_extract #2606
• Fix call to extractall #2648

Backporting fixes:

• Fix: torch PoissonOutput scaling #2619 by @kashif
• Remove dataclasses requirement #2623 by @lostella
• Fix installation docs, fix typos in docstrings #2625 by @lostella

What's Changed

• Backports for v0.10.9 by @jaheba in https://github.com/awslabs/gluonts/pull/2610

Backporting fixes

• #2598
• #2606
• #2604

Full Changelog: https://github.com/awslabs/gluonts/compare/v0.10.8...v0.10.9

Overview

Support for Python 3.6 is dropped (#2542).

Models:

• Added PyTorch implementation of the Temporal Fusion Transformer model (#2536)
• Various improvements to PyTorch DeepAR (#2433, #2476, #2545, #2552, #2553, #2556, #2596)
• Added wrappers for statsforecast models (#2360, #2515, #2561)
• Added wrappers for hierarchical time series models in R (#2396, #2406, #2412)
• Updated R wrappers and dockerfile (#2571, #2572)
• Important the Naive2, Rforecast, Prophet, and Rotbaum models have been moved to gluonts.ext (#2362, #2597)

Data:

• Improved PandasDataset: allows specifying static features as a separate dataframe,
  instead of watefully replicate feature values over time. This was particularly problematic
  in large datasets, such as M5. In the new setup, static features are provided via
  a separate dataframe indexed by item_id, and the dtype of each column determinins
  which are numerical vs categorical features, with automated detection of cardinalities
  in the latter case. See the updated tutorial notebook on how to use it.

Evaluation:

• New evaluation module gluonts.ev (#2450) will gradually replace the existing
  gluonts.evaluation as an improved, more flexible alternative.

Changelog

Breaking changes

• Remove folders of models that have moved to mx.model (#2356) @codingWhale13
• Remove model.common. (#2358) @jaheba
• Remove dataset.rolling_dataset. (#2361) @jaheba
• Remove DummyEstimator. (#2357) @jaheba
• Introduce gluonts.ext. (#2362) @jaheba
• Make serde.dataclass always kw-only. (#2428) @jaheba
• Add copy_dim to QuantileForecast, change dim method for multivariate data (#2352) @codingWhale13
• Include loss computation in torch DeepAR module, decouple MQF2 (#2476) @lostella
• Remove serde dump_code/load_code. (#2482) @jaheba
• Move SelfAttentionEstimator to gluonts.nursery (#2534) @lostella
• Require python 3.7. (#2542) @jaheba
• Simplify forecast.Quantile. (#2544) @jaheba
• Move shell related forecast classes to shell. (#2547) @jaheba
• Consolidate DeepNPTSEstimator (#2496) @lostella
• Improve PandasDataset (#2573) @lostella @jaheba
• Simplify PandasDataset. (#2583) @jaheba

Major improvements / new features

• Add dict like interface for Forecast. (#2384) @jaheba
• Enable dropping of columns in dataset.schema.translate. (#2387) @jaheba
• Exposing the choice of train_sampler and validation_sampler for MQCNN and MQRNN (#2381) @sighellan
• Add wrapper for statsforecast models (#2360) @lostella
• Add dataset.schema.Schema + types. (#2391) @jaheba
• Add IQN implementation (#1784) @kashif
• Add hierarchical time series reconciliation methods from R/hts: top-down and middle-out (#2396) @melopeo
• Add hierarchical time series reconciliation method from R/hts: MinT (#2406) @melopeo
• Change schema.Type to behave like invokable types. (#2443) @jaheba
• Add cdf and icdf methods for StudentT distribution (#2439) @shchur
• Better DeepAR lags for business day frequency time series. (#2433) @sighellan
• Add support for feather; incl compression. (#2452) @jaheba
• Introduce ev module (#2450) @codingWhale13 @jaheba
• Speed up PandasDataset further (#2441) @lostella
• Add Empirical Risk Minimzation (ERM) hierarchical forecasting method (#2412) @melopeo
• Update statsforecast model wrappers (#2515) @lostella
• Add nan values and explainability support for rotbaum (#2537) @zoolhasson
• Enable setting a custom imputation method in deepar pytorch (#2545) @shubhamkapoor
• Add derive_auto_fields for DeepAR PyTorch (#2552) @shubhamkapoor
• Add default_scale to MeanScaler and enable the option in DeepAR-PyTorch (#2553) @shubhamkapoor
• Add statsforecasts models (#2561) @melopeo
• Add TemporalFusionTransformer implementation in PyTorch (#2536) @shchur
• Fix r_forecast methods to work with rpy2 v3+ (#2571) @abdulfatir
• Updated dockerfile for R forecast models (#2572) @abdulfatir
• Shell: Add support for requirements.txt files. (#2582) @jaheba
• Expose weight_decay in torch TFT estimator class (#2603) @gorold
• Allow ReduceLROnPlateau to track val_loss when validation set is available (#2614) @gorold

Minor improvements / new features

• Expose SampleForecast, QuantileForecat directly in model. (#2366) @jaheba
• Mypy fixes (#2427) @jaheba
• Add nursery.pipeline. (#2429) @jaheba
• itertools.select. (#2426) @jaheba
• Add itertools.Filter. (#2438) @jaheba
• Add itertools.trim_nans. (#2460) @jaheba
• Add itertools.inverse. (#2463) @jaheba
• Fix: sort dataset keys in error message when importing non-existing dataset (#2497) @lostella
• Few shot forecasting (#2517) @RingoIngo
• Allow passing of additional args to dataclass. (#2531) @jaheba
• Simplify linear interpolation in forecast.py (#2546) @jaheba
• Add util.lazy_property. (#2557) @jaheba
• Compact PandasDataset string representation (#2558) @lostella
• Add default args and assertions to DeepAR pytorch module, assertions (#2556) @lostella
• Update MANIFEST.in. (#2566) @jaheba
• Add util.copy_with. (#2562) @jaheba
• Add missing value imputation to Seasonal Naive (#2569) @abdulfatir
• Implement get-item for JsonLinesFile. (#2574) @jaheba
• Make itertools Map/Filter dataclasses. (#2579) @jaheba
• Add itertools.StarMap. (#2584) @jaheba
• Add gluonts.maybe. (#2585) @jaheba
• Rework maybe. (#2593) @jaheba

Bug fixes

• Fix dominick dataset bug. (#2364) @haskarb
• Proposed fix to zero seed bug. (#2379) @sighellan
• Fix rotbaum random seed and num_samples argument. (#2408) @sighellan
• Removed unused import in test.(#2409) @kashif
• Hierarchical: Make sure the input S matrix is of right dtype (#2415) @rshyamsundar
• Speed up PandasDataset for long dataframes (#2435) @lostella
• Fix frequency inference in PandasDataset (#2442) @lostella
• Fix plotting date index bug in anomaly detection example (#2446) @Amrit-Bhaskar-abhask10
• Add test cases for PandasDataset, fix missing assertion (#2453) @lostella
• Fix MANIFEST.in (#2456) @lostella
• Fix pandas issue with inferring start of X frequency. (#2462) @jaheba
• Change default forecast_type of ND metric to median (#2472) @codingWhale13
• Fix: use right context in DeepVARHierarchicalEstimator (#2478) @c3-ziqin
• Add requirement files to MANIFEST.in (#2490) @jaheba
• Fix dataclass handling of member inheritance. (#2492) @jaheba
• Fix DateSplitter for multiples of base frequencies (#2500) @lostella
• Fix serde.dataclass inheritance handling. (#2512) @jaheba
• Fix QuantileForecast.quantile in case only mean is stored (#2513) @lostella
• Fix aggregate_valid for non-numerical columns (#2526) @lostella
• Fix dataclass eventual handling. (#2530) @jaheba
• Change SeasonalNaive fallback predictor to nanmean (#2549) @abdulfatir
• Fix: add missing params in rotbaum (#2554) @zoolhasson
• Add NaN validation to Evaluator (#2568) @abdulfatir
• Fix: avoid automatic device detection via serialized tensors when deserializing (#2576) @shubhamkapoor
• serde: Fix encoding of dtypes. (#2586) @jaheba
• Fix bug with static features in PandasDataset (#2589) @lostella
• Fix maybe map_or/map_or_else return types. (#2588) @jaheba
• Add assertion to split function ensuring valid windows (#2587) @MarcelK1102
• Ensure dtype on feat_time in torch DeepAR. (#2596) @jaheba
• Expose aggregation method in ensemble NBEATS, fix forecast shape (#2598) @lostella
• Fix bug with static cardinalities in PandasDataset (#2599) @lostella
• Add gluonts.util.safe_extract (#2606) @lostella
• Fix incorrect import in tsbench, apply latest black (#2613) @lostella

Documentation

• Udpate DeepAR import in README. (#2359) @codingWhale13
• Remove strange quoting marks from docstrings (#2368) @lostella
• Change 'confidence interval' to 'prediction interval' (#2373) @codingWhale13
• Fix use of dump_code in tutorial. (#2488) @jaheba
• Fix docstrings according to docformatter (#2501) @lostella
• Docs: Fix install instructions. (#2508) @jaheba
• Add examples to docstring for periods_between (#2504) @lostella
• Add info on how versioning works. (#2529) @jaheba
• Improve README example (#2538) @lostella
• Update REFERENCES.md @dcmaddix

Test / setup changes

• Update workflow actions to latest versions (#2447) @lostella
• Tests: Change Python versions. (#2448) @jaheba
• Use ruff instead of flake8. (#2485) @jaheba
• Apply ruff/pyupgrade to test. (#2489) @jaheba
• Add smoke tests for torch models (#2495) @lostella
• Pin docformatter version. (#2507) @jaheba
• Cap numpy compatibility in mxnet extra requirements (#2506) @lostella
• Clean up test code for evaluator (#2505) @lostella
• Remove mypy plugin for dataclass. (#2514) @jaheba
• GH Actions: Use authenticated requests for just. (#2522) @jaheba
• Simplify setup.py (#2525) @jaheba
• Test: Only check relevant require-packages.txt for test run. (#2595) @jahaba
• Fix version in requirements to comply with stricter setuptools. (#2604) @lostella

Other

• Move NPTS back to gluonts.model (#2597) @lostella

Backporting fixes:

• Fix: avoid automatic device detection via serialized tensors when deserializing PyTorchPredictor. #2576 by @shubhamkapoor
• Fix Map representation. #2579 by @jaheba
• serde: Fix encoding of dtypes. #2586 by @jaheba
• Add assertion to split function ensuring valid windows #2587 by @MarcelK1102
• Ensure dtype on feat_time in torch DeepAR. #2596 by @jaheba
• Expose aggregation method in ensemble NBEATS, fix forecast shape #2598 by @lostella
• Fix requirements following breaking change in setuptools #2604 by @lostella
• Add gluonts.util.safe_extract #2606 by @lostella

Backporting fixes:

• Update workflow actions to latest versions #2447 by @jaheba
• Simplify setup.py #2525 by @jaheba
• Fix dataclass eventual handling. #2530 by @jaheba
• Improve README example #2538 by @lostella
• Change SeasonalNaive fallback predictor to nanmean #2549 by @abdulfatir
• Compact PandasDataset string representation #2558 by @lostella
• Update MANIFEST.in. #2566 by @jaheba
• Add NaN validation to Evaluator #2568 by @abdulfatir

Backporting fixes:

• Make serde.dataclass always kw-only. (#2428 by @jaheba)
• Fix serde.dataclass inheritance handling. (#2512 by @jaheba)
• Fix QuantileForecast.quantile in case only mean is stored (#2513 by @lostella)
• Remove mypy plugin for dataclass. (#2514 by @jaheba)
• GH Actions: Use authenticated requests for just. (#2522 by @jaheba)
• Fix aggregate_valid for non-numerical columns (#2526 by @lostella)

Backporting fixes:

• itertools.select. #2426 by @jaheba
• Fix dataclass handling of member inheritance. #2492 by @jaheba
• Fix: sort dataset keys in error message when importing non-existing dataset #2497 by @lostella
• Fix DateSplitter for multiples of base frequencies #2500 by @lostella
• Fix docstrings according to docformatter #2501 by @lostella
• Add examples to docstring for periods_between #2504 by @lostella
• Cap numpy compatibility in mxnet extra requirements #2506 by @lostella
• Pin docformatter version. #2507 by @jaheba
• Docs: Fix install instructions. #2508 by @jaheba

What's Changed

• Backports for v0.11.5. by @jaheba in https://github.com/awslabs/gluonts/pull/2491

Full Changelog: https://github.com/awslabs/gluonts/compare/v0.11.4...v0.11.5

Backports:

• Fix pandas issue with inferring start of X frequency. (#2462 by @jaheba)