Can a hybrid model forecast clean energy further?

Three datasets test different scales, not three independent deployments

The Weather benchmark contains 52,696 observations sampled every ten minutes from January 2020 to January 2021, with 21 variables including temperature and humidity. The Solar dataset contains 8,760 hourly observations from calendar year 2014 and seven variables: global, direct and diffuse irradiance, atmospheric pressure, relative humidity, wind speed and wind direction. The Electricity dataset contains 26,304 hourly observations from July 2016 to July 2019 for 321 load series.

Every dataset was divided chronologically: 70% for training, 10% for validation and 20% for testing. That is more appropriate than a random row split for a forecasting task because the test period comes after the data used to fit and tune the model. Candidate input lengths of 96, 192, 336, 512 and 720 time steps were selected through validation performance, and the locked configuration was then evaluated at forecast horizons of 96, 192, 336 and 720 steps.

The denominator nevertheless needs care. A 720-step horizon means five days on the ten-minute Weather series but 30 days on the hourly Solar and Electricity series. The same horizon label therefore represents different real durations. The benchmarks also come from one historical period each. They cannot show how the method handles new solar hardware, changed demand behaviour, extreme weather outside the training distribution or a shift in measurement quality.[1]

The accuracy gains are consistent but small

The authors reproduced four Transformer baselines—PatchTST, Preformer, FEDformer and Autoformer—alongside TimesNet, MICN-regre, DLinear and three recent state-space approaches, S-Mamba, DPEM and SST. The models used the same data partitions and hardware environment, while architecture-specific settings followed official implementations or recommendations. Mean-squared error was the main measure and mean absolute error was also reported.

With its input length selected from the candidate set, D-MambaFormer recorded an average mean-squared error of 0.221 on Weather, compared with 0.228 for the strongest baseline, PatchTST: an improvement of about 3%. On Solar it reached 0.575 against 0.577 for DPEM, roughly 0.3%. On Electricity it reached 0.158 against 0.161 for DPEM, about 2%. Those results support the description competitive and sometimes best on these tables. They do not support claims of a step-change in forecast reliability.

Three random seeds—2020, 2021 and 2022—were used for the proposed model, with mean and standard deviation reported. Across additional horizons, mean-squared-error standard deviations were 0.001 to 0.007 on Weather, 0.002 to 0.010 on Solar and 0.001 to 0.003 on Electricity. Baselines were reported as three-seed means rather than with matching uncertainty intervals, and the paper did not provide a formal test of whether the small average gaps would persist across fresh data periods or sites.[1]

Ablations support the design, while efficiency has caveats

Removing components generally made the model worse in the Solar and Weather ablations. Across those tests, the patching step reduced mean-squared error by an average 32% and mean absolute error by 30% compared with the no-patching variant. The Mixture of Patch Extractors produced smaller average reductions of 7% and 6%. Transformer-only encoding performed better over short and medium horizons, while the Mamba-only branch did better at the longer horizons. Concatenating both feature sets outperformed scalar-weighted alternatives.

The compute experiments help explain the hybrid design. Compared with the Transformer encoder alone over six input lengths, the Mamba encoder used 59% less GPU memory on average, reduced training time by 61% and cut inference time by 30% on the Weather benchmark. In a full-model comparison with input length 512 and prediction horizon 336, D-MambaFormer used less peak memory than the listed alternatives on Weather and Solar, and a compact 2.974 million parameters on the high-dimensional Electricity data.

Those numbers are laboratory measurements on four NVIDIA Quadro RTX 6000 GPUs. The paper also states that reported floating-point operations exclude kernels the profiler does not capture, including Mamba's selective scan. S-Mamba, a pure state-space model, remained faster and lighter on several measures. Hardware efficiency in one training setup does not determine inference cost on an operator's servers, edge devices or cloud service, and no energy consumption or carbon footprint was measured.[1]

What remains unproven for grids and renewable operators

Forecast error matters because operators can use predictions when scheduling reserves, planning storage, buying power or managing variable renewable supply. But this study stops before those decisions. It does not compare the forecasts with a utility's existing production model, quantify avoided imbalance costs, test probabilistic uncertainty bands or simulate how a decision rule responds to an error. A lower average MSE can still conceal misses during the rare ramps or extreme conditions that matter most operationally.

Reproducibility is also uneven. The authors provide a public code repository, and the Weather and Electricity data are linked to public sources. The Solar dataset is described as collected by State Power Investment Corporation in China, but the paper's data-availability statement provides no download link for it. Independent reproduction of that portion may therefore depend on access not documented in the paper.

A stronger next test would lock the architecture and hyperparameters, evaluate later periods and new geographic sites, and compare it against operator baselines without retuning on the test environment. It should report performance during extreme weather and rapid renewable ramps, produce calibrated prediction intervals, measure end-to-end latency and energy use, and connect forecast differences to costs, reliability and human decisions. A prospective shadow deployment could then show whether the modest benchmark gains survive real data quality and operational constraints.[1]

Funding, interests and the practical conclusion

The authors are affiliated with Zhengzhou University and SPIC Qinghai Photovoltaic Industry Innovation Center in China. The work was supported by China's National Natural Science Foundation, grant 52305559, and the China Postdoctoral Science Foundation, grant 2023M733208. The authors declared no known competing financial interests or personal relationships that could have influenced the work.

For energy data teams, D-MambaFormer is a credible research candidate: it combines complementary sequence models, is tested against recent alternatives and exposes code. For utilities and regulators, the conclusion should remain narrower. The study shows modest error reductions on three historical benchmarks under one experimental protocol. It does not yet show better grid reliability, cheaper power, lower emissions or safer operating decisions.[1]