Rollout update - #2749

Open

sophie-xhonneux wants to merge 93 commits into

ecmwf:develop-ssl-diffusion-v1from

grassesi:rollout_update

Commits on May 22, 2026

Revert "Spherical RoPE (#2082)" (#2399)
clessig
authored
89f97a3

Commits on May 26, 2026

adding three new regions for evaluation (#2385)

Tewson1
and
Tharmeekan
authored
388b90c

Commits on May 27, 2026

Commits on May 28, 2026

added arctic region for plotting in stereographic projection and modified projection logic (#2401)

authored
b684247

Commits on May 29, 2026

Sgrasse/develop/342 streams as dict (#2242)
grassesi
authored
835e0b8
combine inference from multiple ranks in evaluation (#2400)

iluise
and
SavvasMel
authored
764c455
Sgrasse/develop/2353 plot train (#2354)

grassesi
and
clessig
authored
ef637b5
Score animations with fixed colorbar (#2402)

SavvasMel
and
iluise
authored
84a60a9
apply scale_z_channels (#2417)

jpolz
and
iluise
authored
283f73a

Commits on Jun 1, 2026

Fix bug in the evaluation wegen_reader.py (#2431)
SavvasMel
authored
693f342

Commits on Jun 5, 2026

integrate plot as a function of initialization time into FastEvaluation (#2436)

iluise
and
shmh40
authored
ee0010a

Commits on Jun 7, 2026

Fixed how alive runs are determined. Made col len configurable (#2462)
clessig
authored
90ab24b
Remove memory pinning for validation to avoid crashes (#2460)
clessig
authored
5d7df94
Move data reader fesom to extra package (#2454)

kacpnowak
and
clessig
authored
8bfb2c3

Commits on Jun 8, 2026

remove clim align when not necessary (#2456)

authored
7423f17
implement power spectra (#2398)
iluise
authored
8c1af86

Commits on Jun 9, 2026

Tropical cyclone casestudy (#2391)

s6sebusc
and
buschow1
authored
5822a16
Fix empty first sample in inference (and also all other modes): missing (#2469)
clessig
authored
d30421f
Update default rank value in wegen_reader.py (#2475)
iluise
authored
c8c25e1

Commits on Jun 10, 2026

Fix missing type of ranks when specified as list (#2478)

clessig
and
iluise
authored
f83bc3a
Implement regular subsampling for DataReaderMesh (#2408)

kacpnowak
and
SavvasMel
authored
06803b7

Commits on Jun 12, 2026

Restore streams_directory overwrite behavior (#2490)

authored
79082ac
update json file (#2483)

authored
054c013
implement regridding in FastEval (#2494)
iluise
authored
4a92441
remove redundant plots for score_timeseries (#2497)
iluise
authored
ee193c2

Commits on Jun 15, 2026

[1050] Upgrade to torch 2.9.1 (#2310)
florianscheidl
authored
e65d99a

Commits on Jun 18, 2026

Implement Dynamic Channel-Weighting MSE loss (#2486)
kacpnowak
authored
1468a50
Evenmn/clessig/cristianl/pr1699 anemoi config join (#2519)

authored
4e52780
Override nvidia-nccl-cu12 >=2.29 to fix multi-node training on Alps (#2523)

ekouts
and
clessig
authored
6c94022

Commits on Jun 19, 2026

Restore gitignore that was accidentally removed in a recent commit (#2530)
evenmn
authored
f9bc4ee

Commits on Jun 22, 2026

multi_stream_data_sampler: Select existing filename from multiple options (#2525)
jpolz
authored
2317e19

Commits on Jun 25, 2026

[2555] chore(embeddings): remove forward_columns path in StreamEmbedTransformer (#2556)
florianscheidl
authored
10f838d
Fused optimizer (#2544)

florianscheidl
and
clessig
authored
61773bd
[2552] feat(trainer): add nvtx annotations (#2553)

florianscheidl
and
clessig
authored
3ea6024

Commits on Jun 26, 2026

[2186] Scaling utils (#2231)

authored
c15d20a
[2548] feat(train): make gradient scaler optional (#2549)

florianscheidl
and
clessig
authored
d62a212
[2298] Fix CI (#2299)
tjhunter
authored
f8f3080

Commits on Jun 29, 2026

call BatchSample method instead of repeating content (#2348)
TillHae
authored
54595ea
[2304] Adjust eval for precipitations (#2521)
vhertel
authored
9d603fe
[2526] Add configurable coords column names to obs reader (#2533)

vhertel
and
clessig
authored
689a82d

Commits on Jun 30, 2026

reinstating functions for power spectra (#2575)
enssow
authored
a52117d
Fix Dynamic Loss EMA update with forecast offset (#2567)

kacpnowak
and
clessig
authored
1850df9

Commits on Jul 1, 2026

Add timeseries plotting (#2435)
SavvasMel
authored
50196f9
fix sample and ipoint duplication with multiple ranks. (#2565)

iluise
and
clessig
authored
4ae7d06

Commits on Jul 3, 2026

Commits on Jul 10, 2026

[2502][evaluation] score bug fixes (#2503)

moritzhauschulz
and
claude
authored
c4d2aa1

Commits on Jul 13, 2026

[2507][Evaluation] Implement Adjusted SSR (#2508)

authored
e38dd45

Commits on Jul 14, 2026

[2531] Require geoinfo_channels for obs streams (#2534)

vhertel
and
clessig
authored
f2e43ad

Commits on Jul 15, 2026

avoid score computation when unnecessary and trigger json recompilation when config settings change (#2598)

iluise
and
jpolz
authored
680066f
Add geoinfos to obs streams (#2641)

vhertel
and
iluise
authored
2bcc95c
Export esemble members to cf-compliant netcdf (#2247)

authored
9da4fcf

Commits on Jul 16, 2026

Update operational analysis filename to up to date (#2651)
shmh40
authored
4f9932b

Commits on Jul 17, 2026

Update surface dataset paths to v5 (#2653)
shmh40
authored
52f650a
Fix filename for integration test (#2654)
lxavier
authored
1de1e47

Commits on Jul 20, 2026

Synop int. test, token_size 512 tok_spctm = False (#2659)
shmh40
authored
634440a
Change colorbars in scatter_plot (#2634)

iluise
and
clessig
authored
c3a9119

Commits on Jul 22, 2026

add std for ensemble plotting for individual samples (#2505)
saibr
authored
880bf5c
Fix export bug, add IMERG N320 (#2670)

s6sebusc
and
buschow1
authored
deb4f6c
merge PDFs and more granular folder structure for FastEval output (#2597)
iluise
authored
38779e0

Commits on Jul 23, 2026

use explicit lists to enable plot/score visualization in FastEval (#2620)

authored
b0a5cba
Restore SEEPS (#2662)

authored
9e93a74
Fair and threshold weighted CRPS (#2644)

jpolz
and
iluise
authored
3353fd2

Commits on Jul 28, 2026

getting seeps scores instead of seeps error + doc string for the func… (#2694)
wael-mika
authored
b36b99e
multi rank option for export (#2648)

enssow
and
iluise
authored
e869add

Commits on Jul 30, 2026

Add ensembles for verif netcdfs (#2499)

authored
6dcf030
[2698] Downloads checkpoint from release bucket (#2699)
tjhunter
authored
3bb98ed

Commits on Aug 4, 2026

[2679] Add hourly model support to the NetCDF parser (#2709)

Matteo-Salis
and
clessig
authored
fb5f9ff

Commits on Aug 5, 2026

fix xlabel for plot (#2735)
TillHae
authored
36d4c58

Commits on Aug 7, 2026

[1849][model] Add optional latent Zarr writer (#1860)

authored
79d8e8d

Commits on Aug 11, 2026

Let BatchSamples stand in for ModelOutput
grassesi
committed
dc0d238
Make ModelOutput describe which forecast steps it holds

grassesi
and
claude
committed
3c31bd7
Index predictions through ModelOutput.chunk_idx/batch_idx

grassesi
and
claude
committed
f6121c9
Run pushforward steps under torch.no_grad()

grassesi
and
claude
committed
5a4f80e
Abstract rollout intialization from either sources or past saved predictions.
grassesi
committed
5070497
Use new abstraction to intialize rollout in `Model.forward`
grassesi
committed
0c4da71
Iterate over forecast_steps in `Model.forward`
grassesi
committed
0091daf
use source_samples instead of batch in `Model.forward`
grassesi
committed
07d07e3
Change interface of `Model.forward` to allow incremental rollout.
grassesi
committed
2b9f561
Spoofed targets no longer depend on non-empty predictions

grassesi
and
claude
committed
5fb0d8c
Pass the forecast steps to OutputBatchData instead of deriving them

grassesi
and
claude
committed
3595841
Write validation output for the forecast steps the chunk describes

grassesi
and
claude
committed
2e26f26
Move the validation rollout and output writing into one method

grassesi
and
claude
committed
a3129b0
Run the validation rollout in chunks of forecast.chunk_size

grassesi
and
claude
committed
f600647