Skip to content

Switch pytorch_inf from float32 to auto to fix OOM on 16GB machines#10

Merged
jewilder merged 1 commit into
microsoft:mainfrom
philnach:fix/pytorch-inf-bfloat16-memory
Apr 2, 2026
Merged

Switch pytorch_inf from float32 to auto to fix OOM on 16GB machines#10
jewilder merged 1 commit into
microsoft:mainfrom
philnach:fix/pytorch-inf-bfloat16-memory

Fix pytorch_inf model loading: use torch_dtype=auto to match official…

acfa7d6
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings

The logs for this run have expired and are no longer available.