Skip to content

exp: validate live RNGD GPU cancellation and producer replacement - #260

Draft
gspark-etri wants to merge 3 commits into
fix/258-dense-hybrid-kvfrom
exp/201-live-gpu-validation
Draft

exp: validate live RNGD GPU cancellation and producer replacement#260
gspark-etri wants to merge 3 commits into
fix/258-dense-hybrid-kvfrom
exp/201-live-gpu-validation

test: verify active GPU decode survives producer death on four models…

f9ce6e8
Select commit
Loading
Failed to load commit list.

There are no checks for this commit