45 lines
2.5 KiB
Plaintext
45 lines
2.5 KiB
Plaintext
|
+
|
|||
|
|
”•j® ã ó. € R t ^ RIHt R R ltR R ltR# )zäGPU-accelerated compressed execution path for XIC.
|
|||
|
|
|
|||
|
|
has_gpu() probes for CUDA via torch. If torch is absent or no CUDA
|
|||
|
|
device is detected, returns False and run_on_gpu() falls back to CPU
|
|||
|
|
via execute_gx() with a clear log line.
|
|||
|
|
)ÚAnyc ó$ € V ^8„ d QhR\ /# )é Úreturn)Úbool)Úformats "Ú2/home/dave/superdave/xic_extensions/gpu_runtime.pyÚ __annotate__r
|
|||
|
|
s € ÷
|
|||
|
|
ñ
|
|||
|
|
Ӗ
|
|||
|
|
ó c ód € ^ RI p V P P 4 # \ d R# i ; i)z€Check if CUDA GPU is available via torch.
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
True if torch is installed and CUDA device is detected, False otherwise
|
|||
|
|
NF)ÚtorchÚcudaÚ is_availableÚ ImportError)r s r Úhas_gpur
|
|||
|
|
s/ € ð ÛØ�z‰z×&Ñ&Ó(Ð(øÜ ô Úðús ‚ /®/c ó< € V ^8„ d QhR\ R\ R\ /# )r Ú
|
|||
|
|
model_pathÚparamsr )ÚstrÚdictr )r s "r r r s! € ÷ "
|
|||
|
|
ñ "
|
|||
|
|
œ3ð "
|
|||
|
|
¬ð "
|
|||
|
|
´ñ "
|
|||
|
|
r
|
|||
|
|
c ó˜ € ^ RI Hp \ 4 ' dZ ^ RIpVP P ^ 4 p\
|
|||
|
|
RV 24 V! V VP RR4 VP RR4 R7 # \
|
|||
|
|
R 4 V! V VP RR4 VP RR4 R7 # \ d p\
|
|||
|
|
RT 24 Rp?LRp?ii ; i)
|
|||
|
|
a` Execute a .gx model with optional GPU acceleration.
|
|||
|
|
|
|||
|
|
If GPU is available (torch + CUDA), logs device info and runs on GPU.
|
|||
|
|
If GPU is not available, logs fallback and runs on CPU via execute_gx().
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
model_path: Path to .gx model file
|
|||
|
|
params: Execution parameters dict (trace, profile, etc.)
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
ExecutionContext from execute_gx()
|
|||
|
|
)Ú
|
|||
|
|
execute_gxNz[XIC-GPU] Device: z.[XIC-GPU] Warning: Could not get device name: ÚtraceFÚprofile)r r u- [XIC-GPU] No CUDA device — executing on CPU) Úruntime_executor.runnerr r r r
|
|||
|
|
Úget_device_nameÚprintÚ ExceptionÚget)r r r r Ú device_nameÚes && r Ú
|
|||
|
|
run_on_gpur! sÇ € õ 3ä‡y‚yð HÛ Ø Ÿ*™*×4Ñ4°QÓ7ˆKÜ Ð& { mÐ4Ô 5ñ Ø Ø—*‘*˜W eÓ,Ø—J‘J˜y¨%Ó0ô
|
|||
|
|
ð
|
|||
|
|
ô Ð=Ô>ÙØ Ø—*‘*˜W eÓ,Ø—J‘J˜y¨%Ó0ô
|
|||
|
|
ð
|
|||
|
|
øô ô HÜ ÐBÀ1À#ÐF× GÑ Gûð Hús ˜-B& Â& C Â1CÃC N)Ú__doc__Útypingr r r! © r
|