Cargando…

Inference of ML models on Intel GPU with SYCL and Intel OneAPI using SOFIE

<!--HTML-->TMVA provides a fast interference system that takes an ONNX model as input and produces compilation-ready standalone C++ scripts as output which can be compiled and executed on CPU architectures. The idea of this project is to extend this capability to generate from the TMVA SOFIE m...

Descripción completa

Detalles Bibliográficos
Autor principal: Panagou, Ioanna Maria
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2869215
Descripción
Sumario:<!--HTML-->TMVA provides a fast interference system that takes an ONNX model as input and produces compilation-ready standalone C++ scripts as output which can be compiled and executed on CPU architectures. The idea of this project is to extend this capability to generate from the TMVA SOFIE model representation code that can be run also on Intel GPU using both SYCL and Intel OneAPI libraries. These will allow for a more efficient evaluation of these models on Intel accelerator hardware.