The PCIe cards, called ‘Hailo-8 Century’, execute at 400frame/s/W on the ResNet50 benchmark model, said the company, and the highest-performance version can run the same benchmark at 10,000frame/s.
Versions start at 52Top/s, and video processing applications are foreseen in multi-camera deployments for security, retail and smart cities.
The IC, called Hailo-8L, executes at up to 13 Top/s and “is designed to support entry-level products requiring limited AI capacity or lower performance”, according to Halio. It can run ResNet50 at 500frame/s.
“Hailo-8 is now accessible to a wider range of applications and products, catering to both demanding and entry-level use-cases, we are driving the industry forward in an era where efficient, scalable edge AI processing is increasingly important for businesses,” said CEO Orr Danon.
The company has a compiler that deploys neural networks into its products, which works with AI frameworks including Keras, TensorFlow, PyTorch and Onnx.
For TensorFlow and Onnx, it has a library of pre-trained models and tasks
Halio AI ICs need to work with a host processor, for which a runtime software package is available as well as application examples.
Founded in 2017, Halio is based in Tel Aviv, with over 200 employees and $220m of funding.
