Investors include the Zisapel family, Gil Agmon, DelekMotors, Alfred Akirov, DCLBA, Vasuki, OurCrowd, Talcar, Comasco, Automotive Equipment (AEV), and PoalimEquity
Hailo has also launched its Hailo-10 GenAI accelerators which allow users to own and run GenAI applications locally without registering to cloud-based GenAI services.
“We designed Hailo-10 to seamlessly integrate GenAI capabilities into users’ daily lives, freeing users from cloud network constraints,” says Hailo co-founder and CEO Orr Danon..
Hailo-10 leverages the same software suite used across the Hailo-8 AI accelerators and the Hailo-15 AI vision processors, enabling integration of AI capabilities across multiple edge devices and platforms.
Enabling GenAI at the edge ensures continuous access to GenAI services, regardless of network connectivity; obviates network latency concerns, which can otherwise impact GenAI performance; promotes privacy by keeping personal information anonymised and enhances sustainability by reducing reliance on the substantial processing power of cloud data centres.
By unlocking the power of GenAI on edge devices, such as personal computers, smart vehicles, and commercial robots, Hailo-10 allows users to completely own their GenAI experiences, making them an integral part of their daily routine.
“As GenAI on the edge becomes immersive, the focus turns to handling large LLMs in the smallest possible power envelope — essentially less than five watts,” says Danon.
Hailo-10 can run Llama2-7B with up to 10 tokens per second (TPS) at under 5W of power. In processing Stable Diffusion 2.1 that produces images from text prompts, Hailo-10 is rated at under 5 seconds per image in the same power envelope.
Hailo-10 is capable of up to 40 TOPS and early applications will target PCs and automotive infotainment systems that cannot by themselves power the chatbots, copilots, personal assistants, and speech-operated operating systems that have become standard. Hailo will begin shipping samples of the Hailo-10 GenAI accelerator in Q2 of 2024.
“Whether users employ GenAI to automate real-time translation or summarization services, generate software code, or images and videos from text prompts, Hailo-10 lets them do it directly on their PCs or other edge systems, without straining the CPU or draining the battery,” says Danon.
