Intel® Gaudi® Software

Optimized to meet deep learning developers where you are.

Intel® Gaudi® Software


Intel Gaudi software, like our accelerator hardware, was purpose-designed to deliver Gen AI performance, efficiency, and, most importantly, increased developer ease of use and productivity. With support for go-to frameworks like PyTorch and DeepSpeed, and popular LLM and multimodal models supported on Hugging Face, the goal of Intel Gaudi software is to enable you to easily enable new models or migrate existing code with 3 to 5 lines of code. In essence, Intel Gaudi software and its many tools and documents are designed to meet deep learning developers where you are — enabling you to develop what and how you want.

Ready to Use Intel® Gaudi® Software?

During the research for this blog post I discovered that “Gaudi” means “fun” in German. I cannot think of a better way to describe the experience I have had with DL1 thus far.

Chaim Rand
ML Algorithm Developer, Mobileye

So, if you have existing code, you can migrate it in minutes. And... the first time I tried this, it took me 10 minutes and that included reading the docs. And I launched my accelerated script and it worked out of the box. I have to say this is one of the simplest development experiences I've ever seen.

Julien Simon
Chief Evangelist, Hugging Face

Simplified Development the Way You Want to Develop

Intel® Gaudi® software: optimized for deep learning training and inference.

Intel Gaudi Software Suite

Integrating frameworks, tools, drivers and libraries.

We Offer Extensive Support for Data Scientists, Developers, and IT and Systems Administrators With:

Habana Developer Site: featuring documentation, customer-available software, “how to” content, community Forum.1

Habana GitHub: providing reference models, set-up and install instructions, snapshot scripts for analysis and debug, custom kernel examples, roadmap, and “issues” sub-site tracking to dos, bugs, feature requests and more.1

Intel Gaudi AI Accelerator

Software ecosystem for deep learning brings together leading software providers, tools and code to accelerate development of state-of-the-art deep learning models based on PyTorch, TensorFlow, PyTorch Lightning and DeepSpeed frameworks. Our collaboration with software partners such as Hugging Face enables Intel to rapidly expand its support for the latest popular models, easing your development process to enable the explosive array of deep learning applications emerging daily. Intel’s software team leverages open code, models and capabilities from trusted partners who share our focus on developing models for computer vision, natural language processing, generative AI and multi-modal applications.

Hugging Face

500k+ AI Models, 320k+ GitHub Stars. Explore Habana Optimum Library for Intel Gaudi accelerators.

DeepSpeed

Easy-to-use deep learning optimization software that enables scale and speed with particular focus on large scale models.

Pytorch Lighting

Acceleration of PyTorch deep learning workloads.

Cnvrg.io

Cnvrg.io provides MLOPs support for customers implementing Intel Gaudi processor solutions.

Show more Show less

Solutions Focused on Business and End-User Outcomes

Intel Gaudi accelerator model development is focused on industries and applications where AI is proven to provide the greatest near-term business revenue and deliver rich consumer experiences. For more information on how our team is enabling high-value applications using computer vision, NLP, generative AI, large-language and multi-modal models, see our industry solutions.

Product and Performance Information

1

Habana Labs is an Intel company and publisher of the Habana Developer Site and Habana GitHub content.