AI

New Compiler Thunder Released for PyTorch by Lightning AI

In partnership with Nvidia, Lightning AI has released Thunder, a source-to-source compiler for PyTorch, designed to accelerate AI model training by utilizing multiple GPUs for efficiency, achieving up to a 40% speedup. At the same time, OpenAI has unveiled the Sora video AI tool, sparking both delight and concern about its capabilities. An AI Impact event in Atlanta on April 10th will focus on putting AI to work in the enterprise with leaders in generative AI and enterprise security presenting case studies.

At a glance

  • Thunder, a source-to-source compiler for PyTorch, accelerates AI model training using multiple GPUs for up to a 40% speedup.
  • Lightning AI partnered with Nvidia to optimize GPU usage and create next-generation deep learning for PyTorch.
  • Thunder is open source under an Apache 2.0 license and is freely available.
  • OpenAI’s Sora AI tool can transform written prompts into realistic videos, sparking both delight and concern about its capabilities.
  • An AI Impact event in Atlanta on April 10th will focus on putting AI to work in the enterprise, featuring leaders in generative AI and enterprise security.

The details

In partnership with Nvidia, Lightning AI has released Thunder, a source-to-source compiler for PyTorch.

Thunder is designed to accelerate AI model training by utilizing multiple GPUs for efficiency, achieving up to a 40% speedup for training large language models in real-world scenarios.

The compiler is open-source under an Apache 2.0 license and is freely available.

Optimizing GPU Usage

Lightning AI unveiled Thunder at Nvidia GTC to optimize GPU usage and aims to create next-generation deep learning for PyTorch that is compatible with Nvidia products.

Thomas Viehmann, a PyTorch core developer, leads the compiler for generative AI models, and Lightning AI CEO William Falcon is excited to collaborate with Viehmann for performance breakthroughs.

It was mentioned that the model training process can be time-consuming and costly, especially with adversarial AI threats.

Performance optimization and profiling tools are crucial for scaling model training, as customers often do not fully utilize available GPUs, leading to wasted resources.

Thunder became available following the release of Lightning 2.2 in February, with Lightning Studios products available at different pricing levels for individual developers, engineers, startups, and larger organizations.

OpenAI’s Sora

On the other hand, OpenAI has unveiled the first short films created using its new video AI tool, Sora.

Filmmakers have described the creations as “totally surreal.” The Sora system, launched last month, has caused a mix of delight and concern about its capabilities.

This AI software can transform simple written prompts into realistic videos, allowing visual artists and directors early access to Sora’s creative potential.

Canadian production company Shy Kids utilized Sora to create a short film featuring a man with a balloon head, showcasing the expansion of stories and abstract expressionism.

Multi-disciplinary artist Paul Trillo believes Sora enables the realization of concepts without limitations.

However, concerns have been raised about the potential misuse of Sora to create deepfake videos and spread misinformation.

OpenAI has acknowledged this potential misuse and is actively working on tools to detect misleading content generated by Sora.

While safety measures are in place for OpenAI’s other AI products to prevent certain types of content, unrestricted versions are available from other companies.

AI Impact Event

Lastly, an AI Impact event is scheduled in Atlanta on April 10th, focusing on putting AI to work in the enterprise.

The event features leaders in generative AI and enterprise security, with case studies from Honeywell and Ally Financial.

Limited to 50 attendees and designed for enterprise technical decision-makers, the event delves into generative AI and security, offering insights from Sheila Jordan of Honeywell on generative AI adoption and Sathish Muthukrishnan from Ally Financial showcasing Ally.ai.

Additionally, Kelly Bissell from Microsoft will discuss using AI to secure operations, highlighting how Microsoft Azure empowers organizations to leverage generative AI. The event is sponsored by Microsoft, emphasizing the importance of data governance strategies for managing data input and output in the context of generative AI applications.

Article X-ray

Facts attribution

This section links each of the article’s facts back to its original source.

If you suspect false information in the article, you can use this section to investigate where it came from.

venturebeat.com
– Lightning AI, in partnership with Nvidia, released Thunder, a source-to-source compiler for PyTorch
– Thunder is designed to speed up AI model training by using multiple GPUs for efficiency
– The compiler achieves up to a 40% speed-up for training large language models in real-world scenarios
– Thunder is open source under an Apache 2.0 license and freely available
– Lightning AI unveiled Thunder at Nvidia GTC to optimize GPU usage
– Lightning AI aims to create next-generation deep learning for PyTorch compatible with Nvidia products
– Lightning AI was formerly known as Grid AI and created PyTorch Lightning
– Lightning AI works with open-source communities like Open AI, Meta AI, and Nvidia
– Thomas Viehmann, PyTorch core developer, leads the compiler for generative AI models
– Lightning AI CEO William Falcon is excited to work with Viehmann for performance breakthroughs
– Model training process can be time-consuming and costly, especially with adversarial AI threats
– Performance optimization and profiling tools are key for scaling model training
– Customers often do not use available GPUs to full capacity, leading to wasted resources
– Thunder is available following the release of Lightning 2.2 in February
– Lightning Studios products are available at different pricing levels for individual developers, engineers, startups, and larger organizations
independent.co.uk
– OpenAI has unveiled the first short films created using its new video AI tool Sora
– Filmmakers describe the creations as “totally surreal”
– Sora system was launched last month, causing a mix of delight and panic about its capabilities
– AI software can turn simple written prompts into realistic videos
– Visual artists and directors have early access to Sora’s creative potential
– Canadian production company Shy Kids used Sora to create a short film about a man with a balloon head
– Sora allows for the expansion of stories and abstract expressionism
– Multi-disciplinary artist Paul Trillo believes Sora allows for the realization of concepts without limitations
– Concerns have been raised about the potential misuse of Sora to create deepfake videos and spread misinformation
– OpenAI has acknowledged the potential for misuse and is working on tools to detect misleading content generated by Sora
– Safety measures are in place for OpenAI’s other AI products to prevent certain types of content, but unrestricted versions are available from other companies
venturebeat.com
– AI Impact event in Atlanta on April 10th
– Focuses on putting AI to work in the enterprise
– Features leaders in generative AI and enterprise security
– Includes case studies from Honeywell and Ally Financial
– Limited to 50 attendees
– Designed for enterprise technical decision-makers
– Dive into generative AI and security
– Learn from others’ experiences with generative AI
– Networking opportunities, food, and cocktails
– Sheila Jordan from Honeywell will share insights on generative AI adoption
– Challenges associated with gen AI applications discussed
– Data governance strategy for managing data input and output
– Honeywell partners with Microsoft for generative AI tools
– Sathish Muthukrishnan from Ally Financial will showcase Ally.ai
– Ally’s unique data warehousing infrastructure discussed
– Robust governance procedures at Ally for generative AI applications
– Kelly Bissell from Microsoft will discuss using AI to secure operations
– Microsoft Azure empowers organizations to leverage generative AI
– Sponsored by Microsoft

What's your reaction?

Excited
0
Happy
0
In Love
0
Not Sure
0
Silly
0

You may also like

Comments are closed.

More in:AI