deepsparse

[DEPRECATED] An inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application

PyPI

Version: 1.5.3

Maintainers: 1

DeepSparse

Sparsity-aware deep learning inference runtime for CPUs

🚨 2025 End of Life Announcement: DeepSparse, SparseML, SparseZoo, and Sparsify

Dear Community,

We’re reaching out with heartfelt thanks and important news. Following Neural Magic’s acquisition by Red Hat in January 2025, we’ve shifted our focus to commercial and open-source offerings built around vLLM (virtual large language models).

As part of this transition, we ceased development and deprecated the community versions of DeepSparse (including DeepSparse Enterprise), SparseML, SparseZoo, and Sparsify on June 2, 2025. These tools no longer will receive updates or support.

From day one, our mission was to democratize AI through efficient, accessible tools. We’ve learned so much from your feedback, creativity, and collaboration—watching these tools become vital parts of your ML journeys has meant the world to us.

Though we’ve wound down the community editions, we remain committed to our original values. Now as part of Red Hat, we’re excited to evolve our work around vLLM and deliver even more powerful solutions to the ML community.

To learn more about our next chapter, visit ai.redhat.com. Thank you for being part of this incredible journey.

With gratitude, The Neural Magic Team (now part of Red Hat)

Keywords

FAQs

What is deepsparse?

Is deepsparse well maintained?

Did you know?

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install