About a-team Marketing Services

A-Team Insight Blogs

Snowflake Releases Arctic Open-Source LLM for Complex Enterprise Workloads

Subscribe to our newsletter

Snowflake has released Arctic, an open-source large language model (LLM) designed to deliver top-tier intelligence and efficiency at scale, and optimised for complex enterprise workloads. The company’s debut of its own open-source LLM takes it into competition with the likes of OpenAI’s GPT-4, Google’s Gemini, Meta Platforms’ Llama 2 and Mistral AI’s Mixtral.

Snowflake Arctic is based on a ‘mixture-of-experts’ architecture and is part of the company’s LLM family that includes practical text-embedding models for retrieval use cases. Underlining the openness of the LLM, Snowflake is releasing Arctic’s weights under an Apache 2.0 license and details of the research leading to how it was trained.

“By delivering intelligence and efficiency in a truly open way to the AI community, we are furthering what open-source AI can do. Our research with Arctic will enhance our capability to deliver reliable, efficient AI to our customers,” says Sridhar Ramaswamy, CEO at Snowflake.

Snowflake Arctic includes code templates and flexible inference and training options so users can get started quickly with deploying and customising Arctic using their preferred frameworks. These will include NVIDIA NIM with NVIDIA TensorRT-LLM, vLLM, and Hugging Face, a machine learning and data science platform and community that helps users build, deploy and train machine learning models, and provides infrastructure to demo, run and deploy AI in live applications.

For immediate use, Arctic is available for serverless inference in Snowflake Cortex, Snowflake’s fully managed service that offers machine learning and AI solutions in the Data Cloud. It will also be available on Amazon Web Services, Microsoft Azure, Hugging Face, Lamini, NVIDIA API catalog, Perplexity and Together AI. When accessed in Snowflake Cortex, Arctic will accelerate customers’ ability to build production-grade AI apps at scale, within the security and governance perimeter of the Data Cloud.

Clement Delangue, CEO and co-founder at Hugging Face, concludes: “There has been a massive wave of open-source AI in the past few months. Snowflake is contributing significantly with this release not only of the model with an Apache 2.0 license but also with details on how it was trained. It gives the necessary transparency and control for enterprises to build AI and for the field as a whole to break new ground.”

Subscribe to our newsletter

Related content

WEBINAR

Upcoming Webinar: Best practices for buy-side data management across structured and unstructured data

Date: 14 November 2024 Time: 10:00am ET / 3:00pm London / 4:00pm CET Duration: 50 minutes Data management is central to asset management, but it can also be a challenge as firms face increased volumes of data, data complexity and the need to consolidate structured and unstructured data to gain valuable insights, improve decision-making, step...

BLOG

Return on Investment Remains a Challenge for Financial Institutions Migrating Data to Cloud

Migrating data and apps to cloud can be a game changer for financial institutions. It can also be more expensive than expected and raise issues around data quality, governance, security, access and integration. A clear data strategy with a defined goal, and an understanding of what can and cannot benefit from a move to cloud,...

EVENT

TradingTech Summit London

Now in its 14th year the TradingTech Summit London brings together the European trading technology capital markets industry and examines the latest changes and innovations in trading technology and explores how technology is being deployed to create an edge in sell side and buy side capital markets financial institutions.

GUIDE

The Data Management Implications of Solvency II

This special report accompanies a webinar we held on the popular topic of The Data Management Implications of Solvency II, discussing the data implications for asset managers and their custodians and asset servicers. You can register here to get immediate access to the Special Report.