Microsoft releases Phi-2, a small language model AI that outperforms Llama 2, Mistral 7B – VentureBeat

Microsoft releases Phi-2, a small language model AI that outperforms Llama 2, Mistral 7B – VentureBeat

Are you ready to bring more awareness to your brand? Consider becoming a sponsor for The AI Impact Tour. Learn more about the opportunities here.

The rapid pace of generative AI news and announcements isn’t slowing down, even as we reach the final stretches of 2023 and the traditional winter holiday quiet period.
Just take a look at Microsoft Research, the blue sky division of the software giant, which today announced the release of its Phi-2 small language model (SML), a text-to-text AI program that is “small enough to run on a laptop or mobile device,” according to a post on X.
At the same time, Phi-2 with its 2.7 billion parameters (connections between artificial neurons) boasts performance that is comparable to other, much larger models including Meta’s Llama 2-7B with its 7 billion parameters and even Mistral-7B, another 7 billion parameter model.
Microsoft researchers also noted in their blog post on the Phi-2 release that it outperforms Google’s brand new Gemini Nano 2 model despite it having half a billion more parameters, and delivers less “toxicity” and bias in its responses than Llama 2.
The AI Impact Tour
Connect with the enterprise AI community at VentureBeat’s AI Impact Tour coming to a city near you!
 
Microsoft also couldn’t resist taking a little dig at Google’s now much-criticized, staged demo video for Gemini in which it showed off how its forthcoming largest and most powerful new AI model, Gemini Ultra, was able to solve fairly complex physics problems and even correct students’ mistakes on them. As it turned out, even though it is likely a fraction of the size of Gemini Ultra, Phi-2 also was able to correctly answer the question and correct the student using the same prompts.
However, despite these encouraging findings, there is a big limitation with Phi-2, at least for the time being: it is licensed only for “research purposes only,” not commercial usage, under a custom Microsoft Research License, which further states Phi-2 may only be used for “non-commercial, non-revenue generating, research purposes.” So, businesses looking to build products atop it are out of luck.
VentureBeat’s mission is to be a digital town square for technical decision-makers to gain knowledge about transformative enterprise technology and transact. Discover our Briefings.
Join us for an evening full of networking and insights at VentureBeat’s AI Impact Tour, coming to San Francisco, New York, and Los Angeles!
© 2023 VentureBeat. All rights reserved.

source


Comments

Leave a Reply

Your email address will not be published. Required fields are marked *