{"id":17648,"date":"2024-07-10T04:54:52","date_gmt":"2024-07-10T04:54:52","guid":{"rendered":"https:\/\/metaverseplanet.net\/blog\/?p=17648"},"modified":"2026-01-23T10:46:46","modified_gmt":"2026-01-23T10:46:46","slug":"meta-ai-develops-a-more-compact-language-model-for-mobile-devices","status":"publish","type":"post","link":"https:\/\/metaverseplanet.net\/blog\/meta-ai-develops-a-more-compact-language-model-for-mobile-devices\/","title":{"rendered":"Meta AI Develops a More Compact Language Model for Mobile Devices"},"content":{"rendered":"\n<p>Meta AI researchers have announced the development of MobileLLM, a compact language model designed specifically for mobile devices.<\/p>\n\n\n\n<p>Recently, smartphone manufacturers have been heavily investing in integrating artificial intelligence features into their devices. In line with this trend, Meta is developing a more compact language model for devices with limited capacity, such as mobile phones and tablets. This new model signifies a shift in the dimensions of efficient artificial intelligence.<\/p>\n\n\n\n<p>The collaboration between the Meta Reality Labs team, PyTorch, and Meta AI Research (FAIR) has resulted in a model with less than 1 billion parameters, making it a thousandth the size of larger models like GPT-4, which boasts over 1 trillion parameters.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">Artificial intelligence is shrinking!<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img decoding=\"async\" width=\"570\" height=\"449\" src=\"https:\/\/metaverseplanet.net\/blog\/wp-content\/uploads\/2024\/07\/Meta-AI-Develops-a-More-Compact-Language-Model-for-Mobile-Devices.jpeg\" alt=\"Meta AI Develops a More Compact Language Model for Mobile Devices\" class=\"wp-image-17649\" style=\"width:750px\" srcset=\"https:\/\/metaverseplanet.net\/blog\/wp-content\/uploads\/2024\/07\/Meta-AI-Develops-a-More-Compact-Language-Model-for-Mobile-Devices.jpeg 570w, https:\/\/metaverseplanet.net\/blog\/wp-content\/uploads\/2024\/07\/Meta-AI-Develops-a-More-Compact-Language-Model-for-Mobile-Devices-300x236.jpeg 300w, https:\/\/metaverseplanet.net\/blog\/wp-content\/uploads\/2024\/07\/Meta-AI-Develops-a-More-Compact-Language-Model-for-Mobile-Devices-150x118.jpeg 150w\" sizes=\"(max-width: 570px) 100vw, 570px\" \/><\/figure>\n\n\n\n<p>Yann LeCun, Meta&#8217;s chief artificial intelligence scientist, shared details of the research in a post on X. The language model, called MobileLLM, is set to bring artificial intelligence to smartphones and other devices.<\/p>\n\n\n\n<p>According to the study, smaller models can enhance performance by prioritizing depth over width. LeCun also mentioned that they increased efficiency on devices with storage constraints by employing advanced weight-sharing techniques. These techniques included embedded sharing, grouped queue queries, and block weight sharing.<\/p>\n\n\n\n<p>Another noteworthy point in the research is that MobileLLM, with only 350 million parameters, performed on par with the 7 billion parameter LLaMA-2 model.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<h3 class=\"wp-block-heading\"><a href=\"javascript:void(0)\"><\/a>You may also like this content<\/h3>\n\n\n<ul class=\"wp-block-latest-posts__list wp-block-latest-posts\"><\/ul>","protected":false},"excerpt":{"rendered":"<p>Meta AI researchers have announced the development of MobileLLM, a compact language model designed specifically for mobile devices. Recently, smartphone manufacturers have been heavily investing in integrating artificial intelligence features into their devices. In line with this trend, Meta is developing a more compact language model for devices with limited capacity, such as mobile phones &hellip;<\/p>\n","protected":false},"author":1,"featured_media":17238,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAown96uCw:productID":"","footnotes":""},"categories":[332],"tags":[335],"class_list":["post-17648","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-information","tag-ai-news"],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/posts\/17648","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/comments?post=17648"}],"version-history":[{"count":1,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/posts\/17648\/revisions"}],"predecessor-version":[{"id":40665,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/posts\/17648\/revisions\/40665"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/media\/17238"}],"wp:attachment":[{"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/media?parent=17648"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/categories?post=17648"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/metaverseplanet.net\/blog\/wp-json\/wp\/v2\/tags?post=17648"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}