{"id":50999,"date":"2024-08-12T12:37:53","date_gmt":"2024-08-12T09:37:53","guid":{"rendered":"https:\/\/saudishopper.com.sa\/en\/?p=50999"},"modified":"2026-03-28T06:18:50","modified_gmt":"2026-03-28T03:18:50","slug":"uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture","status":"publish","type":"post","link":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/","title":{"rendered":"UAE\u2019s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><em>The Falcon Mamba 7B is the no. 1 globally performing open source State Space Language Model (SSLM), as independently verified by Hugging Face<\/em><\/li>\n\n\n\n<li><em>SSLMs have a low memory cost and don\u2019t require additional memory to generate arbitrary long blocks of text<\/em><\/li>\n\n\n\n<li><em>Falcon Mamba 7B also outperforms traditional transformer architecture models such Meta\u2019s Llama 3.1 8B and Mistral\u2019s 7B<\/em><\/li>\n\n\n\n<li><em>New model reflects the innovation and pioneering approach of Abu Dhabi in AI research and development<\/em><\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Abu Dhabi-UAE: 12th August, 2024 &#8211;&nbsp;<\/strong>The&nbsp;<a href=\"https:\/\/checkpoint.url-protection.com\/v1\/r07\/url?o=https%3A\/\/www.tii.ae\/&amp;g=NjI5YzMzZTBjZDM1YmQxZA==&amp;h=OWU4YmZkMWQ1MjlmZTY4ZjEyMzRlNjdiOTRlZmUxNjNkMjYwMWVmNDE0NmU2YzA2MmJmYjY4Yjk3OWU0ZmJjZA==&amp;p=bWVjMTp0ZWNobm9sb2d5aW5ub3ZhdGlvbmluc3RpdHV0ZTpjOm86YTljNmNjYjE3ZjgyMDBkMmM4NjQ5MDBlNzM4ZTZkMjc6NzpwOlQ=\">Technology Innovation Institute<\/a>&nbsp;(TII), a leading global scientific research center and the applied research pillar of Abu Dhabi\u2019s&nbsp;<a href=\"https:\/\/checkpoint.url-protection.com\/v1\/r07\/url?o=https%3A\/\/www.atrc.gov.ae\/&amp;g=ZjNhMGE1NTVhNzgyZjNmYg==&amp;h=ZTU3MjRhODhlOWJiNzZjYzRlMGFhYmM5ODQzNTc2NDQwMDVkNzQ4YjhkZGVmZjlkZWU3NjMxZjI2ZmYyM2Y2Mg==&amp;p=bWVjMTp0ZWNobm9sb2d5aW5ub3ZhdGlvbmluc3RpdHV0ZTpjOm86YTljNmNjYjE3ZjgyMDBkMmM4NjQ5MDBlNzM4ZTZkMjc6NzpwOlQ=\">Advanced Technology Research Council<\/a>&nbsp;(ATRC),&nbsp;has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/Falcon-Mamba-7B_ssict_953_911.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"953\" height=\"911\" src=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/Falcon-Mamba-7B_ssict_953_911.webp\" alt=\"Falcon Mamba 7B_ssict_953_911\" class=\"wp-image-51000\" srcset=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/Falcon-Mamba-7B_ssict_953_911.webp 953w, https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/Falcon-Mamba-7B_ssict_953_911-300x287.webp 300w, https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/Falcon-Mamba-7B_ssict_953_911-768x734.webp 768w\" sizes=\"(max-width: 953px) 100vw, 953px\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said:&nbsp;\u201cThe Falcon Mamba 7B marks TII\u2019s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE\u2019s unwavering commitment to innovation.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For transformer architecture models, Falcon Mamba 7B outperforms Meta\u2019s Llama 3.1 8B, Llama 3 8B, and Mistral\u2019s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace\u2019s new tougher benchmark leaderboard.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Dr. Najwa Aaraj, Chief Executive of TII, said: \u201cThe Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Dr. Hakim Hacid, Acting Chief Researcher of the TII\u2019s AI Cross-Center Unit, said: \u201cAs we introduce the Falcon Mamba 7B, I\u2019m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we\u2019re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"360\" src=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422-1024x360.webp\" alt=\"edlman_ssict_1200_422\" class=\"wp-image-51001\" srcset=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422-1024x360.webp 1024w, https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422-300x106.webp 300w, https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422-768x270.webp 768w, https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422-1080x380.webp 1080w, https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2024\/08\/edlman_ssict_1200_422.webp 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Abu Dhabi-UAE: 12th August, 2024 &#8211;&nbsp;The&nbsp;Technology Innovation Institute&nbsp;(TII), a leading global scientific research center and the applied research pillar of Abu Dhabi\u2019s&nbsp;Advanced Technology Research Council&nbsp;(ATRC),&nbsp;has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) [&hellip;]<\/p>\n","protected":false},"author":16,"featured_media":17916,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_yoast_wpseo_meta-robots-noindex":"","_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","_pr_autopilot_social_copy":"","_yoast_wpseo_opengraph_title":"","_yoast_wpseo_opengraph_description":"","_yoast_wpseo_opengraph_image":"","_yoast_wpseo_opengraph_image_id":0,"_yoast_wpseo_twitter_title":"","_yoast_wpseo_twitter_description":"","_yoast_wpseo_twitter_image":"","_yoast_wpseo_twitter_image_id":0,"_yoast_wpseo_primary_category":28,"_extra_hide_author_box":"","_extra_featured_post":"","_partner_post_id":0,"footnotes":""},"categories":[449],"tags":[],"class_list":["post-50999","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","et-has-post-format-content","et_post_format-et-post-format-standard"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Falcon Mamba 7B - New AI Architecture | Saudi Shopper<\/title>\n<meta name=\"description\" content=\"Falcon Mamba 7B is a top open source SSLM with low memory cost, beating Llama 3.1 8B and Mistral 7B in tests.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Falcon Mamba 7B - New AI Architecture | Saudi Shopper\" \/>\n<meta property=\"og:description\" content=\"Falcon Mamba 7B is a top open source SSLM with low memory cost, beating Llama 3.1 8B and Mistral 7B in tests.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/\" \/>\n<meta property=\"og:site_name\" content=\"Saudishopper\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SaudiShopper\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/zamil\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-12T09:37:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-28T03:18:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/12\/TII-logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"661\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Zamil Safwan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@zsafwan\" \/>\n<meta name=\"twitter:site\" content=\"@ssict\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Zamil Safwan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/\"},\"author\":{\"name\":\"Zamil Safwan\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#\\\/schema\\\/person\\\/8351552105da6d5a684fb7e010f12047\"},\"headline\":\"UAE\u2019s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture\",\"datePublished\":\"2024-08-12T09:37:53+00:00\",\"dateModified\":\"2026-03-28T03:18:50+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/\"},\"wordCount\":637,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/TII-logo.jpg\",\"articleSection\":[\"Artificial Intelligence\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#respond\"]}],\"copyrightYear\":\"2024\",\"copyrightHolder\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/\",\"url\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/\",\"name\":\"Falcon Mamba 7B - New AI Architecture | Saudi Shopper\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/TII-logo.jpg\",\"datePublished\":\"2024-08-12T09:37:53+00:00\",\"dateModified\":\"2026-03-28T03:18:50+00:00\",\"description\":\"Falcon Mamba 7B is a top open source SSLM with low memory cost, beating Llama 3.1 8B and Mistral 7B in tests.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#primaryimage\",\"url\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/TII-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/TII-logo.jpg\",\"width\":1200,\"height\":661,\"caption\":\"TII logo\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"UAE\u2019s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/\",\"name\":\"Saudishopper\",\"description\":\"Saudi ICT Shopper News\",\"publisher\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#organization\",\"name\":\"Saudi ICT News\",\"alternateName\":\"Saudi ICT Shopper News\",\"url\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/08\\\/SSTrans.png\",\"contentUrl\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/08\\\/SSTrans.png\",\"width\":423,\"height\":165,\"caption\":\"Saudi ICT News\"},\"image\":{\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/SaudiShopper\",\"https:\\\/\\\/x.com\\\/ssict\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/#\\\/schema\\\/person\\\/8351552105da6d5a684fb7e010f12047\",\"name\":\"Zamil Safwan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a483a8920db50e1d6142462856d7925f4a9543091c79df709d1380ea7fbef8ec?s=96&d=https%3A%2F%2Fsaudishopper.com.sa%2Fen%2Fwp-content%2Fuploads%2F2020%2F12%2Fcropped-ss-icon--150x150.png&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a483a8920db50e1d6142462856d7925f4a9543091c79df709d1380ea7fbef8ec?s=96&d=https%3A%2F%2Fsaudishopper.com.sa%2Fen%2Fwp-content%2Fuploads%2F2020%2F12%2Fcropped-ss-icon--150x150.png&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a483a8920db50e1d6142462856d7925f4a9543091c79df709d1380ea7fbef8ec?s=96&d=https%3A%2F%2Fsaudishopper.com.sa%2Fen%2Fwp-content%2Fuploads%2F2020%2F12%2Fcropped-ss-icon--150x150.png&r=g\",\"caption\":\"Zamil Safwan\"},\"description\":\"An experienced technologist with expertise spanning Digital Transformation, E-commerce, Start-ups, and Fintech. Zamil offers insightful analysis on the convergence of finance and technology in the evolving digital landscape.\",\"sameAs\":[\"https:\\\/\\\/zsafwan.net\",\"https:\\\/\\\/www.facebook.com\\\/zamil\",\"https:\\\/\\\/x.com\\\/@zsafwan\"],\"url\":\"https:\\\/\\\/saudishopper.com.sa\\\/en\\\/author\\\/zamil\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Falcon Mamba 7B - New AI Architecture | Saudi Shopper","description":"Falcon Mamba 7B is a top open source SSLM with low memory cost, beating Llama 3.1 8B and Mistral 7B in tests.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/","og_locale":"en_US","og_type":"article","og_title":"Falcon Mamba 7B - New AI Architecture | Saudi Shopper","og_description":"Falcon Mamba 7B is a top open source SSLM with low memory cost, beating Llama 3.1 8B and Mistral 7B in tests.","og_url":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/","og_site_name":"Saudishopper","article_publisher":"https:\/\/www.facebook.com\/SaudiShopper","article_author":"https:\/\/www.facebook.com\/zamil","article_published_time":"2024-08-12T09:37:53+00:00","article_modified_time":"2026-03-28T03:18:50+00:00","og_image":[{"width":1200,"height":661,"url":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/12\/TII-logo.jpg","type":"image\/jpeg"}],"author":"Zamil Safwan","twitter_card":"summary_large_image","twitter_creator":"@zsafwan","twitter_site":"@ssict","twitter_misc":{"Written by":"Zamil Safwan","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#article","isPartOf":{"@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/"},"author":{"name":"Zamil Safwan","@id":"https:\/\/saudishopper.com.sa\/en\/#\/schema\/person\/8351552105da6d5a684fb7e010f12047"},"headline":"UAE\u2019s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture","datePublished":"2024-08-12T09:37:53+00:00","dateModified":"2026-03-28T03:18:50+00:00","mainEntityOfPage":{"@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/"},"wordCount":637,"commentCount":0,"publisher":{"@id":"https:\/\/saudishopper.com.sa\/en\/#organization"},"image":{"@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#primaryimage"},"thumbnailUrl":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/12\/TII-logo.jpg","articleSection":["Artificial Intelligence"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#respond"]}],"copyrightYear":"2024","copyrightHolder":{"@id":"https:\/\/saudishopper.com.sa\/en\/#organization"}},{"@type":"WebPage","@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/","url":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/","name":"Falcon Mamba 7B - New AI Architecture | Saudi Shopper","isPartOf":{"@id":"https:\/\/saudishopper.com.sa\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#primaryimage"},"image":{"@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#primaryimage"},"thumbnailUrl":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/12\/TII-logo.jpg","datePublished":"2024-08-12T09:37:53+00:00","dateModified":"2026-03-28T03:18:50+00:00","description":"Falcon Mamba 7B is a top open source SSLM with low memory cost, beating Llama 3.1 8B and Mistral 7B in tests.","breadcrumb":{"@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#primaryimage","url":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/12\/TII-logo.jpg","contentUrl":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/12\/TII-logo.jpg","width":1200,"height":661,"caption":"TII logo"},{"@type":"BreadcrumbList","@id":"https:\/\/saudishopper.com.sa\/en\/uaes-technology-innovation-institute-revolutionizes-ai-language-models-with-new-architecture\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/saudishopper.com.sa\/en\/"},{"@type":"ListItem","position":2,"name":"UAE\u2019s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture"}]},{"@type":"WebSite","@id":"https:\/\/saudishopper.com.sa\/en\/#website","url":"https:\/\/saudishopper.com.sa\/en\/","name":"Saudishopper","description":"Saudi ICT Shopper News","publisher":{"@id":"https:\/\/saudishopper.com.sa\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/saudishopper.com.sa\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/saudishopper.com.sa\/en\/#organization","name":"Saudi ICT News","alternateName":"Saudi ICT Shopper News","url":"https:\/\/saudishopper.com.sa\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/saudishopper.com.sa\/en\/#\/schema\/logo\/image\/","url":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/08\/SSTrans.png","contentUrl":"https:\/\/saudishopper.com.sa\/en\/wp-content\/uploads\/2020\/08\/SSTrans.png","width":423,"height":165,"caption":"Saudi ICT News"},"image":{"@id":"https:\/\/saudishopper.com.sa\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SaudiShopper","https:\/\/x.com\/ssict"]},{"@type":"Person","@id":"https:\/\/saudishopper.com.sa\/en\/#\/schema\/person\/8351552105da6d5a684fb7e010f12047","name":"Zamil Safwan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/a483a8920db50e1d6142462856d7925f4a9543091c79df709d1380ea7fbef8ec?s=96&d=https%3A%2F%2Fsaudishopper.com.sa%2Fen%2Fwp-content%2Fuploads%2F2020%2F12%2Fcropped-ss-icon--150x150.png&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/a483a8920db50e1d6142462856d7925f4a9543091c79df709d1380ea7fbef8ec?s=96&d=https%3A%2F%2Fsaudishopper.com.sa%2Fen%2Fwp-content%2Fuploads%2F2020%2F12%2Fcropped-ss-icon--150x150.png&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a483a8920db50e1d6142462856d7925f4a9543091c79df709d1380ea7fbef8ec?s=96&d=https%3A%2F%2Fsaudishopper.com.sa%2Fen%2Fwp-content%2Fuploads%2F2020%2F12%2Fcropped-ss-icon--150x150.png&r=g","caption":"Zamil Safwan"},"description":"An experienced technologist with expertise spanning Digital Transformation, E-commerce, Start-ups, and Fintech. Zamil offers insightful analysis on the convergence of finance and technology in the evolving digital landscape.","sameAs":["https:\/\/zsafwan.net","https:\/\/www.facebook.com\/zamil","https:\/\/x.com\/@zsafwan"],"url":"https:\/\/saudishopper.com.sa\/en\/author\/zamil\/"}]}},"_links":{"self":[{"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/posts\/50999","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/comments?post=50999"}],"version-history":[{"count":1,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/posts\/50999\/revisions"}],"predecessor-version":[{"id":75035,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/posts\/50999\/revisions\/75035"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/media\/17916"}],"wp:attachment":[{"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/media?parent=50999"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/categories?post=50999"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/saudishopper.com.sa\/en\/wp-json\/wp\/v2\/tags?post=50999"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}