{"id":24276,"date":"2024-01-02T18:00:00","date_gmt":"2024-01-02T18:00:00","guid":{"rendered":"https:\/\/www.prnasia.com\/story\/archive\/4302531_HK02531_0"},"modified":"2024-01-02T18:00:00","modified_gmt":"2024-01-02T18:00:00","slug":"neuchips-to-showcase-industry-leading-gen-ai-inferencing-accelerators-at-ces-2024","status":"publish","type":"post","link":"https:\/\/transmediavictoria.net.au\/?p=24276","title":{"rendered":"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024"},"content":{"rendered":"\n<p><span class=\"legendSpanClass\"><span class=\"xn-location\">LAS VEGAS, Nev.<\/span>, Jan. 3, 2024 \/PRNewswire\/ &#8212;&nbsp;<b><a href=\"https:\/\/www.neuchips.ai\/\" target=\"_blank\" rel=\"nofollow noopener\">Neuchips<\/a><\/b>, a leading AI Application-Specific Integrated Circuits (<span>ASIC<\/span>) solutions provider, will demo its revolutionary <b>Raptor Gen AI accelerator chip <\/b>(previously named N3000) and <b>Evo<\/b> <b>PCIe accelerator card<\/b> LLM solutions at <b>CES 2024<\/b>. Raptor, the new chip solution, enables enterprises to deploy large language models (LLMs) inference at a fraction of the cost of existing solutions.<\/span><\/p>\n<div class=\"PRN_ImbeddedAssetReference\" id=\"DivAssetPlaceHolder1\">\n<p style=\"TEXT-ALIGN: center; WIDTH: 100%\"> <a href=\"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.html\" target=\"_blank\" rel=\"nofollow noopener\"> <img decoding=\"async\" src=\"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600\" title=\"Raptor Gen AI Accelerator Powers Breakthrough LLM Performance\" alt=\"Raptor Gen AI Accelerator Powers Breakthrough LLM Performance\" \/> <\/a> <br \/><span>Raptor Gen AI Accelerator Powers Breakthrough LLM Performance<\/span><\/p>\n<\/p><\/div>\n<p>&quot;We are thrilled to unveil our Raptor chip and Evo card to the industry at CES 2024,&quot; said <span class=\"xn-person\">Ken Lau<\/span>, CEO of Neuchips. &quot;Neuchips&#8217; solutions represent a massive leap in price to performance for natural language processing. With Neuchips, any organisation can now access the power of LLMs for a wide range of AI applications.&quot;<\/p>\n<p><b>Democratising Access to LLMs<\/b><\/p>\n<p>Together, Raptor and Evo provide an optimised stack that makes market-leading LLMs readily accessible for enterprises. Neuchips&#8217; AI solutions significantly reduce hardware costs compared to existing solutions. The high energy efficiency also minimizes electricity usage, further lowering the total cost of ownership.<\/p>\n<p>At CES 2024, Neuchips will demo Raptor and Evo, accelerating the Whisper and Llama AI chatbots on a Personal AI Assistant application. This solution highlights the power of LLM inferencing for real business needs.<\/p>\n<p><b>Enterprises interested in test-driving Neuchips&#8217; breakthrough performance can visit booth 62700 to enrol in a free trial program. Additional technical sessions will showcase how Raptor and Evo can slash deployment costs for <span id=\"spanHghlt3914\">speech-to-text applications.<\/span><\/b><\/p>\n<p><b>Raptor Gen AI Accelerator Powers Breakthrough LLM Performance<\/b><\/p>\n<p>The Raptor chip delivers up to 200 tera operations per second (TOPS) per chip. Its outstanding performance for AI inferencing operations such as Matrix Multiply, Vector, and embedding table lookup suits Gen-AI and transformer-based AI models. This groundbreaking throughput is achieved via Neuchips&#8217; patented compression and efficiency optimisations tailored to neural networks.<\/p>\n<p><b>Evo Gen 5 PCIe Card Sets New Standard for Acceleration and Low Power Consumption<\/b><\/p>\n<p>Complementing Raptor is Neuchips&#8217; ultra-low powered Evo acceleration card. Evo combines PCIe Gen 5 with eight lanes and LPDDR5 32GB to achieve 64GB\/s host I\/O bandwidth and <span id=\"spanHghlt746c\">1.6-Tbps<\/span> per second of memory bandwidth at just 55 watts per card.<\/p>\n<p>As demonstrated with DLRM, Evo also features 100% scalability, allowing customers to linearly increase performance by adding more chips. This modular design ensures investment protection for future AI workloads.<\/p>\n<p>An upcoming half-height half-length (HHHL) form factor product, Viper, set to be launched by the second half of 2024, will provide even greater deployment flexibility. The new series brings data centre-class AI acceleration in a compact design.<\/p>\n<p>More information about Neuchips&#8217; involvement at CES 2024 can be found at <a href=\"http:\/\/www.neuchips.ai\/\" target=\"_blank\" rel=\"nofollow noopener\">www.neuchips.ai<\/a>.<\/p>\n<p><b>Booth Information&nbsp; <br \/><\/b>Date: 9 \u2013 <span class=\"xn-chron\">12 January 2024<\/span><br \/>Location: Westgate Las Vegas &amp; Las Vegas Convention and World Trade Center (LVCC)<br \/>Booth Number: 62700<\/p>\n<p><b>About Neuchips <\/b><\/p>\n<p>Neuchips is at the forefront of AI <span>ASIC<\/span> solutions, pioneering the development of purpose-built hardware for DLRM and LLM. With our dedicated team of experts, a commitment to innovation, and a strong presence in industry organizations, we are poised to continue shaping the future of AI hardware and ushering in a new era of efficiency and performance.<\/p>\n<div class=\"PRN_ImbeddedAssetReference\" id=\"DivAssetPlaceHolder2\">\n<p style=\"TEXT-ALIGN: center; WIDTH: 100%\"> <a href=\"https:\/\/mma.prnasia.com\/media2\/2309403\/Evo_1.html\" target=\"_blank\" rel=\"nofollow noopener\"> <img decoding=\"async\" src=\"https:\/\/mma.prnasia.com\/media2\/2309403\/Evo_1.jpg?p=medium600\" title=\"Evo Gen 5 PCIe Card Sets New Standard for Acceleration and Low Power Consumption\" alt=\"Evo Gen 5 PCIe Card Sets New Standard for Acceleration and Low Power Consumption\" \/> <\/a> <br \/><span>Evo Gen 5 PCIe Card Sets New Standard for Acceleration and Low Power Consumption<\/span><\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>LAS VEGAS, Nev., Jan. 3, 2024 \/PRNewswire\/ &#8212;&nbsp;Neuchips, a leading AI Application-Specific Integrated Circuits (ASIC) solutions provider, will demo its revolutionary Raptor Gen AI accelerator chip (previously named N3000) and Evo PCIe accelerator card LLM solutions at CES 2024. Raptor, the new chip solution, enables enterprises to deploy large language models (LLMs) inference at a [&hellip;]<\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-24276","post","type-post","status-publish","format-standard","hentry","category-business-news"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024 - My Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/transmediavictoria.net.au\/?p=24276\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024 - My Blog\" \/>\n<meta property=\"og:description\" content=\"LAS VEGAS, Nev., Jan. 3, 2024 \/PRNewswire\/ &#8212;&nbsp;Neuchips, a leading AI Application-Specific Integrated Circuits (ASIC) solutions provider, will demo its revolutionary Raptor Gen AI accelerator chip (previously named N3000) and Evo PCIe accelerator card LLM solutions at CES 2024. Raptor, the new chip solution, enables enterprises to deploy large language models (LLMs) inference at a [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/transmediavictoria.net.au\/?p=24276\" \/>\n<meta property=\"og:site_name\" content=\"My Blog\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-02T18:00:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600\" \/>\n<meta name=\"author\" content=\"admin_tony\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin_tony\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276\"},\"author\":{\"name\":\"admin_tony\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#\\\/schema\\\/person\\\/5b51d407d652c0aa802bea269ea5d7e7\"},\"headline\":\"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024\",\"datePublished\":\"2024-01-02T18:00:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276\"},\"wordCount\":530,\"image\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2309402\\\/Raptor_3.jpg?p=medium600\",\"articleSection\":[\"Business News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276\",\"url\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276\",\"name\":\"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024 - My Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2309402\\\/Raptor_3.jpg?p=medium600\",\"datePublished\":\"2024-01-02T18:00:00+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#\\\/schema\\\/person\\\/5b51d407d652c0aa802bea269ea5d7e7\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#primaryimage\",\"url\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2309402\\\/Raptor_3.jpg?p=medium600\",\"contentUrl\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2309402\\\/Raptor_3.jpg?p=medium600\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=24276#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/transmediavictoria.net.au\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#website\",\"url\":\"https:\\\/\\\/transmediavictoria.net.au\\\/\",\"name\":\"My Blog\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#\\\/schema\\\/person\\\/5b51d407d652c0aa802bea269ea5d7e7\",\"name\":\"admin_tony\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g\",\"caption\":\"admin_tony\"},\"url\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?author=8\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024 - My Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/transmediavictoria.net.au\/?p=24276","og_locale":"en_US","og_type":"article","og_title":"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024 - My Blog","og_description":"LAS VEGAS, Nev., Jan. 3, 2024 \/PRNewswire\/ &#8212;&nbsp;Neuchips, a leading AI Application-Specific Integrated Circuits (ASIC) solutions provider, will demo its revolutionary Raptor Gen AI accelerator chip (previously named N3000) and Evo PCIe accelerator card LLM solutions at CES 2024. Raptor, the new chip solution, enables enterprises to deploy large language models (LLMs) inference at a [&hellip;]","og_url":"https:\/\/transmediavictoria.net.au\/?p=24276","og_site_name":"My Blog","article_published_time":"2024-01-02T18:00:00+00:00","og_image":[{"url":"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600","type":"","width":"","height":""}],"author":"admin_tony","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin_tony","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/transmediavictoria.net.au\/?p=24276#article","isPartOf":{"@id":"https:\/\/transmediavictoria.net.au\/?p=24276"},"author":{"name":"admin_tony","@id":"https:\/\/transmediavictoria.net.au\/#\/schema\/person\/5b51d407d652c0aa802bea269ea5d7e7"},"headline":"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024","datePublished":"2024-01-02T18:00:00+00:00","mainEntityOfPage":{"@id":"https:\/\/transmediavictoria.net.au\/?p=24276"},"wordCount":530,"image":{"@id":"https:\/\/transmediavictoria.net.au\/?p=24276#primaryimage"},"thumbnailUrl":"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600","articleSection":["Business News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/transmediavictoria.net.au\/?p=24276","url":"https:\/\/transmediavictoria.net.au\/?p=24276","name":"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024 - My Blog","isPartOf":{"@id":"https:\/\/transmediavictoria.net.au\/#website"},"primaryImageOfPage":{"@id":"https:\/\/transmediavictoria.net.au\/?p=24276#primaryimage"},"image":{"@id":"https:\/\/transmediavictoria.net.au\/?p=24276#primaryimage"},"thumbnailUrl":"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600","datePublished":"2024-01-02T18:00:00+00:00","author":{"@id":"https:\/\/transmediavictoria.net.au\/#\/schema\/person\/5b51d407d652c0aa802bea269ea5d7e7"},"breadcrumb":{"@id":"https:\/\/transmediavictoria.net.au\/?p=24276#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/transmediavictoria.net.au\/?p=24276"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/transmediavictoria.net.au\/?p=24276#primaryimage","url":"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600","contentUrl":"https:\/\/mma.prnasia.com\/media2\/2309402\/Raptor_3.jpg?p=medium600"},{"@type":"BreadcrumbList","@id":"https:\/\/transmediavictoria.net.au\/?p=24276#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/transmediavictoria.net.au\/"},{"@type":"ListItem","position":2,"name":"Neuchips to Showcase Industry-Leading Gen AI Inferencing Accelerators at CES 2024"}]},{"@type":"WebSite","@id":"https:\/\/transmediavictoria.net.au\/#website","url":"https:\/\/transmediavictoria.net.au\/","name":"My Blog","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/transmediavictoria.net.au\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/transmediavictoria.net.au\/#\/schema\/person\/5b51d407d652c0aa802bea269ea5d7e7","name":"admin_tony","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g","caption":"admin_tony"},"url":"https:\/\/transmediavictoria.net.au\/?author=8"}]}},"_links":{"self":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/posts\/24276","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=24276"}],"version-history":[{"count":0,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/posts\/24276\/revisions"}],"wp:attachment":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=24276"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=24276"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=24276"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}