{"id":38643,"date":"2025-07-31T10:53:00","date_gmt":"2025-07-31T10:53:00","guid":{"rendered":"https:\/\/www.prnasia.com\/story\/archive\/4741736_CN41736_0"},"modified":"2025-07-31T10:53:00","modified_gmt":"2025-07-31T10:53:00","slug":"zilliz-sets-new-industry-standard-with-vdbbench-1-0-for-benchmarking-real-vector-database-production-workloads","status":"publish","type":"post","link":"https:\/\/transmediavictoria.net.au\/?p=38643","title":{"rendered":"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads"},"content":{"rendered":"<table name=\"logo_release\" border=\"0\" cellspacing=\"10\" cellpadding=\"5\" align=\"right\">\n<tbody>\n<tr>\n<td><img decoding=\"async\" src=\"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600\" border=\"0\" alt title=\"logo\" hspace=\"0\" vspace=\"0\" width=\"118\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><i>This Open-source solution eliminates the multi-billion-dollar gap between benchmark promises and production reality.<\/i><\/p>\n<p><span class=\"legendSpanClass\">REDWOOD CITY, Calif.&nbsp;<\/span>, <span class=\"legendSpanClass\"><span class=\"xn-chron\">July 31, 2025<\/span><\/span> \/PRNewswire\/ &#8212;&nbsp;<u><a href=\"https:\/\/zilliz.com\/?utm_source=vendor&amp;utm_medium=referral&amp;utm_campaign=vdbbench\" target=\"_blank\" rel=\"nofollow noopener\">Zilliz<\/a><\/u>, the company behind the popular open-source vector database <u><a href=\"https:\/\/milvus.io\/?utm_source=vendor&amp;utm_medium=referral&amp;utm_campaign=vdbbench\" target=\"_blank\" rel=\"nofollow noopener\">Milvus<\/a><\/u>, recently announced the release of <u><a href=\"https:\/\/milvus.io\/blog\/vdbbench-1-0-benchmarking-with-your-real-world-production-workloads.md?utm_source=vendor&amp;utm_medium=referral&amp;utm_campaign=vdbbench\" target=\"_blank\" rel=\"nofollow noopener\">VDBBench 1.0<\/a><\/u>, an open-source benchmarking platform designed to test vector databases under realistic production conditions. Unlike traditional benchmarks that rely on static data and idealized scenarios, VDBBench evaluates systems during streaming data ingestion, metadata filtering, and concurrent workloads that mirror actual enterprise deployments.<\/p>\n<p>&#8220;The vector database market has experienced explosive growth since 2023, but our benchmarking methodologies haven&#8217;t kept pace,&#8221; said <span class=\"xn-person\">James Luan<\/span>, VP of Engineering at Zilliz. &#8220;Organizations are making multi-million dollar infrastructure decisions based on misleading benchmarks that don&#8217;t reflect production realities. VDBBench 1.0 fundamentally changes this dynamic by establishing new standards for authentic, production-relevant performance evaluation.&#8221;<\/p>\n<p> What&#8217;s New in VDBBench 1.0 <\/p>\n<ul type=\"disc\">\n<li><b>Advanced Filtering Analysis<\/b>: Systematically tests metadata filtering across selectivity levels (50% to 99.9%), revealing the &#8220;hidden performance killer&#8221; that dramatically impacts query speeds and recall accuracy in production.<\/li>\n<li><b>Streaming Read\/Write Testing<\/b>: Simulates continuous data ingestion while serving queries, conditions where many databases fail despite impressive static benchmarks.<\/li>\n<li><b>Modern&nbsp;Datasets<\/b>: Uses vectors from state-of-the-art embedding models, including OpenAI and Cohere, with dimensions ranging from 768 to 1,536, reflecting current AI workloads.<\/li>\n<li><b>Custom&nbsp;Dataset Support<\/b>: Organizations can benchmark using their production data and embedding models for industry-specific testing requirements.<\/li>\n<li><b>Production-Focused Metrics<\/b>: Prioritizes P95\/P99 tail latency, sustainable throughput under load, and recall accuracy for realistic capacity planning.<\/li>\n<\/ul>\n<p>VDBBench also features a redesigned dashboard with interactive visualizations that help engineers quickly identify performance gaps. Testing results for major platforms including Milvus, Zilliz Cloud, Pinecone, and Elasticsearch are available on the VDBBench Leaderboard.<\/p>\n<p> Open Source Availability <\/p>\n<p>VDBBench is available on GitHub with complete documentation and community support. Organizations ready to move beyond misleading benchmarks can access the platform immediately and customize it for specific testing requirements.<\/p>\n<p><u><a href=\"https:\/\/github.com\/zilliztech\/VectorDBBench\/releases\/tag\/v1.0.0\" target=\"_blank\" rel=\"nofollow noopener\">Download VDBBench 1.0 \u2192<\/a><\/u>&nbsp;|<u><a href=\"https:\/\/zilliz.com\/vdbbench-leaderboard?dataset=vectorSearch&amp;__hstc=175614333.dc4bcf53f6c7d650ea8978dcdb9e7009.1727350436713.1753950817927.1753955149890.743&amp;__hssc=175614333.1.1753955149890&amp;__hsfp=1940526538\" target=\"_blank\" rel=\"nofollow noopener\">&nbsp;View Leaderboard \u2192<\/a><\/u> | <u><a href=\"https:\/\/zilliz.com\/contact-sales?utm_source=vendor&amp;utm_medium=referral&amp;utm_campaign=vdbbench\" target=\"_blank\" rel=\"nofollow noopener\">Contact us for Support<\/a><\/u><\/p>\n<p> <b>About Zilliz<\/b> <\/p>\n<p>Zilliz builds next-generation database technologies that help organizations unlock the value of unstructured data and rapidly develop AI applications. Headquartered in Redwood Shores, <span class=\"xn-location\">California<\/span>, Zilliz is backed by leading investors, including Aramco&#8217;s Prosperity7 Ventures and Temasek&#8217;s Pavilion Capital. Learn more at <a href=\"https:\/\/www.zilliz.com\" target=\"_blank\" rel=\"nofollow noopener\">www.zilliz.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This Open-source solution eliminates the multi-billion-dollar gap between benchmark promises and production reality. REDWOOD CITY, Calif.&nbsp;, July 31, 2025 \/PRNewswire\/ &#8212;&nbsp;Zilliz, the company behind the popular open-source vector database Milvus, recently announced the release of VDBBench 1.0, an open-source benchmarking platform designed to test vector databases under realistic production conditions. Unlike traditional benchmarks that rely [&hellip;]<\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-38643","post","type-post","status-publish","format-standard","hentry","category-business-news"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads - My Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/transmediavictoria.net.au\/?p=38643\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads - My Blog\" \/>\n<meta property=\"og:description\" content=\"This Open-source solution eliminates the multi-billion-dollar gap between benchmark promises and production reality. REDWOOD CITY, Calif.&nbsp;, July 31, 2025 \/PRNewswire\/ &#8212;&nbsp;Zilliz, the company behind the popular open-source vector database Milvus, recently announced the release of VDBBench 1.0, an open-source benchmarking platform designed to test vector databases under realistic production conditions. Unlike traditional benchmarks that rely [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/transmediavictoria.net.au\/?p=38643\" \/>\n<meta property=\"og:site_name\" content=\"My Blog\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-31T10:53:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600\" \/>\n<meta name=\"author\" content=\"admin_tony\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin_tony\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643\"},\"author\":{\"name\":\"admin_tony\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#\\\/schema\\\/person\\\/5b51d407d652c0aa802bea269ea5d7e7\"},\"headline\":\"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads\",\"datePublished\":\"2025-07-31T10:53:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643\"},\"wordCount\":377,\"image\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2713871\\\/zilliz_milvus_Logo.jpg?p=medium600\",\"articleSection\":[\"Business News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643\",\"url\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643\",\"name\":\"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads - My Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2713871\\\/zilliz_milvus_Logo.jpg?p=medium600\",\"datePublished\":\"2025-07-31T10:53:00+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#\\\/schema\\\/person\\\/5b51d407d652c0aa802bea269ea5d7e7\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#primaryimage\",\"url\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2713871\\\/zilliz_milvus_Logo.jpg?p=medium600\",\"contentUrl\":\"https:\\\/\\\/mma.prnasia.com\\\/media2\\\/2713871\\\/zilliz_milvus_Logo.jpg?p=medium600\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?p=38643#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/transmediavictoria.net.au\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#website\",\"url\":\"https:\\\/\\\/transmediavictoria.net.au\\\/\",\"name\":\"My Blog\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/transmediavictoria.net.au\\\/#\\\/schema\\\/person\\\/5b51d407d652c0aa802bea269ea5d7e7\",\"name\":\"admin_tony\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g\",\"caption\":\"admin_tony\"},\"url\":\"https:\\\/\\\/transmediavictoria.net.au\\\/?author=8\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads - My Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/transmediavictoria.net.au\/?p=38643","og_locale":"en_US","og_type":"article","og_title":"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads - My Blog","og_description":"This Open-source solution eliminates the multi-billion-dollar gap between benchmark promises and production reality. REDWOOD CITY, Calif.&nbsp;, July 31, 2025 \/PRNewswire\/ &#8212;&nbsp;Zilliz, the company behind the popular open-source vector database Milvus, recently announced the release of VDBBench 1.0, an open-source benchmarking platform designed to test vector databases under realistic production conditions. Unlike traditional benchmarks that rely [&hellip;]","og_url":"https:\/\/transmediavictoria.net.au\/?p=38643","og_site_name":"My Blog","article_published_time":"2025-07-31T10:53:00+00:00","og_image":[{"url":"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600","type":"","width":"","height":""}],"author":"admin_tony","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin_tony","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/transmediavictoria.net.au\/?p=38643#article","isPartOf":{"@id":"https:\/\/transmediavictoria.net.au\/?p=38643"},"author":{"name":"admin_tony","@id":"https:\/\/transmediavictoria.net.au\/#\/schema\/person\/5b51d407d652c0aa802bea269ea5d7e7"},"headline":"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads","datePublished":"2025-07-31T10:53:00+00:00","mainEntityOfPage":{"@id":"https:\/\/transmediavictoria.net.au\/?p=38643"},"wordCount":377,"image":{"@id":"https:\/\/transmediavictoria.net.au\/?p=38643#primaryimage"},"thumbnailUrl":"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600","articleSection":["Business News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/transmediavictoria.net.au\/?p=38643","url":"https:\/\/transmediavictoria.net.au\/?p=38643","name":"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads - My Blog","isPartOf":{"@id":"https:\/\/transmediavictoria.net.au\/#website"},"primaryImageOfPage":{"@id":"https:\/\/transmediavictoria.net.au\/?p=38643#primaryimage"},"image":{"@id":"https:\/\/transmediavictoria.net.au\/?p=38643#primaryimage"},"thumbnailUrl":"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600","datePublished":"2025-07-31T10:53:00+00:00","author":{"@id":"https:\/\/transmediavictoria.net.au\/#\/schema\/person\/5b51d407d652c0aa802bea269ea5d7e7"},"breadcrumb":{"@id":"https:\/\/transmediavictoria.net.au\/?p=38643#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/transmediavictoria.net.au\/?p=38643"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/transmediavictoria.net.au\/?p=38643#primaryimage","url":"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600","contentUrl":"https:\/\/mma.prnasia.com\/media2\/2713871\/zilliz_milvus_Logo.jpg?p=medium600"},{"@type":"BreadcrumbList","@id":"https:\/\/transmediavictoria.net.au\/?p=38643#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/transmediavictoria.net.au\/"},{"@type":"ListItem","position":2,"name":"Zilliz Sets New Industry Standard with VDBBench 1.0 for Benchmarking Real Vector Database Production Workloads"}]},{"@type":"WebSite","@id":"https:\/\/transmediavictoria.net.au\/#website","url":"https:\/\/transmediavictoria.net.au\/","name":"My Blog","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/transmediavictoria.net.au\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/transmediavictoria.net.au\/#\/schema\/person\/5b51d407d652c0aa802bea269ea5d7e7","name":"admin_tony","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/102836fe5f9cd6c64e96e90e7341dbc815b7d12726a85708326dc0db40afd906?s=96&d=mm&r=g","caption":"admin_tony"},"url":"https:\/\/transmediavictoria.net.au\/?author=8"}]}},"_links":{"self":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/posts\/38643","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=38643"}],"version-history":[{"count":0,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=\/wp\/v2\/posts\/38643\/revisions"}],"wp:attachment":[{"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=38643"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=38643"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/transmediavictoria.net.au\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=38643"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}