{"id":42958,"date":"2026-01-30T18:10:00","date_gmt":"2026-01-30T18:10:00","guid":{"rendered":"http:\/\/www.prnasia.com\/story\/archive\/4875426_CN75426_0"},"modified":"2026-01-30T18:10:00","modified_gmt":"2026-01-30T18:10:00","slug":"zilliz-open-sources-industry-first-bilingual-semantic-highlighting-model-to-slash-rag-token-costs-and-boost-accuracy","status":"publish","type":"post","link":"https:\/\/transmediavictoria.net.au\/?p=42958","title":{"rendered":"Zilliz Open Sources Industry-First Bilingual “Semantic Highlighting” Model to Slash RAG Token Costs and Boost Accuracy"},"content":{"rendered":"
\n\n\n\n
\"\"<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

REDWOOD CITY, Calif.<\/span>, Jan. 31, 2026 \/PRNewswire\/ — Zilliz<\/a><\/u>, the company behind the leading open-source vector database Milvus<\/a><\/u>, today announced the open-source release of its Bilingual Semantic Highlighting Model<\/a><\/u>, an industry-first AI model designed to dramatically reduce token<\/span> usage and improve answer quality in production RAG-powered AI applications.<\/span><\/p>\n

This highlighting model introduces sentence-level relevance filtering, enabling AI developers to remove low-signal context before sending prompts to large language models. This approach directly addresses rising inference costs and accuracy issues caused by oversized context windows in enterprise RAG and RAG-powered AI deployments.<\/p>\n

"As RAG systems move into production, teams are running into very real cost and quality limits," said James Luan<\/span>, VP of Engineering at Zilliz. "This model gives developers a practical way to reduce prompt size and improve answer accuracy without reworking their existing pipelines."<\/p>\n

\n

\"Traditional<\/a>
Traditional Highlight VS Semantic Highlight<\/span><\/p>\n<\/p><\/div>\n

Key Innovations and Technical Breakthroughs<\/b><\/p>\n