Zilliz Launches Vector Lakebase for Enhanced AI Data Management
On June 22, Zilliz, the creator of Milvus—one of the most popular open-source vector databases—announced the public preview of its new product, Zilliz Vector Lakebase. This innovative feature is part of the Zilliz Cloud and combines a powerful vector database with a new shared data foundation.
Vector Lakebase builds on Zilliz Cloud’s strengths in real-time vector search, which thousands of businesses and AI teams, including Zillow and MiniMax, currently depend on. The new offering introduces three important functionalities: interactive data discovery, large-scale analytics, and the ability to search directly within external data lakes. This means that all operations can now run on a single copy of the data, making it both easier to manage and more cost-effective.
Charles Xie, the Founder and CEO of Zilliz, emphasized the importance of vector search for the company: “Production vector search is essential to Zilliz, and with every update, we are making it faster and more affordable. Vector Lakebase represents our vision for the future: a unified data platform that allows for efficient querying, data discovery, and extensive training data processing—all without the hassle of data duplication or migration.”
The Importance of a Unified Data Foundation
AI systems have evolved beyond simple queries; they now operate in a continuous cycle of serving, learning, and refining data. However, this cycle traditionally requires separate systems for each task, leading to high costs and delays when transferring data. Many teams abandon the process, leaving valuable data underutilized.
Vector Lakebase addresses these challenges with an efficient, shared environment for all types of data tasks. This zero-copy data management allows for real-time serving, in-depth discoveries, and batch analytics to be handled seamlessly on a single data copy that can scale from small to massive sizes.
Robert Guo, Zilliz’s VP of Product, noted: “Our users wanted a streamlined solution to manage their data and perform different tasks efficiently. Vector Lakebase fulfills that need with a unified storage that supports various workloads—from immediate data retrieval to extensive data processing.”
Key Features of Vector Lakebase
-
Tiered Real-Time Serving: Three performance tiers cater to different needs, including high-speed processing for quick queries and cost-effective solutions for larger data sets. All options offer impressive reliability and speed.
-
On-Demand Search: This cost-effective model charges users only for the compute power they actually utilize, helping to reduce expenses significantly compared to traditional server models.
-
External Data Lake Search: This feature allows users to search through existing external data without duplicating it, maintaining the data’s original location while still accessing advanced search capabilities.
-
Full-Spectrum AI Search: Users can conduct searches across various types of data, including vectors and text. Advanced search techniques ensure comprehensive and accurate results.
-
Unified Lake-Native Storage: Built on Vortex technology, this system allows for shared storage for both analytics and serving, enhancing performance and reducing costs.
In conclusion, the capabilities of Zilliz Vector Lakebase enable AI teams to manage their tasks on a single platform, making it easier to maintain consistent data and scale their operations efficiently.
Related Updates
- Power Integrations introduces new PSU designs suitable for NVIDIA AI data centers.
- Toshiba announces the shipment of SiC MOSFET samples for enhanced performance in AI data centers.
- SKT collaborates with Iceotope and SK Enmove to push innovations in AI data center technology.
