Vespa Product Updates, August 2020
In the June updates, we mentioned Approximate Nearest Neighbor Search, Streaming Search Speedup, Rank Features, and a GKE Sample Application.
This month, we’re excited to share the following updates:
Introducing NLP with Transformers on Vespa
There has been considerable interest lately to bring sophisticated natural language processing (NLP) power using machine learned models such as BERT and other transformer models to production. We have extended the tensor execution engine in Vespa to support transformer based models, so you can deploy transformer models as part of your Vespa applications and evaluate these models in parallel on each content partition when executing a query. This makes it possible to scale evaluation to any corpus size without sacrificing latency.
We released a new Grafana integration by leveraging our existing Prometheus integration, with a few improvements. This allows you to add Grafana monitoring to the Quick Start and you can add a random load to generate a sample work graph. We’ve provided a sample application to get you started with monitoring Vespa using Grafana.
Improved GEO Search Support
We added support for geoLocation items to the Vespa query language to make it possible to create arbitrary query conditions which include positional information. We also added additional distance rank features to provide more support for ranking by positions.
Query Profile Variants Optimizations
Query Profile Variants make it possible to configure bundles of query parameters which vary by properties of the request, such as e.g market, bucket, or device. We added a new algorithm for resolving the parameters that applies for a given query which greatly reduces both compilation and resolution time with variants, leading to faster container startup and lower query latency for applications using variants.
Build Vespa on Debian 10
About Vespa: Largely developed by Yahoo engineers, Vespa is an open source big data processing and serving engine. It’s in use by many products, such as Yahoo News, Yahoo Sports, Yahoo Finance, and the Verizon Media Ad Platform. Thanks to feedback and contributions from the community, Vespa continues to grow.
Subscribe to the mailing list for more frequent updates!