Description
Dimensions: 1536 and number of objects: 500k
We are observing high latency 490ms(p50),640ms(p90), 1.4s(p99) for throughput 32 RPS, Pod have enough CPU and memory available during the test however it is not utilizing fully. These results are not even close to benchmarks performed by Weaviate. Any suggestions to reduce the latency?
Server Setup Information
- Weaviate Server Version: 1.22.8
- Deployment Method: k8s
- Multi Node? Number of Running Nodes: single node
- Client Language and Version: python v3
- Multitenancy?: No