Description
We have a cluster with 3 nodes (and 3 replicas).
Every day we have ~150k vector delete/insert operations (NOT updates).
And WAL’s folder grows unlimittely… 100Gb+ per day…
Because of this, pod’s launch takes several hours.
How to limit size (file count) or historicity of append’s logs?
Server Setup Information
- Weaviate Server Version: 1.25.6
- Deployment Method: k8s
- Multi Node? Number of Running Nodes: Yes, 3
- Client Language and Version: Python3, Python Client v4
- Multitenancy?: No
Any additional Information
PERSISTENCE_HNSW_MAX_LOG_SIZE: 4GiB