Weaviate not backing up for a long time
Hi, I batch uploaded around 20k objects and backed them up in s3, worked fine. I can see the backup json file and node1 folder in s3. Moments later I deleted all the data and then batch uploaded them...
View ArticleHow to build up Vector Database ranking criteria?
should we need to define the training format for vector database or GAI if we want to build up common vector database…
View ArticleWeaviate Deployment not possible due to Azure Policies
@DudaNogueira Thank you again for your help. I checked also with my colleagues. Problem is still, that we do not know what this container is doing and therefore we don’t want to just disable it. Any...
View ArticleBatch thread died unexpectedly
to my surprise batching is working as expected using fastapi and async methods. The problem was that I was running pycharm in debug mode and in this mode batching, async and event loops are not good...
View ArticleBatch thread died unexpectedly
Yes, of course @Dirk , we will be watching if it works as expected. Anyway, I think there is a plan to release a Weaviate async client. Do you know when it would be the release? And lets see what is...
View Articleweaviate.exceptions.WeaviateQueryError: Query call with protocol GRPC search...
Description Can you please help me fix this issue? What could be causing it? Is there any configuration I can add to increase the execution time? I have created the Weavaite index with Ollama and...
View ArticleConstant storage drain without increasing number of vectors
Hi, we still observe constant storage drain in one of our 3 replicas. This replica fails with condensing with the following error: {"action":"hnsw_condensing","level":"info","msg":"start hnsw...
View ArticleTimeout values in Wevaiate config
Thank you. Yeah. We’ve been trying to trigger an earlier exit by setting the query timeout to 1 sec - hoping to see an effect. However, that does not change the query behaviour since it runs up until...
View ArticleUpdate golden ragtriever?
Thank you @DudaNogueira My docker image of Verba says that I am running the last version, (which is definitely, it’s the 0.3.1). Is there a plan for Weaviate to release the new image so that I can...
View ArticlePlease clarify restoring filesystem backup on another instance
Description I have backed up my weaviate collection on the local filesystem of my ‘finland’ weaviate instance. Here is the resulting tree view: mema@newisa:/sata/backup/20240722060001_mema_wv_backup$...
View ArticleProblems restoring from weaviate backup
Using latest is a recipe for disaster Always use a know version/tag so things are repeatable.
View ArticleTotal count of collection items yielding 0 despite 60k objects according to...
I am using versionp 4.6.7 of the python client have a managed production cluster (not sanbox) I am getting a total count of 0 when I run collection.aggregate.over_all(total_count=True) However, on the...
View ArticleBasic authorisation to tenant
hi @scvthorsten !! Welcome to our community This is a “high up” request in our roadmap: I see that MChorfa has pointed the support for tenant granularity here Could you give your thumbs up on that...
View Articleweaviate.exceptions.WeaviateQueryError: Query call with protocol GRPC search...
Hi @Mariam!! Can you post the full stacktrace? My bet here is that the GRPC port is not exposed properly. Also, could you share the docker compose you are using? considering you are mapping the ports...
View ArticleTrouble Batch Inserting Records Using Langchain w/ Weaviate
Description I get the following error message running a batch job to load records into my Weaviate nodes. Reason: local index "<INDEX_NAME>" not found: deadline exceeded for waiting for update:...
View ArticleTrouble Batch Inserting Records Using Langchain w/ Weaviate
Oh, had to increase my timeout time for this. Here’s the config I ended up using: weaviate.config.AdditionalConfig( timeout=weaviate.config.Timeout(init=30, query=60, insert=120) )
View ArticleUsing sentence_transformers together with Weaviate
Hi @DudaNogueira , I have a similar requirement and I understood the resolution you shared. However, I was wondering if it would be easier to just change the model path to the fine-tuned model (given...
View ArticleVertex AI and Weaviate
New to vertexAI/GCP. I’m trying to do generative search / basic RAG using vertex ai and weaviate vector db. I’m trying to follow the docs but kept running into this issue. Generative Search - Google |...
View ArticleVertex AI and Weaviate
Hello, we have tests that verify that Weaviate works with Vertex AI and they are green, which version of Weaviate are you using? and which model you are trying out?
View ArticleUnable to restore a filesystem based backup on another machine
EDIT to put the solution on top. In my case the process failed since I created the collection I wanted to restore and then tried the restore. Also I find the HTTP methods to check if the restore went...
View Article