Quantcast
Channel: Weaviate Community Forum - Latest posts
Viewing all articles
Browse latest Browse all 3588

GRCP connection failure when processing data-intensive batches

$
0
0

hi @Nancy_Viviana_Espino !!

What is the batch configuration you are using?

We suggest using something like this as a base, and start tweaking the batch size and concurrent requests according to the resources you have for you cluster:

with movies.batch.fixed_size(batch_size=20, concurrent_requests=2) as batch:
    for i, row in df.iterrows():
        obj_body = {
            c: row[c] for c in data_columns
        }
        batch.add_object(
            properties=obj_body
        )

Let me know if this helps.

Thanks!


Viewing all articles
Browse latest Browse all 3588

Trending Articles