Duplicate data detection in weaviate

Hi!

With that code you will endup with 2 uuids.

This is what you are looking for, to generate one single uuid based on a list of different ids and making sure to sort the list before:

from weaviate.util import generate_uuid5
my_ids = ["123", "456"]
my_ids_different_order = ["456", "123"]
print(generate_uuid5(sorted(my_ids)))
print(generate_uuid5(sorted(my_ids_different_order)))

both lists will endup generating the uuid:

9f5bdeb4-dc32-5f94-9689-177bf744c134

Let me know if this helps!

Thanks!