Quantcast
Channel: Weaviate Community Forum - Latest posts
Viewing all articles
Browse latest Browse all 3601

How to use 'trust_remote_code=True' in case of locally downloaded gated model

$
0
0

I’m still getting errors for this as well trying to use the built-in weaviate methods of manipulating models. After peeking at the files, I don’t see how any of this supposed to work in the first place.

t2v-transformers-models/download.py at main · weaviate/t2v-transformers-models (github.com)

Take this file for example. It tries to unpack via

trust_remote_code = os.getenv(“TRUST_REMOTE_CODE”, False)

but outside of the python script, I will always be setting a shell variable which I believe will just always be evaluated as a string by getenv. Then when that gets passed to the hf function, it just ignores it if its a string and the only time it is a real, python boolean, it is always False. This is a pretty common problem of working with shells and python scripts. see:

We’ve all been there: on boolean environment variables. - Ru (rusingh.com)


Viewing all articles
Browse latest Browse all 3601

Trending Articles