Although it is stated that GSE tokenizer is available from WCD v1.24, it seems that it is still unavailable (When I try to use it, the error message suggests I have to set environmental variable ENABLE_TOKENIZER_GSE to be true but I cannot do that on WCD), the reference is here.
I really need to use hybrid search with decent tokenizer for my
Japanese client and it will be great if I could use GSE somehow on
WCD.
Thanks.