test/dify
1
0
Fork 0
mirror of https://gitee.com/dify_ai/dify.git synced 2024-12-02 03:07:59 +08:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

zhipu embedding token method (#1976)

Browse Source 
Co-authored-by: jyong <jyong@dify.ai>
This commit is contained in:
Jyong 2024-01-09 19:54:02 +08:00 committed by GitHub
parent 5b24d7129e
commit 60ee98f578
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
api/core/model_runtime/model_providers/zhipuai/text_embedding/text_embedding.py
View File

@ -55,7 +55,7 @@ class ZhipuAITextEmbeddingModel(_CommonZhipuaiAI, TextEmbeddingModel):
total_num_tokens = 0
for text in texts:
total_num_tokens += len(_get_token_ids_default_method(text))
total_num_tokens += self._get_num_tokens_by_gpt2(text)
return total_num_tokens