test/AIAS
1
0
Fork 0
mirror of https://gitee.com/mymagicpower/AIAS.git synced 2024-12-02 04:08:21 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
9a334e878b
AIAS/nlp_sdks/sentence_encoder_sdk
History
Calvin a672248acd Add Bert qa model.
2021-08-05 16:22:43 +08:00
..
doc/img Add Bert qa model. 2021-08-05 16:22:43 +08:00
lib Add sentence encoder english sdk. 2021-08-05 14:37:34 +08:00
src/main Add sentence encoder english sdk. 2021-08-05 14:37:34 +08:00
pom.xml Add sentence encoder english sdk. 2021-08-05 14:37:34 +08:00
README.md no message 2021-08-05 14:43:03 +08:00
sentence_encoder_sdk.iml Add sentence encoder english sdk. 2021-08-05 14:37:34 +08:00

README.md

句向量SDK【英文】

句向量是指将语句映射至固定维度的实数向量。 将不定长的句子用定长的向量表示，为NLP下游任务提供服务。

  • 句向量 img

句向量应用：

  • 语义搜索，通过句向量相似性，检索语料库中与query最匹配的文本
  • 文本聚类，文本转为定长向量，通过聚类模型可无监督聚集相似文本
  • 文本分类，表示成句向量，直接用简单分类器即训练文本分类器

SDK包含两个模型：（模型较大，首次运行耐心等待下载）

  • SentenceEncoder 500M
  • SentenceEncoderLarge5 1G

SDK功能：

  • 句向量提取
  • 相似度计算

运行例子 - SentenceEncoderExample

  • 测试语句：
  • I am a sentence for which I would like to get its embedding
  • I am a sentence
  • I am a sentence for which I would like to get ...

运行成功后，命令行应该看到下面的信息:

...
[INFO ] - length: 512

[INFO ] - [0.050808605, -0.016524296, 0.015737822, -0.042864114, ..., 0.017881196]
[INFO ] - [0.018138515, -0.037706323, 0.04290087, -0.019213252, ..., 0.058189757]
[INFO ] - [0.04447042, -0.07614114, 0.0073701036, -0.045335855, ..., 0.054146692]

[INFO ] - 0.80258906
[INFO ] - 0.90100515

帮助

添加依赖库：lib/aias-sentence-encoder-lib-0.1.0.jar