Commit Graph

1298 Commits

Author SHA1 Message Date
ChenXin
a88fe24c34 update the word2vec download link 2019-08-15 16:46:43 +08:00
xuyige
aaabcd6bab update io/file_utils.py 2019-08-15 15:59:10 +08:00
ChenXin
392badabf9 tidy up the BERT download list 2019-08-15 14:00:42 +08:00
xuyige
09e24b3bd7 update matching pipe. 2019-08-15 02:01:16 +08:00
xuyige
02c8fc0de7 rename param names in model/bert.py to adjust fastNLP.Const 2019-08-15 01:47:16 +08:00
yh
3ae383efc3 修复BertEmbedding中长度会额外加长的bug 2019-08-15 01:20:35 +08:00
yh
cf64412dad merge docs 2019-08-14 23:16:11 +08:00
yh
7a21c2a587 1. 增强BertEmbedding使其可以自动判断token_type_ids; 2.增加CrossEntropyLoss中对label dimension的报错处理 2019-08-14 23:14:59 +08:00
ChenXin
ad9d5eba3a fix some mistakes 2019-08-14 20:45:37 +08:00
ChenXin
cdf8406ec1 updated docs 2019-08-14 20:29:14 +08:00
ChenXin
b6bad76415 update the Makefile to make api-extractor work better 2019-08-14 20:28:49 +08:00
ChenXin
a8a21b169a fix a serial bugs on importing 2019-08-14 20:18:54 +08:00
ChenXin
afa73bf5c8 format some docs 2019-08-14 18:03:42 +08:00
yh
014e9786c7 1. 分类DataSetLoader中的Loader功能Pipe功能; 2. 增加数据集自动下载; 3.修复vocabulary中的bug 2019-08-14 15:35:05 +08:00
yh
efb909d191 修复SpanFMetric中的micro计算bug 2019-08-12 13:36:26 +08:00
yh
6b22d6d3be bert embedding修复bug 2019-08-12 11:14:03 +08:00
yh
88dafd7f9a 修复BertEmbedding的bug 2019-08-12 01:20:04 +08:00
yh
b0c50f7299 修复BertEmbedding的bug 2019-08-12 01:18:24 +08:00
yh
1b661e907a 修复BertEmbedding的bug 2019-08-12 01:12:08 +08:00
yh
a45f18cba5 Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0 2019-08-12 00:59:03 +08:00
yh
2098a81f2f 修复BertEmbedding的bug 2019-08-12 00:58:57 +08:00
yhcc
8f9dc5a23d
Merge pull request #202 from SrWYG/dev0.5.0
[verify] add data source in readme
2019-08-08 15:52:56 +08:00
wyg
216efb446f [verify] add data source in readme 2019-08-08 14:56:03 +08:00
SrWYG
c1f9d6f330
Merge pull request #8 from fastnlp/dev0.5.0
Dev0.5.0更新fork
2019-08-08 14:40:04 +08:00
xuyige
e7d027cdb4 add tqdm bars in tester and fix some import statements 2019-08-07 03:19:32 +08:00
yh_cc
e166c119f5 bert_embedding增加一个auto_truncate的参数,在word pieces长度超过512的情况自动使用0去padding 2019-08-06 02:01:02 +08:00
yh
c3d5128ab5 1. merge conflict 2019-07-30 00:00:58 +08:00
yh
af55db2019 1.修改callback prepare_callbacks, 2.让Dist_Trainer支持find_unused_parameters, 但仅在1.1以上版本有效 2019-07-29 23:56:53 +08:00
yh
71c9e0c30e 从远程下载权重 2019-07-29 23:54:57 +08:00
yh
db8c6a0b8a 解决读取bert权重潜在的bug问题 2019-07-26 19:44:20 +08:00
yunfan
cacf40366c [fix] distributed trainer 2019-07-26 16:26:43 +08:00
yh
d401bd2208 sst loader中增加一列raw_words 2019-07-25 16:56:54 +08:00
yh
cb3cb8bc5c 修复BertEmbedding的weight 2019-07-25 16:51:59 +08:00
yh
a8111087a3 删除getattr的default keyword 2019-07-25 16:36:28 +08:00
yh
210af73c6e 修复callback连续两次加入的bug 2019-07-25 16:01:17 +08:00
yunfan
329a18976f [update] distributed trainer, add evaluation part 2019-07-20 17:12:15 +08:00
yunfan
606d63a5a4 [update] distributed trainer 2019-07-20 16:24:12 +08:00
yunfan
861f5387a4 [add] very first version of distributed trainer 2019-07-19 22:40:26 +08:00
yh
4718804e22 1. 修改内部函数位置; 2.修改BertWordPieceEncoder的部分功能 2019-07-19 17:33:41 +08:00
xuyige
c2d687528e fix bugs and add test codes for: 1. models.snli; 2. core.metrics.extractive_qa; 3. io.data_loader.mnli 2019-07-19 02:05:33 +08:00
yh
22a8702d22 1. Trainer支持使用DistributedDataParallel训练; 但是还没有经过广泛测试,谨慎使用; 2. 修复import os bug; 3.FitlogCallback支持不传入任何DataSet; 4. NullOptimizer的construct_from_optimer返回self; 5. 修复Bert中pooled_cls的bug;“ 2019-07-18 23:43:10 +08:00
yh
c19499e60a 1. 修复DataSet.delete_instance的bug; 2. FieldArray中支持只使用第一个instance推断dimension和type,节省时间 2019-07-18 22:53:30 +08:00
yh
3c2e419059 增加pooled_cls选项,可以是Bert在做分类时可以使用预训练的权重 2019-07-17 20:06:40 +08:00
ChenXin
d9e9f9ca7c delete a todo item 2019-07-12 15:24:18 +08:00
ChenXin
f6bb8c83f3
Merge pull request #194 from fastnlp/dev0.5.0
fix embedding tutorials
2019-07-12 14:59:46 +08:00
xuyige
ec824376c6 fix embedding tutorials 2019-07-12 14:51:11 +08:00
ChenXin
d6326de8d2
Merge pull request #193 from fastnlp/dev0.5.0
Dev0.4.5
2019-07-12 14:35:17 +08:00
Yige XU
25421d104d
Merge branch 'master' into dev0.5.0 2019-07-12 14:30:59 +08:00
ChenXin
1fed3650d5 check了 embeddings 的文档 2019-07-12 14:18:04 +08:00
xuyige
98ebc3c0b1 在README.md添加版本说明 2019-07-12 14:12:13 +08:00