Commit Graph

982 Commits

Author SHA1 Message Date
yh_cc
9a8fe42cd4 新增NER的数据加载与模型代码; 修改metric中的typo; 修改LSTM中的默认初始化将forget gate设置为1. 2019-06-18 10:02:24 +08:00
xuyige
93620e76ed update framework of matching 2019-06-18 02:04:53 +08:00
xuyige
342b7026d7 Merge remote-tracking branch 'origin/dev0.5.0' into dev0.5.0 2019-06-17 21:48:42 +08:00
xuyige
39388567ad update matching.py 2019-06-17 21:48:18 +08:00
yh_cc
2f5d8967a3 1. 适配将Batch修改为pytorch的DataLoader的修改
2. 修改embedding.py中的bug
3. ConllReader默认跳过所有的DOCSTART标签
4. 交换bert的heavy lifting到_bert, 将BertEncoder在bert.py中暴露
5. crf中allow_transition的include_end_start修改为false,以与CRF的默认值适配
6. allow_transition与SpanMetric支持BIOES类型的tag
7. datainfo中增加打印格式化输出
2019-06-17 20:18:07 +08:00
yh_cc
839d712467 增强field中的value_count支持对nested的field的支持 2019-06-17 16:46:39 +08:00
yhcc
66f51395d7
Merge pull request #166 from fastnlp/batch
[new] 兼容pytorch的DataLoader,替换Batch为DataSetIter
2019-06-17 16:42:28 +08:00
yh_cc
95e8e2af7d Merge branch 'dev0.5.0' of github.com:fastnlp/fastNLP into dev0.5.0 2019-06-17 13:27:59 +08:00
yh_cc
30b012ac20 修复metric和loss在映射时出现重复同名输入时会覆盖的bug 2019-06-17 13:27:52 +08:00
lyhuang18
0e6a2a74e9
Merge pull request #168 from lyhuang18/lyhuang-reproduction
[New] Add MTL16Loader
2019-06-16 23:51:51 +08:00
lyhuang18
c78811f87f add TC/MTL16Loader 2019-06-16 23:43:37 +08:00
lyhuang18
97b5909f5d
Merge pull request #3 from fastnlp/dev0.5.0
Dev0.5.0
2019-06-16 21:22:11 +08:00
yh_cc
4b5113cbea prefecth变更为deprecated warning; 2019-06-15 14:17:48 +08:00
yh_cc
17b5fd0066 1. 删除Trainer中对train_data必须为DataSet的assert
2. 删除Trainer的prefetch参数; 在注释中增加num_workers参数
3. Trainer中默认sampler为RandomSampler
2019-06-15 13:10:28 +08:00
yunfan
efe3574014 Merge remote-tracking branch 'origin/dev0.5.0' into batch 2019-06-15 12:23:59 +08:00
yunfan
7564818f4b [unstable] change Batch to torch's DataLoader 2019-06-15 12:12:57 +08:00
yh_cc
fabc692b4e Merge branch 'dev0.5.0' of github.com:fastnlp/fastNLP into dev0.5.0 2019-06-13 21:26:24 +08:00
yh_cc
acf18e2e89 修改DataSet split的一个注释错误 2019-06-13 21:25:47 +08:00
xuyige
1a4c3c2d20 fix some bugs in test 2019-06-13 20:33:15 +08:00
xuyige
e5e4381eb2 add fasttext embedding 2019-06-13 20:05:59 +08:00
yunfan
ba9c591d9b Merge remote-tracking branch 'origin/dev0.5.0' into batch
# Conflicts:
#	fastNLP/core/batch.py
2019-06-13 13:38:10 +08:00
yhcc
4124b385d7
Update quickstart.rst 2019-06-13 11:17:02 +08:00
yhcc
e4b0782466
增加requests依赖 2019-06-13 11:09:26 +08:00
xuyige
a366f156ac update documents in embedding.py 2019-06-13 00:36:13 +08:00
xuyige
0f7c732f21 update embedding.py 2019-06-12 19:08:36 +08:00
yh
7b8b5884a2 修复_ignore_type的bug. 2019-06-12 14:09:04 +08:00
yh_cc
ed3098e1b8 1. 修改bert,elmo的cache方式; 这样不需要使用sentence_index这种方式进行索引 2019-06-12 12:21:13 +08:00
yh_cc
6309eafd25 1. 在fieldarray中支持split,int等handy的function
2. 重大更新,支持ElmoEmbedding, BertEmbedding
2019-06-12 11:10:33 +08:00
yh_cc
37c50d6625 Merge branch 'dev0.5.0' of github.com:fastnlp/fastNLP into dev0.5.0 2019-06-11 16:42:11 +08:00
lyhuang18
a504c416fc
Merge pull request #2 from fastnlp/dev0.5.0
Dev0.5.0
2019-06-10 20:41:26 +08:00
Yige XU
bc31b28b31
Merge pull request #163 from violetyao/dev0.5.0
[New] Add yelpLoader
2019-06-09 22:37:35 +08:00
Violet Yao
83729dfc39 moved test to reproduction folder 2019-06-09 21:46:34 +08:00
Violet Yao
6a9ebd5a7a Merge branch 'dev0.5.0' of https://github.com/violetyao/fastNLP into dev0.5.0 2019-06-09 21:31:37 +08:00
Violet Yao
74925f8237 wrong folder 2019-06-09 21:30:40 +08:00
Violet Yao
e1869ec057
Delete yelp_sample.json
transfer to reproduction folder
2019-06-09 21:25:56 +08:00
Violet Yao
189a0a066c removed ast 2019-06-09 16:45:54 +08:00
Violet Yao
d17acd0cb1 remove ast 2019-06-09 16:45:08 +08:00
Violet Yao
ad6a55ba26 fixed comment format 2019-06-08 14:32:25 +08:00
Violet Yao
2edb2a1a00 added yelpLoader 2019-06-08 14:27:52 +08:00
yh_cc
9e5c4f665c Merge branch 'dev0.5.0' of github.com:fastnlp/fastNLP into dev0.5.0 2019-06-08 09:48:11 +08:00
yh_cc
bddce51b05 merge update 2019-06-08 09:47:39 +08:00
yh
e90bbbb3f1 !!!重要更新,DataSet理论上支持任意类型的数据了,但是因为改动非常大,所以可能会有bug 2019-06-07 23:28:05 +08:00
yunfan
9f5c00b17d change Batch to torch.DataLoader 2019-06-06 01:40:46 +08:00
yh
420112e0dc Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0 2019-06-06 00:28:26 +08:00
yh
0257dc6dde 修复Trainer无法捕获Exception的bug 2019-06-06 00:28:12 +08:00
xuyige
8e82c91751 update bert for nli in reproduction/matching 2019-06-06 00:09:25 +08:00
ChenXin
9bfedbdfe9 修复了 metrics 文档中的公式 2019-06-05 19:36:40 +08:00
yh
eca04cd079 Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0 2019-06-05 18:22:19 +08:00
yh
e40447cc84 禁止travis测试非 test之外的文件 2019-06-05 18:21:35 +08:00
yhcc
32fb342ada
Create .gitignore
增加一个常用.gitignore
2019-06-05 16:35:59 +08:00