Commit Graph

2470 Commits

Author SHA1 Message Date
x54-729
24ca2851bb 修改ddp python -m a.b.c 启动时的错误 2022-10-17 16:16:27 +08:00
x54-729
3aed436bb7 修改 README.md 中的安装方法 2022-10-12 17:19:55 +08:00
x54-729
668430d33d 修正 paddle 多卡下替换 sampler 的逻辑及测试 2022-10-12 17:19:34 +08:00
x54-729
196c864ff2 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-10-12 15:17:21 +08:00
x54-729
3d8214c783 追加paddle和oneflow关于替换dataloader的改动 2022-10-12 15:01:36 +08:00
x54-729
28db704f70 初步修正了多卡情况下 evaluate_dataloader 使用定制 batch_sampler 会报错的问题,改为给出 warning 2022-10-12 14:15:37 +08:00
yhcc
dbb16d8ba4 修复fitlog在raise exception的时候的问题 2022-10-10 16:38:20 +08:00
x54-729
fe30d02f86 small 2022-10-08 13:49:22 +08:00
x54-729
67aee2c897 1.修改 DataSet.drop,使之在 inplace 为 False 时也能返回空 FieldArray 的数据 2.添加 FieldArray 的迭代方法 3. 增加 DataBunlde 的 drop 和 add_seq_len 函数及测试 2022-10-07 14:51:04 +08:00
x54-729
c083073e60 Merge branch 'master' into dev0.8.0 2022-10-06 10:15:06 +08:00
x54-729
65c7193075 修改 README 中部分教程的链接 2022-10-06 10:10:35 +08:00
TrellixVulnTeam
1af9d842c0
Adding tarfile member sanitization to extractall() (#424)
Co-authored-by: TrellixVulnTeam <kasimir.schulz@trellix.com>
2022-10-06 09:56:25 +08:00
x54-729
f090e4a99c .Jenkinsfile 添加 shm-size 设置;test_seq2seq_model 调整训练参数 2022-09-28 13:47:26 +08:00
x54-729
4775581084 small 2022-09-27 15:22:57 +08:00
x54-729
6a99e2fa8c test_metric 添加torch标签 2022-09-27 15:13:27 +08:00
x54-729
9f60246749 test_fsdp device 统一为[0,1] 2022-09-20 19:30:52 +08:00
x54-729
b01b84ae47 ddp barrier 添加是否已初始化的判断 2022-09-20 14:53:26 +08:00
x54-729
babf4b2f19 修复测试的一些bug 2022-09-20 13:31:33 +08:00
x54-729
82fe167ea3 限制测试时使用的设备;为fsdp的测试添加版本限制 2022-09-19 16:31:25 +08:00
x54-729
5ebc8d1be4 删除debug信息 2022-09-19 16:29:57 +08:00
x54-729
1f4208b1c9 fix bugs of _FDataset of paddle, jittor and oneflow 2022-09-19 15:03:46 +08:00
MorningForest
46b94002af 增加metric测试用例,修改metric的 setattr方法 2022-09-16 13:34:07 +08:00
x54-729
bb52c8c3d2 delete log infos 2022-09-13 15:16:12 +08:00
x54-729
749415970e 1. fix bugs of DataSet.from_dataset 2. fix bugs of some tests 3. add to OneflowDriver.load_model 2022-09-13 14:41:22 +08:00
x54-729
96e8c6bda2 update .Jenkinsfile 2022-09-13 13:33:31 +08:00
x54-729
09a558c2c9 small change for tests 2022-09-12 14:36:27 +08:00
x54-729
72e51c0f1f Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-09-12 13:16:56 +08:00
YWMditto
3f4a1f8e80 修改了 fdl._FDataSet 中在使用 pickle 时出现的 bug 2022-09-10 11:10:31 +08:00
YWMditto
6db70df2a7 添加了 torch_driver.load_model 在ddp 时出现显存爆炸的todo事项 2022-08-31 20:37:28 +08:00
x54-729
faf12216c6 small 2022-08-30 20:03:31 +08:00
x54-729
bc5c5c9eb3 update docs of apply and apply_field 2022-08-30 19:55:59 +08:00
x54-729
5aea874125 change version to 1.0.0beta 2022-08-23 10:43:43 +08:00
x54-729
8b8dcdd82b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-08-22 15:45:19 +08:00
x54-729
716e1ade69 update docs 2022-08-22 15:13:02 +08:00
x54-729
2128d8d97c change parameters of oneflow.full to fit different versions 2022-08-22 15:10:17 +08:00
yhcc
e2c8aae798 element如果没有初始化在reset时不起作用 2022-08-21 23:46:34 +08:00
YWMditto
0033219fe1 修正 _TruncatedDataLoader 2 2022-08-08 20:32:52 +08:00
YWMditto
e86645380a 修正 _TruncatedDataLoader 1 2022-08-08 19:40:34 +08:00
YWMditto
d7ce92975c 为 _TruncatedDataLoader 添加 __setattr__ 2022-08-08 19:35:04 +08:00
yhcc
c11c30a5fc beta version 2022-07-25 16:21:33 +08:00
yhcc
6f84091bfa update部分代码 2022-07-25 16:17:17 +08:00
x54-729
e23eb1b6e9 small 2022-07-17 18:40:49 +08:00
x54-729
5a41cca483 seq_len_to_mask 添加oneflow部分;完善oneflow的测试标签 2022-07-17 18:39:45 +08:00
x54-729
cce133d806 更新oneflow.full的参数 2022-07-17 00:10:05 +08:00
x54-729
189050d25d Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-07-10 12:11:31 +00:00
x54-729
b404293743 å修改set_env_on_import的è°执行逻辑 2022-07-10 12:09:05 +00:00
YWMditto
4724a7206a 添加了 saver 中对于保存文件夹的打印 2022-07-10 17:51:17 +08:00
YWMditto
74d8d66bef 修改了 torch_driver.load_model,添加了 strict 参数的设定 2022-07-08 12:53:28 +08:00
yhcc
ddce6e960c fix typo 2022-07-08 08:17:23 +08:00
yhcc
e3b02cd1a5 update packaging related 2022-07-08 00:18:25 +08:00