Commit Graph

1996 Commits

Author SHA1 Message Date
MorningForest
6323fbfdbb Merge remote-tracking branch 'refs/remotes/origin/dev0.8.0' into dev0.8.0 2022-04-11 19:40:35 +08:00
MorningForest
ffcf3ddcd3 修改测试用例unittest为pytest 2022-04-11 19:39:53 +08:00
YWMditto
afb87b4375 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-11 18:59:04 +08:00
YWMditto
d39fa5137e 修改了DDPDriver.set_dist_repro_dataloader 的逻辑 2022-04-11 18:58:55 +08:00
MorningForest
b161aa6c93 添加README.md 2022-04-11 18:50:36 +08:00
MorningForest
36149a57b0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-11 18:44:31 +08:00
MorningForest
f81d2e0552 合并冲突 2022-04-11 18:43:30 +08:00
yh_cc
9216c6117e 新增UnrepeatedSortedSampler 2022-04-11 16:44:08 +08:00
YWMditto
9675eae798 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-11 15:45:28 +08:00
YWMditto
8ca17fc9ed 修改了断点重新sampler中的部分逻辑 2022-04-11 15:45:06 +08:00
MorningForest
74dd154cf5 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-11 15:22:48 +08:00
MorningForest
ea03967de9 修改element的bug 2022-04-11 15:22:40 +08:00
yh_cc
607367588c 1.增加DataSet的__setitem__方法,使得其可以直接random.shuffle(dataset); 2.优化部分log输出显示 2022-04-11 15:21:45 +08:00
yh_cc
ce835212e6 将CheckpointCallback拆分为ModelCheckpointCallback和TrainerCheckpointCallback,修改了部分实现 2022-04-11 14:34:11 +08:00
yh_cc
0a093e1c3f 解决rich运行的时候会隐藏cursor的问题 2022-04-11 00:35:52 +08:00
yh_cc
28aabb5a2f Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 23:57:02 +08:00
yh_cc
e8b6298fb1 完善SpanFPreRecMetric即测试 2022-04-10 23:56:55 +08:00
YWMditto
96cca42a5b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 23:16:01 +08:00
YWMditto
7bd0ce0b5e 修改了 device 为 -1 时 的逻辑 2022-04-10 23:15:47 +08:00
MorningForest
9c62e300a7 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 23:10:44 +08:00
MorningForest
0cab4dc526 修改F1RecPreMetric测试用例 2022-04-10 23:10:35 +08:00
x54-729
ebfa118ff2 PaddleDriver的测试例调整 2022-04-10 15:07:52 +00:00
x54-729
9678c559c9 跟进断点重训的设置 2022-04-10 14:59:45 +00:00
x54-729
da849564d6 添加利用命令获取gpu数目的函数 2022-04-10 14:59:05 +00:00
x54-729
193c04c9e2 initialize_paddle_driver的测试例 2022-04-10 14:57:55 +00:00
yh_cc
817f6d6ad6 修改fastnlp_torch_all_gather函数,使得它gather后的tensor都在当前device 2022-04-10 22:28:48 +08:00
x54-729
e3d565b639 small 2022-04-10 14:18:53 +00:00
x54-729
08ee15fa10 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 12:49:38 +00:00
yh_cc
12d3e08568 增加BucketedBatchSampler的测试 2022-04-10 20:42:37 +08:00
x54-729
447e673afa Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 06:55:17 +00:00
x54-729
791580797c paddle 分布式的测试例 2022-04-10 06:55:05 +00:00
x54-729
5ea4f75ff8 paddle 环境设置 2022-04-10 06:54:31 +00:00
yh_cc
983c587cba Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 14:36:52 +08:00
yh_cc
20b8ca9a92 实现了BucketedBatchSampler; 创建了reproducible_batch_sampler.py 2022-04-10 14:36:47 +08:00
YWMditto
a376eea776 重新修改了断点重训的逻辑,主要修改了 trainer.save/load 和 driver.save 和 load 函数 2022-04-10 12:56:49 +08:00
YWMditto
770b2eaf4b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 11:47:01 +08:00
yh_cc
0e7961cd9f Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-10 00:08:24 +08:00
yh_cc
8e4abf2aa5 删除了driver的replace_sampler替换为set_dist_repro_dataloader; 同时修改 driver.load/driver.save 函数 2022-04-10 00:08:19 +08:00
x54-729
680421fe86 paddle分布式训练 2022-04-09 12:52:19 +00:00
x54-729
49d18f3683 修复但å单卡的设备逻辑 2022-04-09 16:48:18 +08:00
YWMditto
a8597602d0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-09 15:28:19 +08:00
YWMditto
929abc3953 加入了 test_logger.py 2022-04-09 15:28:13 +08:00
yh_cc
5b54a0cd73 修改Trainer的catch_KeyboardInterrupt行为,防止一直warning 2022-04-09 14:57:06 +08:00
x54-729
f5f1c280e0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-09 14:38:31 +08:00
x54-729
6ef912675b 新的paddle测试数据集 2022-04-09 14:37:55 +08:00
YWMditto
10db8c9373 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-09 13:59:39 +08:00
YWMditto
d03bc5ce14 ddp 加入了更为详细的注释;修复了一个错误 2022-04-09 13:59:32 +08:00
x54-729
f144bc31c3 fleet test 2022-04-09 13:42:30 +08:00
x54-729
fd3b82c5b0 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-08 15:28:34 +00:00
yh_cc
4781178a5a 修复测试 2022-04-08 22:36:52 +08:00