Commit Graph

257 Commits

Author SHA1 Message Date
Coet
ef3c753e0d
Update test_seq_label.py 2018-09-17 19:51:30 +08:00
FengZiYjun
ad044ef4c7 fix test path to pass py.test 2018-09-16 14:16:04 +08:00
FengZiYjun
f2fc98b5e6 add Field support in Predictor:
- apply DataSet in Predictor; remove sub-predictors; add "task" argument to specify which task to predict, as how Trainer/Tester did.
- remove Action class
- add helper function for DataSet, to create DataSet easily
- more code comments
- clean up unnecessary codes
- add unit tests for Batch, Predictor, Preprocessor, Trainer, Tester
2018-09-16 14:08:52 +08:00
FengZiYjun
05af2e7544 Introduce Fields concept to eliminate the use of different sub-trainers/sub-testers.
- update LabelField's to_tensor method to support int & str single label
- update preprocessor's convert_to_dataset method to support single label inputs
- introduce "task" in Trainer/Tester's data_forward, Tester's evaluate and metrics methods
- in cnn_text_classification.py, change the name of the argument of forward
- in sequence_modeling.py, change the name of the argument of forward
- minor adjustments in test codes
- text_classify.py works
2018-09-15 19:23:10 +08:00
FengZiYjun
758f0c0bd6 Introduce Field concept to optimize data representation.
- add DataSet, Instance, Field to represent data in different levels
- encapsulate batching method in Batch class
- modify samplers in action.py to fit Batch
- preprocessor.run returns DataSet, instead of list
- Use Batch in Trainer/Tester
- add required_arg "task" in Trainer/Tester
- remove SeqLabelTrainer/SeqLabelTester dependencies successfully. They empty classes to deprecate.
- modify SeqLabeling model, add another argument in forward, in order to compute mask inside model
- test\model\seq_labeling.py works
2018-09-15 16:48:59 +08:00
yunfan
bc04b3e7fd add basic Field support 2018-09-14 14:58:04 +08:00
Yunfan Shao
82502aa67d
Merge pull request #69 from choosewhatulike/format
format test folder
2018-09-14 14:53:37 +08:00
yunfan
4dfe7aaacc format test folder 2018-09-14 14:19:39 +08:00
lyhuang18
4846cfd9a8
Merge pull request #68 from lyhuang18/docs
add mathjax and update pictures
2018-09-12 17:18:46 +08:00
lyhuang
a521fdffd1 add mathjax and update pictures 2018-09-12 16:57:55 +08:00
lyhuang18
a5abee80a2
Merge pull request #3 from fastnlp/master
update
2018-09-10 09:19:07 +08:00
Coet
4bcfc5f930
Merge pull request #65 from xuyige/test_code
add config saver
2018-09-09 20:34:44 +08:00
xuyige
aac7982e93 fix a bug in config saver testing code 2018-09-09 17:57:09 +08:00
xuyige
6ddf5fcdcd update test code for testing config saver 2018-09-09 17:55:54 +08:00
xuyige
7138ff210f update config file for testing code, add more sections for testing. 2018-09-09 17:55:30 +08:00
xuyige
bbb02d0c1f clean up the code in config saver 2018-09-09 17:54:49 +08:00
xuyige
534bc67521 overwrite '==' operator and '!=' operator in ConfigSection class 2018-09-09 17:53:32 +08:00
xuyige
66b471c7fb Merge remote-tracking branch 'origin/test_code' into test_code 2018-09-09 16:27:04 +08:00
xuyige
48c1e8700b fix code style of config saver 2018-09-09 16:26:16 +08:00
Coet
7567053d76
Merge pull request #66 from lyhuang18/test2
add requirements: tensorboardX
2018-09-09 15:34:37 +08:00
lyhuang
a7fa63a0db add tensorboardX 2018-09-09 14:11:47 +08:00
lyhuang
6a77731d86 add tensorboardX 2018-09-09 14:08:05 +08:00
Yige XU
be2f4aade3
Merge branch 'master' into test_code 2018-09-09 12:46:11 +08:00
xuyige
12f06d09d2 clean up code in test loader 2018-09-09 12:39:47 +08:00
xuyige
7fb2bcc78c update config loader 2018-09-09 12:36:56 +08:00
xuyige
7c57bc6fc9 fix a bug for config saver 2018-09-09 12:32:39 +08:00
xuyige
58ccb6576f clean up codes 2018-09-09 12:30:33 +08:00
xuyige
476988573b add test code for testing config saver 2018-09-09 12:13:42 +08:00
xuyige
2dd2f0c8f4 update config file for test 2018-09-09 12:12:16 +08:00
xuyige
edd9dedb5d add config saver 2018-09-09 12:11:38 +08:00
lyhuang18
43c09fca5c
Merge pull request #2 from fastnlp/master
merge
2018-09-08 16:57:45 +08:00
Coet
49ad966c5f
Merge pull request #60 from KuNyaa/master
add tensorboardX for loss visualization
2018-09-06 09:56:14 +08:00
Coet
ee2f98fce1
Merge pull request #62 from fastnlp/text_classify_interface
Text Classification Interface
2018-09-06 09:54:03 +08:00
FengZiYjun
5309c98846 Text classification interface is ready.
- fix issue #58, use path.join instead of +
- modify description and version in setup.py
- docstring in core/ follows RestructureText format
2018-09-05 10:00:57 +08:00
KuNya
68b63fb071 add graph summary in _train_step 2018-09-04 20:47:43 +08:00
Coet
63c687d906
Merge pull request #54 from fastnlp/pos_tag_service
CWS+POS tag interface
2018-09-04 11:51:33 +08:00
Zhen Ke
a665ddf909
Merge pull request #56 from keezen/master
Rewrite classification model and add initialization for conv_maxpool module
2018-09-04 11:27:02 +08:00
Coet
a13b8e5c82
Merge branch 'master' into pos_tag_service 2018-09-04 09:25:46 +08:00
KuNya
baf17892a7 add tensorboardX for loss visualization 2018-09-03 19:37:44 +08:00
Xipeng Qiu
4f371446c2
Merge pull request #59 from lyhuang18/test2
update docs
2018-09-02 21:52:07 +08:00
lyhuang
34c78cb9de update docs
move example to docs
2018-09-02 20:08:17 +08:00
lyhuang
292853c84a Merge branch 'master' into test2 2018-09-02 17:50:16 +08:00
lyhuang18
c80ae39fb3
Merge pull request #1 from fastnlp/master
update
2018-09-02 17:48:56 +08:00
xuyige
dbf1e492fd add config saver 2018-09-02 17:40:43 +08:00
Xipeng Qiu
961a321712
Merge pull request #55 from fastnlp/add-more-badges
add more badges in README
2018-09-02 16:45:31 +08:00
Ke Zhen
de89674436 Merge remote-tracking branch 'upstream/master' 2018-09-02 16:42:00 +08:00
Ke Zhen
d910ae3c77 Rewrite classification model, add intialization for conv_maxpool 2018-09-02 16:39:36 +08:00
Coet
e82ec43b37
Update README.md 2018-09-02 15:23:13 +08:00
FengZiYjun
31eac4a795 fix bug in preprocessor: reported in issue 47 2018-09-02 14:33:23 +08:00
FengZiYjun
6f59384d6c pass CI 2018-09-02 14:18:04 +08:00