Commit Graph

253 Commits

Author SHA1 Message Date
FengZiYjun
758f0c0bd6 Introduce Field concept to optimize data representation.
- add DataSet, Instance, Field to represent data in different levels
- encapsulate batching method in Batch class
- modify samplers in action.py to fit Batch
- preprocessor.run returns DataSet, instead of list
- Use Batch in Trainer/Tester
- add required_arg "task" in Trainer/Tester
- remove SeqLabelTrainer/SeqLabelTester dependencies successfully. They empty classes to deprecate.
- modify SeqLabeling model, add another argument in forward, in order to compute mask inside model
- test\model\seq_labeling.py works
2018-09-15 16:48:59 +08:00
yunfan
bc04b3e7fd add basic Field support 2018-09-14 14:58:04 +08:00
Yunfan Shao
82502aa67d
Merge pull request #69 from choosewhatulike/format
format test folder
2018-09-14 14:53:37 +08:00
yunfan
4dfe7aaacc format test folder 2018-09-14 14:19:39 +08:00
lyhuang18
4846cfd9a8
Merge pull request #68 from lyhuang18/docs
add mathjax and update pictures
2018-09-12 17:18:46 +08:00
lyhuang
a521fdffd1 add mathjax and update pictures 2018-09-12 16:57:55 +08:00
lyhuang18
a5abee80a2
Merge pull request #3 from fastnlp/master
update
2018-09-10 09:19:07 +08:00
Coet
4bcfc5f930
Merge pull request #65 from xuyige/test_code
add config saver
2018-09-09 20:34:44 +08:00
xuyige
aac7982e93 fix a bug in config saver testing code 2018-09-09 17:57:09 +08:00
xuyige
6ddf5fcdcd update test code for testing config saver 2018-09-09 17:55:54 +08:00
xuyige
7138ff210f update config file for testing code, add more sections for testing. 2018-09-09 17:55:30 +08:00
xuyige
bbb02d0c1f clean up the code in config saver 2018-09-09 17:54:49 +08:00
xuyige
534bc67521 overwrite '==' operator and '!=' operator in ConfigSection class 2018-09-09 17:53:32 +08:00
xuyige
66b471c7fb Merge remote-tracking branch 'origin/test_code' into test_code 2018-09-09 16:27:04 +08:00
xuyige
48c1e8700b fix code style of config saver 2018-09-09 16:26:16 +08:00
Coet
7567053d76
Merge pull request #66 from lyhuang18/test2
add requirements: tensorboardX
2018-09-09 15:34:37 +08:00
lyhuang
a7fa63a0db add tensorboardX 2018-09-09 14:11:47 +08:00
lyhuang
6a77731d86 add tensorboardX 2018-09-09 14:08:05 +08:00
Yige XU
be2f4aade3
Merge branch 'master' into test_code 2018-09-09 12:46:11 +08:00
xuyige
12f06d09d2 clean up code in test loader 2018-09-09 12:39:47 +08:00
xuyige
7fb2bcc78c update config loader 2018-09-09 12:36:56 +08:00
xuyige
7c57bc6fc9 fix a bug for config saver 2018-09-09 12:32:39 +08:00
xuyige
58ccb6576f clean up codes 2018-09-09 12:30:33 +08:00
xuyige
476988573b add test code for testing config saver 2018-09-09 12:13:42 +08:00
xuyige
2dd2f0c8f4 update config file for test 2018-09-09 12:12:16 +08:00
xuyige
edd9dedb5d add config saver 2018-09-09 12:11:38 +08:00
lyhuang18
43c09fca5c
Merge pull request #2 from fastnlp/master
merge
2018-09-08 16:57:45 +08:00
Coet
49ad966c5f
Merge pull request #60 from KuNyaa/master
add tensorboardX for loss visualization
2018-09-06 09:56:14 +08:00
Coet
ee2f98fce1
Merge pull request #62 from fastnlp/text_classify_interface
Text Classification Interface
2018-09-06 09:54:03 +08:00
FengZiYjun
5309c98846 Text classification interface is ready.
- fix issue #58, use path.join instead of +
- modify description and version in setup.py
- docstring in core/ follows RestructureText format
2018-09-05 10:00:57 +08:00
KuNya
68b63fb071 add graph summary in _train_step 2018-09-04 20:47:43 +08:00
Coet
63c687d906
Merge pull request #54 from fastnlp/pos_tag_service
CWS+POS tag interface
2018-09-04 11:51:33 +08:00
Zhen Ke
a665ddf909
Merge pull request #56 from keezen/master
Rewrite classification model and add initialization for conv_maxpool module
2018-09-04 11:27:02 +08:00
Coet
a13b8e5c82
Merge branch 'master' into pos_tag_service 2018-09-04 09:25:46 +08:00
KuNya
baf17892a7 add tensorboardX for loss visualization 2018-09-03 19:37:44 +08:00
Xipeng Qiu
4f371446c2
Merge pull request #59 from lyhuang18/test2
update docs
2018-09-02 21:52:07 +08:00
lyhuang
34c78cb9de update docs
move example to docs
2018-09-02 20:08:17 +08:00
lyhuang
292853c84a Merge branch 'master' into test2 2018-09-02 17:50:16 +08:00
lyhuang18
c80ae39fb3
Merge pull request #1 from fastnlp/master
update
2018-09-02 17:48:56 +08:00
xuyige
dbf1e492fd add config saver 2018-09-02 17:40:43 +08:00
Xipeng Qiu
961a321712
Merge pull request #55 from fastnlp/add-more-badges
add more badges in README
2018-09-02 16:45:31 +08:00
Ke Zhen
de89674436 Merge remote-tracking branch 'upstream/master' 2018-09-02 16:42:00 +08:00
Ke Zhen
d910ae3c77 Rewrite classification model, add intialization for conv_maxpool 2018-09-02 16:39:36 +08:00
Coet
e82ec43b37
Update README.md 2018-09-02 15:23:13 +08:00
FengZiYjun
31eac4a795 fix bug in preprocessor: reported in issue 47 2018-09-02 14:33:23 +08:00
FengZiYjun
6f59384d6c pass CI 2018-09-02 14:18:04 +08:00
FengZiYjun
57911f771a - clean up unused codes
- improve code comments
- BaseLoader & its subclasses does not need a data name any more
- update file tree
- add setup.py
2018-09-02 13:32:57 +08:00
FengZiYjun
32a036e8e6 [fix] drop "data" in Tester.make_batch; correct spelling of "show_metrics"
[add] PeopleDailyCorpusLoader, to parse PeopleDaily Corpus
[update] add CWS + POS_tag interface at FastNLP, see example in test_fastNLP.py
[update] modify README.md and readme_example.py to the latest version.
2018-09-01 21:33:28 +08:00
Coet
3a9b5d17e3
Merge pull request #52 from fastnlp/cws_service
Chinese word segmentation interface
2018-09-01 17:54:16 +08:00
FengZiYjun
0430067faf update 2018-08-31 11:51:56 +08:00