mirror of
https://gitee.com/fastnlp/fastNLP.git
synced 2024-12-05 05:38:31 +08:00
Migrated repository
5824b7f4c7
* dataset检查slice开始位置，确保结果不为空 * fieldarray检查content不为空 * optimizer接受的model params是一个generator，不能赋值 * code style refine |
||
|---|---|---|
| .github | ||
| docs | ||
| fastNLP | ||
| reproduction | ||
| test | ||
| .travis.yml | ||
| LICENSE | ||
| README.md | ||
| requirements.txt | ||
| setup.py | ||
fastNLP
FastNLP is a modular Natural Language Processing system based on PyTorch, built for fast development of NLP models.
A deep learning NLP model is the composition of three types of modules:
For example:
Requirements
- numpy>=1.14.2
- torch>=0.4.0
- tensorboardX
Resources
Installation
Run the following commands to install fastNLP package.
pip install fastNLP
Project Structure
| module type | functionality | example |
| encoder | encode the input into some abstract representation | embedding, RNN, CNN, transformer |
| aggregator | aggregate and reduce information | self-attention, max-pooling |
| decoder | decode the representation into the output | MLP, CRF |
| fastNLP | an open-source NLP library |
| fastNLP.api | APIs for end-to-end prediction |
| fastNLP.core | data representation & train/test presedure |
| fastNLP.models | a collection of NLP models |
| fastNLP.modules | a collection of PyTorch sub-models/components/wheels |
| fastNLP.io | readers & savers |