Migrated repository
Go to file
2018-11-10 18:49:22 +08:00
.github add logging in Trainer & Tester 2018-08-17 11:16:13 +08:00
docs update docs 2018-10-05 05:34:26 +08:00
examples Merge Preprocessor and DataSet 2018-09-28 21:35:17 +08:00
fastNLP improve trainer: log mean and std of model params, and sum of gradients 2018-11-10 18:49:22 +08:00
reproduction improve trainer: log mean and std of model params, and sum of gradients 2018-11-10 18:49:22 +08:00
test add tests 2018-11-01 15:09:41 +08:00
.travis.yml - add progress bar for data set loading 2018-10-01 20:33:29 +08:00
LICENSE add LICENSE, setup.py & requirements.txt 2018-05-25 18:32:02 +08:00
README.md Update README.md 2018-10-20 14:27:05 +08:00
requirements.txt update requirements 2018-11-09 19:58:15 +08:00
setup.py Update setup.py 2018-10-01 21:40:34 +08:00

fastNLP

Build Status codecov PyPI version Hex.pm Documentation Status

fastNLP is a modular Natural Language Processing system based on PyTorch, for fast development of NLP tools. It divides the NLP model based on deep learning into different modules. These modules fall into 4 categories: encoder, interaction, aggregation and decoder, while each category contains different implemented modules. Encoder modules encode the input into some abstract representation, interaction modules make the information in the representation interact with each other, aggregation modules aggregate and reduce information, and decoder modules decode the representation into the output. Most current NLP models could be built on these modules, which vastly simplifies the process of developing NLP models. The architecture of fastNLP is as the figure below:

Requirements

  • numpy>=1.14.2
  • torch==0.4.0
  • torchvision>=0.1.8
  • tensorboardX

Resources

Installation

Run the following commands to install fastNLP package.

pip install fastNLP

Project Structure

fastNLP an open-source NLP library
fastNLP.core trainer, tester, predictor
fastNLP.loader all kinds of loaders/readers
fastNLP.models a collection of NLP models
fastNLP.modules a collection of PyTorch sub-models/components/wheels
fastNLP.saver all kinds of savers/writers
fastNLP.fastnlp a high-level interface for prediction