NLP Models
A repository for building transformer based nlp models
Installation
Install from PyPi
pip install nlp-models
Install from source
git clone git@github.com:minggnim/nlp-models.git
pip install -r requirements
Llama2 Quantization model on consumer CPU
Run Chat applications on CPU
-
Streamlit UI
cd apps
streamlit run chat.py
-
Command line
llm_app chat -s 'hi there'
Run Q&A application on CPU
-
Steamlit UI
cd apps
streamlit run qa.py
Models
-
bert_classifier
A wrapper package around BERT-based classification models
-
multi_task_model
An implementation of multi-tasking model built on encoder models
-
GPT-2
-
Falcon 7B
-
Quantized Llama2 models