Provdes two scripts:
- ainyan-training
- ainyan-dataset
DATASET PREPARE
ainyan-datasets --source jgate-lite --dspath s3://wadalabs/jgate-test --profile jpx
TRAINING
TRAINING=jgate.ini ainyan-training
With jgate.ini like:
[training]
model=NousResearch/Llama-2-7b-chat-hf
aws_profile=jpx
dataset=s3://wadalabs/jgate-small
finalname=jgate-small
learning_rate=2e-3
max_steps=100
MODEL S3 HELPER
ainyan-model-helper --profile jpx --mode up --model jgate-full --bucket wadalabs
ainyan-model-helper --profile jpx --mode dl --model jgate-full --bucket wadalabs