Python
meta llama 파인 튜닝(fine tuning)
ndlessrain
2023. 12. 6. 15:31
728x90
https://github.com/OpenPipe/OpenPipe/tree/main/examples/classify-recipes
따라해보려나...
메타 : https://ai.meta.com/llama/get-started/
Getting started with Llama 2 - AI at Meta
import torch model_id = "meta-llama/Llama-2-7b-hf" new_model = "output/llama-2-guanaco-7b/checkpoint-1875/adapter_model" # change if needed quantization_config = BitsAndBytesConfig( load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_use_dou
ai.meta.com
728x90