pauldtyler/naic-guide-llama3.2-3b

NAIC Guide - Llama 3.2 3B Fine-tuned (Experimental)

Note: This is an experimental model created for learning and research purposes. It should not be used for actual insurance advice.

A fine-tuned model that answers questions about life insurance and annuities using official NAIC (National Association of Insurance Commissioners) Buyer's Guides.

Overview

This model was created as an experiment in fine-tuning LLMs on domain-specific regulatory content. It demonstrates how a small language model can be trained to:

• Answer questions from specific source documents
• Cite sources (guide name, section)
• Refuse off-topic questions

Training

• Base Model: Llama 3.2 3B Instruct
• Method: LoRA fine-tuning with MLX on Apple Silicon
• Training Data: ~1,700 synthetic Q&A pairs generated from 5 official NAIC Buyer's Guides covering:
  • Annuities (general and fixed)
  • Life insurance
  • Cancer insurance
  • Long-term care insurance

Usage with Ollama

1. Download naic-guide-f16.gguf
2. Create a Modelfile:

   FROM ./naic-guide-f16.gguf
   PARAMETER temperature 0.3
   SYSTEM "You are a precise advisor that answers questions about life insurance and annuities using ONLY the official NAIC Buyer's Guides. Always cite the guide name and section. If something isn't covered in the guides, say so. Never give personalized financial, legal, or tax advice."
   

3. Register with Ollama:

   ollama create naic-guide -f Modelfile
   

4. Run:

   ollama run naic-guide
   

Example

Q: What is a surrender charge?

A: A surrender charge is a fee you'll have to pay if you cancel your policy before being eligible for the full return of premiums (GUIDE: Anb Annuities Fixed, SECTION: Fees, Charges, and Adjustments).

Limitations

• This is an experimental model for educational purposes only
• Not a substitute for professional insurance advice
• Knowledge is limited to the 5 NAIC guides used in training
• May occasionally hallucinate or provide incomplete information

License

This model inherits the Llama 3.2 license. The training content is derived from publicly available NAIC consumer guides.