inference.c

LLM inference engine based on the C language.

What I should develop

1. .gguf Parser

• Dequantizer

2. Inference Logic for LLM

• Positional Encoder
• Feed-Forward Layer
• Multi-Head Attention
• Normalization Layer
• Actavation function
• SIMD
• KV cache management
• Sampling algorithms
• Tokenizer
• Look-up algorithm