Posts for: #llama.cpp

Vectorising convolution kernels in llama.cpp

2026-04-10 Paddy McNabb

Experimenting with a range of RISC-V vectorisation ops for comparison to the scalar op in llama.cpp.

Optimising LLM Inference on RISC-V with Custom GEMM Kernels

2026-03-23 Paddy McNabb

risc-v llm gemm llama.cpp rvv gem5 performance

Extending llama.cpp RISC-V GEMM tile from 4×8 to 4×16 — register pressure analysis, LLVM IR metrics, and cycle-accurate gem5 simulation showing a 31% improvement in cycles per output value.

[Read more]

RISC-V LLM Code Reference

2026-03-23 Paddy McNabb

risc-v rvv llama.cpp gem5 qemu code

A concise reference for RISC-V vector intrinsics, QEMU emulation, gem5 simulation, and llama.cpp kernel patterns used in LLM inference optimisation.

[Read more]