Spaces:
Running
Running
Commit History
metal : tune soft_max number of threads (#0) 99d668a
metal : fix indent (ggml/0) d4f82d5
ggml : full ALiBi support (llama/7192) 192bda4
metal : fix flash attention kernel requirements (llama/7169) 6cb3028
metal : use `vm_allocate` instead of `posix_memalign` on macOS (llama/7078) eb910b1
Gilad S commited on
ggml : introduce bfloat16 support (llama/6412) 81ec961
Justine Tunney commited on
switch to using localizedDescription (llama/7010) fd25ba6
metal : remove deprecated error code (llama/7008) 42a84fb
metal : log more info on error (llama/6987) d4dcef9
ggml : add Flash Attention (llama/5021) 34d3b03
ggml : group all experts in a single ggml_mul_mat_id (llama/6505) f0b5c67
llama : add qwen2moe (llama/6074) daae175
Added support for GGML_OP_CLAMP in Metal (llama/6662) a06cbc7
Dave dave-fl commited on
metal : unify mul_mv_id kernels (llama/6556) e9910b5
slaren commited on
feat: implemented sigmoid function (ggml/806) cd0c122
Justina Cho commited on
ggml : mul_mat_id use the same tensor for all the experts (llama/6387) 26fdc9f unverified
sync : ggml (#2001) cbbfa9e unverified
metal : build metallib + fix embed path (llama/6015) 27311ef unverified
ggml : reuse quantum structs across backends (llama/5943) bb0625f unverified
metal : move mm_id indices to shared mem (llama/5982) 1350705 unverified
ggml : introduce ggml_status (ggml/750) 151c676 unverified
IQ4_XS: a 4.25 bpw quantization (llama/5747) 0ee1bfb unverified
code : normalize enum names (llama/5697) 93e0830 unverified
IQ3_S: a much better alternative to Q3_K (llama/5676) 32589c9 unverified
Introduce backend GUIDs (ggml/743) a7eb9f6 unverified
UEXTM.com slaren commited on
sync : llama.cpp (ggml/0) f8e8d34 unverified
1.5 bit quantization (llama/5453) 9c3aa6a unverified
ggml : add ALiBi support for ggml_soft_max_ext (llama/5488) 26c019a unverified
metal : use autoreleasepool to avoid memory leaks (llama/5437) c276f12 unverified
metal : option to embed MSL source into compiled binary (#1842) a46b62a unverified
Didzis Gosko commited on
metal : add im2col F32 dst support (llama/5132) 26aec77 unverified
SOTA 3-bit quants (llama/5196) 4649943 unverified
ggml : add max buffer sizes to opencl and metal backends (llama/5181) 3d354d0 unverified
slaren commited on
metal : free metal objects (llama/5161) ea7167a unverified
Paul Tsochantaris commited on
ci : fix yolo URLs + fix metal capture (ggml/712) 588f789 unverified
metal : add debug capture backend function (ggml/694) ece88c3 unverified
ggml : add Vulkan backend (llama/2059) 5a97aba unverified
metal : remove unused `n_buffers` and `buffers` (llama/5129) a3e87d3 unverified
Paul Tsochantaris commited on