How to use allenai/H_pre_LQK_32kv_8k_11k_SWA with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("allenai/H_pre_LQK_32kv_8k_11k_SWA", dtype="auto")
