inference kv-cache kv-cache-compression large-language-models llm long-context python pytorch transformers

cnn flickr8k-dataset grouped-query-attention image-captioning image-text kv-cache llama3 mobilenetv3 nlp pytorch pytorch-lightning rms-norm rotary-position-embedding transformer

huggingface kv-cache llamacpp llm-inference probability prompt-engineering text-classification zero-shot