Search results

Question about Activation quantization

Status: Open.

#113 In OpenGVLab/OmniQuant;

· Tfloow opened on Apr 11, 2026

Question regarding Figure A5

Status: Open.

#112 In OpenGVLab/OmniQuant;

· pahrendt-semron opened on Feb 2, 2026

Bad performance with Auto-GPTQ kernel.d

Status: Open.

#111 In OpenGVLab/OmniQuant;

· jiuyixu25 opened on Jan 16, 2026

Can omniquant be used on CNN models, similar to YOLO?

Status: Open.

#109 In OpenGVLab/OmniQuant;

· yz302 opened on Dec 16, 2025

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:7 and cuda:0! (when checking argument for argument index in method wrapper_CUDA__index_select)

Status: Open.

#105 In OpenGVLab/OmniQuant;

· forcekkk opened on Apr 11, 2025

I encounter a error: "AttributeError: 'LlamaAttention' object has no attribute 'rotary_emb'",when i run code with llama-1-7b. It happened in int_llama_layer.py: self.rotary_emb = copy.deepcopy(org_module.rotary_emb)

Status: Open.

#104 In OpenGVLab/OmniQuant;

· WX-yh opened on Jan 5, 2025

I encounter a error: "AttributeError: 'LlamaAttention' object has no attribute 'rotary_emb'",when i run code with llama-1-7b.

Status: Open.

#103 In OpenGVLab/OmniQuant;

· WX-yh opened on Jan 5, 2025

Fail to reproduce the result of w2a16 using llama2 7b

Status: Open.

#102 In OpenGVLab/OmniQuant;

· stackByStack opened on Dec 16, 2024

Obtained different PPL for Wikitext and C4 compared to results reported in the paper

Status: Open.

#95 In OpenGVLab/OmniQuant;

· yc2367 opened on Sep 12, 2024

Error when evaluating MMLU

Status: Open.

#91 In OpenGVLab/OmniQuant;

· zjq0455 opened on Sep 4, 2024

how to enable llama3-8b int4 awq models

Status: Open.

#90 In OpenGVLab/OmniQuant;

· FlexLaughing opened on Aug 29, 2024

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat2 in method wrapper_CUDA_bmm)

Status: Open.

#89 In OpenGVLab/OmniQuant;

· mcpaulgeorge opened on Aug 5, 2024