Skip to content

lm_eval_hf error #871

@jimmy-adams

Description

@jimmy-adams

Hello,
I follow the guidance and install by git clone the repo and followed the pip installation.
Then when i go into the example/llm_eval/ and tried running lm_eval_hf.py, it gave the error like below:
//===================================================================
Traceback (most recent call last):
File "/proj/xcohdstaff5/huji/Model-Optimizer/examples/llm_eval/lm_eval_hf.py", line 42, in
from lm_eval.main import cli_evaluate, parse_eval_args, setup_parser
ImportError: cannot import name 'parse_eval_args' from 'lm_eval.main' (/proj/rdi/staff/huji/conda/envs/Quark_Rocm/lib/python3.12/site-packages/lm_eval/main.py)
//===================================================================//
My python version is 3.12
Hope you can help with it, thank you

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions