https://github.com/hao-ai-lab/LookaheadDecoding/blob/9d50de4a81d1b473bfce104ace18fbbbb6dc3255/lade/decoding.py#L34C26-L34C39
def sample_proxy(self, *args, **kwargs):
USE_LADE = int(os.environ.get("USE_LADE", 0))
if USE_LADE:
return jacobi_sample_multilevel(self, chat=int(os.environ.get("CHAT", 0)), *args, **kwargs)
else:
return FUNC_MAP["greedy_search"](self, *args, **kwargs)
last line of sample_proxy shoule bereturn FUNC_MAP["sample"](self, *args, **kwargs) ?
https://github.com/hao-ai-lab/LookaheadDecoding/blob/9d50de4a81d1b473bfce104ace18fbbbb6dc3255/lade/decoding.py#L34C26-L34C39
last line of sample_proxy shoule be
return FUNC_MAP["sample"](self, *args, **kwargs)?