【第73期】HiAR-ICL:LLM推理的ICLSeventy3

【第73期】HiAR-ICL:LLM推理的ICL

19分钟 ·
播放数5
·
评论数0

Seventy3: 用NotebookLM将论文生成播客,让大家跟着AI一起进步。

今天的主题是:

Beyond Examples: High-level Automated Reasoning Paradigm in In-Context Learning via MCTS

Summary

This research paper introduces HiAR-ICL, a novel framework for improving in-context learning (ICL) in large language models (LLMs), particularly for complex mathematical reasoning. Instead of relying solely on example demonstrations, HiAR-ICL uses Monte Carlo Tree Search (MCTS) to automatically generate and select higher-level reasoning patterns, effectively "teaching the LLM to think" rather than just mimicking examples. The approach uses five atomic reasoning actions as building blocks for these patterns, and a cognitive complexity framework to match problems with appropriate patterns. Experimental results show HiAR-ICL achieves state-of-the-art accuracy on several benchmarks, surpassing even some closed-source LLMs, especially when used with smaller, open-source models.

原文链接:arxiv.org