GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
Yannic Kilcher · 37:06
The reviewer agrees that Apple's GSM-Symbolic paper runs solid experiments: LLM math accuracy drops and swings widely when GSM8K problems are lightly changed. He disagrees with its conclusion that LLMs "aren't reasoni...