To further research on LLM math reasoning, OpenAI released Grade School Math (GSM8k), a dataset of high quality math word problems requiring multi-step solutions. The dataset contains 8.5k, linguisticaly diverse, grade school math word problems with correct answers.

The problems cover concepts up to early algebra. While no specific age range is given, the authors suggest a bright middle school student should be able to answer every question.

In the main dataset, each answer contains a multi-step solution. In the socratic dataset, each answer contains a multi-step solution as well as socratic sub-questions.

The dataset is useful for assessing LLM math reasoning capabilities and developing automatic student feedback tools.

Permissions and licensing

License

MIT License

Key restrictions

This dataset is open for use without limitation to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies. The permission notice shall be included in all copies or substantial portions of the Software.

How to access the data

This dataset is available to anyone. To access the data, head to the Data download tab and follow the instructions provided.