Is 3.15 bigger than Pi?

A blog discussing a mathematical issue LLMs face when comparing between infinite decimals
LLMs
mathematics
numbers
Author

Emoo

Published

February 2, 2024

Is 3.15 bigger than Pi?

pi.png

While comparing Pi to other numbers is straightforward for individuals familiar with its properties, LLMs appear to struggle with this task.

These are very different answers I get from GPT-4.0 and GPT-3.5.

Note

GPT-3.5: Screenshot 2024-05-12 at 6.30.02 PM.png

Note

GPT-4.0: Screenshot 2024-05-12 at 6.31.41 PM.png

So now I have an idea to let GPT-4.0 correct GPT-3.5.

Screenshot 2024-05-12 at 6.33.03 PM.png

Then I put this correction back to 3.5

Screenshot 2024-05-12 at 6.33.54 PM.png

Screenshot 2024-05-12 at 6.34.19 PM.png