I am experimenting with Foundation Models in my time tracking app to analyze users tracked events, but I am finding that the model struggles with even basic computation of time. Specifically converting from seconds to hours and minutes.
To give just one example, when I prompt:
"Convert 3672 seconds to hours, minutes, and seconds. Don't include the calculations in the resulting output"
I get this:
"3672 seconds is equal to 1 hour, 0 minutes, and 36 seconds".
Which is clearly wrong - it should be 1 hour, 1 minute, and 12 seconds. Another issue that I saw a lot is that seconds were considered to be minutes, or that the hours were just completely off.
What can I do to make the support for math better? Or is that just something that the model is not meant to be used for?
As of today, doing math is probably not the best use case for the on-device 3B Apple Foundation Models. Feel free to file a feedback report for us though.
Probably not quite relevant, but if your intent is to do time component conversion, DateComponentsFormatter should help.
Best,
——
Ziqiao Chen
Worldwide Developer Relations.
