LanguageModelSession.GenerationError.exceededContextWindowSize not called

Machine Learning & AI Foundation Models
limtc
limtc OP
Created 2w
Replies 2
Boosts 0
Views 308
Participants 2

When context window size exceeded, this error is not called (instead another error has shown up) to handle new session.

LanguageModelSession.GenerationError.exceededContextWindowSize

Or am I doing things wrong?

Answered by Frameworks Engineer in 847671022

Thanks for flagging this. This is a known issue tracked under 153892731 and it happens only when you are streaming the response.

Replies  2
Boosts  0
Views  308
Participants  2
Apple Staff, Frameworks Engineer
Frameworks Engineer OP
Apple
2w
Accepted Answer
Recommended

Thanks for flagging this. This is a known issue tracked under 153892731 and it happens only when you are streaming the response.

0
limtc
limtc OP
1w

It is fixed in beta 3 (streaming version, I didn't try non streaming). Thanks!

0
LanguageModelSession.GenerationError.exceededContextWindowSize not called
First post date Last post date
 
 
Q