Sending follow up options with response for chat message

[paulGeoghegan]

I'm setting up a chat bot using the AI SDK and the svelte package for handeling the chat.
I'm using Ollama for local testing but will probably deploy to Deepinfra for prod.
As part of the project I want to generate follow up prompts for the bot as the bot is meant for educators so they can learn more about a particular topic.
I have tried a few different approaches to this:

1. Generating structured data. As far as I know the chat class doesn't support this and I couldn't figure out how to just turn the response as UIMessageStreamResponse like you can with just a text stream. Even if I tried to manually build the object to return it it wouldn't be picked up by the chat class.
2. I have also tried using a tool. This was not a great fix but I would call something like llama3.2 to generate the response and then use a tool to then generate the followups by using generateObject and send it the bots response. I would use a lower powered model for this but it wouldn't return the actual response just the tool response. I could get the response from the tool input but this seems like a rather fragile solution.
   Is there a better way to approach this? I have considered other alternatives like trying to have it generate a structured text response e.g.:

My answer goes here
-----
Follow up 1
Follow up 2

I also don't think that's a good idea as if it deviates from the prompt at all they would be displayed in the body of the response and wouldn't be clickable action buttons.

[ronald-das]

@paulGeoghegan check https://www.aihero.dev/streaming-in-next-question-suggestions-with-the-ai-sdk