How to stream the tool invocation steps to the client for display #1908
              
                Unanswered
              
          
                  
                    
                      kalcifield
                    
                  
                
                  asked this question in
                Q&A
              
            Replies: 1 comment
-
| Hi @kalcifield, just fyi, I had a similar question a while back: #960 (but no response/update). | 
Beta Was this translation helpful? Give feedback.
                  
                    0 replies
                  
                
            
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
I am curious if its possible to stream the function calls in the Assistant response right before doing it, so the user knows what process is going on in the background. Like in the case of perplexity:

I am using the bedrock converse implementation.
I suppose the proxy toolcall might be of use, but I would prefer to extend the original assistant message on the fly
Beta Was this translation helpful? Give feedback.
All reactions