I need to change tool definitions between steps

[theswerd]

How can I change the tools definitions between steps?

Use case: Multi step code execution, need to run code -> get output -> put output into env var for future executions -> update the tool definition to include the env var.

Any thoughts?

[1hachem]

@theswerd did you find any solution for this, it seems that the sdk doesn't support this natively you need to implement your own chat loop

[1hachem]

you can checkout #6615

[1hachem]

here is an example

      const maxSteps = 5; // Define maximum number of steps
      let currentStep = 0;

      while (currentStep < maxSteps) {
        const result = streamText({
          model: isLearning
            ? myProvider.languageModel('learning-model')
            : myProvider.languageModel('execution-model'),
          system: isLearning
            ? learningSystemPrompt({ memories: user.memories })
            : workingSystemPrompt({
                role: agent.role,
                goal: agent.goal,
                backstory: agent.backstory,
                steps: agent.steps,
                tips: agent.tips,
                memories: user.memories,
              }),
          experimental_generateMessageId: generateUUID,
          messages: currentMessages,
          experimental_transform: smoothStream({ chunking: 'word' }),
          tools: runtimeAgent.tools,
          maxSteps: 1,
        });

        result.consumeStream();
        result.mergeIntoDataStream(writer);

        const response = await result.response;

        // using this as trick to convert response message to UI message :p
        const [, assistantMessage] = appendResponseMessages({
          messages: [userMessage],
          responseMessages: response.messages,
        });

        await repository.message.create({
          chatId,
          role: assistantMessage.role,
          parts: assistantMessage.parts,
          attachments: {},
        });

        if (
          assistantMessage.parts?.every(
            (part) => part.type != 'tool-invocation'
          )
        ) {
          break;
        }

        // Update messages for next iteration
        currentMessages = [...currentMessages, ...response.messages];
        currentStep++;
      }

[github-actions[bot]]

This discussion was automatically locked because it has not been updated in over 30 days. If you still have questions about this topic, please ask us at community.vercel.com/ai-sdk