Automated data synthesis. I made a bot! #39
DataBassGit
started this conversation in
Data
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
So I've built a bot to generate the logs that can be used for phase 2 - Synthesize CoT and Self-Critique data.
Essentiallly, it follows the process outlined in this video: https://www.youtube.com/watch?v=zzaEBGOVKIg
There are a few additional things it's doing, however. It's implementing theory of mind to kind of reframe the question. It also has a knowledge base and infinite memory rag system, complete with reranker. This all occurs at the beginning of the proccess and is less that 5% of total token usage, so we can scrap it if it's deemed irrelevant. Link to repo below.
https://github.com/DataBassGit/o7
Oh yeah, did I mention that because it's built on AgentForge, it can run through any LLM?
Beta Was this translation helpful? Give feedback.
All reactions