Repository navigation
Become a maintainer of the FINOS AI Evals Framework #29
Replies: 5 comments 5 replies
|
@lucaborella89 : Would be interested in contributing |
|
Hi Luca, I’d be very interested in contributing as a maintainer. My background is in enterprise cloud and data architecture, with a focus on AI-ready platforms, AI governance, cybersecurity, and agentic systems. I’m particularly interested in evaluation frameworks for agentic AI, including reliability, tool-use and authorization behavior, data/context grounding, security, and governance-oriented evals. I’d be happy to contribute both technically and on framework/use-case development. Please let me know the best next step for getting involved with the maintainer group. |
|
@scha54 @antara13 thanks for showing your interest in contributing to this project, which has been now approved finos/community#438 I will share details on next steps shortly. In the meantime, please get familiar with https://community.finos.org/docs/governance/ and https://community.finos.org/docs/finos-maintainers-cheatsheet/ |
|
Hi Luca — I’d like to contribute and work toward maintainer responsibilities through sustained project work. I have completed EasyCLA and started contributing to FINOS through Backplane #59, whose current checks are green. For AI Evals, I can take ownership of a concrete first slice: a versioned, vendor-neutral evaluation contract linking use cases, AIGF risks and mitigations, metrics, test cases, evidence, and results. I can pair that with an executable offline blueprint using schemas, deterministic fixtures, validation, and CI so contributors can test it without model credentials. I would begin with a scoped design issue and a worked agent-security example, then iterate with the project rather than treating the first proposal as final. I’ve reviewed the FINOS governance and maintainer guidance linked above. Would this be a useful initial scope? I’m also happy to arrange an onboarding call. |
|
Hi Luca — I’d like to contribute toward becoming a maintainer of the AI Evals Framework. My focus is system-level evaluation of agentic AI: evaluator correctness, reproducible evaluation harnesses, RAG/tool-use evaluation, runtime/trajectory metrics, and governance-oriented evidence. I’m already contributing upstream to AI evaluation/benchmark infrastructure and would like to take ownership of a concrete workstream here rather than contribute isolated documentation. The Agentic Evaluations, Metrics, and evaluation-monitoring/reference-architecture milestones look especially relevant. I’m happy to start with a scoped milestone/deliverable agreed with the current maintainers and build from there under the project’s governance process. |
Uh oh!
There was an error while loading. Please reload this page.
FINOS AI Evals is approved by the FINOS AI Fund, now we are looking for maintainers
All reactions