-
Notifications
You must be signed in to change notification settings - Fork 499
Description
Ticket Contents
Description
Project Context
IDInsight is building a digital experimentation tool to enable non-technical users—such as program managers, field leaders, and policymakers—to run behavioral or policy experiments without writing code. However, users currently face friction in setting up experiments due to unclear configurations, lack of guidance, and decision overload.
Feature Requirement
This project proposes the design of an AI-powered experiment creation assistant—a conversational or form-based interface that guides users step-by-step through the setup process. The AI agent should:
- Ask contextual questions
- Explain tradeoffs (e.g., type of randomization, priors)
- Auto-fill or recommend values where possible
- Surface helpful definitions and examples
This assistant will significantly improve user experience, reduce setup errors, and make the platform more accessible for non-technical users.
Goals & Mid-Point Milestone
Goals
- Design and prototype a wizard-like interface that walks users through experiment setup using intelligent question flow
- Enable dynamic prompts based on previous inputs (e.g., “Do you want equal randomization?” → suggest simple vs. stratified)
- Integrate AI-based suggestion engine to recommend values for experiment fields (e.g., sample size, priors)
- Allow users to review, accept, or override any suggestions before launching the experiment
- Ensure each step includes contextual tooltips or inline guidance to educate the user
- Support eventual extensibility to support natural language or chat-style interfaces
Setup/Installation
A guided experiment creation tool that helps users complete setup with confidence
Reduced user confusion and support queries about technical terms or configuration
A more accessible experimentation platform with smarter defaults and better usability
Foundation laid for future conversational agent integration (LLM-style wizard)
Expected Outcome
No response
Acceptance Criteria
✅ Wizard interface guides users step-by-step through all fields required to set up an experiment
✅ Intelligent recommendations or tooltips are surfaced at decision points (e.g., priors, assignment ratios)
✅ Users can review all fields before confirming the setup
✅ Suggestions adapt to earlier user inputs and field types
✅ System logs which values were suggested, accepted, or overridden (for future learning)
Implementation Details
Frontend: React/Next.js with wizard component or modal-based navigation
Logic Layer: Rule-based + optional AI model to generate field-level suggestions
NLP Integration (Optional): OpenAI/Gemini-style prompt interface for later iteration
User Logging: Track user interactions with the assistant for improvement
Mockups/Wireframes
To be co-designed with IDInsight's team
Product Name
Experiment Setup Agent
Organisation Name
IDInsight
Domain
Financial Inclusion
Tech Skills Needed
React/Next.js, UX Design, Form Logic, AI Prompt Engineering
Mentor(s)
Category
AI for Research