Skip to content

[DMP 2025]: AI-Powered Assistant for Guided Experiment Creation #551

@tanishk2907

Description

@tanishk2907

Ticket Contents

Description

Project Context
IDInsight is building a digital experimentation tool to enable non-technical users—such as program managers, field leaders, and policymakers—to run behavioral or policy experiments without writing code. However, users currently face friction in setting up experiments due to unclear configurations, lack of guidance, and decision overload.

Feature Requirement
This project proposes the design of an AI-powered experiment creation assistant—a conversational or form-based interface that guides users step-by-step through the setup process. The AI agent should:

  • Ask contextual questions
  • Explain tradeoffs (e.g., type of randomization, priors)
  • Auto-fill or recommend values where possible
  • Surface helpful definitions and examples

This assistant will significantly improve user experience, reduce setup errors, and make the platform more accessible for non-technical users.

Goals & Mid-Point Milestone

Goals

  • Design and prototype a wizard-like interface that walks users through experiment setup using intelligent question flow
  • Enable dynamic prompts based on previous inputs (e.g., “Do you want equal randomization?” → suggest simple vs. stratified)
  • Integrate AI-based suggestion engine to recommend values for experiment fields (e.g., sample size, priors)
  • Allow users to review, accept, or override any suggestions before launching the experiment
  • Ensure each step includes contextual tooltips or inline guidance to educate the user
  • Support eventual extensibility to support natural language or chat-style interfaces

Setup/Installation

A guided experiment creation tool that helps users complete setup with confidence

Reduced user confusion and support queries about technical terms or configuration

A more accessible experimentation platform with smarter defaults and better usability

Foundation laid for future conversational agent integration (LLM-style wizard)

Expected Outcome

No response

Acceptance Criteria

✅ Wizard interface guides users step-by-step through all fields required to set up an experiment
✅ Intelligent recommendations or tooltips are surfaced at decision points (e.g., priors, assignment ratios)
✅ Users can review all fields before confirming the setup
✅ Suggestions adapt to earlier user inputs and field types
✅ System logs which values were suggested, accepted, or overridden (for future learning)

Implementation Details

Frontend: React/Next.js with wizard component or modal-based navigation

Logic Layer: Rule-based + optional AI model to generate field-level suggestions

NLP Integration (Optional): OpenAI/Gemini-style prompt interface for later iteration

User Logging: Track user interactions with the assistant for improvement

Mockups/Wireframes

To be co-designed with IDInsight's team

Product Name

Experiment Setup Agent

Organisation Name

IDInsight

Domain

Financial Inclusion

Tech Skills Needed

React/Next.js, UX Design, Form Logic, AI Prompt Engineering

Mentor(s)

@sidravi1

Category

AI for Research

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions