langfuse-setup-dataset

[priyanshu6238]

## Description
Added a new endpoint /evaluation/upload-dataset to facilitate the uploading of evaluation datasets in CSV format. This endpoint allows users to create datasets in Langfuse for model evaluation purposes.

Features

• CSV file upload with validation for required columns (input and expected_output)
• Automatic dataset creation in Langfuse using organization-specific credentials
• Processing of up to 30 rows per dataset to manage evaluation time and costs
• Comprehensive error handling and logging
• Integration with existing authentication and authorization system

Technical Details

• Endpoint: POST /evaluation/upload-dataset
• Required Parameters:
  • dataset_name: Name for the dataset in Langfuse
  • file: CSV file containing evaluation data

CSV Format Requirements:

• Must contain two columns: input and expected_output
• Maximum 30 rows will be processed
• Headers must be exactly as specified

[x] Ran fastapi run --reload app/main.py or docker compose up in the repository root and test.
[x ] If you've fixed a bug or added code that is tested and has test cases.

Notes

Please add here if any other information is required for the reviewer.

[codecov]

Codecov Report

Attention: Patch coverage is 25.39683% with 47 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
backend/app/api/routes/evaluation.py	24.19%	47 Missing ⚠️

📢 Thoughts on this report? Let us know!

[AkhileshNegi]

Putting it on hold for some time