release: 0.2.0-alpha.23

Author: whoseoyster

.release-please-manifest.json

@@ -1,3 +1,3 @@
 {
-  ".": "0.2.0-alpha.22"
-}
+  ".": "0.2.0-alpha.23"
+}

CHANGELOG.md

@@ -5,20 +5,15 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/)
 and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.html).
 
-## Unreleased
+## 0.2.0-alpha.23 (2024-08-26)
 
-### Added
-* Added support for OpenAI assistants. The `llm_monitor` now supports monitoring OpenAI assistant runs with the function `monitor_run`.
-* Added the ability to use the `llm_monitor.OpenAIMonitor` as a context manager.
-* Added `openlayer_inference_pipeline_id` as an optional parameter to the `OpenAIMonitor`. This is an alternative to `openlayer_inference_pipeline_name` and `openlayer_inference_project_name` parameters for identifying the inference pipeline on the platform.
-* Added `monitor_output_only` as an argument to the OpenAI `llm_monitor`. If set to `True`, the monitor will only record the output of the model, and not the input.
-* Added `costColumnName` as an optional field in the config for LLM data.
+Full Changelog: [v0.2.0-alpha.22...v0.2.0-alpha.23](https://github.com/openlayer-ai/openlayer-python/compare/v0.2.0-alpha.22...v0.2.0-alpha.23)
 
-### Changed
-* `llm_monitor` for OpenAI models now records the `cost` estimate and uploads it.
+### Features
 
-### Removed
-* Deprecated and removed `publish_ground_truths` method. Use `update_data` instead.
+* improvement: updates to custom metric runner
+* improvement: skip metrics if already computed, surface errors for each metric
+* feat: add --dataset flag so custom metrics can be forced to run on only specific datasets
 
 ## 0.2.0-alpha.22 (2024-08-21)
 

pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "openlayer"
-version = "0.2.0-alpha.22"
+version = "0.2.0-alpha.23"
 description = "The official Python library for the openlayer API"
 dynamic = ["readme"]
 license = "Apache-2.0"

src/openlayer/_version.py

@@ -1,4 +1,4 @@
 # File generated from our OpenAPI spec by Stainless. See CONTRIBUTING.md for details.
 
 __title__ = "openlayer"
-__version__ = "0.2.0-alpha.22"  # x-release-please-version
+__version__ = "0.2.0-alpha.23"  # x-release-please-version