Add Quarto evaluation workflow and test suite #24
Conversation
Introduces a GitHub Actions workflow to run Quarto-related evaluations and publish reports to Posit Connect. Adds an R script for automated evaluation and a CSV file containing test cases for Quarto help scenarios.
Changed the solver argument in eval_quartohelp.R to reference the chat_quartohelp function directly instead of calling it. Updated the callout block example in the evaluation suite CSV to use the generic :::{.callout-*} syntax for improved accuracy.
t-kalinowski
left a comment
t-kalinowski
left a comment
There was a problem hiding this comment.
Thank you, LGTM!. I added one small comment on the gha action.
| env: | ||
| OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }} | ||
| run: | | ||
| Rscript -e 'source("R/store.r"); update_store()' |
There was a problem hiding this comment.
Instead of sourcing one of the files, can we install the quartohelp package here?
Adds installation step for the quartohelp package and updates the store download step to use quartohelp::update_store() instead of sourcing store.r.
Changed the R package installation in the eval-and-publish workflow to use tidyverse/vitals instead of any::vitals for improved package sourcing.
|
|
||
| - name: Install quartohelp package | ||
| run: | | ||
| R CMD INSTALL . |
There was a problem hiding this comment.
I think you can just add a local::. to the extra-packages list of the previous setup-r-dependencies action, which will automatically pull in all the quartohelp dependencies! https://github.com/r-lib/actions/tree/v2-branch/setup-r-dependencies#installing-the-local-package
There was a problem hiding this comment.
I am getting an error - Error in library(readr) : there is no package called ‘readr’ if I do this:
- uses: r-lib/actions/setup-r-dependencies@v2
with:
extra-packages: |
local::.
tidyverse/vitals
needs: check
- name: Download ragnar store
env:
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
run: |
Rscript -e 'quartohelp::update_store()'I need the dev version of vitals since the feature is not on the CRAN version yet
Replaces individual R package installations with 'local::.' and removes explicit installation of the quartohelp package. This streamlines dependency management in the GitHub Actions workflow.
2 participants
Introduces a GitHub Actions workflow to run Quarto-related evaluations and publish reports to Posit Connect. Adds an R script for automated evaluation and a CSV file containing test cases for Quarto help scenarios.