Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor to put the AZ CLI related calls behind an interface #259

Open
wants to merge 57 commits into
base: main
Choose a base branch
from

Merge remote-tracking branch 'origin/main' into ralphe/refactor_azcli…

db83201
Select commit
Loading
Failed to load commit list.
Open

Refactor to put the AZ CLI related calls behind an interface #259

Merge remote-tracking branch 'origin/main' into ralphe/refactor_azcli…
db83201
Select commit
Loading
Failed to load commit list.
Azure Pipelines / Azure.azure-ai-cli failed Apr 5, 2024 in 20m 40s

Build #20240405.3 had test failures

Details

Tests

  • Failed: 18 (100.00%)
  • Passed: 0 (0.00%)
  • Other: 0 (0.00%)
  • Total: 18

Annotations

Check failure on line 1489 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Azure.azure-ai-cli

Build log #L1489

Script failed with exit code: 1

Check failure on line 19 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Azure.azure-ai-cli

Build log #L19

There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.

Check failure on line 1 in yaml.ai_chat_tests.ai init.TestCases.ai init speech

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Azure.azure-ai-cli

yaml.ai_chat_tests.ai init.TestCases.ai init speech

EXIT CODE: 1
Raw output
/home/cloudtest/.dotnet/tools/ai ai init speech --subscription "e72e5254-f265-4e95-9bd2-9ee8e7329051" --name "robch-cranky-red-koala-ais" --interactive "false"
COMMAND: ai init speech
subscription:
e72e5254-f265-4e95-9bd2-9ee8e7329051
name:
robch-cranky-red-koala-ais
interactive:
false

Check failure on line 1 in yaml.test_ai_vision.Test AI Vision Image Analysis.TestCases.09.test ai IA caption (JSON)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Azure.azure-ai-cli

yaml.test_ai_vision.Test AI Vision Image Analysis.TestCases.09.test ai IA caption (JSON)

EXIT CODE: 1
Raw output
/home/cloudtest/.dotnet/tools/ai run --command @/tmp/tmpvsNvZn.tmp --expect @/tmp/tmpKy14Kn.tmp --not expect @/tmp/tmpgIlbVq.tmp
COMMAND: ai vision image analyze
url:
https://aka.ms/azsdk/image-analysis/sample.jpg
visual-features:
caption
outputtype:
json

Check failure on line 1 in yaml.ai_chat_tests.Test AI Chat history.TestCases.01.test ai chat history save

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Azure.azure-ai-cli

yaml.ai_chat_tests.Test AI Chat history.TestCases.01.test ai chat history save

EXIT CODE: 1
Raw output
/home/cloudtest/.dotnet/tools/ai run --process "/bin/bash" --pre.script -l --script "/tmp/tmpDr7Hln.tmp"  --expect @/tmp/tmpqXmjno.tmp
#!/bin/bash  
rm *

ai chat --question "Why is the sky blue, what's it called" --output-chat-history-file chat-history.jsonl

# Read the jsonl file  
FILE="chat-history.jsonl"  
NUM_LINES=$(wc -l < "$FILE")  
ROLE_SYSTEM_COUNT=$(grep -c "\"role\":\"system\"" "$FILE")  
ROLE_USER_COUNT=$(grep -c "\"role\":\"user\"" "$FILE")  
ROLE_ASSISTANT_COUNT=$(grep -c "\"role\":\"assistant\"" "$FILE")  

# Validate if the file is correct jsonl  
jq -e ".[]" < "$FILE" > /dev/null 2>&1  
JSONL_VALID=$?  

# Check the conditions  
if [ $NUM_LINES -eq 3 ] && [ $ROLE_SYSTEM_COUNT -eq 1 ] && [ $ROLE_USER_COUNT -eq 1 ] && [ $ROLE_ASSISTANT_COUNT -eq 1 ] && [ $JSONL_VALID -eq 0 ]; then  
    echo "The file is valid."  
else  
    echo "The file is not valid."  
    if [ $JSONL_VALID -ne 0 ]; then  
        echo " - The file is not a valid JSONL."  
    fi  
    if [ $NUM_LINES -ne 3 ]; then  
        echo " - There are not exactly 3 rows."  
    fi  
    if [ $ROLE_SYSTEM_COUNT -ne 1 ]; then  
        echo " - There is no row with \"role\":\"system\" in it."  
    fi  
    if [ $ROLE_USER_COUNT -ne 1 ]; then  
        echo " - The row with \"role\":\"user\" is not exactly as above."  
    fi  
    if [ $ROLE_ASSISTANT_COUNT -ne 1 ]; then  
        echo " - There is no row with \"role\":\"assistant\" in it."  
    fi  
fi  
rm *

Check failure on line 1 in yaml.test_ai_vision.Test AI Vision Image Analysis.TestCases.06.test ai IA from file

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Azure.azure-ai-cli

yaml.test_ai_vision.Test AI Vision Image Analysis.TestCases.06.test ai IA from file

EXIT CODE: 1
Raw output
/home/cloudtest/.dotnet/tools/ai run --command @/tmp/tmpAJU2Gq.tmp --expect @/tmp/tmpwWNCon.tmp --not expect @/tmp/tmpoxDh0q.tmp
COMMAND: ai vision image analyze
file:
../tests/image-analysis-sample.jpg
visual-features:
caption