Skip to content

add win arm64 tests #652

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
prathikr wants to merge 32 commits into
base: main
Choose a base branch
from
Open

add win arm64 tests #652

Show file tree
Hide file tree
Changes from 17 commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
4e66905
fixes
Apr 17, 2026
9d3c418
arm64
Apr 17, 2026
4b2e002
fix
Apr 17, 2026
0f8335b
lfs on mac
Apr 17, 2026
b055fb1
lfs
Apr 17, 2026
414bb75
skip osx flc tests
Apr 17, 2026
6f534b3
more fixes
Apr 17, 2026
03f5f2e
linux
Apr 17, 2026
b6914ac
disable embeddings tests on CI
Apr 17, 2026
d65d924
revert python
Apr 17, 2026
b84dc1a
Revert "disable embeddings tests on CI"
Apr 17, 2026
9b8158c
final fixes pls
Apr 17, 2026
6deecba
RestoreCleanupAssetsForUnsupportedProjects
Apr 17, 2026
1236d7c
Merge remote-tracking branch 'origin' into prathikrao/pipeline-fixes-…
Apr 17, 2026
1203fb0
pls work
Apr 17, 2026
3320548
revert linux
Apr 17, 2026
23780cf
win-arm64
Apr 17, 2026
96d14a2
fix
Apr 18, 2026
14ee568
Revert "fix"
Apr 18, 2026
1beeb0f
Merge remote-tracking branch 'origin' into prathikrao/add-win-arm64-t…
May 12, 2026
dc47177
Add back
May 12, 2026
a852c5a
scan
May 12, 2026
9bd2fac
checkout template
May 12, 2026
30a48b0
custom
May 12, 2026
65b108f
fixes
May 13, 2026
cf711d4
restrict
May 13, 2026
1b42b23
typo
May 13, 2026
4591abb
diff pool
May 13, 2026
ab8cbcf
new pool
May 13, 2026
cbfdb6a
pool
May 13, 2026
f0f4182
fix
May 13, 2026
13e0b7e
more arm fixes
May 13, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
209 changes: 203 additions & 6 deletions .pipelines/foundry-local-packaging.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ extends:
- job: flc_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-Win-CPU-2022
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
outputs:
Expand All @@ -165,6 +165,8 @@ extends:
steps:
- checkout: neutron-server
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/build-core-steps.yml@self
parameters:
flavor: win-arm64
Expand Down Expand Up @@ -203,8 +205,13 @@ extends:
artifactName: 'flc-osx-arm64'
targetPath: '$(Build.ArtifactStagingDirectory)/native'
steps:
# AcesShared macOS agents don't have git-lfs pre-installed
- script: brew install git-lfs && git lfs install
displayName: 'Install Git LFS'
- checkout: neutron-server
clean: true
- checkout: test-data-shared
lfs: true
Comment thread
prathikr marked this conversation as resolved.
Outdated
- template: .pipelines/templates/build-core-steps.yml@self
parameters:
flavor: osx-arm64
Expand Down Expand Up @@ -669,6 +676,30 @@ extends:
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_cs_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
artifactName: 'flc-nuget'
targetPath: '$(Pipeline.Workspace)/flc-nuget'
- input: pipelineArtifact
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
- checkout: self
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/test-cs-steps.yml@self
parameters:
isWinML: false
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_cs_linux_x64
displayName: 'linux-x64'
pool:
Expand Down Expand Up @@ -709,6 +740,9 @@ extends:
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
# AcesShared macOS agents don't have git-lfs pre-installed
- script: brew install git-lfs && git lfs install
displayName: 'Install Git LFS'
- checkout: self
clean: true
- checkout: test-data-shared
Expand Down Expand Up @@ -748,6 +782,30 @@ extends:
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_js_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
artifactName: 'flc-nuget'
targetPath: '$(Pipeline.Workspace)/flc-nuget'
- input: pipelineArtifact
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
- checkout: self
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/test-js-steps.yml@self
parameters:
isWinML: false
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

# The Linux JS test job is currently disabled due to intermittent SSL errors when running get_model_list. This issue is under investigation.
# Error: Command 'get_model_list' failed: Error: System.Net.Http.HttpRequestException: An error occurred while sending the request.
# ---> System.IO.IOException: The decryption operation failed, see inner exception.
Expand Down Expand Up @@ -793,6 +851,9 @@ extends:
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
# AcesShared macOS agents don't have git-lfs pre-installed
- script: brew install git-lfs && git lfs install
displayName: 'Install Git LFS'
- checkout: self
clean: true
- checkout: test-data-shared
Expand Down Expand Up @@ -836,11 +897,11 @@ extends:
sdkWheelsDir: '$(Pipeline.Workspace)/python-sdk'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_python_linux_x64
displayName: 'linux-x64'
- job: test_python_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-Ubuntu2404-AMD-CPU
os: linux
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
Expand All @@ -864,6 +925,36 @@ extends:
sdkWheelsDir: '$(Pipeline.Workspace)/python-sdk'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

# Linux Python tests are disabled due to native dependency resolution issues
# (onnxruntime-gpu / onnxruntime-genai-cuda not found correctly on CI agents).
# - job: test_python_linux_x64
# displayName: 'linux-x64'
# pool:
# name: onnxruntime-Ubuntu2404-AMD-CPU
# os: linux
# templateContext:
# inputs:
# - input: pipelineArtifact
# artifactName: 'flc-wheels'
# targetPath: '$(Pipeline.Workspace)/flc-wheels'
# - input: pipelineArtifact
# artifactName: 'python-sdk'
# targetPath: '$(Pipeline.Workspace)/python-sdk'
# - input: pipelineArtifact
# artifactName: 'deps-versions-standard'
# targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
# steps:
# - checkout: self
# clean: true
# - checkout: test-data-shared
# lfs: true
# - template: .pipelines/templates/test-python-steps.yml@self
# parameters:
# isWinML: false
# flcWheelsDir: '$(Pipeline.Workspace)/flc-wheels'
# sdkWheelsDir: '$(Pipeline.Workspace)/python-sdk'
# depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_python_osx_arm64
displayName: 'osx-arm64'
pool:
Expand All @@ -883,6 +974,9 @@ extends:
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
# AcesShared macOS agents don't have git-lfs pre-installed
- script: brew install git-lfs && git lfs install
displayName: 'Install Git LFS'
- checkout: self
clean: true
- checkout: test-data-shared
Expand Down Expand Up @@ -923,6 +1017,30 @@ extends:
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_rust_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
artifactName: 'flc-nuget'
targetPath: '$(Pipeline.Workspace)/flc-nuget'
- input: pipelineArtifact
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
- checkout: self
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/test-rust-steps.yml@self
parameters:
isWinML: false
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-standard'

- job: test_rust_linux_x64
displayName: 'linux-x64'
pool:
Expand Down Expand Up @@ -963,6 +1081,9 @@ extends:
artifactName: 'deps-versions-standard'
targetPath: '$(Pipeline.Workspace)/deps-versions-standard'
steps:
# AcesShared macOS agents don't have git-lfs pre-installed
- script: brew install git-lfs && git lfs install
displayName: 'Install Git LFS'
- checkout: self
clean: true
- checkout: test-data-shared
Expand Down Expand Up @@ -1002,7 +1123,7 @@ extends:
- job: flc_winml_win_arm64
displayName: 'win-arm64 (WinML)'
pool:
name: onnxruntime-Win-CPU-2022
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
outputs:
Expand Down Expand Up @@ -1271,6 +1392,30 @@ extends:
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget-winml'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-winml'

- job: test_cs_winml_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
artifactName: 'flc-nuget-winml'
targetPath: '$(Pipeline.Workspace)/flc-nuget-winml'
- input: pipelineArtifact
artifactName: 'deps-versions-winml'
targetPath: '$(Pipeline.Workspace)/deps-versions-winml'
steps:
- checkout: self
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/test-cs-steps.yml@self
parameters:
isWinML: true
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget-winml'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-winml'

# ── Test JS SDK (WinML) ──
- stage: test_js_winml
displayName: 'Test JS (WinML)'
Expand Down Expand Up @@ -1300,6 +1445,30 @@ extends:
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget-winml'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-winml'

- job: test_js_winml_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
artifactName: 'flc-nuget-winml'
targetPath: '$(Pipeline.Workspace)/flc-nuget-winml'
- input: pipelineArtifact
artifactName: 'deps-versions-winml'
targetPath: '$(Pipeline.Workspace)/deps-versions-winml'
steps:
- checkout: self
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/test-js-steps.yml@self
parameters:
isWinML: true
flcNugetDir: '$(Pipeline.Workspace)/flc-nuget-winml'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-winml'

# ── Test Python SDK (WinML) ──
- stage: test_python_winml
displayName: 'Test Python (WinML)'
Expand Down Expand Up @@ -1332,3 +1501,31 @@ extends:
flcWheelsDir: '$(Pipeline.Workspace)/flc-wheels-winml'
sdkWheelsDir: '$(Pipeline.Workspace)/python-sdk-winml'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-winml'

- job: test_python_winml_win_arm64
displayName: 'win-arm64'
pool:
name: onnxruntime-native-arm64-16core
os: windows
templateContext:
inputs:
- input: pipelineArtifact
artifactName: 'flc-wheels-winml'
targetPath: '$(Pipeline.Workspace)/flc-wheels-winml'
- input: pipelineArtifact
artifactName: 'python-sdk-winml'
targetPath: '$(Pipeline.Workspace)/python-sdk-winml'
- input: pipelineArtifact
artifactName: 'deps-versions-winml'
targetPath: '$(Pipeline.Workspace)/deps-versions-winml'
steps:
- checkout: self
clean: true
- checkout: test-data-shared
lfs: true
- template: .pipelines/templates/test-python-steps.yml@self
parameters:
isWinML: true
flcWheelsDir: '$(Pipeline.Workspace)/flc-wheels-winml'
sdkWheelsDir: '$(Pipeline.Workspace)/python-sdk-winml'
depsVersionsDir: '$(Pipeline.Workspace)/deps-versions-winml'
3 changes: 2 additions & 1 deletion .pipelines/templates/build-core-steps.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,8 @@ steps:
projects: '$(nsRoot)/src/FoundryLocalCore/Core/Core.csproj'
arguments: '--no-restore -r ${{ parameters.flavor }} /p:Platform=${{ parameters.platform }} /p:IncludeWebService=true /p:Configuration=Release'

- ${{ if or(eq(parameters.flavor, 'win-x64'), eq(parameters.flavor, 'linux-x64'), eq(parameters.flavor, 'osx-x64')) }}:
# FLC tests on osx-arm64 are flaky in CI, will investigate separately. Skip for now since the main goal of this job is to produce the AOT binary.
- ${{ if or(eq(parameters.flavor, 'win-x64'), eq(parameters.flavor, 'win-arm64'), eq(parameters.flavor, 'linux-x64')) }}:
- task: DotNetCoreCLI@2
displayName: 'Restore FLC Tests ${{ parameters.flavor }}'
inputs:
Expand Down
14 changes: 14 additions & 0 deletions .pipelines/templates/test-cs-steps.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,20 @@ steps:
if ($LASTEXITCODE -ne 0) { throw "Windows App SDK Runtime install failed" }
errorActionPreference: 'stop'

# Clear the NuGet global packages cache to avoid corrupt/stale packages on reused agents.
- task: PowerShell@2
displayName: 'Clear NuGet packages cache'
inputs:
targetType: inline
script: |
$cacheDir = Join-Path $env:USERPROFILE '.nuget' 'packages'
if (Test-Path $cacheDir) {
Write-Host "Clearing NuGet packages cache: $cacheDir"
Remove-Item -Recurse -Force "$cacheDir\*"
} else {
Write-Host "NuGet packages cache not found at $cacheDir, skipping."
}
Comment thread
prathikr marked this conversation as resolved.
Outdated

- task: PowerShell@2
displayName: 'Restore & build tests'
inputs:
Expand Down
Loading