Skip to content

Convert CircleCI config to Github Actions #8147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 183 commits into from
Apr 10, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
183 commits
Select commit Hold shift + click to select a range
69a4e4c
convert circle ci config to github actions
hotzenklotz Oct 24, 2024
4a9811e
use new docker compose syntax
hotzenklotz Oct 24, 2024
d0eed33
only run github actions on PRs and master branch
hotzenklotz Oct 24, 2024
53e35c4
CI
hotzenklotz Oct 28, 2024
53d1c23
fix yarn lockfile
hotzenklotz Oct 28, 2024
eb8af0b
CI
hotzenklotz Oct 28, 2024
1d77e3c
CI
hotzenklotz Oct 28, 2024
03c1cbf
Ci
hotzenklotz Oct 28, 2024
7acf3a9
CI
hotzenklotz Oct 28, 2024
9521869
Merge branch 'master' of github.com:scalableminds/webknossos into ci
hotzenklotz Oct 28, 2024
633b9bf
CI
hotzenklotz Oct 28, 2024
267d646
sudo!
hotzenklotz Oct 28, 2024
188753d
sudo
hotzenklotz Oct 28, 2024
47e66d6
bump ubuntu version
hotzenklotz Oct 28, 2024
f69e1c9
CI
hotzenklotz Oct 28, 2024
98337a4
use different package names for ubuntu
hotzenklotz Oct 28, 2024
da87a2a
CI
hotzenklotz Oct 28, 2024
a15f95c
enable ssh debug
hotzenklotz Oct 28, 2024
5a2766f
CI
hotzenklotz Oct 28, 2024
35e7381
CI
hotzenklotz Oct 28, 2024
e81a452
add sbt action
hotzenklotz Oct 28, 2024
e3bd804
ci
hotzenklotz Oct 28, 2024
d12c110
ci
hotzenklotz Oct 28, 2024
46aafa2
Merge branch 'master' of github.com:scalableminds/webknossos into ci
hotzenklotz Oct 30, 2024
b91701d
CI
hotzenklotz Oct 30, 2024
c15cc6b
CI
hotzenklotz Oct 30, 2024
e3c6b4d
CI
hotzenklotz Oct 30, 2024
543bba1
CI
hotzenklotz Oct 30, 2024
f25cca0
enable ssh debugging
hotzenklotz Nov 11, 2024
e6de5cb
set postgres url
hotzenklotz Nov 11, 2024
816989d
CI
hotzenklotz Nov 11, 2024
495296e
CI
hotzenklotz Nov 11, 2024
d9322ce
ci
hotzenklotz Nov 11, 2024
035f5a3
ci
hotzenklotz Nov 11, 2024
b162be2
ci
hotzenklotz Nov 11, 2024
6c06ca3
CI
hotzenklotz Nov 11, 2024
18b7cb4
ci
hotzenklotz Nov 11, 2024
77d54be
ci
hotzenklotz Nov 12, 2024
46f6696
ci
hotzenklotz Nov 12, 2024
e864dbb
ci
hotzenklotz Nov 12, 2024
c9f8868
ci
hotzenklotz Nov 12, 2024
219a68f
Merge branch 'master' of github.com:scalableminds/webknossos into ci
hotzenklotz Dec 4, 2024
0be3a3b
Update .github/workflows/build_test_deploy.yml
hotzenklotz Dec 4, 2024
afb35b6
Update .github/workflows/build_test_deploy.yml
hotzenklotz Dec 4, 2024
d22dade
Update .github/workflows/build_test_deploy.yml
hotzenklotz Dec 4, 2024
c0c3db5
fix directory permissions
robert-oleynik Dec 4, 2024
cb6f60c
Merge branch 'master' into ci
hotzenklotz Jan 10, 2025
5efdae3
fix GA composite action path
hotzenklotz Jan 10, 2025
9b42b84
add postgres env to e2e tests
hotzenklotz Jan 10, 2025
83ee733
CI
hotzenklotz Jan 16, 2025
864e306
Merge branch 'master' into ci
hotzenklotz Mar 17, 2025
2a93eed
Replace postgres hostname with localhost:5432
robert-oleynik Mar 17, 2025
0aac54b
change port for CI postgres container
robert-oleynik Mar 26, 2025
15626ce
log docker containers
robert-oleynik Mar 26, 2025
ec399cc
fix postgres ports
robert-oleynik Mar 26, 2025
dddf65d
mkdir Organization_X
robert-oleynik Mar 27, 2025
eafae09
unzip test dataset
robert-oleynik Mar 27, 2025
4fbf0d2
fix unzip order
robert-oleynik Mar 27, 2025
48d4736
add cache for sbt and yarn
robert-oleynik Apr 1, 2025
7cd2c6a
update hash files expression
robert-oleynik Apr 1, 2025
6920603
use cache of setup-node
robert-oleynik Apr 1, 2025
b51ceec
remove node caching
robert-oleynik Apr 1, 2025
83e6348
rework build_test_deploy step
robert-oleynik Apr 1, 2025
252c647
fix indentation
robert-oleynik Apr 1, 2025
3a338e7
fix action uses
robert-oleynik Apr 1, 2025
387016a
fix github actions expression
robert-oleynik Apr 1, 2025
7400445
enable corepack
robert-oleynik Apr 1, 2025
0ba0ad5
prepare e2e tests
robert-oleynik Apr 1, 2025
e7fc3e2
add tmate sessions
robert-oleynik Apr 1, 2025
29ace54
cache node modules
robert-oleynik Apr 1, 2025
3b8e9ef
reorder steps and set explicit context
robert-oleynik Apr 1, 2025
e9ff2bc
fix quoting
robert-oleynik Apr 1, 2025
9863e91
fix quoting
robert-oleynik Apr 1, 2025
3dfaa71
fix yarn.lock path
robert-oleynik Apr 1, 2025
377498a
fix docker flags
robert-oleynik Apr 1, 2025
ddb1c2d
reorder backend tests
robert-oleynik Apr 1, 2025
bf61fe6
ci run as non root
robert-oleynik Apr 2, 2025
aa482b2
remove unnecessary cache
robert-oleynik Apr 2, 2025
ba2db9c
fix node_modules caching
robert-oleynik Apr 2, 2025
1dc8f7c
add dbtool asserts and fix permissions
robert-oleynik Apr 2, 2025
8a8f1fb
add postgres user env
robert-oleynik Apr 2, 2025
3b1e4b3
move environment to job declaration
robert-oleynik Apr 2, 2025
080f47c
use postgres env from global scope
robert-oleynik Apr 2, 2025
d8b0db9
fix user permissions
robert-oleynik Apr 2, 2025
d5f69df
fix postgres url
robert-oleynik Apr 2, 2025
b2bdc47
fix path and reorder steps
robert-oleynik Apr 2, 2025
b902f58
fix binary data path
robert-oleynik Apr 2, 2025
2994f0d
move e2e test to separate stage
robert-oleynik Apr 3, 2025
1ee2e86
run e2e tests without retry
robert-oleynik Apr 3, 2025
3774608
merge all pipeline build and test stages and disable caches
robert-oleynik Apr 3, 2025
d4865bc
Merge branch 'master' into ci
robert-oleynik Apr 3, 2025
2315d8f
add <cstdint> header
robert-oleynik Apr 3, 2025
147129f
fix docker tags
robert-oleynik Apr 3, 2025
69b5e4a
fix docker tag for compose
robert-oleynik Apr 3, 2025
4a4677a
add separate e2e-test
robert-oleynik Apr 3, 2025
3caacd6
fix docker tag reference
robert-oleynik Apr 3, 2025
187e115
add backend tests
robert-oleynik Apr 3, 2025
3f79463
add system dependencies to backend tests
robert-oleynik Apr 3, 2025
9547c29
add tmate debugging sessions
robert-oleynik Apr 3, 2025
42b89bc
remove backend-test job
robert-oleynik Apr 3, 2025
e16895a
add node to e2e tests
robert-oleynik Apr 3, 2025
a3d85d7
add missing environment
robert-oleynik Apr 3, 2025
8a63834
update checkout action to v4
robert-oleynik Apr 3, 2025
bc30b7c
add tmate debugging session
robert-oleynik Apr 3, 2025
39d64ce
merge end-to-end test and build job
robert-oleynik Apr 3, 2025
caf0153
fix DOCKER_TAG
robert-oleynik Apr 3, 2025
7e5edeb
replace build job with one-to-one port of circle ci
robert-oleynik Apr 3, 2025
fc9e5f9
fix build_test_deploy step
robert-oleynik Apr 3, 2025
374c4c3
use docker compose instead of docker-compose
robert-oleynik Apr 3, 2025
8e9c0e7
add tmate debugging session
robert-oleynik Apr 3, 2025
b679297
fix CI
robert-oleynik Apr 3, 2025
3b08b3e
replace not-on-master script with checks
robert-oleynik Apr 3, 2025
e40c112
replace string literal for branch checks
robert-oleynik Apr 3, 2025
e9d2d0c
use native sbt, nod and yarn and upadte env
robert-oleynik Apr 3, 2025
4656bdc
setup postgres env
robert-oleynik Apr 3, 2025
cfc6bf2
remove slack notification
robert-oleynik Apr 3, 2025
396a604
install system dependencies
robert-oleynik Apr 3, 2025
86c670f
fix typo
robert-oleynik Apr 3, 2025
3d39b97
generate WK_VERSION from github.run_number
robert-oleynik Apr 3, 2025
93c1492
add services and docker action
robert-oleynik Apr 3, 2025
85a7b61
fix typos
robert-oleynik Apr 3, 2025
dd1628a
fix namespace name
robert-oleynik Apr 3, 2025
271d116
fix typo
robert-oleynik Apr 3, 2025
9dc919a
fix typo
robert-oleynik Apr 3, 2025
300cca4
remove conflicting port
robert-oleynik Apr 3, 2025
31f229f
run e2e tests without docker compose
robert-oleynik Apr 8, 2025
d52d64d
ci: pg_isready with correct user
robert-oleynik Apr 8, 2025
e1a1d98
Merge branch 'master' into ci
robert-oleynik Apr 8, 2025
58431d1
bucketScanner.cpp add missing dependency
robert-oleynik Apr 8, 2025
60e0f13
fix pg_isready command
robert-oleynik Apr 8, 2025
9f71353
use docker compose instead of GitHub services
robert-oleynik Apr 8, 2025
115666e
fossildb open ports
robert-oleynik Apr 8, 2025
eec9ae5
fix fossildb startup command
robert-oleynik Apr 8, 2025
0dc335c
fix e2e-test command
robert-oleynik Apr 8, 2025
7caaf90
use smoke test action
robert-oleynik Apr 8, 2025
5901353
add missing redis port
robert-oleynik Apr 8, 2025
4068888
fix smoke test url
robert-oleynik Apr 8, 2025
b637a2b
cleanup old commands
robert-oleynik Apr 8, 2025
0595cac
add custom retry action
robert-oleynik Apr 8, 2025
307dc52
add separate backend test step
robert-oleynik Apr 8, 2025
4cb7da7
add pull policy
robert-oleynik Apr 8, 2025
ec411a8
add extra debugging step
robert-oleynik Apr 8, 2025
3556814
remove backend-tests
robert-oleynik Apr 8, 2025
0f5cb1e
fix docker image export
robert-oleynik Apr 9, 2025
b4d0a1a
remove double frontend tests
robert-oleynik Apr 9, 2025
dffe12b
create separate backend test job
robert-oleynik Apr 9, 2025
7a1300c
backend tests install system dependencies
robert-oleynik Apr 9, 2025
34f5230
backend tests start postgres
robert-oleynik Apr 9, 2025
bf3c1ab
fix typo
robert-oleynik Apr 9, 2025
fba9780
fix docker driver
robert-oleynik Apr 9, 2025
8dd799a
backend tests install node
robert-oleynik Apr 9, 2025
b2e7ab0
prevent backend tests from running on master
robert-oleynik Apr 9, 2025
4292d4e
fix typo
robert-oleynik Apr 9, 2025
407ed15
remove node_modules caches
robert-oleynik Apr 9, 2025
9dc8ca4
cleanup jobs
robert-oleynik Apr 9, 2025
0e7f0fd
remove cache
robert-oleynik Apr 9, 2025
9c0a6b8
fix retry e2e test command
robert-oleynik Apr 9, 2025
a89830e
remove coverage step
robert-oleynik Apr 9, 2025
8a560f6
move Dockerfiles to .github directory
robert-oleynik Apr 9, 2025
60bcd72
setup slack notifications and fix branch enumeration
robert-oleynik Apr 9, 2025
ebd45aa
fix permissions
robert-oleynik Apr 9, 2025
c668132
remove debug options
robert-oleynik Apr 9, 2025
82b15c2
fix fossildb command
robert-oleynik Apr 9, 2025
425bb07
fix dockerfile naming
robert-oleynik Apr 9, 2025
c43c9e5
apply suggestions and fix errors
robert-oleynik Apr 9, 2025
85f1528
add missing env
robert-oleynik Apr 9, 2025
9b5b19f
add cerficate env
robert-oleynik Apr 9, 2025
062afc6
rename secret
robert-oleynik Apr 9, 2025
439e3e9
enable slack notifications only on master
robert-oleynik Apr 9, 2025
fb4511b
cleanup .github
robert-oleynik Apr 9, 2025
e7cce81
cleanup circle ci and old dockerfiles
robert-oleynik Apr 9, 2025
5c7e64e
Merge branch 'master' into ci
robert-oleynik Apr 9, 2025
f7807a9
fix normalized branch name
robert-oleynik Apr 9, 2025
e6e608c
Apply suggestions from code review
robert-oleynik Apr 9, 2025
8c592ab
fix branch conditions and environment variables
robert-oleynik Apr 9, 2025
a05c253
Merge branch 'ci' of github.com:scalableminds/webknossos into ci
robert-oleynik Apr 9, 2025
fd199b6
add debugging session
robert-oleynik Apr 9, 2025
cf05576
use GITHUB_HEAD_REF
robert-oleynik Apr 9, 2025
e908be4
remove tmate session
robert-oleynik Apr 9, 2025
9594164
update changelog
robert-oleynik Apr 9, 2025
6c455a3
fix CI_BUILD_NUM env
robert-oleynik Apr 9, 2025
41e2cf2
Merge branch 'master' into ci
robert-oleynik Apr 10, 2025
82ebc72
Update CHANGELOG.unreleased.md
normanrz Apr 10, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
217 changes: 0 additions & 217 deletions .circleci/config.yml

This file was deleted.

8 changes: 0 additions & 8 deletions .circleci/not-on-master.sh

This file was deleted.

39 changes: 0 additions & 39 deletions .circleci/slack-notification.sh

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ VOLUME /webknossos-datastore/binaryData /tmp
COPY target/universal/stage .

RUN chown -R webknossos . \
&& chmod go+x bin/webknossos-datastore \
&& chmod +x bin/webknossos-datastore \
&& chmod go+w .

RUN echo '#!/bin/bash\numask 002\nbin/webknossos-datastore "$@"\n' > /docker-entrypoint.sh \
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ VOLUME /webknossos-tracingstore/tracingData /tmp
COPY target/universal/stage .

RUN chown -R webknossos . \
&& chmod go+x bin/webknossos-tracingstore \
&& chmod +x bin/webknossos-tracingstore \
&& chmod go+w .

RUN echo '#!/bin/bash\numask 002\nbin/webknossos-tracingstore "$@"\n' > /docker-entrypoint.sh \
Expand All @@ -31,4 +31,4 @@ HEALTHCHECK \
EXPOSE 9050

ENTRYPOINT ["/docker-entrypoint.sh"]
CMD ["-J-Xmx20G", "-J-Xms1G", "-Dconfig.file=conf/standalone-tracingstore.conf", "-Dlogger.file=conf/logback-docker.xml", "-Dlogback.configurationFile=conf/logback-docker.xml", "-Dhttp.port=9090", "-Dhttp.address=0.0.0.0"]
CMD ["-J-Xmx20G", "-J-Xms1G", "-Dconfig.file=conf/standalone-tracingstore.conf", "-Dlogger.file=conf/logback-docker.xml", "-Dlogback.configurationFile=conf/logback-docker.xml", "-Dhttp.port=9050", "-Dhttp.address=0.0.0.0"]
4 changes: 3 additions & 1 deletion Dockerfile → .github/Dockerfile.webknossos
Original file line number Diff line number Diff line change
Expand Up @@ -8,13 +8,15 @@ RUN curl -sL "https://deb.nodesource.com/setup_${VERSION_NODE}" | bash - \
RUN mkdir -p /webknossos
WORKDIR /webknossos

# Copy compiled Scala output from a previous build step, e.g. output of the Docker-dev image
COPY target/universal/stage .

RUN addgroup --system --gid 999 webknossos \
&& adduser --system --uid 999 --ingroup webknossos webknossos \
&& mkdir disk \
&& chown -R webknossos . \
&& chmod go+x bin/webknossos \
&& chmod +x bin/webknossos \
&& chmod +x tools/postgres/dbtool.js \
&& chmod go+w .

RUN echo '#!/bin/bash\numask 002\nbin/webknossos "$@"\n' > /docker-entrypoint.sh \
Expand Down
24 changes: 24 additions & 0 deletions .github/actions/retry/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
name: "Shell Retry"
description: "Runs a small shell script with retries"
inputs:
run:
description: "Command to execute."
required: true
retries:
description: "Maximum number of retries until failed"
required: true
retry_delay_seconds:
description: "Amount of time to sleep between each retry"
default: 0
runs:
using: 'composite'
steps:
- shell: bash
run: |
for i in {1..${{ inputs.retries }}}; do
bash -c "$INPUT_COMMAND" && exit 0
sleep "${{ inputs.retry_delay_seconds }}"
done
exit 1
env:
INPUT_COMMAND: ${{ inputs.run }}
Loading