Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
103 commits
Select commit Hold shift + click to select a range
20d5b31
Kafka Connect: Add Trivy CVE scan to CI (#15430) (#15430)
rmoff May 11, 2026
f86a672
Build: Bump software.amazon.awssdk:bom from 2.42.41 to 2.44.0 (#16279)
huaxingao May 11, 2026
3d682a3
INFRA: Expand Trivy CVE scan to all bundle and runtime modules (#16291)
kevinjqliu May 11, 2026
64ba246
Core: Add partition to TrackedFile (#16253)
nastra May 12, 2026
575446e
Spark: Fix dropped file length in SerializableFileIOWithSize (#16284)
ajayky-os May 12, 2026
e5e2e8b
Build: Improve PR title check pattern for multi-word prefixes and rev…
manuzhang May 12, 2026
e1182e2
Spark 4.1: Migrate SparkCopyOnWriteScan to SupportsRuntimeV2Filtering…
drexler-sky May 12, 2026
b986d73
Build: Fix transitive dependency CVEs across all distributions (#16290)
kevinjqliu May 12, 2026
4cebcdd
Build: Bump to Parquet 1.17.1 (#16257)
Fokko May 12, 2026
42f3d01
Move all analyticscore references behind a AnalyticsCoreUtil class (#…
talatuyarer May 12, 2026
947a7b7
API: Remove unnecessary EOFException in FileRange constructor. (#15973)
mukund-thakur May 12, 2026
1cea23e
Core: Fix row ID assignment for EXISTING entry during a manifest merg…
amogh-jahagirdar May 12, 2026
a676552
Spark 3.4: Support recursive delegate unwrapping to find ExtendedPars…
kevinjqliu May 13, 2026
062e822
Spark 3.4: Pass FileIO on Spark's read path (#16307)
kevinjqliu May 13, 2026
bdbb375
Spark 3.4: Set data file sort_order_id in manifest for writes from Sp…
kevinjqliu May 13, 2026
e57247b
Spark 3.4: Backport Async Micro Batch Planner to 3.4 (#16311)
kevinjqliu May 13, 2026
11e582b
Spark: Backport aggregate pushdown tests with NaN's (#16316)
psvri May 13, 2026
5bbe19f
Flink: Nanosecond gaps in SortKeySerializer and ColumnStatsWatermarkE…
talatuyarer May 13, 2026
38c78c4
Flink: Nanosecond gaps in SortKeySerializer and ColumnStatsWatermarkE…
talatuyarer May 13, 2026
c72c2bd
Flink: Nanosecond gaps in SortKeySerializer and ColumnStatsWatermarkE…
talatuyarer May 13, 2026
721980d
Spark: Disable min/max aggregation push down for string under any mod…
hantangwangd May 13, 2026
bc8f264
Spark: Backport migrate SparkCopyOnWriteScan to SupportsRuntimeV2Filt…
drexler-sky May 14, 2026
1919ae6
Flink: Support UUID type in Avro and Parquet readers and writers (#16…
joyhaldar May 14, 2026
6b8b57e
Flink: Refresh table in ListMetadataFiles to prevent incorrect orphan…
yadavay-amzn May 14, 2026
adfd4a4
Flink: Backport support UUID type in Avro and Parquet readers and wri…
joyhaldar May 14, 2026
294f80d
Flink: Use native slot sharing group inheritance for maintenance task…
Guosmilesmile May 14, 2026
87a7e4b
Spark: Also disable min/max aggregation push down for binary (#16328)
hantangwangd May 14, 2026
bf340af
Flink: Backport Use native slot sharing group inheritance for mainten…
Guosmilesmile May 14, 2026
22f8666
Flink: Backport PR #16324 to v2.0 and v1.20 (#16338)
kevinjqliu May 14, 2026
8b45abc
Close metrics reporter in RESTSessionCatalog and add test in CatalogT…
talatuyarer May 14, 2026
62fe817
Spark 4.1: Add session configs for adaptive split sizing and parallel…
karuppayya May 15, 2026
6976e02
Spark: Backport #16088 to Spark 3.4, 3.5, 4.0 (#16344)
karuppayya May 15, 2026
9789f85
Build: Designate a single Gradle cache writer across CI workflows (#1…
kevinjqliu May 16, 2026
089434b
Core: Fix ByteBufferInputStream.read() to return -1 at EOF (#16167)
sachinnn99 May 16, 2026
8caf7c2
Website: remove duplicated entries from search (#16368)
MaxNevermind May 17, 2026
56ca272
Build: Bump pymarkdownlnt from 0.9.36 to 0.9.37 (#16372)
dependabot[bot] May 17, 2026
c8b35af
Build: Bump datamodel-code-generator from 0.56.1 to 0.57.0 (#16373)
dependabot[bot] May 17, 2026
4f5033a
Build: Bump jetty from 12.1.8 to 12.1.9 (#16374)
dependabot[bot] May 17, 2026
74634cf
Build: Bump org.xerial:sqlite-jdbc from 3.53.0.0 to 3.53.1.0 (#16379)
dependabot[bot] May 17, 2026
6dfdcb0
Build: Bump github/codeql-action from 4.35.1 to 4.35.4 (#16375)
dependabot[bot] May 17, 2026
6a3f782
Build: Bump actions/labeler from 6.0.1 to 6.1.0 (#16378)
dependabot[bot] May 17, 2026
e1705f4
Core, Flink: Add UUID to DataTestBase SUPPORTED_PRIMITIVES (#16364)
joyhaldar May 18, 2026
886ecab
Core: Fix NPE in RemoveOrphanFiles with prefix_listing for root table…
liuliquan-marshal May 18, 2026
c08a8e4
Core: Use ArrayList for manifest list materialization (#15640)
manuzhang May 18, 2026
e617d34
Spec: Clarify non-default CRS conventions (#15834)
milastdbx May 18, 2026
ae4dfea
Flink: Add decimal write/read roundtrip test for FlinkParquetReaders …
wombatu-kun May 18, 2026
3e88117
Build: Bump gradle-wrapper from 8.14.4 to 8.14.5 (#16381)
huaxingao May 18, 2026
4bdb2c2
Spark: Add compaction only benchmark - rewrite data files (#16219)
varun-lakhyani May 18, 2026
1d8de4a
Build: Speed up Spark CI with parallel test execution (#16357)
kevinjqliu May 18, 2026
3571629
OpenAPI: Add CatalogObjectIdentifier schema (#16144)
stevenzwu May 18, 2026
fab0d10
Docs: switch default docs version from nightly to latest (#16398)
MaxNevermind May 18, 2026
2fe32aa
Kafka Connect: Surface commit failures instead of silently swallowing…
yadavay-amzn May 18, 2026
cc9abe8
infra: add 1.10.2 to issue template (#16404)
amogh-jahagirdar May 18, 2026
ce2bb9a
Doap: Update Doap to reference 1.10.2 (#16405)
amogh-jahagirdar May 18, 2026
1802dbf
Docs: Add release notes for 1.10.2 (#16406)
amogh-jahagirdar May 19, 2026
4bece41
Docs: Fix duplicate search results by moving versioned docs out of do…
kevinjqliu May 19, 2026
26a6f53
Build: Bump com.google.cloud:libraries-bom from 26.80.0 to 26.81.0 (#…
huaxingao May 19, 2026
7f1d90d
Docs: add more to 1.10.2 release notes (#16410)
kevinjqliu May 19, 2026
8e049f0
Core: Remove redundant string concatenation (#16409)
ebyhr May 19, 2026
0cd9e9b
Build: Let revapi compare against 1.11.0 (#16412)
aihuaxu May 19, 2026
5049675
infra: add 1.11.0 to issue template (#16413)
aihuaxu May 19, 2026
5b1cc3c
Doap: Update DOAP to reference 1.11.0 (#16415)
aihuaxu May 19, 2026
6d8ebbb
Flink: Allow setting slot sharing group for fine-grained resource man…
sqd May 19, 2026
be94cb0
Build: Use major.minor versions in runtime-deps baselines (#16233)
kevinjqliu May 20, 2026
8e7ab3c
CI: Make CVE scan blocking on PRs, informational on main (#16287)
kevinjqliu May 20, 2026
f825d09
Spec: Add v4 content stats representation (#14234)
nastra May 20, 2026
463249a
Spark: Remove Spark 3.4 support (#14122)
kevinjqliu May 20, 2026
684a187
Flink: Fix ALTER TABLE to add column to specific position (#16419)
SteveStevenpoor May 20, 2026
e2569ef
Backport #16065 to Flink v2.0 and v1.20 (#16429)
sqd May 20, 2026
866d50e
Docs: Add release notes for 1.11.0 (#16431)
aihuaxu May 20, 2026
e3a4c64
Arrow: Fix ClassCastException in vectorized reader on int-to-long pro…
xndai May 20, 2026
90c2c4c
Flink: Backport add column fix to flink v1.20, v2.0 (#16447)
SteveStevenpoor May 21, 2026
d0a4954
Site: Add version URL alias hook for docs (#16496)
kevinjqliu May 21, 2026
8a90699
Encrypting IO as a `DelegateFileIO` (#14876)
smaheshwar-pltr May 21, 2026
693e8a7
Flink: Handle table comments in FlinkSQL (#16423)
SteveStevenpoor May 21, 2026
46ae3ad
Docs: Update information about metrics mode (#16391)
psvri May 21, 2026
2f05390
Build: Ban Preconditions.checkState with %d placeholder (#16407)
ebyhr May 21, 2026
56013b7
Flink: Backport handle table comments in FlinkSQL (#16503)
SteveStevenpoor May 21, 2026
c4f835e
CI: Skip spotlessCheck in core-tests (#16505)
ebyhr May 21, 2026
2cce97a
Build: Fix order in revapi.yml (#16511)
gaborkaszab May 21, 2026
7bb0fa2
Docs: Drop manual deploy step from release instructions (#16495)
stevenzwu May 21, 2026
10ba4ee
Flink: Support writing shredded variant (#15596)
Guosmilesmile May 22, 2026
f37a04b
Core, Orc: Remove deprecated partition stats read functionality (#14998)
gaborkaszab May 22, 2026
26169f7
Kafka Connect: Fix ConcurrentModificationException in IcebergSinkConf…
wombatu-kun May 22, 2026
ad9af85
Add `.claude/` to .gitignore (#16533)
xndai May 22, 2026
41a9599
ci: only run site-ci deploy job for apache/iceberg (#16535)
kevinjqliu May 22, 2026
fca74a0
Spark: Backport Add _row_id and _last_updated_sequence_number raeder …
Guosmilesmile May 22, 2026
f23da21
Core, Parquet: Allow for Writing Parquet/Avro Manifests in V4 (#15634)
RussellSpitzer May 22, 2026
4c767c1
Kafka Connect: Add end-to-end test for commit failure propagation (#1…
yadavay-amzn May 22, 2026
99e451a
Core: Skip testAddManyFilesWithConsistentOrdering if WORKER_THREAD_PO…
ebyhr May 22, 2026
36ef887
[SPEC] Add relative paths to v4 spec (#15630)
danielcweeks May 23, 2026
29ba0a1
Core: Add V4 location relativization utilities (#16174)
anoopj May 23, 2026
988d6cd
Core: Fix SerializableTable.sortOrders() throwing on historical sort …
MonkeyCanCode May 24, 2026
ffb29d3
Build: Bump software.amazon.awssdk:bom from 2.44.4 to 2.44.7 (#16555)
dependabot[bot] May 24, 2026
95c86f8
Build: Bump github/codeql-action from 4.35.4 to 4.35.5 (#16554)
dependabot[bot] May 24, 2026
d9a12fa
Build: Bump com.diffplug.spotless:spotless-plugin-gradle (#16552)
dependabot[bot] May 24, 2026
2245a81
Build: Bump slf4j from 2.0.17 to 2.0.18 (#16553)
dependabot[bot] May 24, 2026
400fff6
Build: Bump zizmorcore/zizmor-action from 0.5.3 to 0.5.6 (#16550)
dependabot[bot] May 24, 2026
75fcb8d
Build: Bump com.google.cloud:libraries-bom from 26.81.0 to 26.83.0 (#…
dependabot[bot] May 24, 2026
23c7f23
fix int96 timestamp offset in arrow dictionary decode (#16435)
sungwy May 24, 2026
d3cb9e3
Core: Replace deprecated CloseableHttpClient.execute (#16149)
ebyhr May 25, 2026
f12e0cf
Data: Remove Flag FEATURE_META_ROW_LINEAGE in BaseFormatModelTests (#…
Guosmilesmile May 25, 2026
0bfceac
Merge branch 'main' into rk/upstream
robert3005 May 25, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
6 changes: 6 additions & 0 deletions .baseline/checkstyle/checkstyle.xml
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,12 @@
<property name="format" value="Preconditions\.checkArgument\([^;]+%d[^;]+\);"/>
<property name="message" value="Preconditions.checkArgument does not support %d. use %s instead"/>
</module>
<module name="RegexpMultiline">
<property name="fileExtensions" value="java"/>
<property name="matchAcrossLines" value="true"/>
<property name="format" value="Preconditions\.checkState\([^;]+%d[^;]+\);"/>
<property name="message" value="Preconditions.checkState does not support %d. use %s instead"/>
</module>
<module name="RegexpMultiline">
<property name="format" value="^\s*import\s+static\s+(?!\Qorg.assertj.core.api.Assertions.\E).*\.assertThatThrownBy;"/>
<property name="message" value="assertThatThrownBy() should be statically imported from org.assertj.core.api.Assertions"/>
Expand Down
4 changes: 3 additions & 1 deletion .github/ISSUE_TEMPLATE/iceberg_bug_report.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,9 @@ body:
description: What Apache Iceberg version are you using?
multiple: false
options:
- "1.10.1 (latest release)"
- "1.11.0 (latest release)"
- "1.10.2"
- "1.10.1"
- "1.10.0"
- "1.9.2"
- "1.9.1"
Expand Down
3 changes: 3 additions & 0 deletions .github/workflows/api-binary-compatibility.yml
Original file line number Diff line number Diff line change
Expand Up @@ -60,6 +60,9 @@ jobs:
distribution: zulu
java-version: 17
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: small job; restore opportunistically from other jobs' caches but never write.
cache-read-only: true
- run: |
echo "Using the old version tag, as per git describe, of $(git describe)";
- run: ./gradlew revapi --rerun-tasks
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/codeql.yml
Original file line number Diff line number Diff line change
Expand Up @@ -46,11 +46,11 @@ jobs:
persist-credentials: false

- name: Initialize CodeQL
uses: github/codeql-action/init@e46ed2cbd01164d986452f91f178727624ae40d7 # v4.35.3
uses: github/codeql-action/init@9e0d7b8d25671d64c341c19c0152d693099fb5ba # v4.35.5
with:
languages: actions

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@e46ed2cbd01164d986452f91f178727624ae40d7 # v4.35.3
uses: github/codeql-action/analyze@9e0d7b8d25671d64c341c19c0152d693099fb5ba # v4.35.5
with:
category: "/language:actions"
172 changes: 172 additions & 0 deletions .github/workflows/cve-scan.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,172 @@
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#

name: "CVE Scan"
on:
push:
branches:
- 'main'
- '0.*'
- '1.*'
- '2.*'
tags:
- 'apache-iceberg-**'
pull_request:

permissions:
contents: read

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: ${{ github.event_name == 'pull_request' }}

jobs:

# ------------------------------------------------------------------
# Trivy CVE scan — scans bundled jars for known vulnerabilities.
#
# Behaviour:
# - On PRs: the scan blocks CI if CVEs are found (exit-code 1).
# SARIF upload is skipped because GitHub's Security tab only
# accepts results from default/protected branches.
# - On push to main/release branches: the scan is informational
# (exit-code 0) and results are uploaded as SARIF to the GitHub
# Security tab for ongoing tracking.
# ------------------------------------------------------------------
cve-scan:
runs-on: ubuntu-24.04
permissions:
contents: read
security-events: write
strategy:
fail-fast: false
matrix:
include:
- distribution: kafka-connect-runtime
build-task: >-
-DkafkaVersions=3
:iceberg-kafka-connect:iceberg-kafka-connect-runtime:distZip
scan-path: kafka-connect/kafka-connect-runtime/build/distributions
unpack: true
- distribution: aws-bundle
build-task: :iceberg-aws-bundle:shadowJar
scan-path: aws-bundle/build/libs
unpack: false
- distribution: azure-bundle
build-task: :iceberg-azure-bundle:shadowJar
scan-path: azure-bundle/build/libs
unpack: false
- distribution: gcp-bundle
build-task: :iceberg-gcp-bundle:shadowJar
scan-path: gcp-bundle/build/libs
unpack: false
- distribution: spark-runtime-3.5_2.12
build-task: >-
-DsparkVersions=3.5
:iceberg-spark:iceberg-spark-runtime-3.5_2.12:shadowJar
scan-path: spark/v3.5/spark-runtime/build/libs
unpack: false
- distribution: spark-runtime-4.0_2.13
build-task: >-
-DsparkVersions=4.0
:iceberg-spark:iceberg-spark-runtime-4.0_2.13:shadowJar
scan-path: spark/v4.0/spark-runtime/build/libs
unpack: false
- distribution: spark-runtime-4.1_2.13
build-task: >-
-DsparkVersions=4.1
:iceberg-spark:iceberg-spark-runtime-4.1_2.13:shadowJar
scan-path: spark/v4.1/spark-runtime/build/libs
unpack: false
- distribution: flink-runtime-1.20
build-task: >-
-DflinkVersions=1.20
:iceberg-flink:iceberg-flink-runtime-1.20:shadowJar
scan-path: flink/v1.20/flink-runtime/build/libs
unpack: false
- distribution: flink-runtime-2.0
build-task: >-
-DflinkVersions=2.0
:iceberg-flink:iceberg-flink-runtime-2.0:shadowJar
scan-path: flink/v2.0/flink-runtime/build/libs
unpack: false
- distribution: flink-runtime-2.1
build-task: >-
-DflinkVersions=2.1
:iceberg-flink:iceberg-flink-runtime-2.1:shadowJar
scan-path: flink/v2.1/flink-runtime/build/libs
unpack: false
- distribution: open-api-test-fixtures-runtime
build-task: :iceberg-open-api:shadowJar
scan-path: open-api/build/libs
unpack: false
name: ${{ matrix.distribution }}
steps:
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
with:
persist-credentials: false
- uses: actions/setup-java@be666c2fcd27ec809703dec50e508c2fdc7f6654 # v5.2.0
with:
distribution: zulu
java-version: 21
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: small job; restore opportunistically from other jobs' caches but never write.
cache-read-only: true
- name: Build ${{ matrix.distribution }}
run: |
./gradlew -DsparkVersions= -DflinkVersions= \
${{ matrix.build-task }} \
-Pquick=true -x test -x javadoc
- name: Prepare scan directory
run: |
mkdir -p /tmp/cve-scan
if [ "${{ matrix.unpack }}" = "true" ]; then
unzip ${{ matrix.scan-path }}/*.zip -d /tmp/cve-scan
else
cp ${{ matrix.scan-path }}/iceberg-${{ matrix.distribution }}-*.jar /tmp/cve-scan/
fi
- name: Run Trivy vulnerability scan
uses: lhotari/sandboxed-trivy-action@f01374b6cc3bf7264ab238293e94f6db7ada6dd0 # v1.0.2
with:
scan-type: 'rootfs'
scan-ref: '/tmp/cve-scan'
scanners: 'vuln'
severity: 'HIGH,CRITICAL'
limit-severities-for-sarif: true
trivyignores: ${{ matrix.trivyignores || '' }}
# Block PRs on CVE findings; on main/release branches report without failing
exit-code: ${{ github.event_name == 'pull_request' && '1' || '0' }}
format: 'sarif'
output: 'trivy-results.sarif'
- name: Print Trivy scan results
if: always()
run: |
if [ -f trivy-results.sarif ]; then
echo "## Trivy CVE Scan Results — ${{ matrix.distribution }}"
jq -r '.runs[].results[] | "- \(.ruleId): \(.message.text)"' trivy-results.sarif 2>/dev/null || echo "No findings or unable to parse SARIF."
else
echo "No SARIF file found — scan may have failed to install."
fi
- name: Upload Trivy results to GitHub Security tab
if: always() && github.event_name == 'push'
uses: github/codeql-action/upload-sarif@9e0d7b8d25671d64c341c19c0152d693099fb5ba # v4.35.5
with:
sarif_file: 'trivy-results.sarif'
category: ${{ matrix.distribution }}
8 changes: 8 additions & 0 deletions .github/workflows/delta-conversion-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,9 +37,11 @@ on:
- '.github/workflows/java-ci.yml'
- '.github/workflows/jmh-benchmarks-ci.yml'
- '.github/workflows/kafka-connect-ci.yml'
- '.github/workflows/cve-scan.yml'
- '.github/workflows/labeler.yml'
- '.github/workflows/license-check.yml'
- '.github/workflows/open-api.yml'
- '.github/workflows/pr-title-check.yml'
- '.github/workflows/publish-snapshot.yml'
- '.github/workflows/recurring-jmh-benchmarks.yml'
- '.github/workflows/site-ci.yml'
Expand Down Expand Up @@ -88,6 +90,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts
- run: ./gradlew -DsparkVersions=3.5 -DscalaVersion=2.12 -DkafkaVersions= -DflinkVersions= :iceberg-delta-lake:check -Pquick=true -x javadoc
- uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
Expand All @@ -114,6 +119,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts
- run: ./gradlew -DsparkVersions=3.5 -DscalaVersion=2.13 -DkafkaVersions= -DflinkVersions= :iceberg-delta-lake:check -Pquick=true -x javadoc
- uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/flink-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,9 +37,11 @@ on:
- '.github/workflows/java-ci.yml'
- '.github/workflows/jmh-benchmarks-ci.yml'
- '.github/workflows/kafka-connect-ci.yml'
- '.github/workflows/cve-scan.yml'
- '.github/workflows/labeler.yml'
- '.github/workflows/license-check.yml'
- '.github/workflows/open-api.yml'
- '.github/workflows/pr-title-check.yml'
- '.github/workflows/publish-snapshot.yml'
- '.github/workflows/recurring-jmh-benchmarks.yml'
- '.github/workflows/site-ci.yml'
Expand Down Expand Up @@ -92,6 +94,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts
- run: ./gradlew -DsparkVersions= -DkafkaVersions= -DflinkVersions=${{ matrix.flink }} :iceberg-flink:iceberg-flink-${{ matrix.flink }}:check :iceberg-flink:iceberg-flink-runtime-${{ matrix.flink }}:check -Pquick=true -x javadoc -DtestParallelism=auto
- uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/hive-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,9 +37,11 @@ on:
- '.github/workflows/java-ci.yml'
- '.github/workflows/jmh-benchmarks-ci.yml'
- '.github/workflows/kafka-connect-ci.yml'
- '.github/workflows/cve-scan.yml'
- '.github/workflows/labeler.yml'
- '.github/workflows/license-check.yml'
- '.github/workflows/open-api.yml'
- '.github/workflows/pr-title-check.yml'
- '.github/workflows/publish-snapshot.yml'
- '.github/workflows/recurring-jmh-benchmarks.yml'
- '.github/workflows/site-ci.yml'
Expand Down Expand Up @@ -89,6 +91,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts
- run: ./gradlew -DsparkVersions= -DflinkVersions= -DkafkaVersions= -Pquick=true :iceberg-mr:check -x javadoc
- uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
Expand Down
16 changes: 15 additions & 1 deletion .github/workflows/java-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,9 +37,11 @@ on:
- '.github/workflows/hive-ci.yml'
- '.github/workflows/jmh-benchmarks-ci.yml'
- '.github/workflows/kafka-connect-ci.yml'
- '.github/workflows/cve-scan.yml'
- '.github/workflows/labeler.yml'
- '.github/workflows/license-check.yml'
- '.github/workflows/open-api.yml'
- '.github/workflows/pr-title-check.yml'
- '.github/workflows/publish-snapshot.yml'
- '.github/workflows/recurring-jmh-benchmarks.yml'
- '.github/workflows/site-ci.yml'
Expand Down Expand Up @@ -84,8 +86,11 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts
- run: ./gradlew check -DsparkVersions= -DflinkVersions= -DkafkaVersions= -Pquick=true -x javadoc
- run: ./gradlew check -DsparkVersions= -DflinkVersions= -DkafkaVersions= -Pquick=true -x javadoc -x spotlessCheck
- uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
if: failure()
with:
Expand All @@ -108,6 +113,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Writes cache on main; read-only otherwise.
cache-read-only: ${{ !(github.ref == 'refs/heads/main' && matrix.jvm == 17) }}
- run: ./gradlew -DallModules build -x test -x javadoc -x integrationTest

build-javadoc:
Expand All @@ -125,6 +133,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: ./gradlew -Pquick=true javadoc

check-runtime-deps:
Expand All @@ -138,4 +149,7 @@ jobs:
distribution: zulu
java-version: 17
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: ./gradlew checkAllRuntimeDeps -q -DallModules=true
3 changes: 3 additions & 0 deletions .github/workflows/jmh-benchmarks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -104,6 +104,9 @@ jobs:
distribution: zulu
java-version: 17
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Disabled: dispatched against arbitrary repo/ref inputs; never restore or write to avoid cache poisoning.
cache-disabled: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts

- name: Run Benchmark
Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/kafka-connect-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,11 @@ on:
- '.github/workflows/labeler.yml'
- '.github/workflows/license-check.yml'
- '.github/workflows/open-api.yml'
- '.github/workflows/pr-title-check.yml'
- '.github/workflows/publish-snapshot.yml'
- '.github/workflows/recurring-jmh-benchmarks.yml'
- '.github/workflows/site-ci.yml'
- '.github/workflows/cve-scan.yml'
- '.github/workflows/spark-ci.yml'
- '.github/workflows/stale.yml'
- '.gitignore'
Expand Down Expand Up @@ -89,6 +91,9 @@ jobs:
distribution: zulu
java-version: ${{ matrix.jvm }}
- uses: gradle/actions/setup-gradle@0723195856401067f7a2779048b490ace7a47d7c # v5.0.2
with:
# Read-only: java-ci's build-checks (17) is the global canonical writer.
cache-read-only: true
- run: echo -e "$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1)\t$(hostname -f) $(hostname -s)" | sudo tee -a /etc/hosts
- run: |
./gradlew -DsparkVersions= -DflinkVersions= -DkafkaVersions=3 \
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/labeler.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,6 @@ jobs:
triage:
runs-on: ubuntu-slim
steps:
- uses: actions/labeler@634933edcd8ababfe52f92936142cc22ac488b1b # v6.0.1
- uses: actions/labeler@f27b608878404679385c85cfa523b85ccb86e213 # v6.1.0
with:
sync-labels: true
Loading
Loading