Skip to content

HIVE-29260: Add smoke tests for Docker images#6238

Merged
okumin merged 3 commits intoapache:masterfrom
okumin:HIVE-29260-docker-smoke-test
Feb 9, 2026
Merged

HIVE-29260: Add smoke tests for Docker images#6238
okumin merged 3 commits intoapache:masterfrom
okumin:HIVE-29260-docker-smoke-test

Conversation

@okumin
Copy link
Contributor

@okumin okumin commented Dec 17, 2025

What changes were proposed in this pull request?

Run some integration tests against Docker images. Key points:

  • It uses Kubernetes as an orchestration tool because it is the most widely adopted option. In my mind, I would like to add k8s manifests or a Helm chart for Hive; Integation tests on k8s can be a preparation of the move
  • It uses Apache Ozone as a storage because it is k8s-friendly
  • Test cases are simple queries and Iceberg REST Compatibility Kit

https://issues.apache.org/jira/browse/HIVE-29260

Why are the changes needed?

We don't run any testing on Docker images. The new test cases can relieve a release manager a bit more.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Another thought

I wonder whether we should run the test cases for every PR or for every update to the master branch. Otherwise, we run the job once a quarter, which may not allow us to detect an ongoing issue in a timely manner. The drawback is CI cost(not sure how much our budget is). Or may we merge build.yml and docker-GA-images.yml?

@sonarqubecloud
Copy link

@okumin okumin marked this pull request as ready for review December 27, 2025 09:49
@deniskuzZ
Copy link
Member

hi @okumin this is awesome, but why we add k8s only for tests, why not add it for local testing? could we move the k8s setup to packaging next to docker and reuse it for tests?

@okumin
Copy link
Contributor Author

okumin commented Jan 23, 2026

@deniskuzZ
Though I'm not sure what you meant by local testing, we can add any deployments, including pure Docker commands or Docker Compose. I suppose Docker or Docker Compose would work if our image works with k8s, and we finally want k8s support. We can add all if we want.

mountPath: /tmp/ext-jars
containers:
- name: hive
image: hive:test
Copy link
Member

@deniskuzZ deniskuzZ Jan 31, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a locally built test image that we use only for testing and don’t push to Docker Hub?
Should we instead build and publish nightly images here and reference them via a corresponding image tag?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This patch builds an image locally, runs integration tests, and then publishes it to Docker Hub. If ASF allows a nightly image to be published, it could be a better option. I thought it was in a gray zone. Apache Solr has a nightly repo, and we might follow their choice
https://hub.docker.com/r/apache/solr-nightly/tags

Copy link
Member

@deniskuzZ deniskuzZ Feb 7, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it builds and publishes hive:test image? i think would be better to have hive-nightly similar to solr

Copy link
Contributor Author

@okumin okumin Feb 8, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It does not push hive:test because of push: false. I'm willing to start a thread to discuss if we should publish it or how we can legally push it in public 👍

Copy link
Member

@deniskuzZ deniskuzZ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, some minor questions

@sonarqubecloud
Copy link

sonarqubecloud bot commented Feb 7, 2026

Copy link
Member

@deniskuzZ deniskuzZ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@okumin okumin merged commit f5ce542 into apache:master Feb 9, 2026
2 checks passed
@okumin okumin deleted the HIVE-29260-docker-smoke-test branch February 9, 2026 07:20
@okumin
Copy link
Contributor Author

okumin commented Feb 9, 2026

Merged. @deniskuzZ Thanks for your review.
#6238

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants