mirror of
https://github.com/project-zot/zot.git
synced 2026-06-18 05:28:07 +08:00
95ce68ccb0
* refactor(test/blackbox): extract shared push/pull helpers Move duplicated push/pull/regclient/oras/helm helper functions out of fips140.bats, pushpull.bats and helpers_upgrade.bash into a single helpers_pushpull.bash, then have all three suites load from there. The helpers now share verify_prerequisites, get_zot_port, common assertion helpers (catalog/tag presence, OCI index ref name) and the regclient pagination listing. helpers_upgrade.bash keeps only the test_release_* and test_new_* wrappers that compose those helpers. Net effect: ~1000 lines of duplicated test scaffolding removed across the four files; behavior of the existing test cases is preserved. Refs: #3727 Signed-off-by: Akash Kumar <meakash7902@gmail.com> * refactor(test/blackbox): share pushpull lifecycle and dedupe authn helpers Build on the shared helpers_pushpull.bash to remove more duplicated blackbox scaffolding: - Add pushpull_setup_file/pushpull_teardown/pushpull_teardown_file keyed on PUSHPULL_FIPS_MODE so pushpull.bats and fips140.bats only set the flag and delegate lifecycle, instead of each carrying a near-identical setup_file/teardown. - Add helpers_pushpull_authn.bash (loaded by pushpull_authn.bats and fips140_authn.bats) for shared htpasswd setup, FIPS vs non-FIPS config and teardown, and the regclient/OCI/ML test helpers; both authn suites collapse to one-line @test bodies keyed on PUSHPULL_AUTHN_FIPS_MODE. - Make each authn helper self-sufficient by performing its own regctl login, removing the hidden dependency on the first test having logged in. - Split the implicit manifest delete out of helper_pull_image_index_and_delete into a standalone helper_delete_manifest, surfaced as its own "delete image index" @test in the pushpull, fips140 and upgrade suites, so the delete is explicit and no longer an order-fragile side effect of a pull. Refs: #3727 Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): harden flaky oras pull and sync signature tests Set org.opencontainers.image.title on oras artifact push and verify pull both via oras pull and manifest/blob fetch. Add retry_until_success and use it for periodic notation/cosign signature sync checks on slow CI. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): address Copilot review feedback in push/pull helpers Use curl --fail for manifest deletes so HTTP errors fail the test. Remove the duplicate regctl --format flag in helper_push_manifest_with_regclient. Harden helper_authn_ml_artifacts with run and status checks, using a binary-safe shell redirect for the ONNX artifact round-trip. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): isolate pushpull helper temp files and prerequisites Write oras artifact and docker build files under BATS_TEST_TMPDIR instead of the test working directory, and check git/docker in verify_prerequisites for clearer failures when running bats directly. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test): use verify_prerequisites exit status in bats setup Replace `$(verify_prerequisites)` with a direct call across blackbox and scale-out suites. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): unify blackbox log path to zot/zot-log.json Drop the FIPS vs non-FIPS split between zot-log.json and zot.log in pushpull, authn, and upgrade helpers. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * refactor(test/blackbox): loop over tools in verify_prerequisites Replace repeated command -v checks with a single loop over curl, jq, git, and docker. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * refactor(test/blackbox): fix exit code for retry_until_success Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * refactor(test/blackbox): inline upgrade tests and drop helpers_upgrade Call helper_* directly from upgrade.bats and upgrade_minimal.bats, load helpers_pushpull in those suites, and move teardown there. Remove helpers_upgrade.bash now that the release/new wrappers are gone. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * refactor(test/blackbox): require explicit args on pushpull helpers Drop parameter defaults from shared push/pull helpers and pass image, repository, and pagination values explicitly at each call site. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): clarify docker push/pull negative test naming Rename helper_push_docker_image to helper_build_docker_image_push_and_pull and update test titles to reflect build plus expected push/pull failures without the docker compatibility extension. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): isolate regctl config per BATS suite regctl persists login and TLS settings on disk, so push/pull blackbox tests could leak state into ~/.regctl/config.json across suites. Point REGCTL_CONFIG at BATS_FILE_TMPDIR for pushpull, authn, and upgrade suites, configure TLS once in authn setup, and drop redundant logout and per-login TLS setup. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> * fix(test/blackbox): harden upgrade suite log dump on failure Touch zot-log.json during upgrade setup and only cat it in teardown when the file exists, so a missing log cannot mask the underlying test failure. Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> --------- Signed-off-by: Akash Kumar <meakash7902@gmail.com> Signed-off-by: Andrei Aaron <andreifdaaron@gmail.com> Co-authored-by: Akash Kumar <meakash7902@gmail.com>
546 lines
20 KiB
Bash
546 lines
20 KiB
Bash
# Note: Intended to be run as "make run-blackbox-tests" or "make run-blackbox-ci"
|
|
# Makefile target installs & checks all necessary tooling
|
|
# Extra tools that are not covered in Makefile target needs to be added in verify_prerequisites()
|
|
|
|
load helpers_zot
|
|
load helpers_wait
|
|
load ../port_helper
|
|
|
|
function verify_prerequisites() {
|
|
if [ ! $(command -v curl) ]; then
|
|
echo "you need to install curl as a prerequisite to running the tests" >&3
|
|
return 1
|
|
fi
|
|
|
|
if [ ! $(command -v jq) ]; then
|
|
echo "you need to install jq as a prerequisite to running the tests" >&3
|
|
return 1
|
|
fi
|
|
|
|
if [ ! $(command -v cosign) ]; then
|
|
echo "you need to install cosign as a prerequisite to running the tests" >&3
|
|
return 1
|
|
fi
|
|
|
|
return 0
|
|
}
|
|
|
|
function setup_file() {
|
|
export COSIGN_PASSWORD=""
|
|
|
|
# Verify prerequisites are available
|
|
if ! verify_prerequisites; then
|
|
exit 1
|
|
fi
|
|
|
|
# Download test data to folder common for the entire suite, not just this file
|
|
skopeo --insecure-policy copy --format=oci docker://ghcr.io/project-zot/golang:1.20 oci:${TEST_DATA_DIR}/golang:1.20
|
|
# Setup zot server
|
|
local zot_sync_per_root_dir=${BATS_FILE_TMPDIR}/zot-per
|
|
local zot_sync_ondemand_root_dir=${BATS_FILE_TMPDIR}/zot-ondemand
|
|
|
|
local zot_sync_per_config_file=${BATS_FILE_TMPDIR}/zot_sync_per_config.json
|
|
local zot_sync_ondemand_config_file=${BATS_FILE_TMPDIR}/zot_sync_ondemand_config.json
|
|
|
|
local zot_minimal_root_dir=${BATS_FILE_TMPDIR}/zot-minimal
|
|
local zot_minimal_config_file=${BATS_FILE_TMPDIR}/zot_minimal_config.json
|
|
|
|
local oci_data_dir=${BATS_FILE_TMPDIR}/oci
|
|
mkdir -p ${zot_sync_per_root_dir}
|
|
mkdir -p ${zot_sync_ondemand_root_dir}
|
|
mkdir -p ${zot_minimal_root_dir}
|
|
mkdir -p ${oci_data_dir}
|
|
zot_port1=$(get_free_port_for_service "zot1")
|
|
echo ${zot_port1} > ${BATS_FILE_TMPDIR}/zot.port1
|
|
zot_port2=$(get_free_port_for_service "zot2")
|
|
echo ${zot_port2} > ${BATS_FILE_TMPDIR}/zot.port2
|
|
zot_port3=$(get_free_port_for_service "zot3")
|
|
echo ${zot_port3} > ${BATS_FILE_TMPDIR}/zot.port3
|
|
|
|
cat >${zot_sync_per_config_file} <<EOF
|
|
{
|
|
"distSpecVersion": "1.1.1",
|
|
"storage": {
|
|
"rootDirectory": "${zot_sync_per_root_dir}"
|
|
},
|
|
"http": {
|
|
"address": "0.0.0.0",
|
|
"port": "${zot_port1}"
|
|
},
|
|
"log": {
|
|
"level": "debug"
|
|
},
|
|
"extensions": {
|
|
"sync": {
|
|
"registries": [
|
|
{
|
|
"urls": [
|
|
"http://localhost:${zot_port3}"
|
|
],
|
|
"onDemand": false,
|
|
"tlsVerify": false,
|
|
"PollInterval": "10s",
|
|
"content": [
|
|
{
|
|
"prefix": "**"
|
|
}
|
|
]
|
|
}
|
|
]
|
|
}
|
|
}
|
|
}
|
|
EOF
|
|
|
|
cat >${zot_sync_ondemand_config_file} <<EOF
|
|
{
|
|
"distSpecVersion": "1.1.1",
|
|
"storage": {
|
|
"rootDirectory": "${zot_sync_ondemand_root_dir}"
|
|
},
|
|
"http": {
|
|
"address": "0.0.0.0",
|
|
"port": "${zot_port2}"
|
|
},
|
|
"log": {
|
|
"level": "debug"
|
|
},
|
|
"extensions": {
|
|
"sync": {
|
|
"registries": [
|
|
{
|
|
"urls": [
|
|
"http://localhost:${zot_port3}"
|
|
],
|
|
"onDemand": true,
|
|
"tlsVerify": false,
|
|
"content": [
|
|
{
|
|
"prefix": "**"
|
|
}
|
|
]
|
|
}
|
|
]
|
|
}
|
|
}
|
|
}
|
|
EOF
|
|
cat >${zot_minimal_config_file} <<EOF
|
|
{
|
|
"distSpecVersion": "1.1.1",
|
|
"storage": {
|
|
"rootDirectory": "${zot_minimal_root_dir}"
|
|
},
|
|
"http": {
|
|
"address": "0.0.0.0",
|
|
"port": "${zot_port3}"
|
|
},
|
|
"log": {
|
|
"level": "debug"
|
|
}
|
|
}
|
|
EOF
|
|
git -C ${BATS_FILE_TMPDIR} clone https://github.com/project-zot/helm-charts.git
|
|
|
|
zot_serve ${ZOT_MINIMAL_PATH} ${zot_minimal_config_file}
|
|
wait_zot_reachable ${zot_port3}
|
|
|
|
zot_serve ${ZOT_PATH} ${zot_sync_per_config_file}
|
|
wait_zot_reachable ${zot_port1}
|
|
|
|
zot_serve ${ZOT_PATH} ${zot_sync_ondemand_config_file}
|
|
wait_zot_reachable ${zot_port2}
|
|
}
|
|
|
|
function teardown_file() {
|
|
zot_stop_all
|
|
run rm -rf ${HOME}/.config/notation
|
|
}
|
|
|
|
# sync image
|
|
@test "sync golang image periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run skopeo --insecure-policy copy --dest-tls-verify=false \
|
|
oci:${TEST_DATA_DIR}/golang:1.20 \
|
|
docker://127.0.0.1:${zot_port3}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
run curl http://127.0.0.1:${zot_port3}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[]') = '"golang"' ]
|
|
run curl http://127.0.0.1:${zot_port1}/v2/_catalog
|
|
run curl http://127.0.0.1:${zot_port3}/v2/golang/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"1.20"' ]
|
|
|
|
run sleep 20s
|
|
|
|
run curl http://127.0.0.1:${zot_port1}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[]') = '"golang"' ]
|
|
|
|
run curl http://127.0.0.1:${zot_port1}/v2/golang/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"1.20"' ]
|
|
}
|
|
|
|
@test "sync golang image ondemand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run skopeo --insecure-policy copy --dest-tls-verify=false \
|
|
oci:${TEST_DATA_DIR}/golang:1.20 \
|
|
docker://127.0.0.1:${zot_port3}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
run curl http://127.0.0.1:${zot_port3}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[]') = '"golang"' ]
|
|
|
|
# sync golang on demand
|
|
run curl http://127.0.0.1:${zot_port2}/v2/golang/manifests/1.20
|
|
[ "$status" -eq 0 ]
|
|
|
|
run curl http://127.0.0.1:${zot_port3}/v2/golang/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"1.20"' ]
|
|
|
|
run curl http://127.0.0.1:${zot_port2}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[]') = '"golang"' ]
|
|
|
|
run curl http://127.0.0.1:${zot_port2}/v2/golang/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"1.20"' ]
|
|
}
|
|
|
|
# sync index
|
|
@test "sync image index periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
# --multi-arch below pushes an image index (containing many images) instead
|
|
# of an image manifest (single image)
|
|
run skopeo --insecure-policy copy --format=oci --dest-tls-verify=false --multi-arch=all \
|
|
docker://public.ecr.aws/docker/library/busybox:latest \
|
|
docker://127.0.0.1:${zot_port3}/busybox:latest
|
|
[ "$status" -eq 0 ]
|
|
run curl http://127.0.0.1:${zot_port3}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[0]') = '"busybox"' ]
|
|
run curl http://127.0.0.1:${zot_port3}/v2/busybox/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"latest"' ]
|
|
|
|
run sleep 30s
|
|
|
|
run curl http://127.0.0.1:${zot_port1}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[0]') = '"busybox"' ]
|
|
|
|
run curl http://127.0.0.1:${zot_port1}/v2/busybox/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"latest"' ]
|
|
}
|
|
|
|
@test "sync image index on demand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
# --multi-arch below pushes an image index (containing many images) instead
|
|
# of an image manifest (single image)
|
|
run skopeo --insecure-policy copy --format=oci --dest-tls-verify=false --multi-arch=all \
|
|
docker://public.ecr.aws/docker/library/busybox:latest \
|
|
docker://127.0.0.1:${zot_port3}/busybox:latest
|
|
[ "$status" -eq 0 ]
|
|
run curl http://127.0.0.1:${zot_port3}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[1]') = '"golang"' ]
|
|
run curl http://127.0.0.1:${zot_port3}/v2/busybox/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"latest"' ]
|
|
|
|
# sync busybox index on demand
|
|
run curl http://127.0.0.1:${zot_port2}/v2/busybox/manifests/latest
|
|
[ "$status" -eq 0 ]
|
|
|
|
run curl http://127.0.0.1:${zot_port2}/v2/_catalog
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.repositories[1]') = '"golang"' ]
|
|
|
|
run curl http://127.0.0.1:${zot_port2}/v2/busybox/tags/list
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.tags[]') = '"latest"' ]
|
|
}
|
|
|
|
# sign signatures
|
|
@test "sign/verify with cosign" {
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run cosign initialize
|
|
[ "$status" -eq 0 ]
|
|
run cosign generate-key-pair --output-key-prefix "${BATS_FILE_TMPDIR}/cosign-sign-sync-test"
|
|
[ "$status" -eq 0 ]
|
|
run cosign sign --key ${BATS_FILE_TMPDIR}/cosign-sign-sync-test.key localhost:${zot_port3}/golang:1.20 --yes
|
|
[ "$status" -eq 0 ]
|
|
run env COSIGN_EXPERIMENTAL=1 cosign sign --new-bundle-format=true --registry-referrers-mode=oci-1-1 --key ${BATS_FILE_TMPDIR}/cosign-sign-sync-test.key localhost:${zot_port3}/golang:1.20 --yes
|
|
[ "$status" -eq 0 ]
|
|
run cosign verify --key ${BATS_FILE_TMPDIR}/cosign-sign-sync-test.pub localhost:${zot_port3}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sign/verify with notation" {
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run notation cert generate-test "notation-sign-sync-test"
|
|
[ "$status" -eq 0 ]
|
|
|
|
local trust_policy_file=/tmp/trustpolicy.json
|
|
|
|
cat <<EOF >"${trust_policy_file}"
|
|
{
|
|
"version": "1.0",
|
|
"trustPolicies": [
|
|
{
|
|
"name": "notation-sign-sync-test",
|
|
"registryScopes": [ "*" ],
|
|
"signatureVerification": {
|
|
"level" : "strict"
|
|
},
|
|
"trustStores": [ "ca:notation-sign-sync-test" ],
|
|
"trustedIdentities": [
|
|
"*"
|
|
]
|
|
}
|
|
]
|
|
}
|
|
EOF
|
|
run notation policy import --force "${trust_policy_file}"
|
|
[ "$status" -eq 0 ]
|
|
run notation sign --debug --verbose --key "notation-sign-sync-test" --insecure-registry localhost:${zot_port3}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
run notation verify --debug --verbose --insecure-registry localhost:${zot_port3}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
run notation list --insecure-registry localhost:${zot_port3}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sync signatures periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
# wait for signatures to be copied (PollInterval is 10s; allow extra margin on slow CI)
|
|
run sleep 15s
|
|
|
|
retry_until_success 12 5 notation verify --insecure-registry localhost:${zot_port1}/golang:1.20
|
|
retry_until_success 12 5 cosign verify --key ${BATS_FILE_TMPDIR}/cosign-sign-sync-test.pub localhost:${zot_port1}/golang:1.20
|
|
}
|
|
|
|
@test "sync signatures ondemand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
run notation verify --insecure-registry localhost:${zot_port2}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
|
|
run cosign verify --key ${BATS_FILE_TMPDIR}/cosign-sign-sync-test.pub localhost:${zot_port2}/golang:1.20
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
# sync oras artifacts
|
|
@test "push oras artifact periodically" {
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
echo "{\"name\":\"foo\",\"value\":\"bar\"}" > config.json
|
|
echo "hello world" > artifact.txt
|
|
run oras push --plain-http 127.0.0.1:${zot_port3}/hello-artifact:v2 \
|
|
--config config.json:application/vnd.acme.rocket.config.v1+json artifact.txt:text/plain -d -v
|
|
[ "$status" -eq 0 ]
|
|
rm -f artifact.txt
|
|
rm -f config.json
|
|
}
|
|
|
|
@test "sync oras artifact periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
# wait for oras artifact to be copied
|
|
run sleep 15s
|
|
run oras pull --plain-http 127.0.0.1:${zot_port1}/hello-artifact:v2 -d -v
|
|
[ "$status" -eq 0 ]
|
|
grep -q "hello world" artifact.txt
|
|
rm -f artifact.txt
|
|
}
|
|
|
|
@test "sync oras artifact on demand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
run oras pull --plain-http 127.0.0.1:${zot_port2}/hello-artifact:v2 -d -v
|
|
[ "$status" -eq 0 ]
|
|
grep -q "hello world" artifact.txt
|
|
rm -f artifact.txt
|
|
}
|
|
|
|
# sync helm chart
|
|
@test "push helm chart" {
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run helm package ${BATS_FILE_TMPDIR}/helm-charts/charts/zot -d ${BATS_FILE_TMPDIR}
|
|
[ "$status" -eq 0 ]
|
|
local chart_version=$(awk '/version/{printf $2}' ${BATS_FILE_TMPDIR}/helm-charts/charts/zot/Chart.yaml)
|
|
run helm push ${BATS_FILE_TMPDIR}/zot-${chart_version}.tgz oci://localhost:${zot_port3}/zot-chart
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sync helm chart periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
# wait for helm chart to be copied
|
|
run sleep 15s
|
|
|
|
local chart_version=$(awk '/version/{printf $2}' ${BATS_FILE_TMPDIR}/helm-charts/charts/zot/Chart.yaml)
|
|
run helm pull oci://localhost:${zot_port1}/zot-chart/zot --version ${chart_version} -d ${BATS_FILE_TMPDIR}
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sync helm chart on demand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
local chart_version=$(awk '/version/{printf $2}' ${BATS_FILE_TMPDIR}/helm-charts/charts/zot/Chart.yaml)
|
|
run helm pull oci://localhost:${zot_port2}/zot-chart/zot --version ${chart_version} -d ${BATS_FILE_TMPDIR}
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
# sync OCI artifacts
|
|
@test "push OCI artifact (oci image mediatype) with regclient" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run regctl registry set localhost:${zot_port3} --tls disabled
|
|
run regctl registry set localhost:${zot_port1} --tls disabled
|
|
run regctl registry set localhost:${zot_port2} --tls disabled
|
|
|
|
run regctl artifact put localhost:${zot_port3}/artifact:demo <<EOF
|
|
this is an oci image artifact
|
|
EOF
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sync OCI artifact (oci image mediatype) periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
# wait for helm chart to be copied
|
|
run sleep 15s
|
|
run regctl manifest get localhost:${zot_port1}/artifact:demo
|
|
[ "$status" -eq 0 ]
|
|
run regctl artifact get localhost:${zot_port1}/artifact:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "this is an oci image artifact" ]
|
|
}
|
|
|
|
@test "sync OCI artifact (oci image mediatype) on demand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
run regctl manifest get localhost:${zot_port2}/artifact:demo
|
|
[ "$status" -eq 0 ]
|
|
run regctl artifact get localhost:${zot_port2}/artifact:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "this is an oci image artifact" ]
|
|
}
|
|
|
|
@test "push OCI artifact (oci artifact mediatype) with regclient" {
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run regctl artifact put --artifact-type "application/vnd.example.icecream.v1" localhost:${zot_port3}/newartifact:demo <<EOF
|
|
this is an oci artifact
|
|
EOF
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sync OCI artifact (oci artifact mediatype) periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
# wait for helm chart to be copied
|
|
run sleep 15s
|
|
run regctl manifest get localhost:${zot_port1}/newartifact:demo
|
|
[ "$status" -eq 0 ]
|
|
run regctl artifact get localhost:${zot_port1}/newartifact:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "this is an oci artifact" ]
|
|
}
|
|
|
|
@test "sync OCI artifact (oci artifact mediatype) on demand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
run regctl manifest get localhost:${zot_port2}/newartifact:demo
|
|
[ "$status" -eq 0 ]
|
|
run regctl artifact get localhost:${zot_port2}/newartifact:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "this is an oci artifact" ]
|
|
}
|
|
|
|
@test "push OCI artifact references with regclient" {
|
|
zot_port3=`cat ${BATS_FILE_TMPDIR}/zot.port3`
|
|
run regctl artifact put localhost:${zot_port3}/manifest-ref:demo <<EOF
|
|
test artifact
|
|
EOF
|
|
[ "$status" -eq 0 ]
|
|
run regctl artifact list localhost:${zot_port3}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 0 ]
|
|
run regctl artifact put --annotation demo=true --annotation format=oci --artifact-type "application/vnd.example.icecream.v1" --subject localhost:${zot_port3}/manifest-ref:demo << EOF
|
|
test reference
|
|
EOF
|
|
[ "$status" -eq 0 ]
|
|
# with artifact media-type
|
|
run regctl artifact put localhost:${zot_port3}/artifact-ref:demo <<EOF
|
|
test artifact
|
|
EOF
|
|
[ "$status" -eq 0 ]
|
|
run regctl artifact list localhost:${zot_port3}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 0 ]
|
|
run regctl artifact put --annotation demo=true --annotation format=oci --artifact-type "application/vnd.example.icecream.v1" --subject localhost:${zot_port3}/artifact-ref:demo << EOF
|
|
test reference
|
|
EOF
|
|
[ "$status" -eq 0 ]
|
|
}
|
|
|
|
@test "sync OCI artifact references periodically" {
|
|
zot_port1=`cat ${BATS_FILE_TMPDIR}/zot.port1`
|
|
# wait for OCI artifacts to be copied
|
|
run sleep 20
|
|
run regctl artifact get localhost:${zot_port1}/manifest-ref:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "test artifact" ]
|
|
run regctl artifact list localhost:${zot_port1}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/vnd.example.icecream.v1" localhost:${zot_port1}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/invalid" localhost:${zot_port1}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 0 ]
|
|
# with artifact media-type
|
|
run regctl artifact get localhost:${zot_port1}/artifact-ref:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "test artifact" ]
|
|
run regctl artifact list localhost:${zot_port1}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/vnd.example.icecream.v1" localhost:${zot_port1}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/invalid" localhost:${zot_port1}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 0 ]
|
|
}
|
|
|
|
@test "sync OCI artifact references on demand" {
|
|
zot_port2=`cat ${BATS_FILE_TMPDIR}/zot.port2`
|
|
run regctl artifact get localhost:${zot_port2}/manifest-ref:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "test artifact" ]
|
|
run regctl artifact list localhost:${zot_port2}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/vnd.example.icecream.v1" localhost:${zot_port2}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/invalid" localhost:${zot_port2}/manifest-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 0 ]
|
|
# with artifact media-type
|
|
run regctl artifact get localhost:${zot_port2}/artifact-ref:demo
|
|
[ "$status" -eq 0 ]
|
|
[ "${lines[-1]}" == "test artifact" ]
|
|
run regctl artifact list localhost:${zot_port2}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/vnd.example.icecream.v1" localhost:${zot_port2}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 1 ]
|
|
run regctl artifact list --filter-artifact-type "application/invalid" localhost:${zot_port2}/artifact-ref:demo --format raw-body
|
|
[ "$status" -eq 0 ]
|
|
[ $(echo "${lines[-1]}" | jq '.manifests | length') -eq 0 ]
|
|
}
|