Skip to content

Conversation

@maximsava12
Copy link
Contributor

This patch enhances the cifmw_ceph_client role to:

  • Automatically discover Ceph RGW (RADOS Gateway) endpoint and credentials
  • Create Glance secrets using the discovered RGW settings

This integration allows Glance to leverage Ceph RGW for secret storage when object store backends are enabled in the environment.

Changes:

  • Add RGW discovery tasks to the role
  • Add logic to create Glance secrets with RGW config

@maximsava12 maximsava12 requested a review from a team as a code owner July 30, 2025 08:37
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jul 30, 2025

Hi @maximsava12. Thanks for your PR.

I'm waiting for a openstack-k8s-operators member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/148eba965ca54ffcb1f99d5cd834ff75

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 15s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 14m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 10s
podified-multinode-hci-deployment-crc FAILURE in 54m 53s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 40s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 15s
✔️ build-push-container-cifmw-client SUCCESS in 20m 57s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 34s

@maximsava12 maximsava12 marked this pull request as draft July 30, 2025 13:33
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/61cc1357fe544e08a49db0a7898852f2

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 42m 25s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 13m 24s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 27m 50s
podified-multinode-hci-deployment-crc FAILURE in 51m 42s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 31s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 03s
✔️ build-push-container-cifmw-client SUCCESS in 20m 21s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 18s

@tosky
Copy link
Contributor

tosky commented Jul 31, 2025

Request for the future: if you keep your pull request "clean" as long as you develop it, you won't need to rebase and clean the pull request when it is ready. So if you update this, please ensure to always have a single commit (unless you want to have more commits, but the commits in this pull request are all updates to the same commit).

@maximsava12
Copy link
Contributor Author

Request for the future: if you keep your pull request "clean" as long as you develop it, you won't need to rebase and clean the pull request when it is ready. So if you update this, please ensure to always have a single commit (unless you want to have more commits, but the commits in this pull request are all updates to the same commit).

Ack

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/bbd2fe91fbfa4d28843e48791c3b0b10

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 44m 58s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 41s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 38s
podified-multinode-hci-deployment-crc FAILURE in 52m 54s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 21s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 55s
✔️ build-push-container-cifmw-client SUCCESS in 21m 02s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 17s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b78f7c0247ad4884baa7e18744b0ea35

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 05s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 52s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 34m 07s
podified-multinode-hci-deployment-crc FAILURE in 52m 30s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 59s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 00s
✔️ build-push-container-cifmw-client SUCCESS in 16m 14s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 10s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 18fc8d2 to 31ba8bc Compare August 4, 2025 17:03
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/c6e28a41162640f3bf0ae19b627d1b5a

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 44m 15s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 06m 39s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 09s
podified-multinode-hci-deployment-crc FAILURE in 50m 41s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 33s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 44s
✔️ build-push-container-cifmw-client SUCCESS in 16m 19s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 15s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 31ba8bc to 1677da5 Compare August 5, 2025 07:22
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/2ac991835378471aa3b9ab475f753e13

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 37m 49s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 04m 54s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 21m 07s
podified-multinode-hci-deployment-crc FAILURE in 51m 34s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 04s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 47s
✔️ build-push-container-cifmw-client SUCCESS in 16m 50s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 13s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 1677da5 to 88fa5f4 Compare August 5, 2025 10:55
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/1d3f5d867f7d40eaa3ad3ec1cf166972

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 56s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 07m 12s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 45s
podified-multinode-hci-deployment-crc FAILURE in 50m 23s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 57s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 56s
✔️ build-push-container-cifmw-client SUCCESS in 20m 08s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 07s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 88fa5f4 to 3907733 Compare August 10, 2025 10:51
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/f1619da0b1ea4e2083066012b26534c8

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 57m 17s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 07s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 36m 16s
podified-multinode-hci-deployment-crc FAILURE in 48m 55s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 33s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 00s
✔️ build-push-container-cifmw-client SUCCESS in 18m 45s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 15s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch 2 times, most recently from 5c487c6 to 4b8a24b Compare August 10, 2025 15:16
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/0b58377b5c1d44f08732f26e86a3b288

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 52m 57s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 30s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 30m 02s
podified-multinode-hci-deployment-crc FAILURE in 50m 26s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 23s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 50s
✔️ build-push-container-cifmw-client SUCCESS in 22m 58s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 11s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 4b8a24b to 0e4c85c Compare August 10, 2025 19:08
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3e7b0388f2294c399c0f70c8320e9605

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 49m 48s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 10m 34s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 26m 32s
podified-multinode-hci-deployment-crc FAILURE in 50m 04s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 17s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 54s
✔️ build-push-container-cifmw-client SUCCESS in 15m 36s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 08s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 0e4c85c to de78135 Compare August 11, 2025 04:54
vars:
ceph_command: radosgw-admin

- name: Check if Ceph S3 glance user exists
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed double keys linter error on key ignore_errors

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

makes sense as you handle the error with the next task.

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/323e09ca6a7c40d3853ffc8b8e7708ec

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 53m 49s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 17m 17s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 40m 01s
podified-multinode-hci-deployment-crc FAILURE in 51m 08s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 14s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 16s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 54s
✔️ build-push-container-cifmw-client SUCCESS in 18m 57s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 27s

@fultonj fultonj self-requested a review November 3, 2025 16:28
fultonj
fultonj previously requested changes Nov 3, 2025
Copy link
Contributor

@fultonj fultonj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @maximsava12,

Do you think you can update this to add to the ceph client role instead?

Thanks,
John

force: true

- name: Import glance Ceph RGW discovery playbook
ansible.builtin.import_tasks: ../../playbooks/glance-rgw-discovery/glance-rgw-discovery.yaml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use include_tasks on the moved file, glance-rgw-discovery.yaml, instead

- name: Load vars from ceph admin role
import_role:
name: cifmw_cephadm
tasks_from: main.yml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cifmw_cephadm intentionally leaves main.yml blank so this entire task can be removed

force: true

- name: Import glance Ceph RGW discovery playbook
ansible.builtin.import_tasks: ../../playbooks/glance-rgw-discovery/glance-rgw-discovery.yaml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use include_tasks of the moved file instead.

Copy link
Contributor

@fultonj fultonj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like all of my concerns have been addressed. Thanks Maxim.

@fultonj fultonj dismissed their stale review November 5, 2025 13:47

concerns addressed

@fultonj
Copy link
Contributor

fultonj commented Nov 5, 2025

It would be nice if you could rebase against the latest version of main.

Also, let's see the rdo check pass before merging.

@maximsava12
Copy link
Contributor Author

It would be nice if you could rebase against the latest version of main.

Also, let's see the rdo check pass before merging.

Thank you.
I think it's already rebased

@danpawlik
Copy link
Contributor

/ok-to-test

@maximsava12
Copy link
Contributor Author

/retest

evallesp
evallesp previously approved these changes Nov 10, 2025
--uid="glance"
--display-name="Glance S3 User"
when: cifmw_ceph_s3_glance_user_check != 0
register: cifmw_ceph_s3_glance_user
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(non-blocking) question: Do we want this var?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cifmw_ceph_s3_glance_user can be removed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed var cifmw_ceph_s3_glance_user

@evallesp
Copy link
Contributor

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/49c52abaa9624e7c9c2e66bc39926f00

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 47m 01s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 08s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 59s
podified-multinode-hci-deployment-crc FAILURE in 52m 19s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 47s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 37s
cifmw-pod-pre-commit FAILURE in 8m 12s
✔️ build-push-container-cifmw-client SUCCESS in 21m 36s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 12s

@maximsava12
Copy link
Contributor Author

maximsava12 commented Nov 17, 2025

Fixed set_fact FQDN module error in glance-rgw-discovery.yaml

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from c861df8 to 00517cf Compare November 17, 2025 08:05
This patch enhances the cifmw_ceph_client role to:
- Automatically discover Ceph RGW (RADOS Gateway) endpoint and credentials
- Create Glance secrets using the discovered RGW settings
- Configure glance with Ceph RGW secrets

This integration configures Glance with Ceph RGW access credentials,
enabling it to use RGW as an Glance backend when object storage is enabled

Changes:
- Add RGW discovery playbook
- Add logic to create Glance secrets with RGW config

Signed-off-by: Maxim Sava <[email protected]>
@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 00517cf to 9b5f23b Compare November 17, 2025 08:11
@maximsava12 maximsava12 changed the title Discover and configure Glance with Ceph RGW secrets [cifmw_ceph_client] Discover and configure Glance with Ceph RGW secrets Nov 17, 2025
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/43034d6beb1544e2ad271f00ce939ca6

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 39m 09s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 17m 49s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 25m 29s
podified-multinode-hci-deployment-crc FAILURE in 55m 08s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 20s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 37s
cifmw-pod-pre-commit FAILURE in 7m 48s
✔️ build-push-container-cifmw-client SUCCESS in 19m 01s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 33s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants