Skip to content

refactor(tdp_lib_dag): make yarn_nodemanager_install dependant of spa… #999

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

refactor(tdp_lib_dag): make yarn_nodemanager_install dependant of spa… #999

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
34c15b2
refactor(tdp_lib_dag): make yarn_nodemanager_install dependant of spa…
SteBaum Nov 17, 2025
8e2f3e8
refactor(meta): regenerated the meta playbook
SteBaum Nov 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions playbooks/meta/all.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,10 +28,8 @@
- ansible.builtin.import_playbook: ../yarn_apptimelineserver_install.yml
- ansible.builtin.import_playbook: ../yarn_client_install.yml
- ansible.builtin.import_playbook: ../yarn_mapred_jobhistoryserver_install.yml
- ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
- ansible.builtin.import_playbook: ../yarn_ranger_install.yml
- ansible.builtin.import_playbook: ../yarn_resourcemanager_install.yml
- ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
- ansible.builtin.import_playbook: ../hive_client_install.yml
- ansible.builtin.import_playbook: ../hive_hiveserver2_install.yml
- ansible.builtin.import_playbook: ../hive_metastore_install.yml
Expand All @@ -52,6 +50,8 @@
- ansible.builtin.import_playbook: ../spark3_historyserver_install.yml
- ansible.builtin.import_playbook: ../spark3_ssl-tls_install.yml
- ansible.builtin.import_playbook: ../spark3_yarnshuffle_install.yml
- ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
- ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
- ansible.builtin.import_playbook: ../knox_gateway_install.yml
- ansible.builtin.import_playbook: ../knox_kerberos_install.yml
- ansible.builtin.import_playbook: ../knox_ranger_install.yml
Expand Down Expand Up @@ -182,9 +182,9 @@
- ansible.builtin.import_playbook: ../spark3_hdfs_init.yml
- ansible.builtin.import_playbook: ../spark3_historyserver_config.yml
# spark3_config
# spark3_historyserver_init
- ansible.builtin.import_playbook: ../spark3_jmx-exporter_config.yml
- ansible.builtin.import_playbook: ../spark3_historyserver_start.yml
# spark3_historyserver_init
# spark3_start
# spark3_init
- ansible.builtin.import_playbook: ../knox_gateway_config.yml
Expand Down
2 changes: 1 addition & 1 deletion playbooks/meta/all_per_service.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,8 @@
- ansible.builtin.import_playbook: kerberos.yml
- ansible.builtin.import_playbook: ranger.yml
- ansible.builtin.import_playbook: hdfs.yml
- ansible.builtin.import_playbook: spark3.yml
- ansible.builtin.import_playbook: yarn.yml
- ansible.builtin.import_playbook: hbase.yml
- ansible.builtin.import_playbook: hive.yml
- ansible.builtin.import_playbook: spark3.yml
- ansible.builtin.import_playbook: knox.yml
6 changes: 3 additions & 3 deletions playbooks/meta/restart.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,10 +28,8 @@
# - ansible.builtin.import_playbook: ../yarn_apptimelineserver_install.yml
# - ansible.builtin.import_playbook: ../yarn_client_install.yml
# - ansible.builtin.import_playbook: ../yarn_mapred_jobhistoryserver_install.yml
# - ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
# - ansible.builtin.import_playbook: ../yarn_ranger_install.yml
# - ansible.builtin.import_playbook: ../yarn_resourcemanager_install.yml
# - ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
# - ansible.builtin.import_playbook: ../hive_client_install.yml
# - ansible.builtin.import_playbook: ../hive_hiveserver2_install.yml
# - ansible.builtin.import_playbook: ../hive_metastore_install.yml
Expand All @@ -52,6 +50,8 @@
# - ansible.builtin.import_playbook: ../spark3_historyserver_install.yml
# - ansible.builtin.import_playbook: ../spark3_ssl-tls_install.yml
# - ansible.builtin.import_playbook: ../spark3_yarnshuffle_install.yml
# - ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
# - ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
# - ansible.builtin.import_playbook: ../knox_gateway_install.yml
# - ansible.builtin.import_playbook: ../knox_kerberos_install.yml
# - ansible.builtin.import_playbook: ../knox_ranger_install.yml
Expand Down Expand Up @@ -182,9 +182,9 @@
# - ansible.builtin.import_playbook: ../spark3_hdfs_init.yml
# - ansible.builtin.import_playbook: ../spark3_historyserver_config.yml
## spark3_config
## spark3_historyserver_init
# - ansible.builtin.import_playbook: ../spark3_jmx-exporter_config.yml
- ansible.builtin.import_playbook: ../spark3_historyserver_restart.yml
## spark3_historyserver_init
## spark3_restart
## spark3_init
# - ansible.builtin.import_playbook: ../knox_gateway_config.yml
Expand Down
2 changes: 1 addition & 1 deletion playbooks/meta/spark3.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,8 @@
- ansible.builtin.import_playbook: ../spark3_hdfs_init.yml
- ansible.builtin.import_playbook: ../spark3_historyserver_config.yml
# spark3_config
# spark3_historyserver_init
- ansible.builtin.import_playbook: ../spark3_jmx-exporter_config.yml
- ansible.builtin.import_playbook: ../spark3_historyserver_start.yml
# spark3_historyserver_init
# spark3_start
# spark3_init
6 changes: 3 additions & 3 deletions playbooks/meta/start.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,10 +28,8 @@
# - ansible.builtin.import_playbook: ../yarn_apptimelineserver_install.yml
# - ansible.builtin.import_playbook: ../yarn_client_install.yml
# - ansible.builtin.import_playbook: ../yarn_mapred_jobhistoryserver_install.yml
# - ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
# - ansible.builtin.import_playbook: ../yarn_ranger_install.yml
# - ansible.builtin.import_playbook: ../yarn_resourcemanager_install.yml
# - ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
# - ansible.builtin.import_playbook: ../hive_client_install.yml
# - ansible.builtin.import_playbook: ../hive_hiveserver2_install.yml
# - ansible.builtin.import_playbook: ../hive_metastore_install.yml
Expand All @@ -52,6 +50,8 @@
# - ansible.builtin.import_playbook: ../spark3_historyserver_install.yml
# - ansible.builtin.import_playbook: ../spark3_ssl-tls_install.yml
# - ansible.builtin.import_playbook: ../spark3_yarnshuffle_install.yml
# - ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
# - ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
# - ansible.builtin.import_playbook: ../knox_gateway_install.yml
# - ansible.builtin.import_playbook: ../knox_kerberos_install.yml
# - ansible.builtin.import_playbook: ../knox_ranger_install.yml
Expand Down Expand Up @@ -182,9 +182,9 @@
# - ansible.builtin.import_playbook: ../spark3_hdfs_init.yml
# - ansible.builtin.import_playbook: ../spark3_historyserver_config.yml
## spark3_config
## spark3_historyserver_init
# - ansible.builtin.import_playbook: ../spark3_jmx-exporter_config.yml
- ansible.builtin.import_playbook: ../spark3_historyserver_start.yml
## spark3_historyserver_init
## spark3_start
## spark3_init
# - ansible.builtin.import_playbook: ../knox_gateway_config.yml
Expand Down
2 changes: 1 addition & 1 deletion playbooks/meta/yarn.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,9 @@
- ansible.builtin.import_playbook: ../yarn_apptimelineserver_install.yml
- ansible.builtin.import_playbook: ../yarn_client_install.yml
- ansible.builtin.import_playbook: ../yarn_mapred_jobhistoryserver_install.yml
- ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
- ansible.builtin.import_playbook: ../yarn_ranger_install.yml
- ansible.builtin.import_playbook: ../yarn_resourcemanager_install.yml
- ansible.builtin.import_playbook: ../yarn_nodemanager_install.yml
- ansible.builtin.import_playbook: ../yarn_ssl-tls_install.yml
- ansible.builtin.import_playbook: ../yarn_kerberos_install.yml
# yarn_install
Expand Down
7 changes: 2 additions & 5 deletions tdp_lib_dag/spark3.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,15 +19,13 @@
- spark3_historyserver_install

- name: spark3_yarnshuffle_install
depends_on:
- yarn_nodemanager_install
depends_on: []

- name: spark3_client_config
depends_on:
- tdp-cluster_config
- hadoop_client_config
- spark3_kerberos_install
- hbase_client_config

- name: spark3_historyserver_config
depends_on:
Expand All @@ -48,14 +46,13 @@
- name: spark3_historyserver_start
depends_on:
- spark3_jmx-exporter_config
- yarn_client_config
- spark3_historyserver_config
- spark3_hdfs_init

- name: spark3_historyserver_init
noop: yes
depends_on:
- yarn_client_init
- spark3_historyserver_start

- name: spark3_install
noop: yes
Expand Down
1 change: 1 addition & 0 deletions tdp_lib_dag/yarn.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@
- name: yarn_nodemanager_install
depends_on:
- hadoop_install
- spark3_yarnshuffle_install

- name: yarn_apptimelineserver_install
depends_on:
Expand Down
Loading