Ansible объединить «сложный» словарь

Question

Допустим, у меня есть следующие переменные:

services:
  - name: export
    command: "php app/console export"
  - name: import
    command: "php app/console import"

contextes:
  - site_name: mysite
    stages:
      - stage_name: prod
        url: http://mysite.fr
        db:
          name: mysitedb_prod
          user: myuserdb_prod
        # more and more attributes, some simple, some list, some dictionaries
      - stage_name: qualif
        url: http://qualif.mysite.fr
        db:
          name: mysitedb_qualif
          user: mysiteuser_qualif
  - site_name: my2dsite
    stages:
      - stage_name: prod
        url: http://mysite2.fr
        db:
          name: mysite2db_prod
          user: myuser2db_prod

Я хочу преобразовать их, чтобы иметь следующую структуру переменных:

my_var:
  - site_name: mysite
    stage_name: prod
    services:
      - name: export
        command: "php app/console export"
      - name: import
        command: "php app/console import"
  - site_name: mysite
    stage_name: qualif
    services:
      - name: export
        command: "php app/console export"
      - name: import
        command: "php app/console import"
  - site_name: my2dsite
    stage_name: prod
    services:
      - name: export
        command: "php app/console export"
      - name: import
        command: "php app/console import"

(конечная цель - создать тот же systemD услуги для всех моих сайтов / этапов)

Я попробовал несколько вещей на основе set_fact и with_subelement l oop.

Я пытался этот ответ мог бы помочь мне, но проблема это не одно и то же, и я не понимаю тринаформации, созданной для их адаптации. (Обратите внимание, что если я повторяю сервисы во всех имя_сайта / stage_name, это работает, но я бы хотел этого избежать)

Примечание: я не могу изменить структуру переменных "contextes", на которой основана вся моя инфраструктура ansible.

Большое спасибо

Answer 1

Хотя я в целом согласен с комментарием @larsk о способности ansible справляться со сложными манипуляциями с данными, текущая проблема не так сложна, как кажется, и может иметь довольно краткое решение "ansible only".

Мое решение основано на использовании субэлементов l oop

---
- name: Loop on subelements
  hosts: localhost
  gather_facts: false

  vars:
    services:
      - name: export
        command: "php app/console export"
      - name: import
        command: "php app/console import"

    contextes:
      - site_name: mysite
        stages:
          - stage_name: prod
            url: http://mysite.fr
            db:
              name: mysitedb_prod
              user: myuserdb_prod
            # more and more attributes, some simple, some list, some dictionaries
          - stage_name: qualif
            url: http://qualif.mysite.fr
            db:
              name: mysitedb_qualif
              user: mysiteuser_qualif
      - site_name: my2dsite
        stages:
          - stage_name: prod
            url: http://mysite2.fr
            db:
              name: mysite2db_prod
              user: myuser2db_prod

  tasks:
    - name: Construct my new data structure
      vars:
        current_hash:
          site_name: "{{ item.0.site_name }}"
          stage_name: "{{ item.1.stage_name }}"
          services: "{{ services }}"
      set_fact:
        my_var: "{{ my_var | default([]) + [current_hash] }}"
      loop: "{{ lookup('subelements', contextes, 'stages') }}"

    - name: Show calculated var
      debug:
        var: my_var

, что дает

$ ansible-playbook test.yml 

PLAY [Loop on subelements] **********************************************************************************************************************************************************************************************************************************************

TASK [Construct my new data structure] **********************************************************************************************************************************************************************************************************************************
ok: [localhost] => (item=[{'site_name': 'mysite'}, {'stage_name': 'prod', 'url': 'http://mysite.fr', 'db': {'name': 'mysitedb_prod', 'user': 'myuserdb_prod'}}])
ok: [localhost] => (item=[{'site_name': 'mysite'}, {'stage_name': 'qualif', 'url': 'http://qualif.mysite.fr', 'db': {'name': 'mysitedb_qualif', 'user': 'mysiteuser_qualif'}}])
ok: [localhost] => (item=[{'site_name': 'my2dsite'}, {'stage_name': 'prod', 'url': 'http://mysite2.fr', 'db': {'name': 'mysite2db_prod', 'user': 'myuser2db_prod'}}])

TASK [Show calculated var] **********************************************************************************************************************************************************************************************************************************************
ok: [localhost] => {
    "my_var": [
        {
            "services": [
                {
                    "command": "php app/console export",
                    "name": "export"
                },
                {
                    "command": "php app/console import",
                    "name": "import"
                }
            ],
            "site_name": "mysite",
            "stage_name": "prod"
        },
        {
            "services": [
                {
                    "command": "php app/console export",
                    "name": "export"
                },
                {
                    "command": "php app/console import",
                    "name": "import"
                }
            ],
            "site_name": "mysite",
            "stage_name": "qualif"
        },
        {
            "services": [
                {
                    "command": "php app/console export",
                    "name": "export"
                },
                {
                    "command": "php app/console import",
                    "name": "import"
                }
            ],
            "site_name": "my2dsite",
            "stage_name": "prod"
        }
    ]
}

PLAY RECAP **************************************************************************************************************************************************************************************************************************************************************
localhost                  : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0