[Bug] [zos_job_submit] 'utf-8' codec can't decode byte 0xdd error on zos_job_submit module #677
Comments
|
@GerMFHub - thank you for opening an issue with our offering. Could you try to disable pipelining please by adding this to |
ddimatos
changed the title
ddimatos
added
the
Waiting for Response
|
@ddimatos I am currently running at: Ansible version IBM ZOAU version tried to disable pipelining as you suggested, but this did not help |
|
@GerMFHub thank you, i noticed i had left Pipelining as |
|
Please note that our issue templates , request information so that we can diagnose issues accordingly, please complete the fields so we may be efficient at diagnosing issues. Thus since I don't have the playbook and having to assemble this playbook from the log, it looks to me like your workflow is this:
But in (1) the file /u/userid/tmp/CICS55.jcl" is encoded as IBM-1047 then Generally if no locale is provided the destinations locale is automatically detected, thus given this location was USS, it should have detected the locale as IBM-1047 for both src and dest, I can not tell without a playbook easily if that was your configuration or the auto detection that erred |
|
I think the auto encoding detection in the code is only for the managed node after looking at the code and the controller is defaulted to UTF-8 if you don't specify something which it looks like you did specify ISO=88859-1 |
|
@ddimatos yes, I have specified pipelining as FALSE: may play book looks like this:
encoding:to: "IBM-1047"from: "UTF-8"encoding:to: "IBM-1047"from: "UTF-8"----- here .j2 templete that I am suing: //{{ cicsname }} JOB ,CICS55,CLASS=A,MSGCLASS=X,NOTIFY=&SYSUID Did tried various encoding options or omitting them, result is similar |
|
@ddimatos is there any update on this? |
|
I also ran into this or similar issue: the job ran ok: |
ddimatos
added
Needs Triage
|
Hi @ddimatos, I ran into the same issue. I tried to create a minimal JCL that "causes" the issue for me: The culprit seems to be the machine code control character (more about it here: https://www.ibm.com/docs/en/zos/2.5.0?topic=sets-control-characters). In this case, machine code control characters are a part of the assembler listing which goes to the SYSPRINT ddname. To re-create the issue, I just run: It happens for |
I see that the |
|
I have a similiar issue with a different hex value though. I am uploading a REXX containing a German umlaut to z/OS which works well
Then I'm submitting a job to execute this REXX:
What happens is that the job is submitted, runs fine, ends with CC0, contains the output just as I'd expect. That is what I see when I look into the spool using 3270. So I speculate that something goes wrong when the output is being retrieved back to ansible:
The problem in the job submit disappears if I change the ä in the REXX back to a. Just for the fun of it I changed the upload of the REXX to IBM-1047. As expected this leads to the questionable character in the REXX arriving with a different hex code on the host. But neither an umlaut nor curly brace should break the job. I assume multibyte conversion misinterprets something Does this fit in here or should I create a separate Bug? I am using ibm-ibm_zos_core-1.6.0-beta.1.tar.gz |
|
@vit-tomica - this is very helpful, thus far I have found most of these occur when compile and link outputs are involved (not always) but your points help me, I have also not been able to recreate yet so I will try yours. I have a feeling I know where this happens which you eluded to (pjdd - but goes lower than that), when we migrated our code to use more of ZOAU the Python to C hand off code encounters these bytes that can not be translated to a valid UTF-8 byte that Python expects and breaks. Having a recreate will help me but I expect this is and API change and may not be resolved till later in the year thus I will continue to work on the recreate and see if there is anything we can do from the ansible side and for now mark this as a It was creative to ask for ASA ansi printable chars :) , that a good idea. |
|
@dietmarf Your issue fits very well here, the 11th position is the |
ddimatos
added
the
Waiting on dependency
|
Thanks, @ddimatos. The fourth column displays the record format (RECFM) attribute (in this case, it's UA, V, VA, FBM, VBA) . If the RECFM contains As you say, the |
|
@vit-tomica - this great info, to be honest in the past month I have been exploring ASA for a different use case and have become familiar with ASA printable ANSI chars, my experience on mainframes never needed me to know about them (until now), as always, learning... We will be working to resolve this issue, its happening a in few places where a byte stream which cannot be assigned to a UTF-8 text encoding will break the contract imposed on us by python which text must be UTF-8 assignable. We are entering our next quarters planning and have marked this something to triage, so I will try to use your recreate to help with solving this. I appreciate all the help, it has definitely been helpful. |
ddimatos
removed
the
Waiting on dependency
|
Thanks for the update, @ddimatos. The control characters were strictly used by physical line printers in the past, e.g. to control the flow of the paper etc., check this for more info. I see almost no use cases for why it should be returned. In most cases, it just pollutes the output as we can see. Again, the fix should be done in |
|
@vit-tomica - Thanks for the feedback, I could some additional clarity. There are 2 code paths here, lets comment on the Python path first. The point I was trying to convey is that the what I am referring to as non-printable is not only control chars created for printing,; for me non-printable are EBCDIC characters that fall outside the range of UTF-8 needed for Python, so in this case, a Job having non-printable such as a We are not inspecting sources to know if a For the shell path, its pretty much the same example above, while the shell tolerates a machine printable, we don't inspect the source to know to remove it or not. The overhead and number of permutations needed to inspect source to remove a non-printable seems to be me to be more costly than the gain one would make for ZOAU. I could see value in allowing a user to override a non-printable with a character of their choice to ease parsing; at the moment nothing else comes to mind. I can discuss this with some other folks, please share your thoughts as we are coming to close on our development cycle and would like to finalize on this. I did not state where the fix is being done (e.g. ZOAU. ansible-core, IBM z/OS core, etc) to warrant what is a hack or not, nor did I share the sources for the fix for anyone to make a justification if it is a hack. |
|
@ddimatos Thanks for the explanation. I didn't know that control characters are still pretty used nowadays. I still think having an option somewhere (in ZOAU) not to send them as part of the output would be useful. I realize this may be out of the scope of this issue/ansible project. I get your point about treating control chars and other non-printable chars as one group. I deliberately decoupled control characters from non-printable chars because I can see control characters in every job output on our systems for JESMSGLG and JESYSMSG ddnames and I don't need to see them. In this case, they are printable control characters, so again, out of scope. I deviated a bit from what this issue is trying to fix. Sorry about that :) I think what you suggest, replacing a non-printable char with a selectable char, seems ok to me. |
|
@vit-tomica while I'm not discounting the idea of looking at the record format, it might work, my concern is consistency, because if you submit a job via mvscmd/mvscmdsuth instead of JES,sysout and sysprint if not defined will go to a temporary sequential data and maybe that is good in that many the control chars will not be preserved, I'll look into this idea with the team and maybe we target it for exploration to ensure we can be consistent and accurate in our responses and start by releasing a character replacement that has been prototyped. On the contrary , zos_copy is going to be supporting the preservation of ASA control chars in our next release, hence it's still widely used. I don't mind the deviation, it's important we know what things our users are experiencing and if we can support them . |
|
@ddimatos Thanks for the information. PS: I love this project. You do a great job on that! |
ddimatos
added
the
Waiting on dependency
ddimatos
added
In Plan
|
See the following issues below, they are all related to non-printable UTF-8 chars, essentially chararcetors that don't don't correspond to a UTF-8 value. This is being addressed as noted in ZOAU 1.3 and IBM z/OS Core collection will adopt ZOAU 1.3 in Q1 2024. There is a recreate involving a job submission you can see here. This work is also being tracked in JIRA 9687.
|
ddimatos
removed
the
Waiting on dependency
rexemin
moved this from 👀 Reviewing
to 🔍 Validation
in IBM Ansible z/OS Core Collection
[product_dir@amsdevocicgs01 submit_query_retrieve]$ ansible-playbook -i inventories provision_cics_region.yml --ask-pass -vvv
ansible-playbook 2.9.7
config file = /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/ansible.cfg
configured module search path = ['/home2/product_dir/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
ansible python module location = /usr/lib/python3.6/site-packages/ansible
executable location = /usr/bin/ansible-playbook
python version = 3.6.8 (default, Dec 5 2019, 15:45:45) [GCC 8.3.1 20191121 (Red Hat 8.3.1-5)]
Using /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/ansible.cfg as config file
SSH password:
host_list declined parsing /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/inventories/inventory.yml as it did not pass its verify_file() method
script declined parsing /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/inventories/inventory.yml as it did not pass its verify_file() method
Parsed /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/inventories/inventory.yml inventory source with yaml plugin
PLAYBOOK: provision_cics_region.yml *************************************************************************************************************************************************************************
1 plays in provision_cics_region.yml
PLAY [zos_host] *********************************************************************************************************************************************************************************************
META: ran handlers
TASK [Create JCL template from j2 files in /u/userid/tmp] ***************************************************************************************************************************************************
task path: /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/provision_cics_region.yml:48
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'echo ~userid && sleep 0'"'"''
<localmf.com.COM> (0, b'/u/userid\n', b'')
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'( umask 77 && mkdir -p "
echo /u/userid/.ansible/tmp"&& mkdir /u/userid/.ansible/tmp/ansible-tmp-1679305174.1329653-3411103-77108235533620 && echo ansible-tmp-1679305174.1329653-3411103-77108235533620="echo /u/userid/.ansible/tmp/ansible-tmp-1679305174.1329653-3411103-77108235533620" ) && sleep 0'"'"''<localmf.com.COM> (0, b'ansible-tmp-1679305174.1329653-3411103-77108235533620=/u/userid/.ansible/tmp/ansible-tmp-1679305174.1329653-3411103-77108235533620\n', b'')
Using module file /usr/lib/python3.6/site-packages/ansible/modules/files/stat.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"changed": false, "stat": {"exists": true, "path": "/u/userid/tmp/CICS55.jcl.bin", "mode": "0600", "isdir": false, "ischr": false, "isblk": false, "isreg": true, "isfifo": false, "islnk": false, "issock": false, "uid": 3111, "gid": 200, "size": 15658, "inode": 7433, "dev": 1008, "nlink": 1, "atime": 1679304237.0, "mtime": 1679299799.0, "ctime": 1679299801.0, "wusr": true, "rusr": true, "xusr": false, "wgrp": false, "rgrp": false, "xgrp": false, "woth": false, "roth": false, "xoth": false, "isuid": false, "isgid": false, "blocks": 8, "block_size": 1024, "device_type": 0, "readable": true, "writeable": true, "executable": false, "pw_name": "userid", "gr_name": "PDUSER", "checksum": "a56dd299a0c6d869a016ab7273e861351bf31699", "mimetype": "unknown", "charset": "unknown", "version": null, "attributes": [], "attr_flags": ""}, "invocation": {"module_args": {"path": "/u/userid/tmp/CICS55.jcl.bin", "follow": false, "get_checksum": true, "checksum_algorithm": "sha1", "get_md5": false, "get_mime": true, "get_attributes": true}}}\n', b'')
Using module file /usr/lib/python3.6/site-packages/ansible/modules/files/file.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"path": "/u/userid/tmp/CICS55.jcl.bin", "changed": false, "diff": {"before": {"path": "/u/userid/tmp/CICS55.jcl.bin"}, "after": {"path": "/u/userid/tmp/CICS55.jcl.bin"}}, "uid": 3111, "gid": 200, "owner": "userid", "group": "PDUSER", "mode": "0600", "state": "file", "size": 15658, "invocation": {"module_args": {"mode": 384, "follow": false, "dest": "/u/userid/tmp/CICS55.jcl.bin", "_original_basename": "CICS55.j2", "recurse": false, "state": "file", "path": "/u/userid/tmp/CICS55.jcl.bin", "force": false, "modification_time_format": "%Y%m%d%H%M.%S", "access_time_format": "%Y%m%d%H%M.%S", "_diff_peek": null, "src": null, "modification_time": null, "access_time": null, "owner": null, "group": null, "seuser": null, "serole": null, "selevel": null, "setype": null, "attributes": null, "content": null, "backup": null, "remote_src": null, "regexp": null, "delimiter": null, "directory_mode": null, "unsafe_writes": null}}}\n', b'')
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'rm -f -r /u/userid/.ansible/tmp/ansible-tmp-1679305174.1329653-3411103-77108235533620/ > /dev/null 2>&1 && sleep 0'"'"''
<localmf.com.COM> (0, b'', b'')
ok: [zos_host] => {
"changed": false,
"checksum": "a56dd299a0c6d869a016ab7273e861351bf31699",
"dest": "/u/userid/tmp/CICS55.jcl.bin",
"diff": {
"after": {
"path": "/u/userid/tmp/CICS55.jcl.bin"
},
"before": {
"path": "/u/userid/tmp/CICS55.jcl.bin"
}
},
"gid": 200,
"group": "PDUSER",
"invocation": {
"module_args": {
"_diff_peek": null,
"_original_basename": "CICS55.j2",
"access_time": null,
"access_time_format": "%Y%m%d%H%M.%S",
"attributes": null,
"backup": null,
"content": null,
"delimiter": null,
"dest": "/u/userid/tmp/CICS55.jcl.bin",
"directory_mode": null,
"follow": false,
"force": false,
"group": null,
"mode": 384,
"modification_time": null,
"modification_time_format": "%Y%m%d%H%M.%S",
"owner": null,
"path": "/u/userid/tmp/CICS55.jcl.bin",
"recurse": false,
"regexp": null,
"remote_src": null,
"selevel": null,
"serole": null,
"setype": null,
"seuser": null,
"src": null,
"state": "file",
"unsafe_writes": null
}
},
"mode": "0600",
"owner": "userid",
"path": "/u/userid/tmp/CICS55.jcl.bin",
"size": 15658,
"state": "file",
"uid": 3111
}
TASK [Create JCL template from j2 files in /u/userid/tmp] ***************************************************************************************************************************************************
task path: /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/provision_cics_region.yml:55
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'echo ~userid && sleep 0'"'"''
<localmf.com.COM> (0, b'/u/userid\n', b'')
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'( umask 77 && mkdir -p "
echo /u/userid/.ansible/tmp"&& mkdir /u/userid/.ansible/tmp/ansible-tmp-1679305176.9918606-3411145-249706893767352 && echo ansible-tmp-1679305176.9918606-3411145-249706893767352="echo /u/userid/.ansible/tmp/ansible-tmp-1679305176.9918606-3411145-249706893767352" ) && sleep 0'"'"''<localmf.com.COM> (0, b'ansible-tmp-1679305176.9918606-3411145-249706893767352=/u/userid/.ansible/tmp/ansible-tmp-1679305176.9918606-3411145-249706893767352\n', b'')
Using module file /usr/lib/python3.6/site-packages/ansible/modules/files/stat.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"changed": false, "stat": {"exists": true, "path": "/u/userid/tmp/CSDJOB.jcl.bin", "mode": "0600", "isdir": false, "ischr": false, "isblk": false, "isreg": true, "isfifo": false, "islnk": false, "issock": false, "uid": 3111, "gid": 200, "size": 7259, "inode": 1285, "dev": 1008, "nlink": 1, "atime": 1679304238.0, "mtime": 1679303950.0, "ctime": 1679303951.0, "wusr": true, "rusr": true, "xusr": false, "wgrp": false, "rgrp": false, "xgrp": false, "woth": false, "roth": false, "xoth": false, "isuid": false, "isgid": false, "blocks": 8, "block_size": 1024, "device_type": 0, "readable": true, "writeable": true, "executable": false, "pw_name": "userid", "gr_name": "PDUSER", "checksum": "c039f81aeadf8e1bebe8a2d668d74d9df71db843", "mimetype": "unknown", "charset": "unknown", "version": null, "attributes": [], "attr_flags": ""}, "invocation": {"module_args": {"path": "/u/userid/tmp/CSDJOB.jcl.bin", "follow": false, "get_checksum": true, "checksum_algorithm": "sha1", "get_md5": false, "get_mime": true, "get_attributes": true}}}\n', b'')
Using module file /usr/lib/python3.6/site-packages/ansible/modules/files/file.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"path": "/u/userid/tmp/CSDJOB.jcl.bin", "changed": false, "diff": {"before": {"path": "/u/userid/tmp/CSDJOB.jcl.bin"}, "after": {"path": "/u/userid/tmp/CSDJOB.jcl.bin"}}, "uid": 3111, "gid": 200, "owner": "userid", "group": "PDUSER", "mode": "0600", "state": "file", "size": 7259, "invocation": {"module_args": {"mode": 384, "follow": false, "dest": "/u/userid/tmp/CSDJOB.jcl.bin", "_original_basename": "CSDJOB.j2", "recurse": false, "state": "file", "path": "/u/userid/tmp/CSDJOB.jcl.bin", "force": false, "modification_time_format": "%Y%m%d%H%M.%S", "access_time_format": "%Y%m%d%H%M.%S", "_diff_peek": null, "src": null, "modification_time": null, "access_time": null, "owner": null, "group": null, "seuser": null, "serole": null, "selevel": null, "setype": null, "attributes": null, "content": null, "backup": null, "remote_src": null, "regexp": null, "delimiter": null, "directory_mode": null, "unsafe_writes": null}}}\n', b'')
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'rm -f -r /u/userid/.ansible/tmp/ansible-tmp-1679305176.9918606-3411145-249706893767352/ > /dev/null 2>&1 && sleep 0'"'"''
<localmf.com.COM> (0, b'', b'')
ok: [zos_host] => {
"changed": false,
"checksum": "c039f81aeadf8e1bebe8a2d668d74d9df71db843",
"dest": "/u/userid/tmp/CSDJOB.jcl.bin",
"diff": {
"after": {
"path": "/u/userid/tmp/CSDJOB.jcl.bin"
},
"before": {
"path": "/u/userid/tmp/CSDJOB.jcl.bin"
}
},
"gid": 200,
"group": "PDUSER",
"invocation": {
"module_args": {
"_diff_peek": null,
"_original_basename": "CSDJOB.j2",
"access_time": null,
"access_time_format": "%Y%m%d%H%M.%S",
"attributes": null,
"backup": null,
"content": null,
"delimiter": null,
"dest": "/u/userid/tmp/CSDJOB.jcl.bin",
"directory_mode": null,
"follow": false,
"force": false,
"group": null,
"mode": 384,
"modification_time": null,
"modification_time_format": "%Y%m%d%H%M.%S",
"owner": null,
"path": "/u/userid/tmp/CSDJOB.jcl.bin",
"recurse": false,
"regexp": null,
"remote_src": null,
"selevel": null,
"serole": null,
"setype": null,
"seuser": null,
"src": null,
"state": "file",
"unsafe_writes": null
}
},
"mode": "0600",
"owner": "userid",
"path": "/u/userid/tmp/CSDJOB.jcl.bin",
"size": 7259,
"state": "file",
"uid": 3111
}
TASK [Convert from ASCII to EBCDIC] *************************************************************************************************************************************************************************
task path: /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/provision_cics_region.yml:62
Using module file /home2/product_dir/.ansible/collections/ansible_collections/ibm/ibm_zos_core/plugins/modules/zos_encode.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"changed": true, "src": "/u/userid/tmp/CICS55.jcl.bin", "dest": "/u/userid/tmp/CICS55.jcl", "backup_name": null, "uid": 3111, "gid": 200, "owner": "userid", "group": "PDUSER", "mode": "0644", "state": "file", "size": 15658, "invocation": {"module_args": {"src": "/u/userid/tmp/CICS55.jcl.bin", "dest": "/u/userid/tmp/CICS55.jcl", "encoding": {"to": "IBM-1047", "from": "ISO8859-1"}, "backup": false, "backup_compress": false, "backup_name": null, "tmp_hlq": null, "from_encoding": "ISO8859-1", "to_encoding": "IBM-1047"}}}\n', b'')
changed: [zos_host] => {
"backup_name": null,
"changed": true,
"dest": "/u/userid/tmp/CICS55.jcl",
"gid": 200,
"group": "PDUSER",
"invocation": {
"module_args": {
"backup": false,
"backup_compress": false,
"backup_name": null,
"dest": "/u/userid/tmp/CICS55.jcl",
"encoding": {
"from": "ISO8859-1",
"to": "IBM-1047"
},
"from_encoding": "ISO8859-1",
"src": "/u/userid/tmp/CICS55.jcl.bin",
"tmp_hlq": null,
"to_encoding": "IBM-1047"
}
},
"mode": "0644",
"owner": "userid",
"size": 15658,
"src": "/u/userid/tmp/CICS55.jcl.bin",
"state": "file",
"uid": 3111
}
TASK [ENCODING changes completion] **************************************************************************************************************************************************************************
task path: /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/provision_cics_region.yml:71
ok: [zos_host] => {
"msg": {
"backup_name": null,
"changed": true,
"dest": "/u/userid/tmp/CICS55.jcl",
"failed": false,
"gid": 200,
"group": "PDUSER",
"mode": "0644",
"owner": "userid",
"size": 15658,
"src": "/u/userid/tmp/CICS55.jcl.bin",
"state": "file",
"uid": 3111
}
}
TASK [Convert from ASCII to EBCDIC] *************************************************************************************************************************************************************************
task path: /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/provision_cics_region.yml:75
Using module file /home2/product_dir/.ansible/collections/ansible_collections/ibm/ibm_zos_core/plugins/modules/zos_encode.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"changed": true, "src": "/u/userid/tmp/CSDJOB.jcl.bin", "dest": "/u/userid/tmp/CSDJOB.jcl", "backup_name": null, "uid": 3111, "gid": 200, "owner": "userid", "group": "PDUSER", "mode": "0644", "state": "file", "size": 7259, "invocation": {"module_args": {"src": "/u/userid/tmp/CSDJOB.jcl.bin", "dest": "/u/userid/tmp/CSDJOB.jcl", "encoding": {"to": "IBM-1047", "from": "ISO8859-1"}, "backup": false, "backup_compress": false, "backup_name": null, "tmp_hlq": null, "from_encoding": "ISO8859-1", "to_encoding": "IBM-1047"}}}\n', b'')
changed: [zos_host] => {
"backup_name": null,
"changed": true,
"dest": "/u/userid/tmp/CSDJOB.jcl",
"gid": 200,
"group": "PDUSER",
"invocation": {
"module_args": {
"backup": false,
"backup_compress": false,
"backup_name": null,
"dest": "/u/userid/tmp/CSDJOB.jcl",
"encoding": {
"from": "ISO8859-1",
"to": "IBM-1047"
},
"from_encoding": "ISO8859-1",
"src": "/u/userid/tmp/CSDJOB.jcl.bin",
"tmp_hlq": null,
"to_encoding": "IBM-1047"
}
},
"mode": "0644",
"owner": "userid",
"size": 7259,
"src": "/u/userid/tmp/CSDJOB.jcl.bin",
"state": "file",
"uid": 3111
}
TASK [RUN job - create CICS region datasets] ****************************************************************************************************************************************************************
task path: /home2/product_dir/z_playbooks/z_ansible_collections_samples/zos_concepts/jobs/submit_query_retrieve/provision_cics_region.yml:84
Using module file /home2/product_dir/.ansible/collections/ansible_collections/ibm/ibm_zos_core/plugins/modules/zos_job_submit.py
Pipelining is enabled.
<localmf.com.COM> ESTABLISH SSH CONNECTION FOR USER: userid
<localmf.com.COM> SSH: EXEC sshpass -d9 ssh -C -o ControlMaster=auto -o ControlPersist=60s -o 'User="userid"' -o ConnectTimeout=10 -o ControlPath=/home2/product_dir/.ansible/cp/88bfa6665a localmf.com.COM '/bin/sh -c '"'"'_BPXK_AUTOCVT=ON ZOAU_HOME=/rsusr/idz/zoautil LIBPATH=/rsusr/idz/zoautil/lib:/rsusr/pyz/3.10.7/lib:/lib:/usr/lib:. PATH=/rsusr/idz/zoautil/bin:/rsusr/pyz/3.10.7/bin:/bin:/var/bin _CEE_RUNOPTS='"'"'"'"'"'"'"'"'FILETAG(AUTOCVT,AUTOTAG) POSIX(ON)'"'"'"'"'"'"'"'"' _TAG_REDIR_ERR=txt _TAG_REDIR_IN=txt _TAG_REDIR_OUT=txt LANG=C iflevel=IF3 cicsname=CICD61AN cics_version=TS55 /rsusr/pyz/3.10.7/bin/python3.10 && sleep 0'"'"''
<localmf.com.COM> (0, b'\n{"changed": false, "failed": true, "msg": "The JCL submitted with job id J0633815 but there was an error, please review the error for further details: 'utf-8' codec can't decode byte 0xdd in position 997: invalid continuation byte.", "invocation": {"module_args": {"src": "/u/userid/tmp/CICS55.jcl", "location": "USS", "wait": true, "return_output": true, "max_rc": 4, "encoding": {"to": "IBM-1047", "from": "ISO8859-1"}, "wait_time_s": 10, "volume": null, "temp_file": null, "from_encoding": "ISO8859-1", "to_encoding": "IBM-1047"}}}\n', b'')
fatal: [zos_host]: FAILED! => {
"changed": false,
"invocation": {
"module_args": {
"encoding": {
"from": "ISO8859-1",
"to": "IBM-1047"
},
"from_encoding": "ISO8859-1",
"location": "USS",
"max_rc": 4,
"return_output": true,
"src": "/u/userid/tmp/CICS55.jcl",
"temp_file": null,
"to_encoding": "IBM-1047",
"volume": null,
"wait": true,
"wait_time_s": 10
}
},
"msg": "The JCL submitted with job id J0633815 but there was an error, please review the error for further details: 'utf-8' codec can't decode byte 0xdd in position 997: invalid continuation byte."
}
PLAY RECAP **************************************************************************************************************************************************************************************************
zos_host : ok=5 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0
The text was updated successfully, but these errors were encountered: