Error running a transformation

[Rubens Mendonça]

Error running a transformation. Can anyone help?

[2022-11-09, 16:59:28 -03] {base.py:71} INFO - Using connection ID 'pdi_default' for task execution.
[2022-11-09, 16:59:28 -03] {carte.py:175} INFO - Executing /home/rmendonc/data-integration/transformacoes/LOOP.ktr
[2022-11-09, 16:59:28 -03] {taskinstance.py:1851} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/airflow_pentaho/operators/carte.py", line 183, in execute
status = status_trans_rs['transstatus']
KeyError: 'transstatus'
[2022-11-09, 16:59:28 -03] {taskinstance.py:1406} INFO - Marking task as FAILED. dag_id=pdi_flow2, task_id=loop, execution_date=20221108T003000, start_date=20221109T195927, end_date=20221109T195928
[2022-11-09, 16:59:28 -03] {standard_task_runner.py:105} ERROR - Failed to execute job 256 for task loop ('transstatus'; 5457)
[2022-11-09, 16:59:28 -03] {local_task_job.py:164} INFO - Task exited with return code 1
[2022-11-09, 16:59:28 -03] {local_task_job.py:273} INFO - 0 downstream tasks scheduled from follow-on schedule check

[Cristòfol Torrens]

Hi @rubensmm ,

It seems that there is no status after submitting transformation to carte server. Can you try to use /home/rmendonc/data-integration/transformacoes/LOOP instead (without .ktr extension)?

Also, can you check for the status at carte webserver?

I'll also add some logs to help debugging this cases.

Thanks.

[Cristòfol Torrens]

Hi @rubensmm

Please, upgrade to version 1.0.14 and try again. You will get more information if the same error ocurres.

Thanks.

[Rubens Mendonça]

apache-airflow==2.4.2
pdi-ce-9.3.0.0-428

"Can you try to use /home/rmendonc/data-integration/transformacoes/LOOP instead (without .ktr extension)?"

Version 1.0.14

With .ktr extension

My DAG:

Connection:

Status carte:

===============
I succeed when I run "CarteJobOperator"

[Cristòfol Torrens]

Hi @rubensmm ,

I think that you didn't run it again with the extension .ktr and plugin version 1.0.14. I can confirm that, because the error do not correspond to file:line (carte.py:183) where error ocurres. Can you try again please? Make sure your workers are also up to date.

Thanks.

[Rubens Mendonça]

Hi @piffall,

With the extension .ktr

File "/home/airflow/.local/lib/python3.7/site-packages/airflow_pentaho/operators/carte.py", line 190, in execute
'Unexpected server response: ' + json.dumps(status_trans_rs))

Without the .ktr extension

[Cristòfol Torrens]

You got the RCE just below first highlighted image, so it seems that carte is not finding it.

[Rubens Mendonça]

OK. I will check if there is any blockage in the firewall connections.

Thank you for your help!