Giters

damavis / airflow-pentaho-plugin

Pentaho plugin for Apache Airflow - Orquestate pentaho transformations and jobs from Airflow

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to find repository: pentaho_server

thisthiago opened this issue · comments

commented

Hello everyone, I'm facing a problem when trying to use the airflow_pentaho.operators.CarteTransOperator.

I am getting this error even after I have created the repository. CarteTransOperator just can't find my jobs. This is the log of my DAG.

ERROR Unexpected error executing the transformation: org.pentaho.di.core.exception.KettleException: Unable to find repository: pentaho_server org.pentaho.di.www.ExecuteTransServlet.openRepository(ExecuteTransServlet.java:410) org.pentaho.di.www.ExecuteTransServlet.doGet(ExecuteTransServlet.java:261) javax.servlet.http.HttpServlet.service(HttpServlet.java:687) javax.servlet.http.HttpServlet.service(HttpServlet.java:790) org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873) org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700) org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667) org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61) org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:513) org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) org.eclipse.jetty.server.Server.handle(Server.java:505) org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698) org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804) java.lang.Thread.run(Thread.java:750)

This is my connection:

image

This is my task using the CarteTransOperator:
    job1 = CarteTransOperator(
        task_id="job1",
        trans="/public/home/my_asewome_ktr",
        params=None,
        pdi_conn_id="pdi_pentaho_server",
        level='Basic',
        dag=dag)

The same happens when I try to run a job through the do CarteJobOperator.

commented

All of my transformations and jobs are in a repository, and I would have to use that repository.

commented

Apparently the problem was related to my carter cluster settings, I followed this documentation:
https://help.hitachivantara.com/Documentation/Pentaho/7.1/0L0/0Y0/060/060