trinodb / benchto

Framework for running macro benchmarks in a clustered environment

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Run Benchto over HTTPS enabled Presto cluster

joshuav11 opened this issue · comments

Hi, I'm getting a 401 Unauthorized error while trying to execute benchmark over a HTTPS-enabled Presto cluster. I can see that Presto receives the queries from Benchto and runs them without a hitch. I'm thinking that Benchto has troubles getting the metrics/results back. I got this idea because I noticed that we're using two separate Java classes to send (presto driver) and retrieve (benchto-driver) the queries .

Presto version: 340
Presto authn: via LDAP
Benchmark driver: 340
I also used the same build to run a benchmark over HTTP and it worked flawlessly.

benchmark-service:
  url: "http://<my-benchto-svc>:8081"
data-sources:
  presto:
    url: jdbc:presto://<presto-url>SSL=true
    username: "<user>"
    password: "<pass>"
    driver-class-name: io.prestosql.jdbc.PrestoDriver
    SSL: true
environment:
  name: <my-env>
presto:
  url: "https://<presto-url>?username=<user>&password=<pass>"
  # username: <user>
  # password: <pass>
benchmark:
  feature:
    presto:
      metrics.collection.enabled: true
macros:
  sleep-4s:
    command: echo "Sleeping for 4s" && sleep 4

I think I also got where the error came from. When I try to go to this URL, the browser still asks for my login credentials. After pressing cancel, I get the Unauthorized response.

https://<presto-url>/v1/query/<query-id>?SSL=true&user=<user>&password=<pass>

Can somebody point me to the correct way of doing it? Or is it possible at all? Thanks!

It seems like I've run into the same issue as yours. https://prestosql.slack.com/archives/CGB0QHWSW/p1600449526028200

@sopel39 mentioned in the thread that metrics collection isn't currently supported for secured Presto. So atm behcnmark.feature.presto.metrics.collection.enabled flag has to be disabled to work with secured Presto.

Thanks for looking into this issue @dongwoo1005.

@joshuav11 I think the issue should still be open. I would like to eventually have behcnmark.feature.presto.metrics.collection.enabled flag enabled for Presto over https as this would allow more detailed analysis from Benchto.