Giters

Azure / aztk

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Account setup script failing in Cloud Shell

gicastel opened this issue · comments

commented

Created a new cloud shell, run the command and this error is given;

`Installing dependencies...
Finished installing dependencies.
Getting account setup script...
Finished getting account setup script.
Running account setup script...

Getting credentials.
Your credentials class does not support session injection. Performance will not be at the maximum.
Traceback (most recent call last):
File "/home/jack/.local/lib/python3.5/site-packages/msrest/pipeline/requests.py", line 65, in send
self._creds.signed_session(session)
File "/home/jack/.local/lib/python3.5/site-packages/azure/common/credentials.py", line 78, in signed_session
return credentials.signed_session(session)
TypeError: signed_session() takes 1 positional argument but 2 were given

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "account_setup.py", line 332, in
tenant_ids = [tenant.id for tenant in subscription_client.tenants.list()]
File "account_setup.py", line 332, in
tenant_ids = [tenant.id for tenant in subscription_client.tenants.list()]
File "/home/jack/.local/lib/python3.5/site-packages/msrest/paging.py", line 143, in next
self.advance_page()
File "/home/jack/.local/lib/python3.5/site-packages/msrest/paging.py", line 129, in advance_page
self._response = self._get_next(self.next_link)
File "/home/jack/.local/lib/python3.5/site-packages/azure/mgmt/subscription/operations/tenants_operations.py", line 81, in internal_paging
request, header_parameters, **operation_config)
File "/home/jack/.local/lib/python3.5/site-packages/msrest/service_client.py", line 336, in send
pipeline_response = self.config.pipeline.run(request, **kwargs)
File "/home/jack/.local/lib/python3.5/site-packages/msrest/pipeline/init.py", line 197, in run
return first_node.send(pipeline_request, **kwargs) # type: ignore
File "/home/jack/.local/lib/python3.5/site-packages/msrest/pipeline/init.py", line 150, in send
response = self.next.send(request, **kwargs)
File "/home/jack/.local/lib/python3.5/site-packages/msrest/pipeline/requests.py", line 68, in send
request.context.session = session = self._creds.signed_session()
File "/home/jack/.local/lib/python3.5/site-packages/azure/common/credentials.py", line 78, in signed_session
return credentials.signed_session(session)
TypeError: signed_session() takes 1 positional argument but 2 were given`

commented

Im with the same issue!

commented

FYI, after creating resources manually, aztk works.

commented

I have the same issue.

commented

FYI, after creating resources manually, aztk works.

Tks for sharing, i will use the Azure AKS for the same propose, for those who are interested

https://docs.microsoft.com/en-us/azure/aks/spark-job

commented

FYI, after creating resources manually, aztk works.

Im with the same issue!

FYI, after creating resources manually, aztk works.

can u explain how?

commented

can u explain how?

I assume you have already an Azure subscription and that you have run aztk spark init.

You have to:

  • Open Azure AD and get the tenant ID -> copy that into .aztk/secrets.yaml in service_principal.tenant_id
  • Create an app registration in Azure AD and get the application ID -> copy into client_id
  • Create a new client secret -> copy into credential
  • Create a new Batch Account (if you dont'have one already) and give the App you created before the "Contributor" role on that. Then take the Batch Account resource Id from the Properties pane and paste it on the secrets.yaml, service_principal, batch_account_resource_id
  • Create a new Storage Account (if you dont'have one already) and give the App you created before the "Contributor" role on that. Then take the Storage Account resource Id from the Properties pane and paste it on the secrets.yaml, service_principal, storage_account_resource_id
  • (Optional) If you want to use Mixed Mode (spot instances), you have to create a Vnet, to give the app the Contributor role on that, to create a subnet into the Vnet, and to put the subnet Resource ID into cluster.yaml