kitchen-cloudstack not working anymore?

Question

kitchen-cloudstack not working anymore?

pdion891 opened this issue 10 years ago · comments

Did try to do a test run. here is the error message while using kitchen-cloudstack-0.9.3.

kitchen test

-----> Starting Kitchen (v1.2.1)
-----> Cleaning up any prior instances of <default-centos-65>
-----> Destroying <default-centos-65>...
       Finished destroying <default-centos-65> (0m0.00s).
-----> Testing <default-centos-65>
-----> Creating <default-centos-65>...
>>>>>> ------Exception-------
>>>>>> Class: Kitchen::ActionFailed
>>>>>> Message: Failed to complete #create action: [wrong number of arguments (1 for 3..4)]
>>>>>> ----------------------
>>>>>> Please see .kitchen/logs/kitchen.log for more details
>>>>>> Also try running `kitchen diagnose --all` for configuration

here is the kitchen.log file:

I, [2014-07-20T21:53:28.456461 #87597]  INFO -- Kitchen: -----> Starting Kitchen (v1.2.1)
I, [2014-07-20T21:53:29.361423 #87597]  INFO -- Kitchen: -----> Cleaning up any prior instances of <default-centos-65>
I, [2014-07-20T21:53:29.361762 #87597]  INFO -- Kitchen: -----> Destroying <default-centos-65>...
I, [2014-07-20T21:53:29.365597 #87597]  INFO -- Kitchen: -----> Testing <default-centos-65>
I, [2014-07-20T21:53:29.365794 #87597]  INFO -- Kitchen: -----> Creating <default-centos-65>...
E, [2014-07-20T21:53:29.596281 #87597] ERROR -- Kitchen: ------Exception-------
E, [2014-07-20T21:53:29.596335 #87597] ERROR -- Kitchen: Class: Kitchen::ActionFailed
E, [2014-07-20T21:53:29.596382 #87597] ERROR -- Kitchen: Message: Failed to complete #create action: [wrong number of arguments (1 for 3..4)]
E, [2014-07-20T21:53:29.596425 #87597] ERROR -- Kitchen: ---Nested Exception---
E, [2014-07-20T21:53:29.596467 #87597] ERROR -- Kitchen: Class: ArgumentError
E, [2014-07-20T21:53:29.596500 #87597] ERROR -- Kitchen: Message: wrong number of arguments (1 for 3..4)
E, [2014-07-20T21:53:29.596526 #87597] ERROR -- Kitchen: ------Backtrace-------
E, [2014-07-20T21:53:29.596555 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/fog-1.23.0/lib/fog/cloudstack/requests/compute/deploy_virtual_machine.rb:9:in `deploy_virtual_machine'
E, [2014-07-20T21:53:29.596581 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/kitchen-cloudstack-0.9.3/lib/kitchen/driver/cloudstack.rb:72:in `create_server'
E, [2014-07-20T21:53:29.596614 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/kitchen-cloudstack-0.9.3/lib/kitchen/driver/cloudstack.rb:87:in `create'
E, [2014-07-20T21:53:29.596640 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:273:in `public_send'
E, [2014-07-20T21:53:29.596666 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:273:in `block in perform_action'
E, [2014-07-20T21:53:29.596692 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:308:in `call'
E, [2014-07-20T21:53:29.596718 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:308:in `synchronize_or_call'
E, [2014-07-20T21:53:29.596744 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:283:in `block in action'
E, [2014-07-20T21:53:29.596777 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
E, [2014-07-20T21:53:29.596804 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:282:in `action'
E, [2014-07-20T21:53:29.596830 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:273:in `perform_action'
E, [2014-07-20T21:53:29.596856 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:252:in `create_action'
E, [2014-07-20T21:53:29.596882 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:246:in `block in transition_to'
E, [2014-07-20T21:53:29.596907 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:245:in `each'
E, [2014-07-20T21:53:29.596941 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:245:in `transition_to'
E, [2014-07-20T21:53:29.596966 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:141:in `verify'
E, [2014-07-20T21:53:29.596990 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:170:in `block in test'
E, [2014-07-20T21:53:29.597047 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
E, [2014-07-20T21:53:29.597072 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:166:in `test'
E, [2014-07-20T21:53:29.597110 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/command.rb:109:in `public_send'
E, [2014-07-20T21:53:29.597136 #87597] ERROR -- Kitchen: /Users/pldion/.rvm/gems/ruby-2.1.2/gems/test-kitchen-1.2.1/lib/kitchen/command.rb:109:in `block (2 levels) in run_action'
E, [2014-07-20T21:53:29.597161 #87597] ERROR -- Kitchen: ----------------------

kitchen list still working:

kitchen list
Instance             Driver      Provisioner  Last Action
default-centos-65    Cloudstack  ChefSolo     <Not Created>
default-ubuntu-1404  Cloudstack  ChefSolo     <Not Created>

Jeff Moody · Answer 1 · Mon Jul 21 2014 21:08:09 GMT+0800 (China Standard Time)

Apparently I broke a few of the shortcuts I'd been taking with kitchen-cloudstack when updating some of the function calls in Fog. I'm updating the code to not use the hacky shortcuts I was using before and should have a new version of this gem out today to resolve this.

Jeff Moody · Answer 2 · Mon Jul 21 2014 21:11:06 GMT+0800 (China Standard Time)

If you want to test the code while I run through my tests, e509290 should resolve these issues.

Pierre-Luc Dion · Answer 3 · Mon Jul 21 2014 21:52:58 GMT+0800 (China Standard Time)

now I can create new Instance but it stuck at the ssh connection and is waiting forever:

kitchen test default-centos-65

kitchen test default-centos-65
-----> Starting Kitchen (v1.2.1)
-----> Cleaning up any prior instances of <default-centos-65>
-----> Destroying <default-centos-65>...
       CloudStack instance <0ed40245-1dd6-471f-9fbf-b1ebe8d1207d> destroyed.
       Finished destroying <default-centos-65> (0m0.40s).
-----> Testing <default-centos-65>
-----> Creating <default-centos-65>...
       CloudStack instance <778e6484-8ed0-495f-a294-1b8ff234f639> created.
       . 
       . 
       . 
       . 
       . 
       (server ready)

Configuration file look as follow: https://github.com/test-kitchen/kitchen-cloudstack/wiki/Configuration-examples

Jeff Moody · Answer 4 · Mon Jul 21 2014 21:57:31 GMT+0800 (China Standard Time)

Hrm.

I'm successfully creating images using this as a config (sanitized):

driver:
name: cloudstack
driver_config:
cloudstack_api_key: [[APIKEY]]
cloudstack_secret_key: [[SECRETKEY]]
cloudstack_api_url: https://cloud.datapipe.com/api/compute/v1
require_chef_omnibus: latest
cloudstack_serviceoffering_id: 43
cloudstack_zone_id: 5
cloudstack_security_group_id: [[SGIDS]]
cloudstack_ssh_keypair_name: [[KEYPAIR]]

provisioner:
name: chef_solo

platforms:

name: Scientific-6
driver:
cloudstack_template_id: 85f92442-318e-4ac1-a7cc-98d0badce661
name: Debian-7
driver:
cloudstack_template_id: e14d4f72-03f4-4d3c-9cfe-b77af0263a55

suites:

name: default
run_list:
- recipe[Test]
  attributes:

Pierre-Luc Dion · Answer 5 · Mon Jul 21 2014 22:01:07 GMT+0800 (China Standard Time)

Is this using the SSH key pair?

Pierre-Luc Dion · Answer 6 · Mon Jul 21 2014 22:03:46 GMT+0800 (China Standard Time)

also, should I see Instance as running with kitchen list? I can destroyed them at least:

$ kitchen list
Instance             Driver      Provisioner  Last Action
default-centos-65    Cloudstack  ChefSolo     <Not Created>
default-ubuntu-1404  Cloudstack  ChefSolo     <Not Created>

$ kitchen destroy
-----> Starting Kitchen (v1.2.1)
-----> Destroying <default-centos-65>...
       CloudStack instance <778e6484-8ed0-495f-a294-1b8ff234f639> destroyed.
       Finished destroying <default-centos-65> (0m0.42s).
-----> Destroying <default-ubuntu-1404>...
       CloudStack instance <0ed25481-6724-4e36-a263-0f78183923b6> destroyed.
       Finished destroying <default-ubuntu-1404> (0m0.16s).
-----> Kitchen is finished. (0m2.14s)

Jeff Moody · Answer 7 · Mon Jul 21 2014 22:06:38 GMT+0800 (China Standard Time)

Yes, this is using a SSH keypair. The cloud-set-guest-sshkey script can sometimes take a minute or so before it syncs everything and adds the key to the /root/.ssh/authorized_keys.

kitchen list is working if you use "kitchen create" to create the instances.
❯ kitchen list [10:05:39 AM]
Instance Driver Provisioner Last Action
default-Scientific-6 Cloudstack ChefSolo Created
default-Debian-7 Cloudstack ChefSolo Created

If you're using "kitchen test" then Test Kitchen is destroying the instances after the test has run.

Pierre-Luc Dion · Answer 8 · Mon Jul 21 2014 22:21:11 GMT+0800 (China Standard Time)

ok, I will test with ssh keypair, I was using cloudstack generated password. which seams to be problematic...

Thanks a lot for your quick response ! :-)

Jeff Moody · Answer 9 · Mon Jul 21 2014 22:22:05 GMT+0800 (China Standard Time)

I'll test with cloudstack-set-guest-password and no SSH key as well.

Pierre-Luc Dion · Answer 10 · Tue Jul 22 2014 00:01:42 GMT+0800 (China Standard Time)

I'm still having some issue while using SSH key.
Does it use the IP address of the instance or the FQDN to ssh on the Instance?

Jeff Moody · Answer 11 · Tue Jul 22 2014 01:22:25 GMT+0800 (China Standard Time)

It fetches the IP address of the first network card:
server_info.fetch('nic').first.fetch('ipaddress')
unless you specify an address for it to use.

It's working fine for me with no SSH key as well (albeit it takes a bit of time):
❯ kitchen create -l debug [1:15:43 PM]
-----> Starting Kitchen (v1.2.1)
D Berksfile found at /home/jmoody/Berksfile, loading Berkshelf
D Berkshelf 3.1.4 library loaded
-----> Creating ...
D {"displayname"=>"default-CentOS-7-jmoody-sardukar-aef22p4y", "securitygroupids"=>"d4d4af89-8ee7-477c-b2c9-634fbfcf22e1,3e1c59a9-ca45-481a-b29a-6ada985d23a2"}
D {"deployvirtualmachineresponse"=>{"id"=>"c205928d-e844-444a-a4d4-28e990609f30", "jobid"=>"68e0fadf-e73d-4555-b31d-58b28668e61f"}}
CloudStack instance created.
D Job ID 68e0fadf-e73d-4555-b31d-58b28668e61f
.
D Server_Start: {"queryasyncjobresultresponse"=>{"accountid"=>"c2af1065-0b42-4ecc-b839-fe1f84176d19", "userid"=>"e7c02928-8fe4-4037-a5f0-fcf8816cefb1", "cmd"=>"org.apache.cloudstack.api.command.user.vm.DeployVMCmd", "jobstatus"=>1, "jobprocstatus"=>0, "jobresultcode"=>0, "jobresulttype"=>"object", "jobresult"=>{"virtualmachine"=>{"id"=>"c205928d-e844-444a-a4d4-28e990609f30", "name"=>"VM-c205928d-e844-444a-a4d4-28e990609f30", "displayname"=>"default-CentOS-7-jmoody-sardukar-aef22p4y", "account"=>"jmoody", "domainid"=>"98bcbe71-0915-11e4-8a3c-52540080ad25", "domain"=>"ROOT", "created"=>"2014-07-21T13:15:22-0400", "state"=>"Running", "haenable"=>false, "zoneid"=>"2ea78795-8a37-4f6b-b761-10d593d22fd8", "zonename"=>"KVMZone", "templateid"=>"11cdacf7-87c2-4c8b-bb52-0b6c446e516f", "templatename"=>"CentOS 7 (Small)", "templatedisplaytext"=>"CentOS 7 (Small)", "passwordenabled"=>true, "serviceofferingid"=>"e875c2cc-d549-49a7-9a36-49626fdb864d", "serviceofferingname"=>"Small Instance", "cpunumber"=>1, "cpuspeed"=>500, "memory"=>512, "guestosid"=>"9964fe0c-0915-11e4-8a3c-52540080ad25", "rootdeviceid"=>0, "rootdevicetype"=>"ROOT", "securitygroup"=>[{"id"=>"3e1c59a9-ca45-481a-b29a-6ada985d23a2", "name"=>"SSH", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}, {"id"=>"d4d4af89-8ee7-477c-b2c9-634fbfcf22e1", "name"=>"default", "description"=>"Default Security Group", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}], "password"=>"rJ2cdzvkv", "nic"=>[{"id"=>"9c5d155b-9305-4f89-9be8-9ed53a134663", "networkid"=>"7dc98f2c-ac20-466b-880a-247ef7704a79", "networkname"=>"defaultGuestNetwork", "netmask"=>"255.255.255.0", "gateway"=>"10.10.0.1", "ipaddress"=>"10.10.0.189", "broadcasturi"=>"vlan://untagged", "traffictype"=>"Guest", "type"=>"Shared", "isdefault"=>true, "macaddress"=>"06:3f:86:00:00:8c"}], "hypervisor"=>"KVM", "tags"=>[], "affinitygroup"=>[], "displayvm"=>true, "isdynamicallyscalable"=>false, "jobid"=>"68e0fadf-e73d-4555-b31d-58b28668e61f", "jobstatus"=>0}}, "created"=>"2014-07-21T13:15:22-0400", "jobid"=>"68e0fadf-e73d-4555-b31d-58b28668e61f"}}

D {"id"=>"c205928d-e844-444a-a4d4-28e990609f30", "name"=>"VM-c205928d-e844-444a-a4d4-28e990609f30", "displayname"=>"default-CentOS-7-jmoody-sardukar-aef22p4y", "account"=>"jmoody", "domainid"=>"98bcbe71-0915-11e4-8a3c-52540080ad25", "domain"=>"ROOT", "created"=>"2014-07-21T13:15:22-0400", "state"=>"Running", "haenable"=>false, "zoneid"=>"2ea78795-8a37-4f6b-b761-10d593d22fd8", "zonename"=>"KVMZone", "templateid"=>"11cdacf7-87c2-4c8b-bb52-0b6c446e516f", "templatename"=>"CentOS 7 (Small)", "templatedisplaytext"=>"CentOS 7 (Small)", "passwordenabled"=>true, "serviceofferingid"=>"e875c2cc-d549-49a7-9a36-49626fdb864d", "serviceofferingname"=>"Small Instance", "cpunumber"=>1, "cpuspeed"=>500, "memory"=>512, "guestosid"=>"9964fe0c-0915-11e4-8a3c-52540080ad25", "rootdeviceid"=>0, "rootdevicetype"=>"ROOT", "securitygroup"=>[{"id"=>"3e1c59a9-ca45-481a-b29a-6ada985d23a2", "name"=>"SSH", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}, {"id"=>"d4d4af89-8ee7-477c-b2c9-634fbfcf22e1", "name"=>"default", "description"=>"Default Security Group", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}], "password"=>"rJ2cdzvkv", "nic"=>[{"id"=>"9c5d155b-9305-4f89-9be8-9ed53a134663", "networkid"=>"7dc98f2c-ac20-466b-880a-247ef7704a79", "networkname"=>"defaultGuestNetwork", "netmask"=>"255.255.255.0", "gateway"=>"10.10.0.1", "ipaddress"=>"10.10.0.189", "broadcasturi"=>"vlan://untagged", "traffictype"=>"Guest", "type"=>"Shared", "isdefault"=>true, "macaddress"=>"06:3f:86:00:00:8c"}], "hypervisor"=>"KVM", "tags"=>[], "affinitygroup"=>[], "displayvm"=>true, "isdynamicallyscalable"=>false, "jobid"=>"68e0fadf-e73d-4555-b31d-58b28668e61f", "jobstatus"=>0}
(server ready)
Waiting for 10.10.0.189:22...
Waiting for 10.10.0.189:22...
Waiting for 10.10.0.189:22...
Waiting for 10.10.0.189:22...
D SSH Connectivity Validated.
Password for root at 10.10.0.189 is rJ2cdzvkv
D 10.10.0.189
D root
D rJ2cdzvkv

D Connecting to host and running ls
D Deploying user private key to server using connection #Fog::SSH::Real:0x0000000481fc28 to guarantee connectivity.
Finished creating (1m14.30s).
-----> Kitchen is finished. (1m17.63s)

elapsed time 1m19s

If you'd be willing to post (or e-mail to fifthecho AT gmail DOT com) a debug output of your "kitchen create" I'd be happy to try and figure out why it's breaking.

Pierre-Luc Dion · Answer 12 · Tue Jul 22 2014 01:40:24 GMT+0800 (China Standard Time)

Still not working on my side even using SSH key. I'm not using a simple networking zone, could it be that?
Here is the debug version, I did replace some semsitive info by "*****".

-----> Starting Kitchen (v1.2.1)
-----> Creating <default-centos-65>...
D      {"displayname"=>"default-centos-65-pdion-pdion-mbook-3.local-6c8phhld", "networkids"=>"462b256d-c1fd-418e-98cc-83be4f6181d8", "keypair"=>"pdion-rd"}
D      {"deployvirtualmachineresponse"=>{"id"=>"7380b8a0-e83a-4f58-8b8d-691121f93718", "jobid"=>"78770039-8d69-41b7-a5fc-e42d3833ce6d"}}
       CloudStack instance <7380b8a0-e83a-4f58-8b8d-691121f93718> created.
D      Job ID 78770039-8d69-41b7-a5fc-e42d3833ce6d
       . 
D      Server_Start: {"queryasyncjobresultresponse"=>{"accountid"=>"108dbd6f-b817-4044-b177-ac6829951b85", "userid"=>"cce9f29c-c494-45d0-8322-a38d8221256f", "cmd"=>"org.apache.cloudstack.api.command.user.vm.DeployVMCmd", "jobstatus"=>1, "jobprocstatus"=>0, "jobresultcode"=>0, "jobresulttype"=>"object", "jobresult"=>{"virtualmachine"=>{"id"=>"7380b8a0-e83a-4f58-8b8d-691121f93718", "name"=>"7380b8a0-e83a-4f58-8b8d-691121f93718", "displayname"=>"default-centos-65-pdion-pdion-mbook-3.local-6c8phhld", "account"=>"eng", "domainid"=>"2539f23f-2356-4f4f-8503-9186985087c3", "domain"=>"******", "created"=>"2014-07-21T13:24:12-0400", "state"=>"Running", "haenable"=>false, "zoneid"=>"******-edfe-4d72-b126-fa545b645b8c", "zonename"=>"******-******-hq", "templateid"=>"252eeb5e-62f6-4eda-af74-b5448e6787c5", "templatename"=>"centos65 sshkey", "templatedisplaytext"=>"centos65 sshkey", "passwordenabled"=>false, "serviceofferingid"=>"4d33d969-3107-4805-8cf9-cf49a01d791a", "serviceofferingname"=>"1CPU.1GB_local_guest", "cpunumber"=>1, "cpuspeed"=>1000, "memory"=>1024, "guestosid"=>"4a56908c-89ec-11e3-9471-d28eced5d8e2", "rootdeviceid"=>0, "rootdevicetype"=>"ROOT", "securitygroup"=>[], "nic"=>[{"id"=>"694958c5-b7d7-4194-941c-8f8c0fbecfd1", "networkid"=>"462b256d-c1fd-418e-98cc-83be4f6181d8", "networkname"=>"******", "netmask"=>"255.255.255.0", "gateway"=>"******", "ipaddress"=>"******", "isolationuri"=>"vlan://******", "broadcasturi"=>"vlan://******", "traffictype"=>"Guest", "type"=>"Shared", "isdefault"=>true, "macaddress"=>"06:6e:ac:00:00:80"}], "hypervisor"=>"XenServer", "tags"=>[], "keypair"=>"pdion-rd", "affinitygroup"=>[], "displayvm"=>true, "isdynamicallyscalable"=>false, "jobid"=>"78770039-8d69-41b7-a5fc-e42d3833ce6d", "jobstatus"=>0}}, "created"=>"2014-07-21T13:24:12-0400", "jobid"=>"78770039-8d69-41b7-a5fc-e42d3833ce6d"}} 

D      {"id"=>"7380b8a0-e83a-4f58-8b8d-691121f93718", "name"=>"7380b8a0-e83a-4f58-8b8d-691121f93718", "displayname"=>"default-centos-65-pdion-pdion-mbook-3.local-6c8phhld", "account"=>"******", "domainid"=>"******-2356-4f4f-8503-9186985087c3", "domain"=>"rd", "created"=>"2014-07-21T13:24:12-0400", "state"=>"Running", "haenable"=>false, "zoneid"=>"******-edfe-4d72-b126-fa545b645b8c", "zonename"=>"******", "templateid"=>"252eeb5e-62f6-4eda-af74-b5448e6787c5", "templatename"=>"centos65 sshkey", "templatedisplaytext"=>"centos65 sshkey", "passwordenabled"=>false, "serviceofferingid"=>"4d33d969-3107-4805-8cf9-cf49a01d791a", "serviceofferingname"=>"1CPU.1GB_local_guest", "cpunumber"=>1, "cpuspeed"=>1000, "memory"=>1024, "guestosid"=>"4a56908c-89ec-11e3-9471-d28eced5d8e2", "rootdeviceid"=>0, "rootdevicetype"=>"ROOT", "securitygroup"=>[], "nic"=>[{"id"=>"694958c5-b7d7-4194-941c-8f8c0fbecfd1", "networkid"=>"462b256d-c1fd-418e-98cc-83be4f6181d8", "networkname"=>"******", "netmask"=>"255.255.255.0", "gateway"=>"172.16.21.1", "ipaddress"=>"172.16.21.152", "isolationuri"=>"vlan://******", "broadcasturi"=>"vlan://******", "traffictype"=>"Guest", "type"=>"Shared", "isdefault"=>true, "macaddress"=>"06:6e:ac:00:00:80"}], "hypervisor"=>"XenServer", "tags"=>[], "keypair"=>"pdion-rd", "affinitygroup"=>[], "displayvm"=>true, "isdynamicallyscalable"=>false, "jobid"=>"78770039-8d69-41b7-a5fc-e42d3833ce6d", "jobstatus"=>0}
       (server ready)

Once the VM is started I can SSH manually using ssh root@172.16.21.152-i ~/.ssh/pdion-rd.pem
I've also wait like 5 minutes and it still stuck at the same place.

What is the user used for SSH? previously it was using root right?

Thanks,

Jeff Moody · Answer 13 · Tue Jul 22 2014 01:46:56 GMT+0800 (China Standard Time)

It looks like that template doesn't have password enabled. "passwordenabled"=>false

It's strange that it isn't working, because I'm testing primarily against a basic zone and it's working fine for me.
The default user is "root" but you can specify a different user to SSH as.

I've added a few more debug statements, can you remove the gem and rebuild from the latest git commit to see if that shows us where the issue might be?

Pierre-Luc Dion · Answer 14 · Tue Jul 22 2014 02:03:12 GMT+0800 (China Standard Time)

just retested it and still stalling at the same place.

       (server ready)

I must have something wrong. I have that working like a month ago :(
Could it be a missing lib? I'm currently running ruby:
ruby 2.1.2p95 (2014-05-08 revision 45877) [x86_64-darwin13.0]

Pierre-Luc Dion · Answer 15 · Tue Jul 22 2014 02:06:03 GMT+0800 (China Standard Time)

when testing with SSH keys template I'm having this:

       (server ready)
D      Keypair being used is /Users/pdion/.ssh/pdion-rd.pem

Jeff Moody · Answer 16 · Tue Jul 22 2014 02:13:13 GMT+0800 (China Standard Time)

Once you see (server ready) it means that the instance deployment job reports as completed successfully. The instance still needs to boot and finish coming online and SSH needs to respond to authentication using either the password or SSH key being set.

What the issue might be is that you ran "gem update" in the last day or two and installed the latest version of FOG which has broken backwards compatibility with some of the lazy function calls I was making. These calls should all be correct now, so I'm not sure where or why the process is breaking for you.

That debug statement shows that your SSH key has been detected correctly and should be used for the SSH connection to the new instance, once that instance responds correctly.

I've added even more debugging to the loop where the process is likely hanging for you which might help figure out where the issue lies. If these debug statements aren't output, the issue might lie in test-kitchen itself, whose "wait_for_sshd" function I'm inheriting.

Additionally, there's, by default, a 45 second wait period for the instance to boot, so depending on the performance of your underlying storage, it may take a few minutes for the instance to start.

Please run:
git pull && gem uninstall kitchen-cloudstack && rm -fv ./*.gem && gem build kitchen-cloudstack.gemspec && gem install *.gem
from the kitchen-cloudstack directory on your machine.

Jeff Moody · Answer 17 · Tue Jul 22 2014 02:23:14 GMT+0800 (China Standard Time)

Using a keypair, you should see debug output like:
❯ kitchen test -l debug [2:15:24 PM]
-----> Starting Kitchen (v1.2.1)
D Berksfile found at /home/jmoody/Berksfile, loading Berkshelf
D Berkshelf 3.1.4 library loaded
-----> Cleaning up any prior instances of
-----> Destroying ...
CloudStack instance <40a5c2df-893e-4220-9c0b-6a7a5f0b9d4a> destroyed.
Finished destroying (0m0.94s).
-----> Testing
-----> Creating ...
D {"displayname"=>"default-CentOS-7-jmoody-sardukar-8ahedbwk", "securitygroupids"=>"d4d4af89-8ee7-477c-b2c9-634fbfcf22e1,3e1c59a9-ca45-481a-b29a-6ada985d23a2", "keypair"=>"jmoody_fifthecho"}
D {"deployvirtualmachineresponse"=>{"id"=>"75336029-f049-4401-8610-f4104a4b5a0d", "jobid"=>"271aef0b-d96f-4e48-bb3c-010dd9ef0f5b"}}
CloudStack instance <75336029-f049-4401-8610-f4104a4b5a0d> created.
D Job ID 271aef0b-d96f-4e48-bb3c-010dd9ef0f5b
.
D Server_Start: {"queryasyncjobresultresponse"=>{"accountid"=>"c2af1065-0b42-4ecc-b839-fe1f84176d19", "userid"=>"e7c02928-8fe4-4037-a5f0-fcf8816cefb1", "cmd"=>"org.apache.cloudstack.api.command.user.vm.DeployVMCmd", "jobstatus"=>1, "jobprocstatus"=>0, "jobresultcode"=>0, "jobresulttype"=>"object", "jobresult"=>{"virtualmachine"=>{"id"=>"75336029-f049-4401-8610-f4104a4b5a0d", "name"=>"VM-75336029-f049-4401-8610-f4104a4b5a0d", "displayname"=>"default-CentOS-7-jmoody-sardukar-8ahedbwk", "account"=>"jmoody", "domainid"=>"98bcbe71-0915-11e4-8a3c-52540080ad25", "domain"=>"ROOT", "created"=>"2014-07-21T14:15:02-0400", "state"=>"Running", "haenable"=>false, "zoneid"=>"2ea78795-8a37-4f6b-b761-10d593d22fd8", "zonename"=>"KVMZone", "templateid"=>"11cdacf7-87c2-4c8b-bb52-0b6c446e516f", "templatename"=>"CentOS 7 (Small)", "templatedisplaytext"=>"CentOS 7 (Small)", "passwordenabled"=>true, "serviceofferingid"=>"e875c2cc-d549-49a7-9a36-49626fdb864d", "serviceofferingname"=>"Small Instance", "cpunumber"=>1, "cpuspeed"=>500, "memory"=>512, "guestosid"=>"9964fe0c-0915-11e4-8a3c-52540080ad25", "rootdeviceid"=>0, "rootdevicetype"=>"ROOT", "securitygroup"=>[{"id"=>"3e1c59a9-ca45-481a-b29a-6ada985d23a2", "name"=>"SSH", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}, {"id"=>"d4d4af89-8ee7-477c-b2c9-634fbfcf22e1", "name"=>"default", "description"=>"Default Security Group", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}], "password"=>"eI4pxeish", "nic"=>[{"id"=>"092701af-f8dc-4264-ba47-f0c2256d8a26", "networkid"=>"7dc98f2c-ac20-466b-880a-247ef7704a79", "networkname"=>"defaultGuestNetwork", "netmask"=>"255.255.255.0", "gateway"=>"10.10.0.1", "ipaddress"=>"10.10.0.120", "broadcasturi"=>"vlan://untagged", "traffictype"=>"Guest", "type"=>"Shared", "isdefault"=>true, "macaddress"=>"06:52:c2:00:00:47"}], "hypervisor"=>"KVM", "tags"=>[], "keypair"=>"jmoody_fifthecho", "affinitygroup"=>[], "displayvm"=>true, "isdynamicallyscalable"=>false, "jobid"=>"271aef0b-d96f-4e48-bb3c-010dd9ef0f5b", "jobstatus"=>0}}, "created"=>"2014-07-21T14:15:03-0400", "jobid"=>"271aef0b-d96f-4e48-bb3c-010dd9ef0f5b"}}

D {"id"=>"75336029-f049-4401-8610-f4104a4b5a0d", "name"=>"VM-75336029-f049-4401-8610-f4104a4b5a0d", "displayname"=>"default-CentOS-7-jmoody-sardukar-8ahedbwk", "account"=>"jmoody", "domainid"=>"98bcbe71-0915-11e4-8a3c-52540080ad25", "domain"=>"ROOT", "created"=>"2014-07-21T14:15:02-0400", "state"=>"Running", "haenable"=>false, "zoneid"=>"2ea78795-8a37-4f6b-b761-10d593d22fd8", "zonename"=>"KVMZone", "templateid"=>"11cdacf7-87c2-4c8b-bb52-0b6c446e516f", "templatename"=>"CentOS 7 (Small)", "templatedisplaytext"=>"CentOS 7 (Small)", "passwordenabled"=>true, "serviceofferingid"=>"e875c2cc-d549-49a7-9a36-49626fdb864d", "serviceofferingname"=>"Small Instance", "cpunumber"=>1, "cpuspeed"=>500, "memory"=>512, "guestosid"=>"9964fe0c-0915-11e4-8a3c-52540080ad25", "rootdeviceid"=>0, "rootdevicetype"=>"ROOT", "securitygroup"=>[{"id"=>"3e1c59a9-ca45-481a-b29a-6ada985d23a2", "name"=>"SSH", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}, {"id"=>"d4d4af89-8ee7-477c-b2c9-634fbfcf22e1", "name"=>"default", "description"=>"Default Security Group", "account"=>"jmoody", "ingressrule"=>[], "egressrule"=>[], "tags"=>[]}], "password"=>"eI4pxeish", "nic"=>[{"id"=>"092701af-f8dc-4264-ba47-f0c2256d8a26", "networkid"=>"7dc98f2c-ac20-466b-880a-247ef7704a79", "networkname"=>"defaultGuestNetwork", "netmask"=>"255.255.255.0", "gateway"=>"10.10.0.1", "ipaddress"=>"10.10.0.120", "broadcasturi"=>"vlan://untagged", "traffictype"=>"Guest", "type"=>"Shared", "isdefault"=>true, "macaddress"=>"06:52:c2:00:00:47"}], "hypervisor"=>"KVM", "tags"=>[], "keypair"=>"jmoody_fifthecho", "affinitygroup"=>[], "displayvm"=>true, "isdynamicallyscalable"=>false, "jobid"=>"271aef0b-d96f-4e48-bb3c-010dd9ef0f5b", "jobstatus"=>0}
(server ready)
D Keypair being used is /home/jmoody/.ssh/jmoody_fifthecho.pem
Waiting for 10.10.0.120:22...
Waiting for 10.10.0.120:22...
Waiting for 10.10.0.120:22...
Waiting for 10.10.0.120:22...
Waiting for 10.10.0.120:22...
D SSH Connectivity Validated.
D Using keypair: /home/jmoody/.ssh/jmoody_fifthecho.pem
SSH for 10.10.0.120 with keypair jmoody_fifthecho.
D Connecting to : 10.10.0.120 as root using keypair /home/jmoody/.ssh/jmoody_fifthecho.pem.
D Connecting to host and running ls
D Deploying user private key to server using connection #Fog::SSH::Real:0x000000032a56e0 to guarantee connectivity.
Finished creating (1m15.66s).
-----> Converging ...
Preparing files for transfer
D Creating local sandbox in /tmp/jmoody/default-CentOS-7-sandbox-20140721-25862-6o6fa1
Resolving cookbook dependencies with Berkshelf 3.1.4...
D Using Berksfile from /home/jmoody/Berksfile
Removing non-cookbook files before transfer

Pierre-Luc Dion · Answer 18 · Tue Jul 22 2014 02:36:59 GMT+0800 (China Standard Time)

Should I be using fog-1.23.0 ? it's required by kitchen-cloudstack-0.10.0.

Jeff Moody · Answer 19 · Tue Jul 22 2014 02:46:47 GMT+0800 (China Standard Time)

This latest, unreleased version of kitchen-cloudstack (0.10.0) is coded against Fog 1.23.0.
If you weren't having issues before, feel free to rollback to Fog 1.22.0 and use kitchen-cloudstack-0.9.2.

However, I'd love to keep working with you if possible (or maybe even get access to your environment if that can be arranged to test/troubleshoot) so that I can release 0.10.0 against Fog 1.23.0 and feel safe that it works.

Jeff Moody · Answer 20 · Wed Jul 23 2014 02:10:59 GMT+0800 (China Standard Time)

This issue appears to be resolved by the latest version of the code in Git, so I'm going to continue doing some testing and should be pushing this Gem out by next week.