Error with FasterCSV and Ruby 1.9.2

Question

Error with FasterCSV and Ruby 1.9.2

epinault opened this issue 12 years ago · comments

I am getting the following error when trying to run an ETL ctl. Is 1.9.x supported? how do I fix this?

/home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/fastercsv-1.5.5/lib/faster_csv.rb:13:in `const_missing': Please switch to Ruby 1.9's standard CSV library.  It's FasterCSV plus support for Ruby 1.9's m17n encoding engine. (NotImplementedError)
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/fastercsv-1.5.5/lib/faster_csv.rb:19:in `method_missing'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/control/source/database_source.rb:153:in `block in write_local'
    from /home/emmanuel/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/1.9.1/benchmark.rb:310:in `realtime'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/control/source/database_source.rb:152:in `write_local'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/control/source/database_source.rb:112:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:315:in `each_with_index'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:315:in `block in process_control'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:309:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:309:in `process_control'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:259:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:257:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/engine.rb:55:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/commands/etl.rb:82:in `block in execute'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/commands/etl.rb:80:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/commands/etl.rb:80:in `execute'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/lib/etl/commands/etl.rb:89:in `<top (required)>'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-2.3.14/lib/active_support/dependencies.rb:182:in `require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-2.3.14/lib/active_support/dependencies.rb:182:in `block in require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-2.3.14/lib/active_support/dependencies.rb:547:in `new_constants_in'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-2.3.14/lib/active_support/dependencies.rb:182:in `require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-0.9.1/bin/etl:28:in `<top (required)>'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/bin/etl:19:in `load'

Thibaut Barrère · Answer 1 · Thu Oct 04 2012 18:48:04 GMT+0800 (China Standard Time)

Ruby 1.9 is supported - but using the old FasterCSV instead of Ruby 1.9 built-in CSV is not supported so far (because this case never happened).

Can you switch to the new Ruby 1.9 built-in CSV instead?

epinault · Answer 2 · Thu Oct 04 2012 19:30:23 GMT+0800 (China Standard Time)

ok, so there is a dependency issue somewhere:

My Gemfile does not include it yet it comes

My Gemfile

source :gemcutter

gem "activerecord"
gem "activewarehouse-etl"
gem "postgres"
gem "mysql"
gem "foreigner"

Output:

Installing rake (0.9.2.2)
Installing i18n (0.6.1)
Installing multi_json (1.3.6)
Installing activesupport (3.2.8)
Installing builder (3.0.3)
Installing activemodel (3.2.8)
Installing arel (3.0.2)
Installing tzinfo (0.3.33)
Installing activerecord (3.2.8)
Installing adapter_extensions (1.0.0)
Installing fastercsv (1.5.5)
Installing activewarehouse-etl (1.0.0)
Installing foreigner (1.2.1)
Installing mysql (2.8.1) with native extensions
Installing pg (0.14.1) with native extensions
Installing postgres (0.8.1)
Using bundler (1.2.1)

So what should I do? remove the gem ?

Thibaut Barrère · Answer 3 · Thu Oct 04 2012 19:42:52 GMT+0800 (China Standard Time)

We need to figure out why FasterCSV is pulled as a dependency - this may be in a dependency or in activewarehouse-etl itself. Let me run a test locally to figure this out, I'll get back to you.

Not commenting on your other issues now, let's first fix this one.

epinault · Answer 4 · Thu Oct 04 2012 19:45:42 GMT+0800 (China Standard Time)

your gemspec adds it

https://github.com/activewarehouse/activewarehouse-etl/blob/master/activewarehouse-etl.gemspec

epinault · Answer 5 · Thu Oct 04 2012 19:49:28 GMT+0800 (China Standard Time)

Maybe a if condition in there to add it based on RUBY_VERSION? Also wonder if a switch case in the code where you do a require also would help?

Thibaut Barrère · Answer 6 · Thu Oct 04 2012 20:12:18 GMT+0800 (China Standard Time)

Oh I figured it out I think. You are apparently using activewarehouse-etl-0.9.1 but this does not support Ruby 1.9 yet.

Is that an old project or a new one?

Can you update to the latest (1.0.0 from june 2012), which has proper support for mysql2, ruby 1.9 etc?

I suspect most of your other issues will go away with it.

Note that I need to go offline for a bit after, but ping me if you have more issues, we'll make this work!

Thibaut Barrère · Answer 7 · Thu Oct 04 2012 20:13:19 GMT+0800 (China Standard Time)

Hum - I may be mistaken; your stack trace mentions 0.9.1, while your gemfile refers to 1.0.0.

Could it be that you have an older version installed in parallel?

epinault · Answer 8 · Thu Oct 04 2012 23:27:14 GMT+0800 (China Standard Time)

Don t know how the older one got in when trying 1.8.7 see if that would work better... . strange. But I cannot get passed anymore the following error unless I hack the code a bit. did you get a chance to look at them?

Source: localhost/ts_development/teams
/home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activerecord-3.2.8/lib/active_record/dynamic_matchers.rb:50:in `method_missing': undefined method `mysql_connection' for #<Class:0xa067ed0> (NoMethodError)
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:212:in `establish_connection'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:143:in `connection'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:219:in `connection'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:213:in `query_rows'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:100:in `columns'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:160:in `block (2 levels) in write_local'
    from /home/emmanuel/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1.9.1/csv.rb:1354:in `open'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:159:in `block in write_local'
    from /home/emmanuel/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:158:in `write_local'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:115:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:333:in `each_with_index'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:333:in `block in process_control'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:327:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:327:in `process_control'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:275:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:272:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:55:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:82:in `block in execute'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:80:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:80:in `execute'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:90:in `<top (required)>'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `block in require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:236:in `load_dependency'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/bin/etl:28:in `<top (required)>'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/bin/etl:23:in `load'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/bin/etl:23:in `<main>'

epinault · Answer 9 · Thu Oct 04 2012 23:28:19 GMT+0800 (China Standard Time)

This is actually odd since bundler says it was also 1.0 installed too !

epinault · Answer 10 · Thu Oct 04 2012 23:31:23 GMT+0800 (China Standard Time)

I cannot reproduce it with 1.9.2 so this is a more of a 1.8 issue. Can you help me with the missing method? this is the one really blocking me

Thibaut Barrère · Answer 11 · Thu Oct 04 2012 23:43:11 GMT+0800 (China Standard Time)

Most likely the previous version was installed without bundler, so it is accessible in the command line first! But this one is done.

I'm now having a look at the missing method issue, hold tight :)

Thibaut Barrère · Answer 12 · Thu Oct 04 2012 23:48:26 GMT+0800 (China Standard Time)

I think you are also using an old version of mysql gem, for some reason!

Make sure:

you use mysql2 and not mysql in your Gemfile
you use adapter: mysql2 in your database.yml

And try again - if you have any more issue, let me know!

epinault · Answer 13 · Thu Oct 04 2012 23:50:15 GMT+0800 (China Standard Time)

I tried both and got the same results :(

epinault · Answer 14 · Thu Oct 04 2012 23:52:09 GMT+0800 (China Standard Time)

Gems included by the bundle:

activemodel (3.2.8)
activerecord (3.2.8)
activesupport (3.2.8)
activewarehouse-etl (1.0.0)
adapter_extensions (1.0.0)
arel (3.0.2)
builder (3.0.3)
bundler (1.2.1)
fastercsv (1.5.5)
foreigner (1.2.1)
i18n (0.6.1)
multi_json (1.3.6)
mysql2 (0.3.11)
pg (0.14.1)
postgres (0.8.1)
rake (0.9.2.2)
tzinfo (0.3.33)

Database.yml

common_mysql: &common_mysql
adapter: mysql2
username: root
host: localhost

common_postgre: &common_postgre
adapter: postgresql
username: etl
host: localhost

etl_execution:
<<: *common_postgre
database: etl_execution

talemetry_match_web:
<<: *common_mysql
database: ts_development
encoding: utf8

talemetry_match_crawl:
<<: *common_mysql
database: ts_web_production
encoding: utf8

datawarehouse:
<<: *common_postgre
database: talemetry_bi
encoding: utf8

and error

home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activerecord-3.2.8/lib/active_record/dynamic_matchers.rb:50:in `method_missing': undefined method `mysql2_connection' for #<Class:0xa79fb44> (NoMethodError)
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:212:in `establish_connection'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:143:in `connection'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:219:in `connection'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:213:in `query_rows'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:100:in `columns'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:160:in `block (2 levels) in write_local'
    from /home/emmanuel/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1.9.1/csv.rb:1354:in `open'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:159:in `block in write_local'
    from /home/emmanuel/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:158:in `write_local'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:115:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:333:in `each_with_index'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:333:in `block in process_control'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:327:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:327:in `process_control'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:275:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:272:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:55:in `process'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:82:in `block in execute'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:80:in `each'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:80:in `execute'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:90:in `<top (required)>'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `block in require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:236:in `load_dependency'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in `require'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/bin/etl:28:in `<top (required)>'
    from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/bin/etl:23:in `load'

epinault · Answer 15 · Thu Oct 04 2012 23:59:52 GMT+0800 (China Standard Time)

Also I am not using Rails directly and trying configure it with the database.yml per your doc. I see the postgresql_connection method in the ETL::Base but nothing around mysql. Something is not loading Mysql in AR correctly?

Thibaut Barrère · Answer 16 · Fri Oct 05 2012 00:04:20 GMT+0800 (China Standard Time)

I'm short on time right now (will get back to this tonight in more depth), but yes it seems there is an issue with loading the MySQL AR or something.

Please comment here if you find something until I have a closer look tonight!

epinault · Answer 17 · Fri Oct 05 2012 01:28:24 GMT+0800 (China Standard Time)

Sounds good. I ll be on till 11pm France time ;) So we can work on it together if you want

Thibaut Barrère · Answer 18 · Fri Oct 05 2012 02:24:48 GMT+0800 (China Standard Time)

Can you invite me to google chat at thibaut.barrere@gmail.com please so we can discuss that?

Thibaut Barrère · Answer 19 · Fri Oct 05 2012 02:32:26 GMT+0800 (China Standard Time)

Currently I believe the issue is linked to the fact that you use both pg and mysql in the same setup.

I will probably need to have a closer look at your ETL scripts privately to figure things out here.

epinault · Answer 20 · Fri Oct 05 2012 03:51:28 GMT+0800 (China Standard Time)

sure here is what it does so far :)

class Account < ActiveRecord::Base
end

source :input,
{
:type => :database,
:target => :talemetry_match_web,
:table => "teams"
},
[
:name,
:company_id,
:talemetry_id,
:country_code,
:status,
:ofccp,
]

transform(:name) do |n,v,r|
p v
p n
p r
r[:name]
end

destination :out, {
:type => :database,
:target => :datawarehouse,
:table => 'accounts'
},
{
:primarykey => [:email],
:order => [:email, :full_name, :email_provider]
}

If going to DB(mysql) => File => File => DB (postgre) works then I might take that route

epinault · Answer 21 · Fri Oct 05 2012 03:58:21 GMT+0800 (China Standard Time)

I tried just mysql to file and not working either with same error...

Thibaut Barrère · Answer 22 · Fri Oct 05 2012 04:20:42 GMT+0800 (China Standard Time)

Try requiring 'mysql2' (if you have 'mysql2' in your database.yml) at the top of you control file maybe?

I won't be able to help much more tonight. If this doesn't work contact me by email so we can discuss that tomorrow afternoon hopefully.

epinault · Answer 23 · Fri Oct 05 2012 04:23:34 GMT+0800 (China Standard Time)

will try that and report back. Is your email posted on here somewhere?

epinault · Answer 24 · Fri Oct 05 2012 04:24:49 GMT+0800 (China Standard Time)

I put it on top of my ctl file and not working

gonna try this http://stackoverflow.com/questions/1298909/multiple-database-connection-in-rails

Thibaut Barrère · Answer 25 · Fri Oct 05 2012 04:32:31 GMT+0800 (China Standard Time)

My email is on my github profile: https://github.com/thbar

This looks a bit complicated - keep me posted in case you find something!

epinault · Answer 26 · Fri Oct 05 2012 04:43:22 GMT+0800 (China Standard Time)

here is what I found

Adding the following to the top of my ctl file

$config = YAML.load_file(File.join(File.dirname(FILE),
'../config/mysql.yml'))

class Account < ActiveRecord::Base
establish_connection $config['talemetry_match_web']
end

where th mysql.yml is only setup for mysql makes it go further though it breaks with

home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activerecord-mysql2-adapter-0.0.3/lib/active_record/connection_adapters/mysql2_adapter.rb:614:in select': wrong number of arguments (3 for 2) (ArgumentError) from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/database_statements.rb:18:inselect_all'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/query_cache.rb:63:in select_all' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:213:inquery_rows'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:100:in columns' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:160:inblock (2 levels) in write_local'
from /home/emmanuel/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1.9.1/csv.rb:1354:in open' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:159:inblock in write_local'
from /home/emmanuel/.rvm/rubies/ruby-1.9.3-p194/lib/ruby/1.9.1/benchmark.rb:295:in realtime' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:158:inwrite_local'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/control/source/database_source.rb:115:in each' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:334:ineach_with_index'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:334:in block in process_control' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:328:ineach'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:328:in process_control' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:276:inprocess'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:273:in process' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/engine.rb:55:inprocess'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:82:in block in execute' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:80:ineach'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:80:in execute' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/lib/etl/commands/etl.rb:90:in<top (required)>'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:in require' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:inblock in require'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:236:in load_dependency' from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activesupport-3.2.8/lib/active_support/dependencies.rb:251:inrequire'
from /home/emmanuel/talemetry/talemetry_warehouse/vendor/ruby/1.9.1/gems/activewarehouse-etl-1.0.0/bin/etl:28:in `<top (required)>'
fr

Thibaut Barrère · Answer 27 · Fri Oct 05 2012 22:38:44 GMT+0800 (China Standard Time)

So the original error (FasterCSV) is solved by upgrading to the latest version of activewarehouse-etl.

I'm closing this one - the end of the issue will be tracked on #110.