logstash-plugins / logstash-input-s3

Hi there,

I am wondering what is the behaviour of this plugin on first run.

Looking at the code, it looks like the plugin will fetch every possible file in the s3 bucket if no sincedb can be found

logstash-input-s3/lib/logstash/inputs/s3.rb

Line 371 in 61d7a7d

return Time.new(0)

I dont want logstash-input-s3 to pull the entire bucket has it contains tons of data. Is there a way to start #parsing files from a specific date ? (ideally, from now)

I was thinking of invoking ruby -e "puts Time.now()" > $SINCEDB_PATH before the first run. What do you think of it ?

Initial import behaviour