Reading config from S3 bucket
Revaapriyan opened this issue · comments
It would be helpful if an efficient way to read the config (or process it) from S3 storage. boto3 client get the file ('s3://path/to/.yaml') as BytesIO which will not be merged with any default.yaml in the config folder.
@danielcoman It would be great if reading from s3 is feasible.
@Revaapriyan, himl supports key value interpolation (retrieval) from S3 and SSM.
Main use case behind himl is to merge the files in a given hierarchy, you can generate the output in a desired path where you store some configs that you do not want merged. There is no mechanism in place to exclude any files from the merge, you could place them in another path, or you could exclude some top keys from the output with --exclude (no interpolation will be done on excluded items) or use --filter to only select the top keys you need.
@Revaapriyan please reopen if needed