Random logging duplication

Question

Random logging duplication

stasOR41k opened this issue 8 months ago · comments

Stanislav Kovalevsky commented 8 months ago

I'm using the latest(48) version of the DataDog Lambda Extention layer with the .NET 7 AOT function to send logs to the DataDog.
The issue is that I have duplicate logs with the same request_id for some requests.
CloudWatch shows logs correctly. No DataDog Forwarder is configured to send logs to the DataDog. No dd-tracer layer is installed as it is not compatible with the .NET AOT.
Does anyone have an idea what is the issue?

Ivan Topolcic · Answer 1 · Wed Sep 20 2023 21:30:28 GMT+0800 (China Standard Time)

Have you been seeing this on a previous version? And would you be able to provide the logs, with DD_LOG_LEVEL set to debug?

Stanislav Kovalevsky · Answer 2 · Wed Sep 20 2023 23:28:30 GMT+0800 (China Standard Time)

Good point, thank you! Found an interesting moment in the duplicated request logs. It is trying to send logs after the REPORT log and facing the issue
UTC | DD_EXTENSION | WARN | Could not send payload: Post "https://http-intake.logs.datadoghq.com/api/v2/logs": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

2023-09-20 15:00:57 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 15:00:57 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 15:00:57.620057003 +0000 UTC m=+410.472997916 before retrying. Backoff duration 100ms due to -1 errors
2023-09-20 15:00:57 UTC | DD_EXTENSION | DEBUG | Send messages for pipeline logs (msg_count:15, content_size=12699, avg_msg_size=846.60)
2023-09-20 15:00:57 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 15:00:57.223557099 +0000 UTC m=+410.076498012 before retrying. Backoff duration 100ms due to 0 errors
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Waiting to shut down HTTP server
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Received shutdown event. Reason: spindown
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Enhanced metrics: {durationMs:1875.302 billedDurationMs:2813 memorySizeMB:256 maxMemoryUsedMB:172 initDurationMs:936.875 initDurationTelemetry:0 initStartTime:{wall:0 ext:0 loc:<nil>}}
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 15:00:56.793280515 +0000 UTC m=+409.646221440 before retrying. Backoff duration 100ms due to 1 errors
2023-09-20 15:00:56 UTC | DD_EXTENSION | WARN | Could not send payload: Post "https://http-intake.logs.datadoghq.com/api/v2/logs": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Send messages for pipeline logs (msg_count:22, content_size=20838, avg_msg_size=947.18)
2023-09-20 15:00:56 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
REPORT RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1	Duration: 1875.30 ms	Runtime Duration: 1255.00 ms	Post Runtime Duration: 620.30 ms	Billed Duration: 2813 ms	Memory Size: 256 MB	Max Memory Used: 172 MB	Init Duration: 936.88 ms
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished flushing
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished metrics flush that was started at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | SyncForwarder has flushed 1 transactions
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Demultiplexer: sendIterableSeries: stop routine
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | SyncForwarder has flushed 1 transactions
2023-09-20 14:54:09 UTC | DD_EXTENSION | INFO | Successfully posted payload to "https://7-47-0-app.agent.datadoghq.com/api/v1/series", the agent will only log transaction success every 500 transactions
2023-09-20 14:54:09 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 14:54:09.395379825 +0000 UTC m=+2.249173698 before retrying. Backoff duration 100ms due to 0 errors
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | The payload was not too big, returning the full payload
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | The payload was not too big, returning the full payload
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.response_duration","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":0.058,"Max":0.058,"Sum":0.058,"Avg":0.058,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Send messages for pipeline logs (msg_count:53, content_size=42887, avg_msg_size=809.19)
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished logs flush that was started at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Flush in the logs-agent done.
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Demultiplexer: sendIterableSeries: start sending iterable series to the serializer
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.response_latency","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":1242.641,"Max":1242.641,"Sum":1242.641,"Avg":1242.641,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.runtime_duration","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":1255,"Max":1255,"Sum":1255,"Avg":1255,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.invocations","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true","init_type:on-demand"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":1,"Max":1,"Sum":1,"Avg":1,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.produced_bytes","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":442,"Max":442,"Sum":442,"Avg":442,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Received a Flush trigger
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Beginning metrics flush at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished traces flush that was started at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | INFO | Triggering a flush in the logs-agent
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Beginning logs flush at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Beginning traces flush at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | The flush strategy end has decided to flush at moment: stopping
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Received a runtimeDone log message for the current invocation a001011b-9ca1-4a9a-9f0b-33837aa243b1
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Runtime done metrics: {responseLatency:1242.641 responseDuration:0.058 producedBytes:442}
END RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1
END RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1
2023-09-20T14:54:09.075Z	a001011b-9ca1-4a9a-9f0b-33837aa243b1	info	{"coldStart":true,"xrayTraceId":"1-650b078e-443dd56a1f33aa0641d2a77b","userPoolId":"eu-west-1_ite8hRsNq","correlationId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","tenantId":"stage-lvt1w6stru20hrjn","functionName":"PreSignUp-dev-eu","functionVersion":"129","functionMemorySize":256,"functionArn":"arn:aws:lambda:eu-west-1:<some_account_id>:function:PreSignUp-dev-eu:current","functionRequestId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","timestamp":"2023-09-20T14:54:09.0593022Z","level":"Information","service":"PreSignUp","name":"AWS.Lambda.Powertools.Logging.Logger","message":"Successfully linked success+user1@simulator.amazonses.com email."}
2023-09-20T14:54:09.075Z	a001011b-9ca1-4a9a-9f0b-33837aa243b1	info	{"coldStart":true,"xrayTraceId":"1-650b078e-443dd56a1f33aa0641d2a77b","userPoolId":"eu-west-1_ite8hRsNq","correlationId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","tenantId":"stage-lvt1w6stru20hrjn","functionName":"PreSignUp-dev-eu","functionVersion":"129","functionMemorySize":256,"functionArn":"arn:aws:lambda:eu-west-1:<some_account_id>:function:PreSignUp-dev-eu:current","functionRequestId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","timestamp":"2023-09-20T14:54:09.0593022Z","level":"Information","service":"PreSignUp","name":"AWS.Lambda.Powertools.Logging.Logger","message":"Successfully linked success+user1@simulator.amazonses.com email."}
2023-09-20 14:54:08 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 14:54:08 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No lambda span, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | InitReport done metrics: {durationMs:0 billedDurationMs:0 memorySizeMB:0 maxMemoryUsedMB:0 initDurationMs:0 initDurationTelemetry:937.205 initStartTime:{wall:0 ext:0 loc:<nil>}}
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No lambda span, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | InitReport done metrics: {durationMs:0 billedDurationMs:0 memorySizeMB:0 maxMemoryUsedMB:0 initDurationMs:0 initDurationTelemetry:937.205 initStartTime:{wall:0 ext:0 loc:<nil>}}
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No init duration, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | The flush strategy end has decided to not flush at moment: starting
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No init duration, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | The flush strategy end has decided to not flush at moment: starting
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Starting Log Collection with ARN: arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu and RequestId:
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Received invocation event...
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Starting Log Collection with ARN: arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu and RequestId:
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Received invocation event...
START RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1 Version: 129
START RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1 Version: 129
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | serverless agent ready in 85.86127ms
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | finding the lambda runtime took 29.292816ms. found runtime: provided.al2
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | serverless agent ready in 85.86127ms
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | finding the lambda runtime took 29.292816ms. found runtime: provided.al2
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting ColdStartSpanCreator on Daemon
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting ColdStartSpanCreator
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting ColdStartSpanCreator on Daemon
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting ColdStartSpanCreator
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting DefaultEnv to "dev-eu" (from 'env' config option)
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Loaded configuration: /var/task/datadog.yaml
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting DefaultEnv to "dev-eu" (from 'env' config option)
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Loaded configuration: /var/task/datadog.yaml
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | grpc agent secure client created
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | grpc agent secure client created
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | attempting to create grpc agent client connection to: localhost:5001
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Adding AWS Logs Log Source
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | logs-agent started
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Starting logs-agent...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | setting agent metadata 'logs_transport': 'HTTP'
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | attempting to create grpc agent client connection to: localhost:5001
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Adding AWS Logs Log Source
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | logs-agent started
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Starting logs-agent...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | setting agent metadata 'logs_transport': 'HTTP'
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | otlp endpoint disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | otlp endpoint disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | appsec: security monitoring is not enabled: DD_SERVERLESS_APPSEC_ENABLED is not set to true
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Subscribing to Telemetry for types: [platform function extension]
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Enabling telemetry collection HTTP route
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | appsec: security monitoring is not enabled: DD_SERVERLESS_APPSEC_ENABLED is not set to true
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Subscribing to Telemetry for types: [platform function extension]
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Enabling telemetry collection HTTP route
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | dogstatsd-udp: starting to listen on 127.0.0.1:8125
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | DogStatsD will run 2 workers
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | dogstatsd-udp: 127.0.0.1:8125 successfully initialized
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | dogstatsd-udp: starting to listen on 127.0.0.1:8125
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | DogStatsD will run 2 workers
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | dogstatsd-udp: 127.0.0.1:8125 successfully initialized
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.aggregator_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Demultiplexer started
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Forwarder started
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.aggregator_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Demultiplexer started
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Forwarder started
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Creating TimeSampler #0
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Retry queue storage on disk is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Using a SyncForwarder with a 5s timeout
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Creating TimeSampler #0
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Retry queue storage on disk is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Using a SyncForwarder with a 5s timeout
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'use_proxy_for_cloud_metadata' is enabled: adding cloud provider URL to the no_proxy list
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'use_proxy_for_cloud_metadata' is enabled: adding cloud provider URL to the no_proxy list
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Unable to restore the state from file
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Unable to restore the state from file
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting daemon to receive messages from runtime...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Datadog extension version : 48|Datadog environment variables: DD_API_KEY=***|DD_APM_REPLACE_TAGS=[]|DD_CAPTURE_LAMBDA_PAYLOAD=true|DD_ENV=dev-eu|DD_LAMBDA_HANDLER=bootstrap|DD_LOG_LEVEL=debug|DD_MERGE_XRAY_TRACES=true|DD_SERVICE=presignup|
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting daemon to receive messages from runtime...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Datadog extension version : 48|Datadog environment variables: DD_API_KEY=***|DD_APM_REPLACE_TAGS=[]|DD_CAPTURE_LAMBDA_PAYLOAD=true|DD_ENV=dev-eu|DD_LAMBDA_HANDLER=bootstrap|DD_LOG_LEVEL=debug|DD_MERGE_XRAY_TRACES=true|DD_SERVICE=presignup|

jordan gonzález · Answer 3 · Thu Jan 11 2024 03:32:46 GMT+0800 (China Standard Time)

Hey @stasOR41k,

Are you still getting this issue with our latest version? We believe starting v50+, something in AWS side changed it was fixed, now our extension is in parity with CloudWatch. Let me know if this issue still persist. I will close it for now, but please feel free to re-open if this persists with the latest versions, or if you have any other questions! 🙇🏽

Onesco · Answer 4 · Mon Jan 22 2024 08:12:37 GMT+0800 (China Standard Time)

@duncanista thanks for the feedback, had the same issue while using the Datadog lambda extension version 48 and will give feedback if it gets resolved.