Bot releases are visible (Hide)
Published by kacper-murzyn over 1 year ago
Release on: 2023-04-20
0.47.8
which has improvements aimed to help large metric collections drop fewer payloads.Published by purple4reina over 1 year ago
arn:aws:lambda:<AWS_REGION>:464622532012:layer:Datadog-Extension:41
arn:aws:lambda:<AWS_REGION>:464622532012:layer:Datadog-Extension-ARM:41
arn:aws-us-gov:lambda:us-gov-<AWS_REGION>:002406178527:layer:Datadog-Extension:41
arn:aws-us-gov:lambda:us-gov-<AWS_REGION>:002406178527:layer:Datadog-Extension-ARM:41
DD_TRACE_MANAGED_SERVICES
to true https://github.com/DataDog/datadog-agent/pull/16176
The extension is now built with the otlp
build tag which enables opentelemetry.
Published by kacper-murzyn over 1 year ago
Release on: 2023-03-07
1.19.6
.Published by kacper-murzyn over 1 year ago
Release on: 2023-02-23
ddtray.exe
have changed from single-dash arguments to double-dash arguments. For example, -launch-gui
must now be provided as --launch-gui
. The start menu shortcut created by the installer will be automatically updated. Any custom scripts or shortcuts that launch ddtray.exe
with arguments must be updated manually.NDM: Add snmp.device.reachable/unreachable metrics to all monitored devices.
Add a new container_image
long running check to collect information about container images.
Enable orchestrator manifest collection by default.
Add a new sbom
core check to collect the software bill of materials of containers.
The Agent now leverages DMI (Desktop Management Interface) information on Unix to get the instance ID on Amazon EC2 when the metadata endpoint fails or is not accessible. The instance ID is exposed through DMI only on AWS Nitro instances. This will not change the hostname of the Agent upon upgrading, but will add it to the list of host aliases.
Adds the option to collect and store in workloadmeta the software bill of materials (SBOM) of containerd images using Trivy. This feature is disabled by default. It can be enabled by setting container_image_collection.sbom.enabled to true. Note: This feature is CPU and IO intensive.
snmp.interface_status
metric reflecting the same status as within NDM.permissions.log
Flare file on Windows. permissions.log
file list the original rights/ACL of the files copied into a Agent flare. This will ease troubleshooting permissions issues.--instance-filter
option to the Agent check command.max_memory
and max_cpu_percent
by default in containerized environments (Docker-only, ECS and CI). Users rely on the orchestrator / container runtime to set resource limits. Note: max_memory
and max_cpu_percent
have been disabled by default in Kubernetes environments since Agent 7.18.0
.1.19.5
.pymem.*
) to track Python heap usage.ddtray.exe
have changed from single-dash arguments to double-dash arguments. For example, -launch-gui
must now be provided as --launch-gui
.DD-Api-Key
). Failure to not send all Datadog headers could cause payloads to be rejected by our endpoints.github.com/ianlancetaylor/cgosymbolizer
.ddtray.exe
now requires admin to launch.Published by kacper-murzyn over 1 year ago
Release on: 2023-02-16
Published by kacper-murzyn over 1 year ago
Release on: 2023-02-02
Published by kacper-murzyn over 1 year ago
Release on: 2023-01-23
Adding the kube_api_version tag to all orchestrator resources.
Kubernetes Pod events generated by the kubernetes_apiserver can now benefit from the new cluster-tagger component in the Cluster-Agent.
APM OTLP: Added compatibility for the OpenTelemetry Collector's datadogprocessor to the OTLP Ingest.
The CWS agent now supports rules on mount events.
Adding a configuration option, exclude_ec2_tags
, to exclude EC2 instance tags from being converted into host tags.
Adds detection for a process being executed directly from memory without the binary present on disk.
Introducing agent sampling rates remote configuration.
Adds support for secret_backend_command_sha256
SHA for the secret_backend_command
executable. If secret_backend_command_sha256
is used, the following restrictions are in place:
secret_backend_command
setting must be an absolute path.- Permissions for the datadog.yaml
config file must disallow write access by users other than ddagentuser
or Administrators
on Windows or the user running the Agent on Linux and macOS. The agent will refuse to start if the actual SHA256 of the secret_backend_command
executable is different from the one specified by secret_backend_command_sha256
. The secret_backend_command
file is locked during verification of SHA256 and subsequent run of the secret backend executable.
Collect network devices topology metadata.
Add support for AWS Lambda Telemetry API
Adds three new metrics collected by the Lambda Extension
`aws.lambda.enhanced.response_latency`: Measures the elapsed time in milliseconds from when the invocation request is received to when the first byte of response is sent to the client.
`aws.lambda.enhanced.response_duration`: Measures the elapsed time in milliseconds between sending the first byte of the response to the client and sending the last byte of the response to the client.
`aws.lambda.enhancdd.produced_bytes`: Measures the number of bytes returned by a function.
Create cold start span representing time and duration of initialization of an AWS Lambda function.
annotations_as_tags
parameter to the kubernetes_state_core check to allow attaching Kubernetes annotations as Datadog tags in a similar way that the labels_as_tags
parameter does.windows_counter_init_failure_limit
option. This option limits the number of times a check will attempt to initialize a performance counter before ceasing attempts to initialize the counter.secret_backend_command
execution to the ddagentuser
account used by the Core Agent service.0.37.1
for Python 2.0.38.4
for Python 3.Published by kacper-murzyn almost 2 years ago
Release on: 2022-12-21
1.18.9
.Published by kacper-murzyn almost 2 years ago
Release on: 2022-12-12
config_id
is specified. This change enables multiple configs to operate on the same journal which is useful for tagging different units. Note: This may have an impact on CPU usage.force_tls_12
configuration parameter has been removed since it's now the default behavior. To continue using TLS 1.0 or 1.1, you must set the min_tls_version
configuration parameter to either tlsv1.0 or tlsv1.1.agent
CLI subcommands related to Windows services are now consistent in use of dashes in the command names (install-service
, start-service
, and so on). The names without dashes are supported as aliases.use_v2_api.series
to false.APM: Don't include extra empty 'env' entries in sampling priority output shown by agent status command.
APM: Fix panic when DD_PROMETHEUS_SCRAPE_CHECKS is set.
APM: DogStatsD data can now be proxied through the "/dogstatsd/v1/proxy" endpoint and the new "/dogstatsd/v2/proxy" endpoint over UDS, with multiple payloads separated by newlines in a single request body. See https://docs.datadoghq.com/developers/dogstatsd#setup for configuration details.
APM - remove extra error message from logs.
Fixes an issue where cluster check metrics would be sometimes sent with the host tags.
The containerd check no longer emits events related with pause containers when exclude_pause_container is set to true.
Discard aberrant values (close to 18 EiB) in the container.memory.rss
metric.
Fix Cloud Foundry CAPI Metadata tags injection into application containers.
Fix Trace Agent's CPU stats by reading correct PID in procfs
Fix a potential panic when df outputs warnings or errors among its standard output.
The OTLP ingest is now consistent with the Datadog exporter (v0.56+) when getting a hostname from OTLP resource attributes for metrics and traces.
Make Agent write logs when SNMP trap listener starts and Agent receives invalid packets.
Fixed a bug in the workloadmeta store. Subscribers that asked to receive only unset events mistakenly got set events on the first subscription for all the entities present in the store. This only affects the container_lifecycle check.
Fix missing tags on the kubernetes_state.cronjob.complete
service check.
In kubernetes_state_core
check, fix the labels_as_tags feature when the same Kubernetes label must be turned into different Datadog tags, depending on the resource:
labels_as_tags:
daemonset:
first_owner: kube_daemonset_label_first_ownerdeployment:
first_owner: kube_deployment_label_first_owner
Normalize the EventID field in the output from the windowsevent log tailer. The type will now always be a string containing the event ID, the sometimes present qualifier value is retained in a new EventIDQualifier field.
Fix an issue where the security agent would panic, sending on a close channel, if it received a signal when shutting down while all components were disabled.
Fix tokenization of negative numeric values in the SQL obfuscator to remove extra characters prepended to the byte array.
Namespace
collection in the orchestrator check and enable it by default.Release on: 2022-11-09
cri-o
like OpenShift, which began failing in 7.40.0.Published by kacper-murzyn almost 2 years ago
Release on: 2022-11-02
Starting Agent 7.40, the Agent will fail to start when unable to determine hostname instead of silently using unrelevant hostname (usually, a container id). Hostname resolution is key to many features and failure to determine hostname means that the Agent is not configured properly. This change mostly affects Agents running in containerized environments as we cannot rely on OS hostname.
Universal Service Monitoring now requires a Linux kernel version of 4.14 or greater.
libxcrypt-compat
system package.JMXFetch now supports ZGC Cycles and ZGC Pauses beans support out of the box.
Adds new aws.lambda.enhanced.post_runtime_duration metric for AWS Lambda functions. This gauge metric measures the elapsed milliseconds from when the function returns the response to when the extensions finishes. This includes performing activities like sending telemetry data to a preferred destination after the function's response is returned. Note that aws.lambda.enhanced.duration is equivalent to the sum of aws.lambda.enhanced.runtime_duration and aws.lambda.enhanced.post_runtime_duration.
Add the flare command to the Cloud Foundry cluster agent to improve support experience.
Add CreateContainerError
and InvalidImageName
to waiting reasons for kubernetes_state.container.status_report.count.waiting
in the Kubernetes State Core check.
[netflow] Ephemeral Port Rollup
APM: A warning is now logged when the agent is under heavy load.
APM: The "http.status_code" tag is now supported as a numeric value too when computing APM trace stats. If set as both a string and a numeric value, the numeric value takes precedence and the string value is ignored.
APM: Add support for cgroup2 via UDS.
A new config option, logs_config.file_wildcard_selection_mode
, allows you to configure how log wildcard file matches are prioritized if the number of matches exceeds logs_config.open_files_limit
.
The option defaults to by_name
which is the previous behavior. The new option is by_modification_time
which prioritizes more recently modified files, but using it can result in slower performance compared to using by_name
.
Agents are now built with Go 1.18.7. This version of Go brings changes to the garbage collection runtime that may change the Agent's memory usage. In internal testing, the RSS of Agent processes showed a minor increase of a few MiB, while CPU usage remained consistent. Reducing the value of GOGC
as described in the Go documentation was effective in reducing the memory usage at a modest cost in CPU usage.
KSM Core check: Add the helm_chart
tag automatically from the standard helm label helm.sh/chart
.
Helm check: Add a helm_chart
tag, equivalent to the standard helm label helm.sh/chart
(see https://helm.sh/docs/chart_best_practices/labels/).
The OTLP ingest endpoint now supports the same settings and protocol as the OpenTelemetry Collector OTLP receiver v0.60.0. In particular, this drops support for consuming OTLP/JSON v0.15.0 or below payloads.
Improve CCCache performance on cache miss, significantly reducing the number of API calls to the CAPI.
Add more flags to increase control over the CCCache, such as refresh_on_cache_miss, sidecars_tags, and isolation_segments_tags flags under cluster_agent properties.
Windows: Add a config option to control how often the agent refreshes performance counters.
Introduces an unbundle_events config to the docker integration. When set to true, Docker events are no longer bundled together by image name, and instead generate separate Datadog events.
Introduces an unbundle_events config to the kubernetes_apiserver integration. When set to true, Kubernetes events are no longer bundled together by InvolvedObject, and instead generate separate Datadog events.
On Windows the Agent now uses high-resolution icon where possible. The smaller resolution icons have been resampled for better visibility.
MetricPayload
to ensure the device tag is properly handled by the backend.dogstatsd_metrics_stats_enable
is trueaerospike
Python package is now correctly built against the embedded OpenSSL and thus the Aerospike integration can be successfully used on RHEL/CentOS./usr/lib/systemd/system
.logs_config.cca_in_ad
feature flag now defaults to true. This selects updated codepaths in Autodiscovery and the Logs Agent. No behavior change is expected. Please report any behavior that is "fixed" by setting this flag to false.helm_chart
tag automatically from the standard helm label helm.sh/chart
.helm_chart
tag, equivalent to the standard helm label helm.sh/chart
(see https://helm.sh/docs/chart_best_practices/labels/).mutateUnlabelled
is enabled and configMode
is set to socket
. This combination could prevent the creation of new DaemonSet Agent pods.Published by kacper-murzyn about 2 years ago
Release on: 2022-10-12
Published by kacper-murzyn about 2 years ago
Release on: 2022-09-27
github.com/open-policy-agent/opa
to v0.43.1 to patch CVE-2022-36085.Published by kacper-murzyn about 2 years ago
Release on: 2022-09-12
helm
check has new configuration parameters:
extra_sync_timeout_seconds
(default 120)informers_resync_interval_minutes
(default 10)min_tls_version
configuration parameter allows configuration of the minimum TLS version used for connections to the Datadog intake. This replaces the force_tls_12
configuration parameter which only allowed the minimum to be set to tlsv1.2.logs_config.open_files_limit
to 200
on Windows and macOS. Raised to 500
for all other operating systems.force_tls_12
configuration parameter is deprecated, replaced by min_tls_version
. If min_tls_version
is not given, but force_tls_12
is true, then min_tls_version
defaults to tlsv1.2.internal_profiling.period
parameter is now taken into account by the agent.df
command, such as when a mountpoint is stuck.helm
check has new configuration parameters:
extra_sync_timeout_seconds
(default 120)informers_resync_interval_minutes
(default 10)is_leader="false"
on the leader instancePublished by kacper-murzyn about 2 years ago
Release on: 2022-08-10
7.38.x
when the containerized agent was launched without hostPID: true
.Published by kacper-murzyn about 2 years ago
Release on: 2022-08-02
Published by ahmed-mez about 2 years ago
Released on: 2022-07-26
Pinned to datadog-agent v7.38.0: CHANGELOG
Published by kacper-murzyn about 2 years ago
Release on: 2022-07-25
kubernetes_state.ingress.count
and kubernetes_state.ingress.path
.otlp_config.debug.loglevel
to determine log level when the OTLP Agent receives metrics/traces for debugging use cases.otlp_config.metrics.instrumentation_library_metadata_as_tags
in in favor of otlp_config.metrics.instrumentation_scope_metadata_as_tags
.enable_payloads.series
or enable_payloads.sketches
are set to false, don't log the error Cannot append a metric in a closed buffered channel
.Published by vboulineau over 2 years ago
Released on: 2022-06-28
Pinned to datadog-agent v7.37.0: CHANGELOG
The Cluster Agent followers now forward queries to the Cluster Agent leaders themselves. This allows a reduction in the overall number of connections to the Cluster Agent and better spreads the load between leader and forwarders.
Make the name of the ConfigMap used by the Cluster Agent for its leader election configurable.
The Datadog Cluster Agent exposes a new metric endpoint_checks_configs_dispatched
.
Fix a panic occuring during the invocation of the check
command on the
Cluster Agent if the Orchestrator Explorer feature is enabled.
Fix the node count reported for Kubernetes clusters.
Published by vboulineau over 2 years ago
Released on: 2022-05-22
Pinned to datadog-agent v7.36.0: CHANGELOG
The Datadog Admission Controller supports multiple configuration injection
modes through the admission_controller.inject_config.mode
parameter
or the DD_ADMISSION_CONTROLLER_INJECT_CONFIG_MODE
environment variable:
hostip
: Inject the host IP. (default)service
: Inject Datadog's local-service DNS name.socket
: Inject the Datadog socket path.Collect ResourceRequirements for jobs and cronjobs for kubernetes live containers.
Added a configuration option to admission controller to allow
configuration of the failure policy. Defaults to Ignore which
was the previous default. The default of Ignore means that pods
will still be admitted even if the webhook is unavailable to
inject them. Setting to Fail will require the admission controller
to be present and pods to be injected before they are allowed to run.
The admission controller's reinvocation policy is now set to IfNeeded
by default.
It can be changed using the admission_controller.reinvocation_policy
parameter.
The Datadog Cluster Agent now supports internal profiling.
KSM core check: add a new kubernetes_state.cronjob.complete
service check that returns the status of the most recent job for
a cronjob.
Fix the node count reported for Kubernetes clusters.
Fixed an issue that created lots of log messages when the DCA admission controller was enabled on AKS.
Time-based metrics (for example, kubernetes_state.pod.age
, kubernetes_state.pod.uptime
) are now comparable in the Kubernetes state core check.
Fix a risk of panic when multiple KSM Core check instances run concurrently.
Remove noisy Kubernetes API deprecation warnings in the Cluster Agent logs.