• Release Notes

v6.2 CE Release Notes

Created：2024-07-05 Last Modified：2024-07-05

This document was translated by ChatGPT

#1. v6.2.6.5 [2023/05/17]

#1.1 New Features (GA)

  • AutoTracing
    • Provide Trace Completion API tracing-completion-by-external-app-spans: Callers can input a set of APP Spans (no need to store them in DeepFlow) to obtain their upstream and downstream SYS/NET Spans, enhancing traditional APM with infrastructure and non-instrumented service tracing capabilities. See the detailed documentation here
  • WASM Plugin
    • Introduce WebAssembly Plugin mechanism to support the parsing of private protocols and enhance the field parsing capabilities of standard protocols. See the detailed documentation here

#1.2 Optimizations

N/A

#2. v6.2.6.4 [2023/05/10]

#2.1 New Features (GA)

N/A

#2.2 Optimizations

  • Refactored the application protocol parsing (metric generation) process to facilitate the addition of new protocols.

#3. v6.2.6.3 [2023/04/27]

#3.1 New Features (GA)

  • AutoTagging
    • Support adding cloud.tag labels to K8s Namespaces in affiliated container clusters.
  • PromQL

#3.2 Optimizations

#4. v6.2.6.2 [2023/04/20]

#4.1 New Features (GA)

  • AutoTracing
    • Add file IO event data and associate it with call logs.

#4.2 Optimizations

  • Management
    • Automatically delete Agents that have been disconnected for longer than the vtap_auto_delete_interval. By default, they are deleted after being disconnected for more than 1 hour.

#5. v6.2.6.1 [2023/04/13]

#5.1 New Features (GA)

  • AutoTagging
    • The Custom Tag field k8s.label now supports K8s Service.
  • PromQL
    • Support querying Prometheus RemoteWrite metrics via PromQL.
    • Support using DeepFlow Universal Tag when querying Prometheus metrics.
  • Grafana
    • Prometheus Dashboard can use DeepFlow as a data source without modification.
    • In Query Editor, support referencing the $__interval variable for the Math operator.

#5.2 Optimizations

  • AutoTagging
    • When a K8s Pod serves as the backend for multiple K8s Services, only the service with the smallest dictionary order is associated in all tags.
  • Compatibility
    • Added two configuration items for Huawei public cloud: domain name and IAM authorization address to adapt to HCSO scenarios.
  • Debug
    • deepflow-server supports continuous profiling to monitor itself.

#6. v6.2.6 [2023/04/06]

#6.1 New Features (GA)

  • Universal Service Map
    • Support displaying application topology grouped by Custom Tag (e.g., k8s.label.xxx).
    • Support filtering the monitored process list using the parent process name (static_config.os-proc-regex.match-type = parent_process_name), simplifying configuration complexity. FR-028-Xiaomi (opens new window)
    • Synchronize only tagged processes to reduce the number of synchronized processes. FR-034-Xiaomi (opens new window). Thanks to @eddietanshuo for the contribution. PR-2974 (opens new window).
  • AutoTagging
    • Added three Universal Tags: tap_port_host, tap_port_chost, tap_port_pod_node, representing the host machine, cloud server, and container node of the collection network card, respectively.
  • Grafana
    • Support referencing another Variable when defining a Variable.
  • OTLP

#6.2 Optimizations

  • Compatibility
    • eBPF programs support automatic kernel offset adaptation using BTF files.
  • Management
    • Support unified configuration of additional network cards for container clusters affiliated with cloud platforms.
  • Debug
    • Lower the collection interval of all DeepFlow self-monitoring metrics to 10s.
    • Embed eBPF data source information (syscall, go-tls, go-http2, openssl, io-event) in the tap_port field to enhance debugging capabilities.

#7. v6.2.5 [2023/03/21]

#7.1 New Features (Alpha)

  • Universal Service Map
    • Added direction score metric. The higher the score, the more accurate the client and server directions. A score of 255 indicates the direction is definitely correct.
  • Querier API
    • Support using DeepFlow AutoTagging automatically injected tags when querying Prometheus native metrics via PromQL.

#7.2 New Features (GA)

  • Universal Service Map
  • Integration
    • Pre-aggregate OpenTelemetry Span data into service and path metrics.
  • AutoTagging
    • When grouping by Pod is not possible, auto_service and auto_instance (resource_glX) prioritize grouping by process.

#7.3 Optimizations

  • Management
    • Support configuring data storage duration with hourly granularity.
    • Support unified configuration of additional routing interfaces for all managed K8s clusters under a public cloud account.
    • Provide two types of deepflow-agent binary packages: dynamic linking and static linking. The former depends on the glibc dynamic library, while the latter has significant malloc/free lock contention under multithreading.
  • Querier API
    • Unified the Category of custom type Tags (k8s.label/cloud.tag/os.app) to map_item.

#8. v6.2.4 [2023/03/07]

#8.1 New Features (Alpha)

  • Integration
    • Pre-aggregate OpenTelemetry Span data into service and path metrics.
  • AutoTagging
    • Support batch input of load balancer and its listener information. FR-022-Xiaomi (opens new window)
    • When grouping by Pod is not possible, auto_service and auto_instance (resource_glX) prioritize grouping by process.

#8.2 New Features (GA)

  • AutoTagging
  • SQL API
    • Support SLIMIT parameter to limit the number of returned Series.

#8.3 Optimizations

  • AutoTagging
    • Adapt process-level application topology to scenarios with port reuse. ISSUE-#2394 (opens new window)
    • Field renaming: use auto_instance instead of resource_gl0, use auto_service instead of resource_gl2.
  • Management
    • Support configuring the interval for deepflow-agent to list k8s-apiserver.
    • Support specifying the Hostname of the environment where the collector is located.

#9. v6.2.3 [2023/02/21]

#9.1 New Features (Alpha)

  • SQL API
    • Added SLIMIT parameter to limit the number of Series in the returned results.

#9.2 New Features (GA)

  • Universal Service Map
  • AutoTagging
    • Processes automatically inherit metadata from their parent processes (os_app tag). FR-024-Xiaomi (opens new window)
    • Support synchronizing Baidu Cloud Intelligent Network (CSN) resource information.
  • Grafana
    • Added Grafana backend plugin module to support standard Grafana alert policy configuration.

#9.3 Optimizations

  • Management
    • Remote upgrade of deepflow-agent on cloud servers can be fully completed via deepflow-ctl, without manually mounting hostPath for deepflow-server.
  • AutoTagging
    • Adapt resource information synchronization for K8s 1.18 and 1.20.
  • SQL API
    • When obtaining the optional values of enum type Tag fields, return the description information corresponding to the values.

#10. v6.2.2 [2023/02/07]

#10.1 New Features (GA)

  • AutoTracing
    • Support zero-instrumentation Golang application distributed tracing
  • AutoTagging
    • Support adding custom metadata for processes, cloud servers, and K8s Namespaces FR-001-Xiaomi (opens new window)
    • Support automatic synchronization of K8s cluster information under AWS and Alibaba Cloud accounts.
  • Management

#10.2 Optimizations

  • deepflow-agent
    • The regular expression list for scanning processes (os-proc-regex) supports configuring action=drop to express ignore semantics. FR-010-Xiaomi (opens new window)
    • Support running in Linux Kernel environments below 3.0. FR-012-Xiaomi (opens new window)
    • Use the operating system's socket information to correct the direction of flow logs. FR-011-Xiaomi (opens new window)
    • Automatically update the corresponding information of the agent when the ctrl_ip or ctrl_mac of the agent's operating environment changes.
  • deepflow-server
    • When a UDP flow times out, set the status field of l4_flow_log to normal.

#11. v6.2.1 [2023/01/17]

#11.1 New Features (Alpha)

  • Universal Service Map
  • AutoTagging
    • Support adding custom metadata for processes, cloud servers, and K8s Namespaces FR-001-Xiaomi (opens new window)
    • Support automatic synchronization of K8s cluster information under AWS and Alibaba Cloud accounts.
    • Support synchronizing Baidu Cloud Intelligent Network (CSN) resource information.
  • Querier API
    • Support PromQL
  • Management

#11.2 Optimizations

  • Querier API
    • Support returning the original field names before AS.
  • Grafana
    • Optimize Enum type Variable to avoid expanding all candidate values in SQL when selecting All.

#12. v6.2.0 [2022/12/29]

#12.1 New Features (Alpha)

  • AutoTracing
    • Support zero-instrumentation Golang application distributed tracing
  • Universal Service Map

#12.2 Optimizations