Changelog (2025)¶

December 24, 2025¶

Feature Updates¶

Role Permissions¶

Dashboard permissions refined: Added an independent "Dashboard Create" permission. The original "Dashboard Management" permission still includes all operations. Assigning the "Create" permission will automatically enable basic view permissions for dashboards and views.
The navigation bar dynamically displays based on user permissions. If a role does not have any permissions in a specified module, that module will not appear in its left navigation bar. This rule applies to the following modules: Cloud Billing, Billing, Scenarios, Event Center, Infrastructure, Logs, Metrics, APM, RUM, LLM Monitoring, Synthetic Tests, Monitoring, Incident, Security Monitoring.

Monitoring¶

Alert Strategies:
- Simultaneously supports search and filtering to filter alert strategies; newly added support for precise filtering by monitor name (checker_title) and member (member);
- Repeat Alert: Added support for setting separate repeat alert suppression intervals for different alert levels (e.g., Critical, Severe, Warning, etc.);
- Added notification aggregation rule: "Custom". Supports freely specifying field combinations for alert aggregation based on business needs. Enter field names (multiple fields separated by English commas), and the system will strictly aggregate based on this combination: aggregation alerts will only be triggered when event data contains all specified fields and their values are valid.
DQL functions built into Arbiter support querying data from a specified workspace by passing workspace parameters. Applicable to scenarios for creating and modifying Programmable Monitors and SIEM detection rules.

APM¶

Performance Metrics:
- Added Apdex statistics to quantify user satisfaction with application performance;
- Statistical metric time series visualization: Upgraded core statistical metrics in the service list, such as average request count, response time, and error count, from numerical display to time series chart format, intuitively presenting change trends.
Service Details:
- Supports displaying OpenTelemetry service language;
- Added Tab pages: Service Map, Profile, Dashboard.

Scenarios¶

Added new chart type "Change Comparison Chart": Quantitatively compares the value of a specified metric in the current period with the same period in history (e.g., same time yesterday, same day last week) or other metrics, and visually displays the change magnitude to quickly identify abnormal fluctuations;
When creating a new Pie Chart (Donut Chart), when the legend is not hidden, you can choose whether to display the Value and Value percentage.
Chart Y-axis: Optimized raw value display.

Snapshots¶

Overall optimization of snapshot list style;
Save Snapshot: Added "Save as static time" setting.

Metrics¶

Metric Analysis: Numerical values in query results now support flexible display format settings, allowing configuration of decimal places and full-precision result display.

Management¶

Cross-workspace Authorization: When "Metrics" is selected as the data scope, detailed configuration of the metric authorization scope is supported;
Share Management: Added quick filtering by type and search box.

Pipelines¶

Each data type now supports setting two default Pipelines (including local and central Pipeline).

Open API¶

Dashboard cross-workspace queries support specifying the default selected workspace.

Deployment Plan¶

Management Console:
- Workspace List > Tenant Configuration Management:
  - Added "Maximum Segment Time" setting, which defines the maximum time search range for a single query. Once sufficient data is obtained within this range, the search stops immediately;
  - Extended "Sampling Threshold" configuration, allowing free definition.
- Supports batch import of members by uploading a member list file;
- Security Settings > Login Method Management: Supports modifying the display name of the system default LDAP account to adapt to actual scenarios where different users have unified login across internal systems.
Added parameter (max_delay), supporting custom service topology calculation time.

New Integrations¶

Added GCP Storage integration;
Added GCP Cloud SQL (MySQL) integration;
Added Alibaba Cloud VPC Peering Connection integration;
Added AWS Lambda Trace integration;
Added Alibaba Cloud WAF Application Firewall integration;
Added Tencent Cloud Tencent CVM / KeewiDB views;
Fixed case sensitivity issue in Ingress-nginx-prom integration documentation;
Fixed integration documentation issues (including Chinese/English character and format issues);
Fixed TencentCloud public CLB collector to support non-public IPs;
Fixed linearBuckets metric bug in GCP Cloud Monitoring;
Added CSPM rule: S3 bucket policies should restrict access from other AWS accounts;
Added cloud integration templates: Aliyun CPFS, Aliyun NLB, HuaweiCloud EVS, Aliyun CNAPIGateway, HuaweiCloud ROMA;
Added cloud script: GCP APIs collector;
Added cloud script: GCP RUN collector.

Bug Fixes¶

Fixed the issue where alert events could not recover;
Fixed the issue of excessive connection count when connecting to external Kafka clusters;
Fixed the issue where email addresses being added to a blacklist prevented normal email receipt;
Fixed the issue where the initial load of the host list did not show the total number of online hosts, requiring waiting for lazy loading;
Fixed the issue where calling the log query task interface returned an error;
Fixed the issue where clicking Mute in the event details page of the Hangzhou site did not take effect;
Fixed the issue where the snapshot share button sometimes did not respond;
Fixed the issue of poor sampling results for APM at overseas sites;
Fixed the issue where alert events could not be associated to view related content;
Fixed the issue where searching log sources triggered large queries, causing platform queries to return no results;
Fixed the issue of not receiving high consumption warning emails;
Fixed the issue where monitor events did not recover as expected;
Fixed the issue of abnormal data display in the RUM error analysis view;
Fixed the issue of errors reported for trace data (7 days) and log queries (7 days);
Fixed the issue of abnormal Sourcemap reporting for the same version;
Fixed the issue where selecting all indices with wildcards when generating metrics from logs would cause generation failure;
Fixed the issue where read-only permission users could not view public dashboards;
Fixed the issue where the quick search function in dashboards could not be concatenated with log stream graphs, and the issue of abnormal display of multi-select view variables in the log analysis function;
Fixed the issue of encountering errors when obtaining samples during time series governance using pipelines at overseas sites;
Fixed the issue where the "Past 1 month" query range in scheduled reports at overseas sites returned an incorrect time range (217 days);
Fixed the issue where dashboard template errors at overseas sites hindered testing;
Fixed the issue of abnormal expression calculation results in monitors;
Fixed the issue where clicking the "Go to Workspace" link often resulted in a blank page with no event details displayed;
Fixed the issue of incorrect paths in the guide for installing data collectors;
Fixed the issue where user access geographic location was displayed as Unknown;
Fixed the issue of abnormal CPU load value display for Windows hosts in Infrastructure;
Fixed the issue of abnormal results when using DQL for trace queries;
Fixed the issue where SESSION REPLAY data could not be displayed;
Fixed the issue where adjusting the time window at overseas sites resulted in incorrect APM data results;
Fixed the issue where the Inner Mongolia region in the China map was displayed in English with incorrect data;
Fixed the issue of no query results after binding logs to external indices;
Fixed the issue where trace data details could not be opened;
Fixed the issue where pipelines processing logs could not judge or filter text with empty content;
Fixed the issue of IP address city resolution failure;
Fixed the issue of Chinese characters appearing in pipeline script functions at overseas sites, and the issue of user IDs not being displayed in the resource explorer, and dashboard errors in the resource analysis section of the user access analysis dashboard;
Fixed the issue of lag when selecting wildcards for variables.

December 10, 2025¶

Feature Updates¶

Billing¶

Based on the newly added Notification Targets, added a new billing item "Phone": Counts the number of voice notifications sent daily (each time/day).

In China region sites, the billing details are as follows:

Billing Item	Settlement Currency	Price Details
Phone	CNY	¥0.6
	USD	$0.09

Monitoring¶

Added support for Voice Phone as a notification target;
Monitors support cross-multi-workspace data detection

Management¶

Data Forwarding: After performing the Delete Rule action, the system sets the status of that rule to "Deleting". After processing is complete, the rule will be automatically removed.

December 3, 2025¶

Feature Updates¶

APM¶

Service Map:
- Clicking a node now slides out the corresponding service details on the right side. In addition to basic information like service name, corresponding team, and contact details, it now includes charts for service request response time, error request distribution, and error log count analysis;
- Added operation buttons: Zoom out, Zoom in, and Show full map;
- Added topology map configuration:
  - Users can manually configure whether to calculate node size based on "Request Count";
  - Users can choose the hover highlight range.
Performance Metrics:
- Added Filter Field Configuration. In addition to official default filter fields, users can customize up to 5 fields as filter fields;
- Added support for exporting the current performance metrics list as a CSV file.
Service Details > Resource Invocation:
- Added sampling hint: When queries for the resource list and distribution chart trigger sampling, a "Sampling Rate icon" is displayed;
- Upstream/Downstream Topology: Added "View Upstream/Downstream Calls" buttons, supporting viewing the call relationships of the upper/lower layers based on the current topology, enabling full-link path analysis starting from the current resource.
Trace > Service Call Relationships:
- Interaction optimization: Only draws call paths between different services, making dependency relationships clearer;
- Node information enhancement: Displays full-path service call relationships through a left-right structure. Simultaneously, each service node directly shows execution time, average response time, call count, and error information; clicking allows viewing the service's parent Spans to trace upstream call sources; if the service has errors, error details are directly displayed.

RUM¶

To adapt to the development of the HarmonyOS ecosystem, added support for Application Type HarmonyOS. Users can select the HarmonyOS client type when creating an application and obtain corresponding SDK integration guidance and configuration support to achieve complete observability integration for HarmonyOS applications.
The View explorer page supports TOBY AI error analysis.

Event Center¶

Added new Event Level: Fatal (df_status:fatal), defined as the highest level.

DQL¶

Added new function histogram_auto(): Automatic histogram range aggregation, no need to manually provide bucket basis, automatically selects appropriate bucket ranges to return statistical information on data distribution.
Optimized eval expression null value handling logic, added OR operator null value determination rule: When the left query result is null, automatically uses the right result for calculation, flexibly adapting to null value completion scenarios. Example analysis:
- (a or 0) / b: When query a result is null, automatically treats it as 0, finally calculating 0 / b;
- (a or b) / b: When query a result is null, automatically uses query b's result, finally calculating b / b.

MCP Server¶

Added support for querying metrics, traces, and RUM data in a standardized way.

Management¶

Data Forwarding: When deleting a rule, the rule name must be entered to confirm the operation;
Member Management: Supports assigning roles to teams. Team roles are automatically applied as additional roles to team members, and a member's final permissions include both personal roles and team roles.

Scenarios¶

Dashboard:
- Added "Filter" button for quickly adding global filter conditions;
- Original functions like "History Versions", "Large Screen Mode", "Report Records" have been moved to the "Settings" dropdown menu.
Charts:
- Advanced Configuration: Added "Repeat Chart" option. When enabled, the system generates multiple charts with the same structure based on each value of the selected view variable;
- Clicking a data point now supports Apply to Filter and Copy Group Label;
- Table Chart: Manually entered return count upper limit increased to 2000.

Monitoring¶

Alert aggregation notification template optimization: In rule aggregation and intelligent aggregation notifications, displays the count of different events triggered within the current aggregation period, helping users quickly identify the scale and impact scope of alerts associated with the alert.

New Integrations¶

Openresty added OpenTelemetry trace access method;
Added Zabbix integration, based on api\stream;
Added Alibaba Cloud Native API Gateway integration, Alibaba Cloud Function Compute integration;
Added Huawei Cloud EVS cloud disk integration;
Added Tencent Cloud WAF monitor;
Optimized Alibaba Cloud NLB view & integration documentation;
Optimized Alibaba Cloud SLB view;
Fixed iis integration view monitor;
Optimized Huawei Cloud ECS, CSS, Functiongraph views and monitors;
Optimized Tencent Cloud clb monitor/view;
Added Huawei Cloud DC/ Alibaba Cloud SLB monitors;
Removed Huawei Cloud GuassDB related integrations (Huawei Cloud has removed related products);
Fixed Huawei Cloud ROMA script;
Added CSPM templates:
- S3 buckets should have "MFA Delete" enabled;
- S3 bucket ACLs should restrict public access;
- S3 bucket content access should be limited to authorized principals;
- IAM users should not have the "AdministratorAccess" policy attached;
- IAM policies should be attached and managed at the group level.
Added Resource Catalog templates:
- Huawei Cloud: dds, functiongraph, kafka, obs, rds(mysql), rds_mariadb, rds_sqlserver
- Volcengine: postgresql
- Alibaba Cloud: nat
- Tencent Cloud: tdsql_c_mysql, mongodb, eip, cos
- AWS: iam_user
- Cloud integration templates:
- Added Tencent Cloud ckafka, es, redis, waf, etc.;
- Optimized Huawei Cloud: rds, postgresl, apig;
- Optimized AWS: WAF.

Bug Fixes¶

Fixed the issue where an email was registered but could not log in to the corresponding workspace normally;
Fixed the issue where log data could not be written to newly created workspaces;
Fixed the issue where the unrecovered event list showed no data after pagination;
Fixed the issue where monitoring indicators showed self-built testing nodes sending data successfully, but there was no data in the explorer;
Fixed the issue where file paths were not correctly displayed in error details after successful SourceMap upload and parsing;
Fixed the issue where global configuration saving was invalid in the performance profiling explorer;
Fixed the issue with abnormal auto-refresh function in single dashboard view mode within Scenarios;
Fixed the issue where workspace administrator accounts could not create new workspaces;
Fixed the issue where clicking the view button in a dashboard to open view details had a time interval inconsistent with the dashboard configuration;
Fixed the issue with abnormal billing timeline charging function;
Fixed the occasional issue where sidebar filter conditions in the log explorer could not return correct results;
Fixed the issue where scheduled reports could not be generated;
Fixed the issue with incorrect text in the testing function studio page;
Fixed the issue of "No metric data query permission" in external API reports;
Fixed the issue where accounts restricted by data access permissions encountered "Internal Server Error" when trying to access the log explorer;
Fixed the interface error when viewing network topology in the Infrastructure network menu;
Fixed the issue where iOS symbol table uploads failed to successfully parse stack information;
Fixed the issue of frequent false alerts (corresponding machines online without issues) in Infrastructure liveness detection V2 version;
Fixed the issue where Chinese searches could not find specific logs in the workspace's log explorer;
Fixed the intermittent issue of incomplete or missing trace query results, requiring repeated page refreshes;
Fixed the issue where the upper limit value supported for setting consecutive trigger conditions in monitors was incorrect (should be 10);
Fixed the issue where data forwarding volume for logs abnormally decreased by 90% starting from a specific date;
Fixed the issue where the error_stack field could not be selected in monitor group settings, while it could be used normally in DQL;
Fixed the issue where DQL queries executed by monitors returned incorrect data, leading to event alerts;
Fixed the issue of accessing Infrastructure function failure at the Ningxia site;
Fixed the issue where drilling down into CPU metrics showed "No data" in all related charts;
Fixed the issue where members in a workspace could display logs via traceid, but searching for keywords in logs returned no results;
Fixed the issue where log monitors could be saved without a data source configuration, but monitoring would fail;
Fixed the error when opening a specific view within a scenario on mobile applications;
Fixed the issue where the "Cross-region Private Network Traffic Fee" billing item in a workspace abnormally increased on a specific date;
Fixed the issue where high consumption warnings set in the Hangzhou site workspace did not send warning emails normally;
Fixed the issue where AWS-related Resource Catalog was displayed in Chinese;
Fixed the issue with abnormal data auto-scaling function when setting dashboard data units;
Fixed the issue of resource topology data display errors and performance profiling page loading failure at the Hangzhou site;
Fixed the issue of abnormal log queries at the Oregon site;
Fixed the issue where service nodes in the resource topology graph had no upstream/downstream, and metrics like request count and p99 were 0;
Fixed the issue where dashboard scheduled reports did not display data normally;
Fixed the issue of abnormal trace jumps when clicking in the APM analysis dashboard;
Fixed the issue of abnormally high error logs (nearly ten thousand per minute) for specific services in the Deployment Plan.

November 20, 2025¶

Feature Updates¶

Query Tools¶

PromQL > Range Query Mode now supports setting the step (step).

Scenarios¶

Text Chart supports introducing view variables and time variables, automatically parsing manually entered view variables #{fieldname} and time variables.
Funnel Chart: The number of nodes that can be added has been increased to 15.
In dashboards, explorers, and query tools, when chart sampling is enabled, a sampling rate icon will be displayed in the upper right corner.
- In query tools, clicking this icon allows temporarily disabling sampling.

Management¶

In blacklist configuration, "Filter" now supports on-demand input.
SSO Management:
- The "Edit" button must be clicked before enabling/disabling operations can be performed;
- The "Edit Identity Provider > Role Authorization" page supports selecting custom roles.

November 12, 2025¶

Feature Updates¶

Billing¶

The billing unit price for "APM/LLM Trace" has been adjusted as follows:

Monitoring¶

Added Programmable Detection monitors, allowing detection rules to be written via scripts, covering detection needs for various system data types.

TOBY AI¶

Added support for anomaly analysis. Based on input text, TOBY AI can intelligently integrate complex and chaotic information to generate clear, concise root cause analysis results for you.

MCP Server¶

Added support for accessing MCP Server (Model Context Protocol). As an open protocol, it provides a unified multi-model callable interface service for TrueWatch TOBY AI, supports multi-client access, and accesses Guance's monitor, log, dashboard, and DQL query capabilities via API Key authentication.

Management¶

Role Management: Scenario configuration management/monitor permission split.
- Scenario configuration management: Permissions subdivided into
  - Dashboard, View View
  - Dashboard Management
  - View Management
  - Note, Explorer Management
- Monitor: Split into Monitor View and Management permissions.
Field Management: Added "Attribute Classification" configuration item, including: System Field, Business Field, Other.
Workspace Settings:
- Added "Data Reporting IP Whitelist" configuration. When enabled, only egress IPs within the whitelist can report data normally; data from other sources will be blocked.
- The original "IP Whitelist" configuration has been renamed to "Login IP Whitelist". When the login (host) IP whitelist is enabled, only requests from sources in the whitelist can log in normally; other source requests will be denied access.

LLM Monitoring¶

Added support for collecting scores (model quality evaluation scores, descriptions, etc.) and displaying them.

Event Center¶

Change Event: After a new host is connected, a new change event will be generated.

Scenarios¶

Time Series Chart > Analysis Mode added style switching and period-over-period comparison;
Charts added "Open in Metric Analysis" function. Seamlessly transition from any chart to the metric analysis interface, with the system automatically bringing in the set query conditions.

Explorer¶

Log Explorer: Display fields now also support filtering values;
All Explorers: Added field type icon display.

Log Index¶

Log Index: Added description and associated service configuration. When querying traces, the system will automatically associate matching service indices.
External Index: Added index description configuration;
Explorer application of index supports single/multi-select mode switching.

APM¶

Service Map: Added display of maximum service response time.

RUM¶

Explorer > Fetch/XHR tab page: The original "Request" column renamed to "Resource URL", and supports displaying the full URL, with a button to toggle display on/off.

Cloud Account Management¶

Added search control, supporting fuzzy matching by keyword.

New Integrations¶

Added Volcengine PostgreSQL integration;
Added Alibaba Cloud CPFS integration;
Added Alibaba Cloud ALB integration;
Optimized Alibaba Cloud NAT view;
Optimized Tencent Cloud Cloud Monitoring;
Optimized Alibaba Cloud Oceanbase dashboard;
Added Pipeline templates:
- AWS ELB
- Squid
- Kong
- CloudFront
- CloudTrail
Added cloud collector templates:
- Alibaba Cloud cfw/cen/apigateway/mqtt/nas/OceanBase/ga;
- AWS step function/ssm run command/waf2;
- Huawei Cloud apic/apig/auto_scaling/cbr/cdm/css_es/dcaas, etc.;
Added CSPM templates.

Bug Fixes¶

Fixed the issue where clicking on a log in the log stream graph to expand the details page could not display the context;
Fixed the issue where the index was not automatically matched in the log side-slide page;
Fixed the issue where view variables could not be selected when there were too many in a dashboard;
Fixed the issue where the latest DK version could not be obtained via Helm in the AWS Oregon region;
Fixed the issue of DQL parsing failure when configuring detection metrics in APM metric detection;
Fixed the issue of workspace invitation member failure feedback and language display issues on the APM interface;
Fixed the display abnormality when clicking the "Data Access" menu;
Fixed the issue where selecting a one-time "Immediate" report in scheduled reports at the Singapore site did not receive emails;
Fixed chart jump issues in the RUM performance analysis dashboard;
Fixed the page error when viewing basic machine information at the Oregon site;
Fixed the issue where log sources under selected indices could not display normally in log detection monitors;
Fixed the issue where clicking log sources in monitors was unresponsive;
Fixed the issue of excessive connection count when forwarding data to Kafka;
Fixed the "Internal Server Error" when querying recent day data in the APM analysis dashboard;
Fixed the issue of duplicate values displayed for extended fields in the console;
Fixed the display abnormality after selecting "All Sources" for the data source in blacklist configuration;
Fixed the abnormal display of trace information in log details;
Fixed the issue where charts displayed "service unavailable" in scheduled reports;
Fixed the abnormal display of APM > Resource Call > Response Time Distribution;
Fixed the issue where bar charts using PromQL queries for a specific metric without aggregation or grouping could not set aliases;
Fixed the error when clicking host details in the Infrastructure page of the Deployment Plan;
Fixed the issue with single group deletion errors in dashboards;
Fixed the issue where changing the top value in leaderboard chart settings returned abnormal results;
Fixed the issue where Profile data opened blank and could not be downloaded;
Fixed the issue of user alerts caused by slow Redis hgetall query logs;
Fixed the issue where the label_values function became unavailable after upgrading the base version to 1.119.212, and view variable settings could not be saved;
Fixed the incorrect jump link opening in the security monitoring rule writing guide;
Fixed the error when querying external index logs;
Fixed the issue of excessive data point fluctuations in log query time series charts;
Fixed the issue where composite detection monitor configurations were empty after exporting from Space A and importing into Space B;
Fixed the display and drill-down abnormalities in Heat maps.

October 22, 2025¶

Feature Updates¶

Open API¶

Supports modifying data retention policy duration;
Supports log field global configuration > key field configuration;
Supports creating log indices via interface.

External API¶

DQL¶

Added function rate_over_sum(), which first sums the field within the aggregation window, then divides by the window length (seconds), used to calculate the average rate, resulting in a floating-point type.
Added function rate_over_count(), which counts the number of non-null values of a field within the aggregation window and divides by the window length (seconds), used to calculate event frequency, resulting in a floating-point type.
Added support for count(*) / 1i syntax.
Example: L::*:( count(*) / 1i ) [::1m]. Means dividing by the number of seconds in the time window (1m), calculating the QPS of log writes.

Billing¶

Data Forwarding > External Storage Forwarding Traffic Statistics: Based on the current workspace, aggregates compressed forwarding traffic by external storage type, counts daily increments, and distinguishes between public and internal network traffic for billing invoicing. Click to view specific price details.
Usage Analysis: Supports manually switching to the billing time zone (UTC+8), solving the issue of user time zone inconsistency with the billing time zone.

Monitoring¶

Alert Strategies: Added support for recovery events not sending notifications: When this option is enabled, all recovery conditions only generate events and do not send external notifications.
Monitors:
Added mass alert protection button: When the number of alerts generated by a single detection exceeds a preset threshold, the system automatically switches to a status summary strategy: instead of processing each alert object individually, it generates a small number of summary alerts based on event status and pushes them.
Log Detection > Detection Metrics: Supports configuring multiple indices.
Range Detection, Outlier Detection: Supports cross-workspace query for detection metrics.

Scenarios¶

Histogram:
- Added support for metric data source queries.
- Based on the BY field in the query condition to control statistical dimensions, divided into "Global Statistics" and "Group Statistics":
- Without BY condition, performs global total statistics, calculating the total distribution of all data.
- With BY condition, groups data by the BY field and then calculates the distribution for each group.
- Added X-axis, Y-axis configuration, allowing customization of data display boundaries by setting maximum and minimum values.
Time Series Chart: At the target time point on the time series chart, clicking allows selecting fixed time markers. Once a marker is set, it will not change due to mouse movement, page scrolling, or switching time series charts.
Composite Chart: Added export button, supporting one-click export of all chart information.
Chart > Link: When creating a new chart in a dashboard (existing charts remain unchanged), if the BY field in the query condition meets specific criteria, the system will automatically enable the display of the corresponding link list.
Reports: Original real-time reports and archived reports unified into "Reports". All reports will be archived and saved, simplifying management and viewing experience.
- Simultaneously supports directly creating new reports on the dashboard page, automatically bringing in the current view and time range.
- The Report Records page allows viewing historical archived data and directly sharing or deleting them.

Infrastructure¶

Hosts: Added real-time performance toggle. When enabled, the system refreshes every 10 seconds and automatically fetches the latest three metric fields: CPU usage, memory usage, and CPU load.

Explorer¶

Global Configuration > Quick Filter Configuration: For RUM, Synthetic Tests explorers:
- Left side displays source list, allowing modification of multiple options simultaneously in a pop-up.
- When opened from different explorers, the corresponding source will be automatically selected.
RUM > Long Task Explorer > Details Page: Added Script details, displaying restored code.
Time Widget: Added Playback button. After selecting a time range and executing a query, clicking the ▶️ button quickly returns to the most recent specified time range.

Snapshots¶

Supports re-editing already saved snapshots.

Management¶

Blacklist: Supports one-click enable/disable.
Pipelines: Optimized template export format and updated official template library samples.
Role Management: Supports one-click export of roles.
Data Forwarding: In addition to JSON text format storage type, added support for Parquet data storage type.

LLM Monitoring¶

Added access to guided configuration steps.

New Integrations¶

Added AWS CloudTrail integration;
Added AWS CloudFront integration;
Added AWS Athena integration;
Added Alibaba Cloud NAS integration;
Added Alibaba Cloud MQTT integration;
Added Alibaba Cloud OceanBase integration;
Optimized Kong integration documentation, added Tracing integration method;
Optimized CSPM templates.

Bug Fixes¶

Fixed the issue where members could not view and timestamp variable settings were incorrect after log field advanced configuration linkage;
Fixed the issue where calling OpenAPI to invite members still sent invitation emails to already joined members;
Fixed the issue where data in dashboard views was not expanded normally;
Fixed the issue with incorrect format after exporting table charts to CSV;
Fixed defects in the Multi-step test creation flow;
Fixed the issue where the return upper limit for area, line, and bar chart query results in metric analysis did not match the documentation description;
Fixed the issue where Profile could not open normally;
Fixed the issue where field aliases were visible when adding quick filters in the explorer but disappeared after addition;
Fixed the issue of scheduled report sending failure;
Fixed the issue where no testing task data appeared on the platform after creating a new testing task, and self-observability queries found related error logs in kodo;
Fixed the error when querying JSON format data with DQL;
Fixed the issue of no data in user access detection Action and View details;
Fixed the issue where actual role permissions existed but were not displayed on the right side in API Keys management;
Fixed the issue where scheduled reports could not be sent in production workspaces but could be sent in test workspaces;
Fixed the issue where custom roles could not be deleted;
Fixed issues with the log explorer: including abnormal bar chart and data count display, and inconsistent number of searched entries with the number of entries found below;
Fixed the issue of no data when clicking to view after sharing a snapshot;
Fixed the APM data empty result issue;
Fixed the issue of data backlog when forwarding to Kafka, with the backuplog service consuming memory until OOM;
Fixed the issue where provinces with data were not displayed in the China map on the dashboard;
Fixed the issue where text charts in panels moved to the top after repositioning and refreshing;
Fixed the slow loading issue when querying 5-minute logs;
Fixed the incorrect escape of filter conditions when jumping to associated views from the event details page;
Fixed the issue where time window parameters affected calculation results when using DQL to query data;
Fixed the issue where guancedb-storage stored data for 1 year, which did not meet expectations;
Fixed the issue where filtering user-customized fields in Actions did not take effect;
Fixed the issue where Webhook object addresses were not properly effective in alert events after modification;
Fixed log query issues: including lag when scrolling down the list for more details and query errors, and significant differences between status distribution chart display results and actual data;
Fixed the issue where cross-workspace trace queries only displayed current workspace data.

October 15, 2025¶

Feature Updates¶

Chart Query¶

Expression Query:

Added an independent "Expression Query" input box for directly writing expression formulas;
All queries are automatically assigned a query identifier (e.g., a, b, c) beforehand;
Compatibility Notes
- Historical chart subquery identifiers (e.g., A, B) cannot be reused by new expressions;
- Original expressions can still be queried normally, not affecting existing chart functionality;
- It is recommended to reconfigure expressions using new query identifiers when editing charts.

Data Forwarding¶

Added support for forwarding data to Volcengine TOS, providing five storage type options: Standard Storage, Infrequent Access Storage, Archive Flashback Storage, Archive Storage, Cold Archive Storage, to adapt to storage needs in different business scenarios.
When the storage type of forwarded data is "Archive", supports restoration tasks to thaw data for access and analysis.

September 24, 2025¶

Feature Updates¶

Open API¶

Added support for creating API Keys with specified permissions for newly created workspaces;
Added support for binding a specified billing center;
Added support for cross-workspace authorization.

Security Monitoring¶

Added CSPM detection type, supporting custom selection of detection types based on actual business scenarios (such as cloud resource protection, compliance audits, etc.), enriching detection coverage scenarios. Detection type descriptions are as follows:
CSPM (Cloud Security Posture Management): Identifies misconfigurations (e.g., open high-risk ports, excessive permission assignments) and compliance risks in cloud infrastructure, continuously assesses cloud resource security, and reduces vulnerability exploitation risks.
SIEM (Security Information and Event Management): Collects and analyzes security data from across the infrastructure, detecting threats and anomalous activities (e.g., abnormal login + bulk data export) through event correlation and log analysis.
Official Detection Library Experience Upgrade: Detection rules added "Belongs to Detection Library" identifier for quick identification of rule sources; simultaneously supports switching views in the template library, allowing browsing of all detection rules including monitors at once, improving rule search efficiency.
Security Detection Rule Editing Experience Optimization: Added "Trigger Detection Immediately" function, eliminating the need to wait for scheduled detection cycles, enabling real-time triggering of detection tasks. This facilitates quick validation of script effectiveness after writing/adjusting detection scripts and immediate viewing of generated security signals.

Management¶

Added Preferences, allowing unified configuration of workspace language, theme mode, detail page opening method, etc.;
Member Management: Added support for exporting members;
Invite Member: Added configuration for member team affiliation and notes.

Monitoring¶

Monitors: Supports "Trigger Detection Immediately" when editing monitor rules;
Mutation Detection, Range Detection V2 support cross-workspace queries
Mute Rules support cloning.

APM¶

Service list page added "Add Service" button.

Synthetic Tests¶

When creating a new testing task, supports configuring task execution frequency by entering a custom crontab.

Incident¶

During the first automatic discovery or manual creation of an Issue, the system supports AI intelligent analysis, automatically summarizing the current Issue content.

Metrics¶

Generate Metrics: Supports infrastructure and resource catalog data sources.

View Variables¶

Removed the original all values option, unified to use * to achieve multi-scenario filtering needs. Supports selective use based on different business scenarios, with specific effects as follows:

Ignore this field filter: When * is selected, ignore this field filter; chart queries will not include filtering conditions for this variable.
Full value filter (equivalent to original all values): When * is selected, all variable values will be used as filter conditions (up to 100 values). Note: Excessive data may impact performance; it is recommended to use selectively based on actual needs, avoiding indiscriminate full-value filtering.

Explorer¶

Log Explorer: Index style adjusted, simultaneously supporting one-click selection of all indices, pinning indices, searching and locating by index name, etc.;
All Explorers: Supports advanced linkage configuration.
Added query acceleration configuration, allowing configuration of indices for commonly used filter fields in the explorer's "Global Configuration" to improve query speed for those fields.

Added support for quick zoom function: One-click expands the current query time range to 3 times the original, reducing manual time range adjustment steps and improving data exploration efficiency.

External Data Sources¶

Added support for SQL Server data source.

New Integrations¶

Added AWS AOSS integration;
Added AWS PCS integration;
Added Alibaba Cloud CEN integration;
Added Continuous Profiler JVM dashboard template (analyzing Profile data);
Added AWS WAF integration;
Added FastDFS integration;
Added Alibaba Cloud API Gateway integration;
Added Alibaba Cloud Cloud Firewall integration;
Translated AWS AOSS/AWS PCS views.

Bug Fixes¶

Fixed the issue of adding tags to df_label in event content via central Pipeline;
Fixed the issue of unsuccessful deletion of workspace authorization;
Fixed the display issue of database resources in the Resource Catalog;
Fixed the issue where host data on the Infrastructure > Hosts page decreased after clicking the sort button;
Fixed the issue of incorrect billing center username value when registering a new account;
Fixed the issue of system internal error when binding external indices (TLS/ES);
Fixed the error when creating a workspace;
Fixed the error "Failed to create Func query task" when drilling down into Redis metric data;
Fixed the issue where data could sometimes be queried in the Dashboard and sometimes reported an Internal Server Error;
Fixed the "View not found" issue after jumping from container_crash related events in K8s within Infrastructure;
Fixed the issue where prometheus exporter metric collection displayed the same interface for different versions;
Fixed the issue where some fields were not displayed in the log stream graph unit settings;
Fixed the discrepancy between Open API call results and documentation;
Fixed the issue where the system view "APM P90 Resource Analysis View" did not contain charts;
Fixed the issue where alert strategies failed to successfully send emails to customers;
Fixed the issue where the key:value format of JSON output in event templates did not follow the format viewed in the explorer;
Fixed the issue of false alerts generated by host data reporting monitors;
Fixed the 502 error when uploading SourceMap;
Fixed the omission in the Webhook alert process;
Fixed the issue of abnormal fields when querying logs with DQL while drawing panels;
Fixed the "unknown Scalar function" error in dashboard queries;
Fixed the mismatch issue when switching DQL to simple queries in dashboards;
Fixed the issue where the Pie Chart Data Display module in Studio dashboard did not work properly;
Fixed the 400 error on the Time Series page in the metric management interface at the Hangzhou site;
Fixed the incorrect text in Integration > Cloud Account Management;
Fixed the issue with incorrect RUM ERROR pattern analysis;
Fixed the issue where RUM could not query Session and View data;
Fixed Warroom issues;
Fixed the issue where no results appeared in the list when filtering for entry-type spans, even though both entry and exit span types existed for the specified resource;
Fixed the issue of incomplete display in the service list view.

September 3, 2025¶

Feature Updates¶

Security Check¶

The Security Check function has been officially discontinued. Its related functionalities can be achieved through the Security Monitoring > Security Information and Event Management (SIEM) module.

LLM Monitoring¶

TrueWatch launched LLM Monitoring, providing "monitoring + tracing" capabilities for large model applications, ending the "black box" of model operation. It fully records input/output, tool calls, retries, latency, cost, and tokens for each call, with visual Trace and Session aggregated by conversation for easy replay and troubleshooting, achieving full-link transparent management. It now prioritizes support for Langfuse integration. If you are already a Langfuse user, you can quickly enable LLM monitoring capabilities.

Free Plan¶

For independent developers and small teams, TrueWatch added a Free Zone (Beijing) node. Under this node, you can register for the Free Plan (other sites no longer support creating Free Plan workspaces), covering key core functionalities.

Open API¶

Incident > Schedule: Supports adding parameters for getting calendars and filtering schedules.

Explorer¶

Log Explorer:
Added Advanced Linkage Configuration: Supports configuring jump links for individual fields, allowing direct opening of target pages from the current field, completing parameter transfer via variables for linkage analysis.
Log Explorer Display Items optimization:
- Added "Delete All Fields", "Reset Fields" buttons;
- Added "Time Column" display toggle.
All Explorers
Supports DQL Query mode.
Supports searching for all IP addresses under a single IP field via the CIDR function.

Event Center¶

Events generated by SIEM rules (security) support TOBY AI intelligent analysis on the details page.
No restriction on dimension tags, default support for jumping to log/trace explorers.

Monitoring¶

Alert Strategies Management: Under Rule Aggregation Mode, supports selecting only "Send First Alert", thereby avoiding missing important abnormal events while waiting for aggregation.
Monitor > Event Content supports defining domain variables:
df_studio_env_name: Current environment name
df_studio_console_base_url: Current environment console address
df_studio_monitor_base_link: Current environment monitor address

Management¶

Workspace administrators support disabling AI Intelligent Analysis at the workspace level.

Metrics > Metric Analysis¶

Table Chart mode added Prom mode, displaying results returned by PromQL queries.
In independent chart mode, chart titles are added based on query conditions.

Infrastructure¶

Host and container explorers support directly creating mute rules.

Synthetic Tests¶

Testing Task: Request body content added support for multipart/form-data.

Sensitive Data Scanning¶

Supports covering all data types, no longer limited to scanning only log data.

Mobile RUM¶

Analysis dashboard added "Crash Analysis", "Stuck Analysis" tab pages.

New Integrations¶

Added Squid integration;
Added Openresty integration;
Added Kafka 4.0 integration;
Added AWS MWAA integration;
Added AWS Step Function State Machine integration;
Added Alibaba Cloud GA integration;
Updated Nginx tracing integration;
Updated AWS OpenSearch monitor/view.

Bug Fixes¶

Fixed the issue where aliases in dashboard grouped table charts did not take effect;
Fixed the issue of incorrect display results in summary charts;
Fixed the issue of Chinese characters appearing when importing dashboards (multiple dashboards - zip file);
Fixed the issue where funnel charts jumping to session lists showed SESSION REPLAY display errors;
Fixed the issue where alerts were still sent despite mute settings;
Fixed the issue of host tags not displaying in Infrastructure;
Fixed the issue where data existed in the Android client explorer but corresponding analysis dashboard charts showed no data for the time period;
Fixed the issue of no connections between services in the service topology map;
Fixed the issue where incorrect alert mute configurations caused all alerts to fail;
Fixed the issue where chart DQL statements returned no results;
Fixed the error reported by testing tasks at the Guangzhou site;
Fixed the issue where importing templates in the Deployment Plan management console did not meet expectations.

August 13, 2025¶

Feature Updates¶

Open API¶

Supports custom roles for Tokens.

RUM¶

To cover query scenarios for application data of different volumes, the system optimized RUM data writing. Accordingly, the following updates were made:

RUM data query drilling down to the application level:
Explorer/Analysis Dashboard: Added application filter at the top of the page, defaulting to "All Applications", supporting custom single or multiple selection; queries are triggered only after selecting applications.
DQL query statements support single or multiple application queries; more usage instructions can be found at RUM Data.

R(app name1)::view:(count_distinct(username))   # Specify querying UV for a specific application name
R(app id1)::view:(count_distinct(username))     # Specify querying UV for a specific application ID
R(*)::view:(count_distinct(username))   # Specify querying UV for all applications in the workspace

Existing users experiencing application data query performance bottlenecks can contact their account manager to enable the "User Access Data Table Splitting" function in the management console. For new users after workspace creation, the system will automatically split data writing based on different applications.

Scenarios¶

Scheduled Reports: Added "Archived Reports": Supports performing full data calculations on dashboards according to set cycles (daily/weekly) and generating static snapshots. Archived results are retained long-term, unaffected by dashboard configuration changes, and can be viewed within the platform or notifications sent as configured.
Dashboard > Log Analysis: Added support for automatically bringing in the dashboard's view variables as filter conditions for display.
Log Stream Graph: Supports querying all data sources within the platform.

Explorer¶

The search bar supports querystring(md5(xxx)) tokenized query method. If data is MD5 encrypted and needs to be searched and located in the explorer after scanning, this method can be used for querying.

DataFlux Func¶

To enhance security protection for DataFlux Func (Automata), the following updates were made:

The "Reset Password" operation was removed from the Automata page in the console, and initial account passwords are no longer sent to email;
For newly created Automata instances, using the Func page for login is disabled by default, only supporting authorized login via console user authorization.
Already installed Automata Func: After upgrading to version 7.2.0 or above, two login methods are supported:
Authorized Studio users can log in directly via the console > DataFlux Func (Automata) interface;
Previously created users in Func (including the initialized admin user) can also log in via the Func page.

APM¶

Trace > Waterfall Details Page/Code Hotspot Tab Page: Resources support one-click expand or collapse;
Topology Map: Added support for displaying "P95 Response Time".

Synthetic Tests¶

Testing Task > Request Body: Supports configuring four types of dynamic variables:

{{ timestamp "ns" }} //1754379375400790109
{{ date "rfc3339" }} // 2006-01-02T15:04:05Z07:00
{{ date "iso8601" }} // 2006-01-02T15:04:05Z
{{ urlencode "hello world" }} // hello+world

Added support for one-click cloning testing tasks.

Monitoring¶

Threshold Detection > Detection Metrics: Supports selecting metric data across workspaces. Subsequently, after the monitor rule is successfully created, cross-workspace alert configuration can be achieved.
Monitor List: After quick filtering monitors, supports cross-page select all and one-click export.

Events¶

For recovery events, added definition of df_fault_end_time extended field as fault recovery time.

DCA¶

List supports selecting all data;
Supports configuring filter conditions based on DataKit version (datakit_ver), operating system (os), environment (env), etc.;
List added environment display.

Management¶

Role Permissions: Added "Client Token View" permission.
Cross-Workspace Authorization: When editing or deleting authorization rules, if data scope or log indices are reduced, a confirmation pop-up appears showing the names of affected monitors and data access configurations, while supporting exporting this list as a CSV file.
System Notifications: Added subscription type – "Monitor": Once a monitor becomes invalid, the system will send email notifications.

New Integrations¶

Added AWS SSM RunCommand integration;
Added AWS EBS integration;
Added AWS ECR integration;
Added AWS EFS integration;
Added TDengine monitor;
Added Milvus K8s view;
Updated Azure cloud billing: EA architecture support;
Rewrote OTEL jvm dashboard: 1._ and 2._ metrics differ (java agent);
Huawei Cloud billing script update: Fixed billing anomalies caused by missing instance IDs;
SIEM templates launched (10 AWS templates);
Optimized AWS MemoryDB;
Optimized Tomcat monitor;
Optimized Tencent Cloud MySQL, supporting cloud disk edition (cloud disk) node dimension metrics, slow log collection;
Optimized Alibaba Cloud Oceanbase collector, supporting supplementary tenant data.

Bug Fixes¶

Fixed the issue of slow log queries recently;
Fixed the issue of inconsistent data performance for resource objects;
Fixed the issue where associated logs in traces showed as 0;
Fixed the error when clicking code hotspots after successful deployment;
Fixed the abnormal data display after scrolling to the bottom of the dashboard log stream graph;
Fixed the import error when importing dashboard JSON due to setting identifier;
Fixed the incorrect jump location for the Resource Catalog official template library;
Fixed the issue where sensitive data scanning configurations did not take effect;
Fixed the issue where count_distinct query results were more than count query results;
Fixed the issue of no data displayed on the trace details page;
Fixed the issue where PromQL statements reported errors, but changing the query time interval did not;
Fixed the issue where the trace service name was not displayed normally;
Fixed the issue where Picture charts could not be modified;
Fixed the issue where cloud billing could not be written in production environments;
Fixed the abnormal display of service topology charts in dashboards;
Fixed the issue of site registration and activation failure;
Fixed the abnormal display of RUM funnel function;
Fixed the issue where after importing dashboards, there was a probability of missing dashboard lists, requiring re-entering the page for complete display;
Fixed the misleading guidance in the interface access guide;
Fixed the 406 - kodo API exception in interface operations;
Fixed the issue where SourceMap file path, environment, and version were correct but source code could not be parsed;
Fixed the abnormal data display in log indices;
Fixed the issue of adding APM guide pages on the page;
Fixed the issue where chart titles displayed variables after sharing charts;
Fixed the issue where service context did not update when clicking different services in the trace flame graph;
Fixed the abnormal search data for fuzzy queries on dashboard view variables;
Fixed the issue of Pipeline script save failure;
Fixed the issue where templates did not take effect after adding SIEM templates, but tags did;
Fixed the topic 404 issue in nsqd logs of the Deployment Plan;
Fixed the issue where popular page performance overview could not display load time normally;
Fixed the issue where .net profile data on the trace details page had no view details button;
Fixed the intermittent issue of no data display for the same DQL expression query;
Fixed the unstable display of infrastructure dependencies in APM;
Fixed the issue where DQL subqueries did not take effect;
Fixed the platform page error after muting events in the Event Center.

July 23, 2025¶

Feature Updates¶

Monitoring¶

SLO
SLO deduction is executed at "second" level frequency;
SLI events added display of corresponding event information generated under the monitor
Details Page added Overview page, with related key metric charts dynamically统计 based on联动 with the time widget in the upper right corner.
Added "SLO Correction" configuration. When SLO is about to be violated due to uncontrollable factors (e.g., infrastructure failure, third-party service interruption), temporary correction mechanisms avoid false alarms while ensuring SLO data audit compliance.
Alert Strategies
Supports cloning alert strategies;
When configuring notification rules based on members, added support for one-click copying member notification configurations.

Event Center¶

The default refresh time for the time widget on the default explorer page is set to refresh every 30 seconds by default;
Alert notifications on the details page no longer display sending status.

Billing¶

Usage Statistics: Added "Backup Log Increment" display,用于统计 daily新增 backup log的数量;
Usage Analysis: Default entry query time adjusted to "Today".

Basic Components¶

For the Shortcut > Snapshot display page:
Supports filtering based on type;
Supports batch delete operations.
Explorer
Search Bar:
- Recent query display count adjusted to 10, saved count adjusted to 50;
- Supports pinning query conditions;
Quick Filter > Workspace Filter Item: After configuring fields, the system automatically adds indices. Simultaneously, in the explorer search bar and chart query dropdown components, an icon identifier is added for these fields.
Details Page: Extended fields added icon identifiers for fields already added to the display column for differentiation.

Infrastructure¶

Database: Added SQL Server data collection type, details page allows viewing all Table related information, including columns, indices, foreign keys.
Resource Catalog: Custom object explorer details page added "Complete Information" tab page.

Metrics¶

Metric Management: Added "Unique Value Count" display for tags,统计 tag values' distinct count globally or under a single metric dimension.

Pipelines¶

One-click Get Sample: Supports specifying data source to obtain test data.

Scenarios > Leaderboard¶

External data source queries support sorting.

Management¶

Data Forwarding: Supports multiple filter conditions as OR;
Token: When replacing Token, added configuration to adjust permission scope, supporting use only for reporting.
Sensitive Data Scanning: Custom rules support lookaround regex test matching
Support Center > Ticket: Added ticket description character limit.

New Integrations¶

Added Huawei Cloud APIG integration;
Added Huawei Cloud SFS Turbo integration;
Optimized Alibaba Cloud ECS integration view;
Updated AWS SQS integration;
Tencent Cloud cloud product collection optimization, supporting multi-dimensional metric collection (Cloud Monitoring V2);
EIP
COS
MySQL
PostgreSQL
MariaDB
TDSQL-C MySQL
TDSQL-C PostgreSQL
Redis
KeeWiDB
MongoDB
Memcached
Huawei Cloud integration related documentation content format adjusted.
Fixed the issue of Chinese appearing in the console's Scene > Dashboards section;
Fixed the issue where some country names in the console's Scene > Dashboards > Create > World Map were displayed in Chinese;
Fixed the issue where if an Issue created by automatic discovery was manually changed to closed or resolved, generating a new Issue would restart the old Issue instead of creating a new one;
Fixed the abnormal display of log explorer status distribution chart;
Fixed the issue where SESSION REPLAY showed as expired;
Fixed the issue of no data when switching Event Center display items to list mode;
Fixed the abnormal frontend display of event data;
Fixed the abnormal data display in RUM explorer Resource data;
Fixed the query error issue for forwarded data;
Fixed the interface exception for /api/v1/inner/alert_opt/get, /api/v1/account/list in Deployment Plan;
Fixed the issue where trace-associated Pod monitoring view template was not updated;
Fixed the abnormal display of data access input data scope filter;
Fixed the issue where PromQL sliced by 1d in time series chart > bar chart returned incorrect time range;
Fixed the issue where PromQL query statements had data within hourly intervals but no data within daily intervals;
Fixed the issue where webpack plugin showed SourceMap file upload success but could not be viewed in the SourceMap list;
Fixed the issue of duplicate Issues generated by Incident > Issue automatic discovery;
Fixed the issue where Prometheus function idelta did not meet expectations;
Fixed the large discrepancy between log explorer query results and DQL query results under the same query conditions;
Fixed the issue where monitors set df_label but events generated had no value for df_label, causing user mute policies not to take effect;
Fixed the issue where IP fields in user access were not effective in Pipeline;
Fixed the error after upgrading kodo-x in private environments;
Fixed the issue where trace details showed "Top Span missing" but the top span actually existed;
Fixed the issue where RUM > Application List could not query application data;
Fixed the issue where the workspace's Billing could not see consumption details;
Fixed the issue where pressing Enter while entering snapshot name in Save Snapshot would directly save;
Fixed the issue of being charged despite monthly log billing usage being 0;
Fixed the display judgment issue for src_ip and dst_ip;
Fixed the occasional display error of log explorer bar charts for the same time interval;
Fixed the usage issue of Incident > search function;
Fixed the issue where Synthetic Tests tasks checked follow direction, but the configuration did not take effect and was cleared upon re-editing;
Fixed the inconsistency between log index query count for multiple days and TLS.

July 9, 2025¶

Feature Updates¶

Billing¶

Introduced a new billing model: Enterprise Plan. This model adopts combined billing of data traffic + total storage volume, more accurately aligning with actual resource consumption in scenarios with extremely high log write volumes, making users' cost structure more transparent and predictable. This mode provides optimized cost-effectiveness for handling massive observability data and is one of the foundational capabilities for building a "globally controllable enterprise-level observability hub."
Within Enterprise Plan workspaces, data retention policies support custom configuration;
To upgrade from the Free Plan to the Enterprise Plan, please contact your account manager.
Commercial Plan:
Usage Statistics, Usage Analysis billing item names adjusted;
Commercial Plan Time Series 180-day, 360-day prices adjusted.

Monitoring¶

Monitor > Threshold Detection: Detection metrics support querying external data sources;
Monitor List: Supports searching and locating based on monitor ID.

Event Center¶

Added Display Items: Supports switching between standard and list mode display.
Change Event > Details Page: Basic Attributes adjusted as follows:
Change Content: Displays df_message content, recording detailed descriptions of resource changes;
Difference Comparison: Displays diff content, recording text differences of resource changes.

Scenarios > Charts¶

SLO Chart: Locked time added "This Year" dynamic time option;
Heat Map:
Added "Metrics" data source type query;
Added Y-axis configuration, supporting Y-axis calculation based on data.

Infrastructure¶

Network > Overview
Supports custom analysis dimensions: By selecting source and target query fields, displays aggregated query data;
Supports cross-workspace network data queries.
Database:
Added Oracle database integration;
For PostgreSQL databases, all Table related information can be viewed, including columns, indices, foreign keys.

Metrics¶

Generate Metrics: Supports different generation rules specifying the same metric name and tags;
Metric Management: Added multi-dimensional time series analysis at the measurement level.

Deployment Plan Updates¶

Workspace List > Index Configuration: Supports configuring data retention policies.

New Integrations¶

Added OpenLLMetry integration;
Added Undertow integration;
Added Cloudflare integration;
Added Huawei Cloud CDM integration;
Added Huawei Cloud DWS integration;
Added Huawei Cloud NAT integration;
Added AWS Transit Gateway integration;
Updated Volcengine ECS monitor, view;
Updated MinIO view, monitor;
Optimized integration Huawei Cloud ASM / CCE;
Optimized integration Alibaba Cloud SAE;
Optimized integration JMX / MQTT.

Bug Fixes¶

Fixed the 404 error when accessing SESSION REPLAY data in SaaS environments via login-free Tokens.
Fixed the issue where Issue automatic discovery configuration content in user access detection was not recognized.
Fixed the issue where events generated by monitoring testing alerts did not display specific association information in event details.
Fixed the issue where modifying tag names after adding tags in global tags prompted duplicate tag names already existing.
Fixed the issue of abnormal DQL query return results.
Fixed the issue where PromQL queries for metrics failed, but DQL queries worked normally.
Fixed the混乱 issue when viewing Deployment > Pod information in multi-cluster scenarios.
Fixed the abnormal display of log status distribution chart.
Fixed the inconsistency between RUM filter time range and time selector, causing inability to view application data.
Fixed the issue where Issue automatic discovery template variables did not take effect in the RUM Error explorer.
Fixed the "Invalid address" error when adding Webhook notification targets.
Fixed the issue of data backlog in base forwarding.
Fixed the abnormal display of log status distribution chart.
Fixed the issue of frequent false alerts caused by DQL query data being 0.
Fixed the issue where base query tools could not sort, slimit was invalid, and pagination failed when querying logs.
Fixed the issue where time series queries出现 time lines不受 filter constraints and without any tags.

June 25, 2025¶

Breaking Changes¶

Extracted df_check_targets, df_check_condition, df_check_rules from the event df_meta field to the same level. Subsequently, in webhook notifications, when df_source = monitor, information such as detection time, detection metrics, detection count, and detection rules from the monitor configuration will be displayed.

Feature Updates¶

External API¶

Added interface index_list_info to query workspace index information list;
Added interface update_index_setting to modify workspace index configuration.

External Data Sources¶

Added integration of PG, Oracle, Clickhouse three external data source types to meet broader data scenario needs.

Logs¶

Added native direct-write index type, allowing direct specification of the write index during data collection for precise classification and storage.

Monitoring¶

Range Detection V2 supports detecting APM, RUM data types;
Mutation Detection > Event Content: Added df_check_detail extended field, supporting output of mutation comparison original values to event details.

Events¶

Alert events triggered based on monitor configuration rules support TOBY AI intelligent analysis.

Infrastructure > Database¶

Added PostgreSQL database integration;
For MySQL databases, all Table related information can be viewed, including columns, indices, foreign keys.

Explorer¶

Search bar added query history record display, click to directly reuse and flexibly modify.

Cloud Account Management¶

Added support for Tencent Cloud, Azure account types.

Scenarios¶

Adjusted Import Dashboard entry,整合原 custom template import functionality,同时支持 batch import of dashboards.
Dashboard page added "Log Analysis" function,无需跳转页面, directly view and analyze related log data in a side-slide new page with one click.

Incident¶

The "Incident" menu on the console left side added "Incident Management" entry,可以直接跳转至 management page.

New Integrations¶

Added Volcengine NAT integration;
Added Ceph integration;
Updated Clickhouse integration;
Huawei Cloud cloud billing script optimization;
Added Tencent Cloud billing;
Added Tencent Cloud WAF integration;
Added Tencent Cloud ES integration;
Added Tencent Cloud cos/cdb/mariadb/postgresql English version views, monitors;
Added AWS Firehose;
Added AWS VPC NAT Gateway integration documentation;
AWS cloud billing script update: T+1 calculation method caused billing inaccuracies for some components (e.g., EC2), adjusted to T-2;
Added Azure cloud billing.

Bug Fixes¶

Fixed the abnormal data display after generating metrics;
Fixed the issue where log content could not load after clicking "Load More" on the log details page;
Fixed the issue where RUM开通链接失效且无报价内容;
Fixed the issue where clicking associated event jumps in Issues could not query data;
Fixed the 406 error when creating Infrastructure liveness detection v2 type monitors;
Fixed the slow loading of SESSION REPLAY pages;
Fixed the issue where Open API creating mute rules did not automatically generate rule names;
Fixed the error when inputting PromQL to query metrics;
Fixed the abnormal display of page error rates;
Fixed the frequent disappearance of host tags;
Fixed the issue where descending order had no effect after adding search conditions to resource invocation leaderboards;
Fixed the issue where after checking "7-day免 MFA login", if MFA was unbound and logged out重新登录, the system did not prompt for重新绑定;
Fixed the issue where empty aliases in exported CSV files from dashboards caused incorrect rendering;
Fixed the issue where monitors did not generate alerts normally, and self-observability logs had query timeout errors;
Fixed the issue where imported fields in the management console were automatically deleted;
Fixed the issue of user experience data loss.

June 11, 2025¶

Feature Updates¶

Billing¶

Added statistical items: Trace write traffic, RUM write traffic, SIEM scan volume; Usage Analysis同步 displays新增 statistical item data.

Scenarios¶

Dashboard > AI Intelligent Analysis: Added support for automatic error discovery and error analysis, further enhancing TOBY AI data processing capabilities.

Monitors¶

Detection frequency supports shortest custom input of 20s, system新增支持 selecting 30s;
APM metric detection, RUM metric detection分别支持 multi-select service, application;

SIEM¶

Official Detection Library launched: The system provides out-of-the-box security information detection template libraries.

Infrastructure > Database¶

Supports cross-workspace data viewing;
Added fields: QPS, TPS, Average Query Duration, Slow Query Log Status, Slow Query Count.

Metrics > Metric Analysis¶

Added Independent Chart mode, suitable for scenarios where multiple queries are added simultaneously and query result units are inconsistent;
Added support for displaying grouped统计总数,同时默认 slimit changed to 50.

Logs > Explorer¶

Stacked Mode added line break toggle;
Context logs support clicking the time column for ascending/descending sorting.

Cloud Account Management¶

Cloud Account type added support for Huawei Cloud.

Management > Environment Variables¶

RUM Android/iOS SDK supports dynamic updates via environment variables.

Query Tools¶

Table charts and metric analysis simple queries both support selecting multiple columns;
DQL quick queries default to simple mode, supporting multi-column configuration queries.

APM¶

ddtrace added package level埋点 configuration. If需要对 package为 com.zy and javax.servlet包下所有的方法进行埋点,则可按照以下方式进行配置 -Ddd.trace.method.packages=com.zy,javax.servlet.

Deployment Plan Updates¶

Mapping Rules added "Append Mapping" toggle. When enabled, accounts using single sign-on will be assigned workspaces and roles according to mapping rules, while原有 workspaces与 roles保持不变.
For workspaces using the ScopeDB engine, supports configuring tenant-level queries.

New Integrations¶

Optimized Tencent Cloud billing script, supporting获取 billing information via sub-account方式;
Added Tencent Cloud billing integration;
Added Tencent Cloud EIP integration documentation;
Added Tencent Cloud CDB monitor (English);
Added Huawei Cloud cloud billing integration;
AWS ELB integration content updated;
AWS LAMBDA integration content updated;
AWS S3 integration content updated;
Added AWS Aurora MySQL integration;
Added AWS Aurora PostgreSQL integration;
Added Hikaricp integration;
TiDB Cloud view optimization;
Added vpc integration;
Added AWS rds postgresql integration.

Bug Fixes¶

Fixed the issue where userid was not displayed in the resource explorer of Singapore site user workspaces;
Fixed the issue where custom reported userid could not be queried via the action explorer;
Fixed the issue of inaccurate AI analysis results in dashboards;
Fixed the issue with Open API获取 time series trend charts;
Fixed the delayed display of data断档 content on the monitor edit page;
Fixed the issue of skipping existing files when uploading SourceMap using webpack plugin;
Fixed the error in quick filters under the network function;
Fixed the issue where filters via variables could not run normally;
Fixed high-risk vulnerabilities from penetration testing;
Fixed dashboard errors in the resource analysis section of the Singapore site user access analysis dashboard;
Fixed the issue of undefined variable values in panel link jumps;
Fixed the issue of no time selector box in the upper right corner of the log explorer;
Fixed the discrepancy between preview chart display data and actual data in monitors (APM);
Fixed the display issue regarding DingTalk and WeChat in emails during cross-workspace authorization;
Fixed the inconsistency between SSO user lists and user details in the management console;
Fixed the display issue of external database data source queries;
Fixed the display issue of trend charts when creating new threshold monitors;
Fixed the search failure when viewing services in APM;
Fixed DQL query errors;
Fixed the issue where daily重复 mute rules did not send mute生效 notifications as expected daily;
Fixed the issue where AI analysis buttons were not visible after entering traces from RUM SESSION REPLAY.

May 28, 2025¶

Open API Updates¶

Incident supports returning associated event count information when listing and getting.

Feature Updates¶

SIEM¶

Detection Rules: Added test, full-screen edit script functionality;
Added Signals explorer;
Added Execution Logs explorer.

Monitoring¶

Alert Strategies > Association: Added selection of SIEM detection rules,同步支持 direct creation.
Edit Monitor Rules > Detection Metrics新增支持 PromQL query preview.
Monitor Rules list:
Import新增支持 "Delete and import monitors with the same name" on the operation page;
Supports one-click export of all monitor rule configurations in the current workspace.
Intelligent Inspection function entry discontinued.

Infrastructure¶

Containers: Added Persistent Volume Claims Explorer.
Added Database Explorer, providing a centralized explorer tool for real-time monitoring of MySQL database performance metrics, resource usage, and log records.
Resource Catalog: Resource Class added Database, and displays the total count of all databases.

Incident¶

Channel > Issue Details Page: Added "Associated Events",可直接点击跳转至 event list for viewing; Issue emails and other sent notification events同步新增 associated event display;
Notification Policy > Issue Escalation: Added event storm option. Can set that when the cumulative number of events associated with an Issue exceeds a specific count, the system sends "repeat" or "once" notification reminders.

Events¶

Unrecovered Events:

Added "Mute" button. Clicking allows direct "Mute" configuration of rules on the current page.
Added "Recover All with One Click" button. Clicking recovers all abnormal events in the current list, with the option to associate with Issues.

APM¶

Flame Graph: Added "Locate to Current Span" function button.

RUM¶

WEB SDK added client time zone recording.
SESSION REPLAY explorer page added client time zone display.
All time widgets统一添加 time zone display.

Scenarios¶

Dashboard > TOBY AI Intelligent Analysis:
Optimized page display效果;
Optimized problem output.
Charts
Time Series Chart: Added hint: Query has exceeded the maximum number of data points for time series charts, only displaying 1,000 data points;
Bar chart mouse hover color adjusted;
Table chart order adjustment optimization: Compatible with PromQL queries.

Metrics¶

Metric Analysis: Added query history and unit configuration.

Management¶

Sensitive Data Masking: Supports one rule configuring masking for multiple fields.
Data Access: Edit page added access site selection.

Explorer > Quick Filter¶

All Explorers:
In Edit Mode, supports modifying "Filter Fields", "Optional Fields";
Added hide field alias function;
When searching fields, if query results have no precise matching value,可以直接创建添加到 "Filter Fields".
Log Explorer:
Two View Modes display adjusted, added "Global Configuration" in "Stacked Mode";
Display Item Configuration adjusted.

Registration¶

Login/Registration page display optimization.

Deployment Plan Updates¶

Configuration Management > Issue Discovery: Rule detection frequency新增支持 1 minute.

New Integrations¶

Added TiDB Cloud integration documentation;
Added Traefik integration documentation;
Added AWS cognito integration;
Added AWS certificatemanager integration;
Added AWS RDS PostgreSQL integration documentation;
Added aliyun rabbitmq integration;
Updated haproxy view and monitor;
Added Huawei Cloud DIS English monitor, view;
Updated AWS ELB application integration documentation, view, added AWS ELB application monitor;
Updated AWS lambda integration documentation, added Lambda抓取 S3 log data operation steps.

Bug Fixes¶

Fixed the issue where generated metric data was not reported normally.
Fixed the issue of tag import failure when calling the Open API import monitor interface.
Fixed the issue of testing tasks not stopping.
Fixed the 406 error when clicking "Context Logs" in log details.
Fixed the cache issue where alertPolicyMemberInfos in the code showed members existed when monitors only configured notification targets without configuring members.
Fixed the issue where saving did not take effect after selecting "Treat result as 0" for data断档 in monitors.
Fixed the failure and error when批量 recovering alerts.
Fixed the issue of inconsistent log explorer query result counts.
Fixed the issue where原有 data was overwritten when批量 modifying monitors via API without configuring extend, rule fields.
Fixed the issue where built-in view templates were not correctly replaced after importing in the management console.
Fixed the issue where one-click获取 key fields in log index configuration did not联动 log explorer stacked mode to display key fields, but displayed based on display items.
Fixed the issue of critical level errors in monitor execution logs.
Fixed the issue where DQL subqueries did not take effect.
Fixed the issue where commas in variable values were not escaped导致填充错误条件 when clicking leaderboard views and selecting to apply to view variables.

May 14, 2025¶

Brand LOGO Change¶

TrueWatch presents a new innovative visual image, showcasing its iterative信念 and technological power in the AI wave.

From this moment on, Obsy will accompany you in洞察 the data world,驾驭 system complexity,走在 the forefront of the AI era.

External API¶

Dashboard: Supports globally importing platform-level dashboards via identifier ID. This operation only updates dashboard configurations and does not affect the binding relationships of this view within each workspace.

Feature Updates¶

Security Monitoring¶

Added SIEM function module: Real-time analysis of logs and event data from various enterprise systems (such as servers, applications, network devices), automatically discovering potential threats, helping teams quickly locate anomalies, fully发挥 security monitoring hub的作用.

Monitoring¶

Alert Strategies:
Association: Supports selecting SIEM detection rules;
Notification Configuration: Added "Security Monitoring" type level.
Monitors: Due to adjustments in data writing for "Infrastructure Change Detection Monitors", old monitors need to be re-saved to avoid affecting event display generated.

Event Center¶

The "Events" function module renamed to "Event Center", interaction page optimized.
Added Event Center explorer, supporting centralized viewing of all event data.
Event recovery added secondary confirmation operation to avoid accidental触发的 scenarios.

Incident¶

After adding schedules in Incident > Calendar, when creating a new Issue or associating a负责人,可以选择 "On-duty Personnel" or "Notification Targets". The system will automatically assign Issue负责人 and notify based on当日 on-duty personnel.

Scenarios¶

Dashboard: Added TOBY AI Intelligent Analysis function.
Time widget logic optimized: When selecting "Relative Time", even if users set refresh frequency to "off", as long as query conditions are modified (e.g., adding/removing conditions using quick filters in explorers, adjusting filter conditions in search boxes, or switching view variables in dashboards/notes), the system will still重新触发查询.

Management¶

Data Forwarding: For the three archive types AWS S3, Huawei Cloud OBS, Alibaba Cloud OSS, added Encrypted Storage selection toggle. When enabled, the system encrypts data forwarded outward.
Audit Events: Added workspace field标记.

Infrastructure¶

Host, Container, Pod, etc. details page built-in pages:
Time Widget: Added Pin function;
Integration Running Status: "View Monitoring View" page optimized;
Associated views added current event occurrence timeline display.
Host Explorer: Default query time adjusted to "Last 2 hours".

Logs¶

Optimized log multi-index matching命中 logic, avoiding计算浪费 caused by逐条 matching index rules.

Deployment Plan Updates¶

Supports creating, deleting, and modifying groups via External API, and adding or removing users in groups;
Workspace Management > Data Retention Policy: Added network storage policy configuration, supporting选择 fixed 2-day storage duration or custom保存 duration.
Added Profile data reporting dynamic parameter toggle. Users can dynamically enable or disable Profile data reporting based on platform performance.
Added API Key configuration and AI function access link configuration toggles, including the following scenarios:
Monitor > Alert Strategies > AI Alert Aggregation
AI Write Pipeline entry
Scenarios > Chart Components > AI Chart Title and Description Generation
Log Explorer > Log details with status error, Logs > Error Tracking > AI Error Analysis entry
RUM > Error Explorer > AI Error Analysis entry
APM > Trace Explorer > Trace details with status error, APM > Error Tracking > Trace Details > AI Error Analysis entry
When editing alert strategies, supports custom repeat alert time. Custom input silence time format examples: 20m (20 minutes), 2h (2 hours), 1d (1 day).

New Integrations¶

Added host-class monitors;
Added MySQL monitor;
Updated CouchDB view and monitor;
Added ActiveMQ integration;
Added AWS SNS integration;
Added Volcengine ESCloud integration;
Added English version Huawei Cloud API, Huawei Cloud CCE monitors and dashboards;
Added Volcengine RabbitMQ integration;
Modified AWS MSK integration metrics.

Bug Fixes¶

Fixed the 413 error when uploading SourceMap via Vite packaging, and SourceMap download errors and TrueWatch inability to display source code error locations.
Fixed the issue where multiple workspace RUM data could not display normally during cross-workspace queries.
Fixed the issue of inaccurate namespace and service display data after selecting self-built log indices in the log explorer.
Fixed the messy page style when creating multi-step tests.
Fixed the issue where quick filter sections in the log explorer could not normally display namespace tag data under multi-index situations.
Fixed the issue of false alerts at the Guangzhou site.
Fixed the abnormality when viewing host details using hosted Doris in version 0409.
Fixed the issue of abnormal external data source query data.
Fixed the重影 display when expanding single logs in log pattern mode.
Fixed the issue where event统计 pages still displayed recovered events.
Fixed the error triggered when clicking the "Batch" button in unrecovered event list display mode.
Fixed the issue where the "Data Forwarding" function一直无法查询 historical logs on S3.
Fixed the issue where FUNC alert message sending logs in version 1.109.196 Volcengine base were reported to business workspaces.

April 23, 2025¶

Breaking Change¶

Testing data storage adjustment: Separated testing data from the original log index,独立建表存储, and added dedicated query Namespace D. This adjustment does not affect historical testing data. If testing data was previously queried via custom charts, please update query configurations promptly. Official testing templates (such as HTTP, ICMP, TCP, WebSocket, Multi-step Test) and related monitors, metric rules have been adapted to this change.

External API¶

Supports adding, modifying, listing specified workspace role lists, member list interfaces;
Optimized interface names and descriptions in OpenAP, External API.

Feature Updates¶

RUM¶

SDK supports environment variable hot updates: Through predefining variable parameters,实现 configuration dynamic updates via environment variable introduction within the application.
Application > New Application: Left-side code examples update in real-time based on user custom parameter configurations,系统会缓存 latest parameter configurations,无需每次重新填写.
Error Explorer: Added support for TOBY AI Error Analysis. Intelligently parses single RUM error logs, automatically extracts key information, and obtains preliminary resolution ideas and suggestions through integrated online search.

Infrastructure¶

Cross-Workspace Authorization: If authorized workspaces exist and the authorized data type is "Basic Objects",可以直接切换 workspace on Infrastructure各 object type explorer pages,实现 object data cross-workspace viewing.
Added "Change Event" tab page,支持基于 Deployments, Daemonsets, Services, Cron Jobs, Statefulsets五种 object type data展示 change details,便于用户回溯 change records.

Monitoring¶

Monitor > Detection Rules: Added "Infrastructure Change Detection". Through continuous monitoring of Kubernetes resource configuration changes (e.g., YAML file modifications), combined with version tracking and intelligent analysis, achieves compliance checks,故障根因定位, and resource usage optimization等效果,最终保障 cluster security, stability, and resource efficiency.
Detection Rules > Event Content > Custom Event Notification Template: Added time automatic conversion template function {{ df_fault_duration | to_date_range_human }}.

Events¶

Added Change Events:
View all event data records triggered based on Infrastructure Change Detection rules.
All Event Details > History Trend: When detection objects have change events, time series charts display change event time nodes, and支持点击后跳转至 change details page.
Event Explorer:
Added "Only Show Unassociated Issue Button", clicking quickly filters out associated events;
Added "Display Items": Supports display preference switching (including list, standard, extended三种方式);

Management¶

Data Forwarding > Data View: Search Component Optimization.

Chart Export¶

Charts support exporting to synchronously created new dashboards or new notes, applicable scope includes:

Metric Analysis
Explorer > List/Dimension Analysis

Explorer¶

Interaction adjustments for basic "List" view and "Dimension Analysis" chart modes;
Dimension Analysis: Added grouped table chart.

Integration¶

In the console left menu, the "Cloud Account Management" function access path adjusted from the original Management interface to under the Integration directory.

Deployment Plan Updates¶

Supports adjusting Login Method (Local Account, LDAP Account, OIDC) order.

New Integrations¶

Added apollo;
Updated Argocd integration documentation, adjusted to kubernetesprometheus collecting metric information;
Updated ingress nginx documentation view monitor;
Neo4j updated dashboard & added monitor;
Added kubelet integration;
Added Azure Virtual Network Gateway integration;
Updated TIDB integration documentation, views and monitor;
Alibaba Cloud 30 components added Automata management.

Bug Fixes¶

Fixed the incorrect member count display on the member management page.
Fixed the untranslated log view time field after switching to the English interface.
Fixed the abnormal label同步 display after switching clusters.
Fixed the issue where卡顿次数 appeared in the User Access Monitoring > Analysis Dashboard > Mobile > Error Analysis page when mobile SDK was not接入,从而影响 user count display异常.
Fixed the timing judgment issue in the Log Explorer > Details Page.

April 9, 2025¶

Open API Updates¶

Supports creating, editing, deleting multi-step testing tasks;
Supports configuring workspace count upper limit restrictions.

Feature Updates¶

Scenarios¶

Chart Optimization
Bar Chart:
- Adjusted Alias position, supports listing all metrics and groups;
- Added X-axis configuration item.
Grouped Table Chart:
- Supports sorting based on group selection;
- Return count dropdown added 200 option, manual input maximum count adjusted to 1,000.
Time Series Chart > Line Chart: Added line "Style" settings, including linear, smooth, step before, step after.
Snapshots: Added permission提示 for dashboard snapshot sharing with configured permissions.
Explorer, Dashboard > Time Widget: Added "Last 1 minute", "Last 5 minutes", default selects the latter.

Management¶

Cross-Workspace Authorization: Supports cross-site data authorization,实现扩展 data sharing.
Data Forwarding:
Data type added "Audit Events".
Adjusted explorer query time logic:
- Changed to daily queries,不支持跨天 queries;
- When viewing forwarded data,系统自动查询并持续加载直至完整显示,无需用户手动点击;
- Management > Workspace Settings > Advanced Settings: Added "Data Forwarding Query Duration" configuration.
Data Access, Pipeline, Blacklist permission split, adjusted "Management" permission to: "Create, Edit" and "Delete".

Monitoring¶

System Notifications: Added associated log jump links, allowing jumps to the log explorer and filtering out logs where notification target sending failed for this notification.
Monitors:
Create from Template > Official Template Library: Added search function;
Configuration Page > Event Content: Updated注意提示. Only when关联异常追踪 is enabled, @ member configuration takes effect and sends event content here to specified members.
Threshold Detection: Added Recovery Conditions toggle,配置 recovery conditions and severity. When query results have multiple values,任意一值满足触发条件则产生 recovery event.

Incident¶

Issue email notification "Source" modified to hyperlink, users can directly访问 by clicking.

RUM¶

SourceMap:

Page interaction adjusted, from original pop-up to separate page;
List page added search, export functions.

TOBY AI¶

Optimized Generate Chart function: Through local Func caching metric management data, generated DQL更加贴近 semantic descriptions.

TOBY AI Error Analysis ¶

Added context support for root cause analysis, helping users更快,更全面理解 error occurrence context,提高诊断效率.

Integration > Extensions¶

DataFlux Func (Automata)/ RUM Headless: Application deduction added email reminders and system notifications.

Infrastructure¶

Host > Details Page: Disk capacity统计区分 local disks and remote disks display.

Deployment Plan Updates¶

Template Management:

Page interaction optimization, including display column added "Template Type"等;
Top filter items added "Template Type";
Supports batch export of templates;
When importing templates, supports previewing template details;
Built-in view, Pipeline, monitor template upload supports同名覆盖 logic.

New Integrations¶

Added GCP Compute Engine;
Added Azure Storage;
Added Azure redis cache;
Added Azure kubernetes;
Added Azure Postgresql;
Added Alibaba Cloud Rds MYSQL Automata integration;
Added Druid integration
Updated Trino;
Adjusted AWS/Alibaba Cloud关于 Automata的 integration documentation: Added Automata开通脚本 steps.

Bug Fixes¶

Fixed the discrepancy between calling Open API获取 unrecovered events and实际情况.
Fixed the error when searching in the event explorer.
Fixed the abnormal external data source data queries.
Fixed related issues with Incident email notifications.
Fixed the slow loading of Incident > Analysis Dashboard.
Fixed incorrect bar chart display colors.
Fixed the issue of no AK提示 for external events.
Fixed the issue where status distribution charts, log volume were not correctly displayed.

March 26, 2025¶

Feature Updates¶

Events¶

Unrecovered Events: Time widget defaults to auto-refresh, manual event recovery成功后新增 frontend page提示.
Event Details: Alert notification page display optimization.
Event, Intelligent Monitoring explorer export appended "Notified or Not" display.

Management¶

Data Forwarding: Added permission configuration. By setting view permissions for forwarded data, effectively提高 data security.

Monitoring¶

Infrastructure Liveness Detection V2: Added configurable detection interval.
Alert Strategies: Notification matching logic adjusted,提升 event execution efficiency in scenarios hitting multiple策略及 complex alert策略.
Notification Targets Management: Added Slack and Teams two notification targets to meet the needs of more global users.

Scenarios¶

View Variables: Supports external data source queries.
Charts:
Added "Monitor Summary" chart, integrating monitor list, displaying latest status,实现即时监测与异常态势感知.
Command Palette: Display optimization;
Chart Query: In DQL queries, when using "wildcard" or "regex", added query suggestion提示.
Explorer, Dashboard > Time Widget: Added "Last 1 minute" and "Last 5 minutes" options.

Billing¶

Added Monthly Bill module,直观展示 monthly consumption total.
Added export bill function.

RUM¶

Application List > New Application: Added "Compressed Upload" and "Custom Hosting Address" parameter configurations.

Synthetic Tests¶

Added "South Africa" and "Hong Kong, China" as testing nodes, further expanding global coverage.

Logs¶

Log Explorer
Quick filter operation items adjusted;
List tokenization logic optimized;
JSON format data added "JSON Search";
Index > Key Fields: Added "One-click Get".

New Integrations¶

Added Azure Network Interfaces;
Added Azure Kubernetes;
Added Azure virtual network gateway;
Improved English integration translations.

Bug Fixes¶

Fixed the low utilization display on the log page.
Fixed the metric unit display issue in Service Map.
Fixed the issue where multiple columns in table charts could not select units.
Fixed the error when exporting CSV from Dashboard > Log Stream Graph with export count other than 1,000.
Fixed the inconsistency between the most popular page's P75 and DQL query results.
Fixed the issue where the time box still showed "Today" after clicking the << button in the time filter.
Fixed the issue where menu management did not meet expectations.
Fixed the abnormal workspace ID filter search in the management console.
Fixed the loss of test samples in the Pipeline interface.
Fixed the excessively long time for configuration migration export function.
Fixed the issue of大量空项 in quick filter tags on the event details interface after upgrade.
Fixed the duplicate detection library list in the monitor official template library, and一旦选中 detection library就无法搜索 other monitors issue.

March 12, 2025¶

Breaking Changes¶

Event df_alert_info field definition adjusted, added alert策略未匹配原因说明, still需要通过 isIgnored做过滤判断获取实际对外发送的 notification targets.

Feature Updates¶

Incident¶

Added Incident Management entry, through which the currently logged-in user can view and manage Incident statuses of all joined workspaces.
Optimized Incident page channel list display,提升 channel过多时的 query efficiency.

Management¶

Cloud Account Management: Added Alibaba Cloud cloud account authorization type.
API Key Management: Added permission control function for API Keys, supporting adding role authorization. Through role authorization, API Keys only have operation permissions within the role scope, thereby effectively reducing security risks.
Data Forwarding: Default interaction changed to not selecting rules.

TOBY AI Error Analysis¶

The following details pages added TOBY AI Error Analysis capability:

error logs
APM > Trace/Error Tracking

Scenarios¶

Scheduled Reports:
Added Webhook sending as a notification method;
Supports sharing dashboard images to WeCom/DingTalk.
Time Series Chart: After selecting area chart as the chart type, added Stacked Mode style,便于观察整体数据的累积效果.

APM¶

Trace: Supports list batch export in JSONL format.

RUM¶

User Analysis > Funnel Analysis: For queried Session lists, supports SESSION REPLAY functionality.

Logs¶

Explorer:
Log Explorer > Index quick filter search bar listing display效果优化;
Log Details > Extended Fields: Added "Perform Dimension Analysis" mode;
Index: Under the index dimension, supports setting专属 Key Fields.

Left side time range selection and right side refresh frequency are independent. Only two situations affect refresh frequency:

Selected time range exceeds 1h
Selected time is absolute time

Infrastructure¶

Hosts: Explorer supports adjusting time range.

Pipeline¶

Configuration page display optimization;
Pipeline processing type added "Events";
Test samples support obtaining JSON format.
Filter Conditions > Synthetic Tests: Supports selecting multi-step tests.

Deployment Plan Updates¶

Template Management: Supports uploading all explorer templates.

New Integrations¶

Added azure_load_balancer;
Rewrote K8S server api;
Updated Gitlab CI;
Translated Volcengine related views;
Translated AWS related views.

Bug Fixes¶

Fixed the issue of no response when exporting log stream graphs to CSV.
Fixed the issue where ddtrace collected JVM metric view variables were runtime-id field, and time series charts added相关筛选后无数据.
Fixed the interface display issue for custom gradient interval color scales.
Fixed the issue where after editing DQL queries in time series charts, selecting filter condition >0 and saving,再次编辑时显示为空.
Fixed the abnormal display of APM > Infrastructure table charts.
Fixed the issue where setting data forwarding storage duration to 1,800 days in the management console was not supported in the前台 forwarding rules.
Fixed the error "kodo service API request error: Service Unavailable" when executing show_object_field(HOST) in quick queries.
Fixed bug issues in Shortcuts.
Fixed the issue where RUM中 session and view had no data, while other resource and action等 had data.
Fixed the issue where multi-step test creation request steps would immediately validate required fields.
Fixed the issue where filter conditions did not take effect when setting role authorization in data access.

February 27, 2025¶

Open API Updates¶

Metrics: Added measurement and tag information获取.

Feature Updates¶

Synthetic Tests¶

HTTP Testing: Supports Script Mode. By writing Pipeline scripts, flexibly customize testing task judgment conditions and data processing logic.
Added Multi-step Test: Allows creating tests using multiple API connection response data, and linking multiple task requests through local variable value passing.

Scenarios¶

Dashboard > Visibility Scope: Added "Custom" configuration,可配置此 dashboard的 "Operation", "View" permissions. Simultaneously this configuration新增 "All Members" option.
Charts:
Added ability to automatically generate chart titles and descriptions based on AI;
Log Stream Graph added "Rule Mapping" function;
Table chart display column optimization;
Grouped Table Chart: Expression results support sorting;
Time series chart, pie chart等多个 tables support data export as CSV files.

Metrics¶

Metric Analysis > Table Chart: When query result return count exceeds 2,000, three modes新增 "Query Result Count" display.
Metric Management: Supports one-click跳转到 metric analysis.
Generate Metrics: Supports import creation方式, supports batch export.

Infrastructure¶

Container/ Pod Explorer: Object data added cpu_usage_by_limit, cpu_usage_by_request, mem_used_percent_base_limit, mem_used_percent_base_request 4 new fields.

APM¶

Profiling > Flame Graph interaction optimization: Selecting a single search method name可直接聚焦定位.
ServiceMap interaction optimization: In upstream/downstream pages, supports searching nodes within the current canvas.

New Integrations¶

Added AWS Cloud Billing;
Added Kube Scheduler;
Added MQTT;
Rewrote APISIX;
Updated tidb English documentation and views;
Updated Zookeeper views,补充 integration icons;
Fixed部分组件 mainfest.yaml English translations.

Bug Fixes¶

Fixed the error display when clicking APM > Trace Details tab pages;
Fixed the issue with incorrect @member in Incident > Issue replies;
Fixed incorrect temperature units in charts.

February 19, 2025¶

Breaking Changes¶

Event df_meta will no longer retain alert_info related information records. Users previously relying on this information to obtain notification targets should switch to using the newly added df_alert_info (event alert notification), df_is_silent (whether muted), df_sent_target_types (event notification target types) 3 fields to complete corresponding functionalities.

Potentially affected functional scenarios:

Custom usage scenarios for integrating with external systems via Open API获取 events
Custom usage scenarios for forwarding events to external systems via Webhook notification targets

Feature Updates¶

PromQL Query¶

Added query type: Instant Query, i.e., querying for a single time point.

Monitoring¶

Monitor configuration page:

Logical matching of trigger conditions added not between option;
Supports directly modifying monitor status ("Enabled" or "Disabled").

APM¶

Trace: Details page added Service Context tab page.

Events¶

Event Details Page: Added support for binding Built-in Views;

Incident¶

Issue added working, closed statuses;
For situations where open status停留超时 and未指定负责人和处理超时, Issue escalation added重复通知配置;
Adjusted Issue system comments, channel notification UI display;
Analysis Dashboard: Added time widget.

Scenarios¶

Chart Link: Added "View Host Monitoring View", default off.
Explorer: Supports deleting fixed name column, users can customize list display.
Cloud Billing Analysis View: Supports viewing billing details.

Management¶

Role Management: SESSION REPLAY View, Audit Events added custom add view permission capability.

Metrics¶

Generate Metrics: Metric name input no longer supports using - hyphen.

Integration¶

Integration cards added description information.

Deployment Plan Updates¶

Template Management: Supports uploading infrastructure explorer templates;
Index Configuration: Deprecated "Backup Logs" item; can configure corresponding storage policy at "Edit Workspace > Data Retention Policy > Data Forwarding-Default Storage".

New Integrations¶

Added Milvus;
Added Volcengine Public IP;
Added opentelemetry-python;
Added openLIT Integration;
Updated k8s\es\mongodb\rabbitmq\oracle\coredns\sqlserver Chinese/English monitors & views.

Bug Fixes¶

Fixed the issue where special characters in AI aggregation notification messages caused result abnormalities;
Fixed the Servicemap Deployment Plan adaptation issue;
Fixed the issue where composite charts could not configure already hidden view variables;
Fixed the混乱 display of "Unrecovered Issue List" in Incident > Analysis Dashboard;
Fixed the inconsistency between the most popular page's P75 results in RUM analysis dashboard and DQL query results;
Fixed the abnormal RUM > Explorer search box issue;
Fixed the issue where in Scenarios > Object Mapping, using Resource Catalog for field mapping, only部分生效 for the same field in dashboards;
Fixed the UI display issue for Monitor > Event Content;
Fixed the issue where quick filter results in the event explorer for unrecovered events did not meet expectations.

January 16, 2025¶

Feature Updates¶

RUM¶

Added Funnel Analysis function: Users can create funnels by defining conversion steps, view data conversion and conduct in-depth analysis;
User Analysis Module Integration: Added User Analysis module, integrating heatmaps and funnel analysis within this module, providing more comprehensive user behavior analysis tools;
Added Mobile SourceMap Restoration: Android and iOS applications support uploading SourceMap files on the page and viewing restored data in the error explorer.

APM¶

When adding services in APM, added installation guide for Host Auto-injection, simplifying the installation process.

Integration¶

DataKit (Data Collection Tool): DataKit installation page added Docker method installation guide, providing more diverse installation options;
External Data Source Optimization: When querying SLS data sources, added query specification hints to help users perform data queries more accurately.

Scenarios¶

Composite Chart Optimization: Composite charts added view variable configuration,支持选取 current dashboard中的 view variables作用于该 composite chart, helping more flexibly filter and analyze data.

Monitoring¶

Mutation Detection Monitor: Added support for week-over-week, month-over-week comparisons of query periods.

TOBY AI¶

Added DataFlux Func related knowledge base.

Pipeline¶

Auto-generate Pipeline Optimization: Supports simultaneously obtaining Pipeline parsing through structured plus natural language方式交互.

Bug Fixes¶

Fixed display issues in log stacked mode;
Fixed the misalignment of function input boxes in log detection monitors;
Fixed incorrect metric calculations;
Fixed the issue where Volcengine did not support having statements;
Fixed the error when selecting "Request Error Rate" and "Average Requests Per Second" two metrics in APM metric detection;
Fixed the issue where not in statements did not take effect in the Volcengine base;
Fixed the issue where event list returned data was too large从而影响 page loading speed;
Fixed the issue where one-click event recovery at the Hangzhou site did not meet expectations.

January 8, 2025¶

Open API Updates¶

Field Management: Supports getting field management list, supports adding/modifying/deleting field management.
Synthetic Tests: Supports modifying testing tasks.
Incident > Schedule: Supports getting schedule list, supports creating/modifying/deleting schedules.
Incident > Configuration Management: Supports getting notification policy list, supports adding/modifying/deleting notification policies; supports getting Issue discovery list, supports creating/modifying/enabling/disabling/deleting Issue discovery configurations.

Feature Updates¶

Logs¶

Log Index Optimization:
When accessing log built-in views, log context tab pages,分别默认选中 current log所在 index, default index,两处 tab pages均支持 index multi-select,同时,在开启了 cross-workspace queries,并在所属菜单选取了 authorized workspaces后, supports directly querying corresponding workspace index data here.最终帮助用户在一个页面完整查看所关联的 log data,优化 log query交互.
When listing log indices,除 default置顶展示之外,其余 log indices按照 A-Z排序列出.
Log Explorer added stacked View Mode: In stacked mode, fields will be整合在同一 column,并且 these fields are presented in rows within the cell. Log information display is more compact and clear,方便用户快速浏览和分析.
Log Pipeline Optimization: Log Pipeline test samples adjusted to获取 log的全部 fields,并且需要以 line protocol format填入.同时用户手动输入的 logs也要遵循 format要求.

Scenarios¶

Table Chart Optimization:
Multi-metric Query Sorting Support: When using one DQL for multi-metric queries, table charts now support sorting.
Table Pagination Selection: Added table pagination selection function, users can choose appropriate pagination size based on data volume and viewing needs.
Composite Chart: Supports adjusting chart order.
Chart Optimization: Adjusted DQL query component function order,同时特别强调了 Rollup function usage scenarios, helping users更好地利用 Rollup function for data aggregation and analysis.

Management¶

Events support configuring Data Forwarding: Supports configuring data forwarding rules for event type, saving event data meeting filter conditions to TrueWatch's object storage and forwarding to external storage, providing flexible management of event data capabilities.
Workspace added DataKit Environment Variables: Workspace supports managing DataKit environment variables, users can easily configure and update environment variables,实现远程同步更新 DataKit collection configuration.
Query Audit Events Optimization: Added multiple fields for recording query information,同时 event content中补充了 query time range,便于追踪和分析 query behavior.

Pipeline¶

Auto-generate Pipeline Optimization: Changed hint appearance方式,优化 product experience.

TOBY AI¶

TOBY AI added Generate Chart: Generate chart function automatically analyzes user-input text data based on large models, intelligently generates suitable charts,解决了手动创建 charts繁琐, chart选择困难等问题.

Monitoring¶

Alert Strategies: Configuring notification rules by member supports appending names for usage description.

Deployment Plan Updates¶

Management Console > Workspace Menu Optimization:
Workspace List added primary storage engine, business two filter items,支持便捷筛选 workspaces;
Optimized workspace list page number return logic, when modifying/deleting a workspace, or modifying workspace data reporting limits, will stay on the current page,以优化 query experience.
Deployment Plan added parameter: alertPolicyFixedNotifyTypes, supports configuring in alert strategies, whether selecting "Email" notification method displays Configuration Reference.

New Integrations¶

Added AWS Gateway Classic ELB;
Added Volcengine TOS Object Storage;
Modified AWS Classic collector name;
Added MinIO V3 integration;
Updated elasticsearch, solr, nacos, influxdb_v2, mongodb integrations (views, documentation, monitors);
Updated kubernetes monitoring views.

Bug Fixes¶

Solved the issue where cross-workspace authorization for event data did not take effect;
Solved the issue where log-associated trace jumps to trace explorer携带 trace_id could not query data;
Solved the issue where view expression queries could not perform numerical filling;
Solved the issue where external event detection monitors did not generate operation audit records when changing alert strategies;
Solved the issue where column widths in event display lists could not be adjusted.