Skip to content

Latest commit

 

History

History
549 lines (401 loc) · 43.8 KB

opensearch-release-notes-1.1.0.md

File metadata and controls

549 lines (401 loc) · 43.8 KB

OpenSearch and Dashboards 1.1.0 Release Notes

Release Highlights

Release Details

OpenSearch and OpenSearch Dashboards 1.1.0 includes the following features, enhancements, bug fixes, infrastructure, documentation, maintenance, and refactoring updates.

OpenSearch Release Notes.

OpenSearch Dashboards Release Notes.

FEATURES

OpenSearch Alerting

  • Add BucketSelector pipeline aggregation extension (#144)
  • Add AggregationResultBucket (#148)
  • Add ActionExecutionPolicy (#149)
  • Refactor Monitor and Trigger to split into Query-Level and Bucket-Level Monitors (#150)
  • Update InputService for Bucket-Level Alerting (#152)
  • Update TriggerService for Bucket-Level Alerting (#153)
  • Update AlertService for Bucket-Level Alerting (#154)
  • Add worksheets to help with testing (#151)
  • Update MonitorRunner for Bucket-Level Alerting (#155)
  • Fix ktlint formatting issues (#156)
  • Execute Actions on runTrigger exceptions for Bucket-Level Monitor (#157)
  • Skip execution of Actions on ACKNOWLEDGED Alerts for Bucket-Level Monitors (#158)
  • Return first page of input results in MonitorRunResult for Bucket-Level Monitor (#159)
  • Add setting to limit per alert action executions and don't save Alerts for test Bucket-Level Monitors (#161)
  • Resolve default for ActionExecutionPolicy at runtime (#165)

OpenSearch Alerting Dashboards Plugin

  • Bucket level alerting create monitor page refactor (#62)
  • Add DefineBucketLevelTrigger component (#63)
  • Refactor CreateTrigger components to support single-page experience (#64)
  • Update CreateMonitor to incorporate new single-page experience (#65)
  • Update Monitor overview page (#66)
  • Alert dashboard table column update (#67)
  • Refactored query and bucket-level trigger definitions to align with new mocks (#68)
  • Alert dashboard update on monitor (#72)
  • Create monitor page, bucket level monitor showing bar graph (#73)
  • Use destination api to validate destination name (#69)
  • Update Monitor Details panel (#75)
  • Flyout panel on alert dashboard page (#78)
  • Add button to refresh graph , add accordion to expand/collapse graph view (#79)
  • Add success toast message for create and update monitor (#80)
  • Refactored trigger condition popover to dropdown menu. Refactored actions panel to hide throttling for 'per execution' (#81)
  • Added Export JSON button and modal to create/edit Monitor page (#82)
  • Added Monitor state EuiHealth element, replaced state item in overview with Monitor level type (#83)
  • Update alert history graph for bucket-level monitors (#84)
  • Refactored query trigger definition components to align with mocks. (#85)
  • Removed the close button from the top-right of the alert dashboard flyout. Refactored monitor details page for anomaly detection monitors. (#86)
  • Several changes in query panel (#87)
  • Implemented test message toast. Fixed alerts dashboard severity display bug. (#88)
  • Refactored Dashboard::getMonitors to function without using the from and size parameters from getAlerts (#89)
  • Query level monitor updates (#90)
  • Changes of metrics expression and graph (#95)
  • Update formik conversion for Bucket-Level Trigger to handle throttle change (#97)
  • Implemented View alert details, and logic for landing page alerts dashboard. (#98)
  • Added limit text, adjusted spacing/sizing/text, etc. (#100)
  • Remove pagination and set default size of alerts pert trigger to 10000 (#99)

OpenSearch Anomaly Detection

  • multi-category support, rate limiting, and pagination (#121)
  • Single flow feature change (#147)
  • Compact rcf integration (#149)

OpenSearch Anomaly Detection Dashboards

  • Add single flow functionality (#63)
  • Support multiple category fields (#66)

OpenSearch Cross Cluster Replication

  • Porting replication plugin to OpenSearch (#8)
  • Pause and Resume API (#10)
  • Leader Stats API (#122)
  • Follower stats API (#126)
  • AutoFollow Stats API Addition (131)

OpenSearch Index Management

  • Storing user information as part of the job when security plugin is installed (#113)
  • Storing user object in all APIs and enabling filter of response based on user (#115)
  • Security improvements (#126)
  • Updating security filtering logic (#137)

OpenSearch Index Management Dashboards Plugin

  • Adds custom label to use with EuiForm component (#40)
  • Adds reusable flyout footer (#41)
  • Adds a small Badge component (#39)
  • Adds legacy notification UI input (#42)
  • Adds draggable action component (#43)
  • Adds notification service to make backend call for getting list of channels for Index Management (#46)
  • Adds new UI for Channel Notification (#44)
  • Adds policy info section for new UI (#45)
  • Adds error notification UI container and updates snapshots (#47)
  • Adds draggable transitions and transition content (#48)
  • Adds UI actions for all the supported ISM actions (#49)
  • Adds individual ISM template UI component (#51)
  • Adds single state UI component (#53)
  • Adds timeout retry settings component used in action flyout (#52)
  • Adds States UI component (#54)
  • Adds ISM Templates UI component (#55)
  • Adds create action container shown in flyout (#56)
  • Adds transition component (#57)
  • Adds create transition container (#59)
  • Adds modal for choosing between visual and json editor (#58)
  • Adds create state container and removes unused props from modal and create transitions (#60)
  • Added PolicySettings and DeleteModal components for PolicyDetails UI (#50)
  • Adds VisualCreatePolicy page, missing backend routes/configs, updates all creation paths to show new modal, updates rates, etc. (#61)
  • Added PolicyDetails page (#62)
  • Register action hook (#64)
  • Fixes policy details page (#80)
  • Removes support for notification channels (#81)

OpenSearch Performance Analyzer

  • AdmissionControl RequestSize AutoTuning (#44)

ENHANCEMENTS

OpenSearch Alerting Dashboards Plugin

  • Show Error Toast Message whenever action execution fails from backend due to incorrect configurations (#22)
  • Bucket level alerting dev UX review feedback (#93)
  • Text updates (#105)

OpenSearch Anomaly Detection

  • Disable model splitting in single-stream detectors (#162)
  • Handle more AD exceptions thrown over the wire/network (#157)
  • support historical analysis for multi-category HC (#159)
  • Limit the max models shown on the stats and profile API (#182)
  • Enable shingle in HCAD (#187)
  • add min score for labeling anomalies to thresholding (#193)
  • support backward compatibility of historical analysis and realtime task (#195)

OpenSearch Anomaly Detection Dashboards

  • Fix BWC for custom & simple filters (#68)
  • Fix BWC for legacy detectors (#69)
  • Enable shingle in HCAD (#71)
  • Change single size description and fix related places (#76)
  • Enable zooming in HC entity charts (#78)
  • Add callouts and make category fields readonly after creation (#79)
  • Tune wording on category field callouts (#83)

OpenSearch Alerting Dashboards Plugin

  • Show Error Toast Message whenever action execution fails from backend due to incorrect configurations (#22)
  • Bucket level alerting dev UX review feedback (#93)
  • Text updates (#105)

OpenSearch Anomaly Detection

  • Disable model splitting in single-stream detectors (#162)
  • Handle more AD exceptions thrown over the wire/network (#157)
  • support historical analysis for multi-category HC (#159)
  • Limit the max models shown on the stats and profile API (#182)
  • Enable shingle in HCAD (#187)
  • add min score for labeling anomalies to thresholding (#193)
  • support backward compatibility of historical analysis and realtime task (#195)

OpenSearch Anomaly Detection Dashboards

  • Fix BWC for custom & simple filters (#68)
  • Fix BWC for legacy detectors (#69)
  • Enable shingle in HCAD (#71)
  • Change single size description and fix related places (#76)
  • Enable zooming in HC entity charts (#78)
  • Add callouts and make category fields readonly after creation (#79)
  • Tune wording on category field callouts (#83)

OpenSearch Cross Cluster Replication

  • Configure the threadpool for leader cluster (#14)
  • Renew retention lease with the last known synced checkpoint (#18)
  • Handling node disconnections and shard movement (#23)
  • Enforce metadata write block on follower indices (#120)
  • Support for storing security metadata and Integration with security plugin (#15)
  • Fix for race condition with snapshot restore (#28)
  • Status api changes (#26)
  • Changed names for assume roles to remote and local from leader and follower (#29)
  • Added preference to fetch the metadata from the primary shard and additional logging for the metadata store (#29)
  • Handling leader cluster disconnection failure scenarios during bootstrap (#17)
  • Support for translog fetch at the leader(remote) cluster and enable translog pruning during replication setup (#25)
  • Added random active shard selector for the getchanges operations (#33)
  • Settings and Alias replication (#22)
  • Rename opendistro endpoints (#36)
  • Added connections alias and doc count in status api (#38)
  • Bootstrapping bug fix and few integ tests. (#41)
  • Adding validation on index settings (#37)
  • Renamed connection alias and changed exception handling (#44)
  • Added non verbose version of status api. (#46)
  • Added replication specific settings for recovery (#46)
  • Add support for parallel reader and writer for ShardReplicationTask (#48)
  • Changes to fail chain replication (#50)
  • Using non null RestoreInProgress value in case of no restore in progress (#54)
  • Not allowing index starting with . for replication (#55)
  • Changing the default recovery chunk size to 10MB (#58)
  • Added reason to the replication metadata store (#57)
  • Propagate shard failures to index task and auto-pause on failures (#56)
  • Propgate 4xx failures from ShardReplicationTask (#60)
  • Bug fixes and autofollow task resiliency (#59)
  • Added permission validation steps at user level and role level (#62)
  • Async metadata update. Separated metadata reader and updater (#52)
  • Validate analyzer path when starting/resuming replication (#64)
  • Prevent starting replication directly on the leader index alias. (#66)
  • Change to stop showing replication related metrics in case of non running (syncing and bootstrap) state. (#68)
  • Integ test for follower index deletion (#68)
  • Adding reason while serializing PauseReplication Request (#71)
  • Add integ test to verify mapping propagation (#72)
  • Integ test to verify that delete/index operation are blocked on follower (#73)
  • Changes to support security plugin integ tests (#70)
  • Integ test: Verify that replication is paused when remote index is deleted (#74)
  • added few integ tests when open and close is triggered on leader index (#77)
  • Integ test to stop replication when remote cluster is unreachable (#69)
  • Moved validation checks after setup checks (#85)
  • Modified tests to use custom roles for default tests (#83)
  • Replication engine tests: Index operations on leader (#79)
  • Add Handling of IndexReplicationTask cancellation and corresponding ITs (#87)
  • Updated security plugin with latest changes (#89)
  • Integ test: forcemerge and snapshot on leader during bootstrap (#76)
  • Validate that soft delete settings is enabled at leader (#84)
  • Adding Security for replication APIs and IT for DLS, FLS or FieldMasking (#90)
  • changed few naming conventions. 1. remote to leader, 2. local to follower, etc (#75)
  • Refactor code for OpenSearch (#98)
  • Port terminology from OpenDistroForElasticsearch to OpenSearch. (#98)
  • Changed the dependency to OS 1.1 (#100)
  • Rename the replication settings (#103)
  • Support for mapping update for the replication store system index (#105)
  • Adding UTs for IndexReplicationTask (#109)
  • OpenSearch Integ tests for reroutes (#114)
  • Adding exp backoff for replay and get changes (#135)
  • Rename to useroles in all the request payloads instead of assumeroles (#154)
  • Initializing shard metric for UT (#141)
  • Changing the log level to debug as this information is surfaced in stats (#149)
  • Pause API should allow reason to be specified in the REST call. (#151)
  • Verifying shard tasks are up in autofollow test (#153)
  • Correcting param name for leader API (#163)
  • Populate "AutoPaused: " prefix in the pause-reason while auto-pausing. (#170)

OpenSearch Dashboards Notebooks

  • Improve wording for sample notebooks (#57)

OpenSearch Index Management

  • Enhance ISM template (#105)

OpenSearch Performance Analyzer

  • Use Collector override disable list for ShardIndexingPressureMetricCollector (#28)
  • Adding metric emission + UT for RCA_FRAMEWORK_CRASH (#36)
  • Replace String split with Guava Splitter (#42)
  • Add master not up writer metric (#51)

OpenSearch Security

  • Added replication specific roles and system index to the configuration (#1408)
  • Handled DLS/FLS/Field masking for replication actions (#1330)
  • Extended role injection support for cross cluster requests (#1195)
  • Added changes to support validation of security roles for plugins (#1367)
  • Adding the default role for IM plugin (#1427)

OpenSearch SQL

  • Support implicit type conversion from string to boolean (#166)
  • Support distinct count aggregation (#167)
  • Support implicit type conversion from string to temporal (#171)
  • Workbench: auto dump cypress test data, support security (#199)

BUG FIXES

OpenSearch Alerting

  • Removing All Usages of Action Get Method Calls and adding the listeners (#130)
  • Fix bug in paginating multiple bucket paths for Bucket-Level Monitor (#163)
  • Various bug fixes for Bucket-Level Alerting (#164)
  • Return only monitors for /monitors/_search (#162)

OpenSearch Anomaly Detection

  • don't replace detector user when update (#126)
  • avoid sending back verbose error message and wrong 500 error to user; fix hard code query size of historical analysis (#150)
  • Bug fixes and unit tests (#177)

OpenSearch Anomaly Detection Dashboards

  • Bug fixes for single flow feature (#77)
  • Clear HC charts when the date range changes (#81)

OpenSearch Asynchronous Search

  • Fix: typo in flag name. (#32)

OpenSearch Cross Cluster Replication

  • Fix submitClusterStateUpdateTask source (#6)
  • Throw exception if replication is not enabled on the remote domain (#86)
  • Increase wait time for snapshot/forcemerge integ tests (#91)
  • Add validation on index name (#92)
  • Remove opendistro security zip (#95)
  • Changes to restore default threadcontext after co-routine is suspended (#102)
  • Remove packaged example as replication plugin will ship with OpenSearch. (#107)
  • Handled errors during test role update (#112)
  • Ignore forbidden APIs to access private members of ES datastructure (#120)
  • Starting missing shard tasks (#114)
  • Fix for RetentionLeaseInvalidRetainingSeqNoException while adding retention lease (#128)
  • Fix IT Test (#137)
  • Fix RetentionLeaseNotFoundException during shard reroute on follower (#138)
  • Fix Flaky integ test (#140)
  • Handled rename change for useroles in tests (#142)
  • Remove the flaky assert in StartReplicationIT (#144)
  • Blocked k-NN index for replication (#158)
  • Gracefully fail replication on bootstrap failure. (#116)

OpenSearch Dashboards Reports

  • Fix url validation (#132)
  • Fix url validation for context menu (#134)

OpenSearch Index Management

  • Removing Usages of Action Get Call and using listeners (#100)
  • Explain response still use old opendistro policy id (#109)
  • Only rollover history index onMaster if enabled (#142)

OpenSearch Index Management Dashboards Plugin

  • Address data stream API security breaking issue (#69)
  • Fix flaky (#76)
  • UI fixes for new ISM UI (#84)
  • Fixes some small UI touchups/issues for new ISM UI (#85)
  • Fixes small issues on new ISM UI (#88)

OpenSearch k-NN

  • Fix copyright in README (#76)

OpenSearch Performance Analyzer

  • Handling empty flow unit during Cache/Queue RCA execution (#34)
  • Fix for OOM error (#35)
  • Fix thread name categorizations for Operation dimension in metrics API (#44)
  • Add privileges for removing files (#45)
  • Fix spotbugs failure by removing unused variable (#47)
  • Change log level and remove retry (#50)
  • Add retries for flaky tests and fix failing tests (#52)
  • Fix deleting files within 60sec interval (#62)

OpenSearch SQL

  • Fix for SQL-ODBC AWS Init and Shutdown Behaviour (#163)
  • Fix import path for cypress constant (#201)

INFRASTRUCTURE

OpenSearch Alerting

  • Add Integtest.sh for OpenSearch integtest setups (#121)
  • Fix snapshot build and increment to 1.1.0 (#142)

OpenSearch Anomaly Detection

  • add deprecated detector type for bwc; add more test cases for historical analysis (#197)
  • Bump OpenSearch core to 1.1 in CI (#212)

OpenSearch Anomaly Detection Dashboards

  • Bump plugin version to 1.1.0.0 (#82)

OpenSearch Asynchronous Search

  • Fix snapshot build and increment to 1.1.0 (#31)

OpenSearch Cross Cluster Replication

  • Add OpenSearch build script (#119)
  • Add basic github workflow for build and test (#123)
  • Modified github workflow to pick the latest changes (#173)

OpenSearch Dashboards Notebooks

  • Fix snapshot build and depend on OpenSearch 1.1. (#62)
  • Bump opensearch ref to 1.1 in CI (#73)

OpenSearch Dashboards Reports

  • Bump opensearch ref to 1.1 in CI (#155)

OpenSearch Dashboards Visualizations

  • Auto dump cypress test data (#23)

OpenSearch Index Management

  • Upgrade dependencies to 1.1 and build snapshot by default. (#121)
  • Update workflow to point to 1.1 (#146)

OpenSearch Job Scheduler

  • Using 1.1 snapshot version for OpenSearch (#48)
  • Use standard snapshot build settings and OpenSearch 1.x. (#49)

OpenSearch k-NN

  • Fix snapshot build, build against OpenSearch 1.1 (#79)

OpenSearch Perftop

  • Update version to 1.1 and add release notes (#17)

OpenSearch SQL

  • Add Integtest.sh for OpenSearch integtest setups (workbench) (#157)
  • Bump path-parse from 1.0.6 to 1.0.7 in /workbench (#178)
  • Use externally-defined OpenSearch version when specified. (#179)
  • Use OpenSearch 1.1 and build snapshot by default in CI. (#181)
  • Workbench: remove curl commands in integtest.sh (#200)
  • Bump opensearch ref to 1.1 in CI (#205)

OpenSearch Trace Analytics

  • Add security support and auto dump test data for cypress (#104)

DOCUMENTATION

OpenSearch Alerting

  • Update Bucket-Level Alerting RFC (#145)

OpenSearch Anomaly Detection

  • Add themed logo to README (#134)

OpenSearch Anomaly Detection Dashboards

  • Add themed logo (#54)

OpenSearch Cross Cluster Replication

  • Add OpenSearch build script (#119)
  • Add basic github workflow for build and test (#123)
  • Modified github workflow to pick the latest changes (#173)

OpenSearch Dashboards Notebooks

  • Update release notes for 1.1.0 release (#71)

OpenSearch Dashboards Visualizations

  • Update copyright notice in readme (#22)

OpenSearch Index Management Dashboards Plugin

  • Adding support to correctly set the dashboards and opensearch endpoint (#33)
  • Documentation url update (#34)
  • Add themed logo to README (#37)

OpenSearch Job Scheduler

  • Add Getting Started to Readme (#50)

OpenSearch Performance Analyzer

  • Add themed logo to README (#40)
  • Fixes typo in APIs to enable PA batch metrics API in readme (#42)

MAINTENANCE

OpenSearch Alerting

  • Remove default assignee (#127)

OpenSearch Alerting Dashboards Plugin

  • Commit the updated yarn lock to maintain consistency. (#26)
  • Add Integtest.sh for OpenSearch integtest setups (#28)
  • Allow for custom endpoints for cypress tests (#29)
  • Add Cypress tests for Bucket-Level Alerting (#91)
  • Update cypress-workflow.yml to use environment variable for OS and OS dashboard versions (#96)
  • Create opensearch-alerting-dashboards-plugin.release-notes-1.1.0.0.md (#101)
  • Update version in package.json (#102)
  • Update jest unit tests (#112)

OpenSearch Dashboards Notebooks

  • Bump version for opensearch 1.1.0 release (#70)

OpenSearch Dashboards Visualizations

  • Bump version for opensearch 1.1.0 release (#24)

OpenSearch Index Management

  • License header check (#142)

OpenSearch Index Management Dashboards Plugin

  • Provide host parameter in integtest.sh (#73)

OpenSearch Job Scheduler

  • Bumping job-scheduler to build with OpenSearch(main) 1.1.0 (#44)

OpenSearch Performance Analyzer

  • Fix snapshot build, upgrade to OpenSearch 1.1 (#55)
  • Add workflow for gauntlet tests and fix spotbug errors (#63)
  • Update version and add release notes for 1.1.0.0 release (#68)

OpenSearch Perftop

  • Bump path-parse from 1.0.6 to 1.0.7 (#16)

OpenSearch Security

  • Upgrade OpenSearch version to 1.1.0 (#1335)
  • Incremented version to 1.1.0.0-SNAPSHOT. (#1429)
  • Remove alerting and ism indices from protected indices usage in sample configuration (#1416)
  • Build against OpenSearch 1.1.0-SNAPSHOT. (#1430)
  • Create release notes 1.1.0.0 (#1440)
  • Switch opensearch from 1.x to 1.1 (#1445)

OpenSearch Security Dashboards Plugin

  • Bump version to 1.1.0.0 (#823)
  • Build OpenSearch 1.1 branch in CI (#827)

OpenSearch Trace Analytics

  • Bump version for opensearch 1.1.0 release (#105)

REFACTORING

OpenSearch Alerting

  • Refactor MonitorRunner (#143)

OpenSearch Performance Analyzer

  • Addressing changes for StatsCollector (#37)
  • Refactor stats collector (#46)