Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] Release version 3.0.0 #3747

Open
15 of 66 tasks
opensearch-trigger-bot bot opened this issue Jul 16, 2023 · 9 comments
Open
15 of 66 tasks

[RELEASE] Release version 3.0.0 #3747

opensearch-trigger-bot bot opened this issue Jul 16, 2023 · 9 comments
Assignees

Comments

@opensearch-trigger-bot
Copy link
Contributor

opensearch-trigger-bot bot commented Jul 16, 2023

Release Status: 3.0.0-alpha1

(Early Integration Phase - Ensure code compilation)

(You can still push feature to 3.0.0-beta1 if not ready by 3.0.0-alpha1)

Release OpenSearch and OpenSearch Dashboards 3.0.0

I noticed that a manifest was automatically created in manifests/3.0.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria Status Description  Comments
Each component release issue has an assigned owner 🟢
Documentation draft PRs are up and in tech review for all component changes 🔴
Sanity testing is done for all components 🔴
Code coverage has not decreased (all new code has tests) 🔴
Release notes are ready and available for all components 🔴
Roadmap is up-to-date (information is available to create release highlights) 🔴
Release ticket is cut, and there's a forum post announcing the start of the window 🔴
Any necessary security reviews are complete 🔴

OpenSearch 3.0.0-alpha1 exit criteria status:

Criteria Status Description  Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions 🔴
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🔴
Documentation has been fully reviewed and signed off by the documentation community. 🔴
All integration tests are passing 🔴
Release blog is ready 🔴

OpenSearch-Dashboards 3.0.0-alpha1 exit criteria status:

Criteria Status Description  Comments
Documentation has been fully reviewed and signed off by the documentation community 🔴
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🔴
All integration tests are passing 🔴
Release blog is ready 🔴

Preparation

Campaigns

Version Increment - (Starts 2025/02/03 Ends 2025/02/18 for 3.0.0-alpha1)

Feature Freeze - (Starts 2025/02/03 Ends 2025/03/03 for 3.0.0-alpha1. Note: if you feature not ready by 3.0.0-alpha1 you can wait until 3.0.0-beta1. However your code must be able to compile for alpha1)

  • OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - (Starts 2025/02/03 Ends 2025/03/03 for 3.0.0-alpha1)

Release Branch, Release Candidate Creation and Testing - (Starts 2025/03/04 for 3.0.0-alpha1)

Performance testing validation - (Starts 2025/03/11 for 3.0.0-alpha1)

  • Post the benchmark-tests
  • Longevity tests do not show any issues.

Pre Release - (2025/03/17 for 3.0.0-alpha1)

Release - (2025/03/18 for 3.0.0-alpha1)

Release Checklist.


Release Checklist

Pre-Release activities

  • Promote Repos.
      • OS
      • OSD
  • Promote Artifacts.
      • Windows
      • Linux Debian
      • Linux RPM
      • Linux TAR
  • Consolidated Release Notes.

Release activities

  • Docker Promotion.
  • Release Validation part 1.
      • OpenSearch and OpenSearch Dashboard Validation.
      • Validate the native plugin installation.
  • Merge consolidated release notes PR.
  • Website and Documentation Changes.
      • Merge staging website PR.
      • Promote the website changes to prod.
      • Add website alert.
  • Release Validation part 2.
      • Validate the artifact download URL's and signatures.
  • Release Validation part 3.
      • Trigger the validation build (Search for Completed validation for <> in the logs).
  • Maven Promotion.
  • Publish blog posts.
  • Advertise on Social Media.
  • Post on public slack and Github Release issue.


Post Release

Components

Replace with links to all component tracking issues.

Component On track Release Notes
{COMPONENT_ISSUE_LINK} {INDICATOR}} {STATUS}

OS:

OSD:

Legend

Symbol Meaning
🟢 On track with overall release
🟡 Missed last milestone
🔴 Missed multiple milestones

  • Update

Issues:

Campaigns:

Dreprecation:

PRs:

Version Bumps alpha1:
(OS)

(OSD)
OSD core vs plugins version table

Open Increment PR: https://github.com/pulls?q=is%3Apr+user%3Aopensearch-project+label%3Av3.0.0+%5BAUTO%5D+Increment+in%3Atitle+is%3Aopen+
Open PRs: https://github.com/pulls?q=is%3Aopen+is%3Apr+archived%3Afalse+user%3Aopensearch-project+label%3Av3.0.0
Open Issues: https://github.com/issues?q=is%3Aopen+is%3Aissue+archived%3Afalse+user%3Aopensearch-project+label%3Av3.0.0
Docs Pending: https://github.com/opensearch-project/documentation-website/issues?q=is%3Aissue+is%3Aopen+label%3Av3.0.0

Gradle 8.10.2 Bump:

Third Party Upgrades:

RFC/Discussion:

@opensearch-trigger-bot opensearch-trigger-bot bot added release untriaged Issues that have not yet been triaged v3.0.0 labels Jul 16, 2023
This was referenced Jul 16, 2023
@opensearch-ci-bot
Copy link
Collaborator

opensearch-ci-bot commented Mar 6, 2025

Core Components CommitID(after 2025-02-11) & Release Notes info

Repo Branch CommitID Commit Date Release Notes Exists
OpenSearch [main] 8ee5eebc 2025-03-14 False
OpenSearch-Dashboards [main] 7915532 2025-03-14 False
alerting [main] d6c838b 2025-03-14 True
alertingDashboards [main] d32321d 2025-03-14 True
anomaly-detection [main] 41db8c0 2025-03-06 True
anomalyDetectionDashboards [main] 262c16d 2025-03-13 True
assistantDashboards [main] 1d14aea 2025-03-15 True
asynchronous-search [main] e1cea9c 2025-02-20 False
common-utils [main] c9c0747 2025-03-10 True
cross-cluster-replication [main] ca5bbd4 2025-03-15 True
custom-codecs [main] 71024d4 2025-03-15 True
customImportMapDashboards [main] 97fd768 2025-03-11 True
flow-framework [main] 1f163e1 2025-03-15 True
flowFrameworkDashboards [main] 1ca0400 2025-03-13 True
functionalTestDashboards [main] 5fe4c27 2025-03-14 False
geospatial [main] 2edfedf 2025-03-12 True
index-management [main] dbaeeac 2025-03-13 True
indexManagementDashboards [main] 1b6c0e8 2025-03-13 True
job-scheduler [main] 0216c3c 2025-03-03 False
k-NN [main] 55b9663 2025-03-13 True
ml-commons [main] c8d1988 2025-03-15 True
mlCommonsDashboards [main] d7f9540 2025-03-13 True
neural-search [main] 57124dd 2025-03-11 True
notifications [main] 830ced9 2025-03-14 True
notifications-core [main] 830ced9 2025-03-14 True
notificationsDashboards [main] 0c4a623 2025-03-14 True
observabilityDashboards [main] ea6e420 2025-03-13 True
opensearch-learning-to-rank-base [main] b809c1d 2025-03-13 True
opensearch-observability [main] da37eec 2025-03-06 True
opensearch-remote-metadata-sdk [main] eac1b5f 2025-03-14 False
opensearch-reports [main] 46c9a40 2025-03-06 True
opensearch-system-templates [main] fef3767 2025-02-27 False
performance-analyzer [main] 468142d 2025-03-04 False
query-insights [main] f3901c5 2025-03-13 False
queryInsightsDashboards [main] 99c8149 2025-03-13 False
queryWorkbenchDashboards [main] 99dd32d 2025-03-13 True
reportsDashboards [main] 2aa4d03 2025-03-13 False
searchRelevanceDashboards [main] deb0894 2025-03-13 True
security [main] 1edc75c 2025-03-13 True
security-analytics [main] f5b7b5f 2025-03-14 True
securityAnalyticsDashboards [main] b405703 2025-03-15 False
securityDashboards [main] f4fdb6c 2025-03-13 True
skills [main] 1b8d93c 2025-03-13 True
sql [main] f805df0 2025-03-13 True

@peterzhuamazon
Copy link
Member

peterzhuamazon commented Mar 7, 2025

See OpenSearch RC 1 and OpenSearch-Dashboards RC 1 details

OpenSearch RC 1 and OpenSearch-Dashboards RC 1 details

## OpenSearch 10901 and OpenSearch-Dashboards 8336 is ready for your test.

OpenSearch - Build 10901
OpenSearch Dashboards - Build 8336

  • Use the following Docker-Compose to setup a cluster

    docker-compose.yml

      
    version: '3'
    services:
      opensearch-node1:
        image: opensearchstaging/opensearch:3.0.0-alpha1.10901
        container_name: opensearch-node1
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node1
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
            hard: 65536
        volumes:
          - opensearch-data1:/usr/share/opensearch/data
        ports:
          - 9200:9200
          - 9600:9600 # required for Performance Analyzer
        networks:
          - opensearch-net
      opensearch-node2:
        image: opensearchstaging/opensearch:3.0.0-alpha1.10901
        container_name: opensearch-node2
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node2
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536
            hard: 65536
        volumes:
          - opensearch-data2:/usr/share/opensearch/data
        networks:
          - opensearch-net
      opensearch-dashboards:
        image: opensearchstaging/opensearch-dashboards:3.0.0-alpha1.8336
        container_name: opensearch-dashboards
        ports:
          - 5601:5601
        expose:
          - "5601"
        environment:
          OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
        networks:
          - opensearch-net
    volumes:
      opensearch-data1:
      opensearch-data2:
    

    networks:
    opensearch-net:

    • Download the above docker-compose.yml on your machine.
    • Get latest image versions docker-compose pull.
    • Start the cluster docker-compose up.
  • OpenSearch docker 3.0.0-alpha1.10901

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch:3.0.0-alpha1.10901 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:3.0.0-alpha1.10901
      • Connect command curl http://localhost:9200/
    • Start with security
      • Docker command
      docker pull opensearchstaging/opensearch:3.0.0-alpha1.10901 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!" opensearchstaging/opensearch:3.0.0-alpha1.10901
      
      • Connect command curl --insecure 'https://admin:myStrongPassword123!@localhost:9200/'
  • OpenSearch-Dashboards docker 3.0.0-alpha1.8336

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:3.0.0-alpha1.8336 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:3.0.0-alpha1.8336
      • URL http://localhost:5601/
    • Start with security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:3.0.0-alpha1.8336 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:3.0.0-alpha1.8336
      • URL http://localhost:5601/
  • Use TARs to deploy OpenSearch Manually

Check how to install opensearch and dashboards on different platforms

Integration Test Results

Thank you

OpenSearch Docker-Scan Results

Workflow run




opensearchstaging/opensearch:3.0.0-alpha1-alpha1 (amazon 2023.6.20250218 (Amazon Linux))
=================================================================================
Total: 0 (UNKNOWN: 0, LOW: 0, MEDIUM: 0, HIGH: 0, CRITICAL: 0)




OpenSearch-Dashboards Docker-Scan Results

Workflow run




opensearchstaging/opensearch-dashboards:3.0.0-alpha1-alpha1 (amazon 2023.6.20250218 (Amazon Linux))
============================================================================================
Total: 0 (UNKNOWN: 0, LOW: 0, MEDIUM: 0, HIGH: 0, CRITICAL: 0)


Node.js (node-pkg)
==================
Total: 3 (UNKNOWN: 0, LOW: 1, MEDIUM: 2, HIGH: 0, CRITICAL: 0)

┌────────────────────────┬────────────────┬──────────┬──────────┬───────────────────┬───────────────┬───────────────────────────────────────────────────────────┐
│        Library         │ Vulnerability  │ Severity │  Status  │ Installed Version │ Fixed Version │                           Title                           │
├────────────────────────┼────────────────┼──────────┼──────────┼───────────────────┼───────────────┼───────────────────────────────────────────────────────────┤
│ cookie (package.json)  │ CVE-2024-47764 │ LOW      │ fixed    │ 0.5.0             │ 0.7.0         │ cookie: cookie accepts cookie name, path, and domain with │
│                        │                │          │          │                   │               │ out of bounds...                                          │
│                        │                │          │          │                   │               │ https://avd.aquasec.com/nvd/cve-2024-47764                │
├────────────────────────┼────────────────┼──────────┼──────────┼───────────────────┼───────────────┼───────────────────────────────────────────────────────────┤
│ prismjs (package.json) │ CVE-2024-53382 │ MEDIUM   │ affected │ 1.27.0            │               │ Prism (aka PrismJS) through 1.29.0 allows DOM Clobbering  │
│                        │                │          │          │                   │               │ (with resulta ...                                         │
│                        │                │          │          │                   │               │ https://avd.aquasec.com/nvd/cve-2024-53382                │
│                        │                │          │          ├───────────────────┼───────────────┤                                                           │
│                        │                │          │          │ 1.29.0            │               │                                                           │
│                        │                │          │          │                   │               │                                                           │
│                        │                │          │          │                   │               │                                                           │
└────────────────────────┴────────────────┴──────────┴──────────┴───────────────────┴───────────────┴───────────────────────────────────────────────────────────┘



@peterzhuamazon
Copy link
Member

See OpenSearch RC 3 details (OpenSearch Dashboards still pending on issue opensearch-project/security-analytics-dashboards-plugin#1185)

OpenSearch RC 3 details

## OpenSearch 10918 is ready for your test.

OpenSearch - Build 10918

  • OpenSearch docker 3.0.0-alpha1.10918

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch:3.0.0-alpha1.10918 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:3.0.0-alpha1.10918
      • Connect command curl http://localhost:9200/
    • Start with security
      • Docker command
      docker pull opensearchstaging/opensearch:3.0.0-alpha1.10918 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!" opensearchstaging/opensearch:3.0.0-alpha1.10918
      
      • Connect command curl --insecure 'https://admin:myStrongPassword123!@localhost:9200/'
  • Use TARs to deploy OpenSearch Manually

Check how to install opensearch and dashboards on different platforms

Integration Test Results

Pending

Thank you

OpenSearch Docker-Scan Results

Workflow run




opensearchstaging/opensearch:3.0.0-alpha1 (amazon 2023.6.20250303 (Amazon Linux))
=================================================================================
Total: 0 (UNKNOWN: 0, LOW: 0, MEDIUM: 0, HIGH: 0, CRITICAL: 0)





@peterzhuamazon
Copy link
Member

peterzhuamazon commented Mar 14, 2025

Hi All,

We have a No Go for 3.0.0-alpha1 :

Thanks.

@rishabh6788
Copy link
Collaborator

3.0.0-alpha1 Performance Report

There is no significant improvement or regression in indexing performance in 3.0.0-alpha1 compared to 2.19.1.
A few search queries have regressed which is being tracked in multiple issues, see https://github.com/opensearch-project/OpenSearch/issues?q=is%3Aissue%20state%3Aopen%20performance%20author%3Aexpani.

HTTP_LOGS

Image

NYC_TAXIS

Image

PMC

Image

PERCOLATOR

Image

BIG5

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: 🏗 In progress
Status: In Progress
Development

No branches or pull requests

7 participants