From a2ae1f925bce1706f3d11903a08dc3b29cb6f32c Mon Sep 17 00:00:00 2001 From: Luca Cinquini Date: Tue, 9 Apr 2024 16:54:45 -0600 Subject: [PATCH 1/2] Updating the date for Release 2.0.0 in CHANGELOG.md --- CHANGELOG.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 268c697..4000d19 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -6,7 +6,7 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). -------- -# [Unity Release 24.1] - 2024-04-04 +# [Unity Release 24.1] - 2024-04-09 ## Tag Version 2.0.0 From 9eebd12f882a77fbc2658bb9feb02ba6cc06f73a Mon Sep 17 00:00:00 2001 From: Drew Meyers Date: Wed, 10 Apr 2024 08:33:32 -0700 Subject: [PATCH 2/2] Fix changelog --- CHANGELOG.md | 296 +++++++++++++++++++++++++++------------------------ 1 file changed, 156 insertions(+), 140 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 4000d19..6b29505 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -6,27 +6,30 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). -------- + # [Unity Release 24.1] - 2024-04-09 ## Tag + Version 2.0.0 -## Repositories: -- unity-sps: https://github.com/unity-sds/unity-sps/releases/tag/2.0.0 -- unity-sps-api: https://github.com/unity-sds/unity-sps/releases/tag/2.0.0 +## Repositories + +- unity-sps: +- unity-sps-ogc-processes-api: ## Epics - EPIC: `Airflow Deployment` - - [[New Feature]: Deploy EKS to MCP venues with Terraform](https://github.com/unity-sds/unity-sps/issues/28) - - [[New Feature]: Deploy Airflow to MCP venues with Terraform (no adaptation yet)](https://github.com/unity-sds/unity-sps/issues/29) - - [[New Feature]: Create a CWL Operator or simply a CWL DAG to execute a CWL workflow](https://github.com/unity-sds/unity-sps/issues/31) - - [[New Feature]: Using shared disk space for inter-task communication](https://github.com/unity-sds/unity-sps/issues/32) - - [[New Feature]: Implement autoscaling of Kubernetes pods on a given set of worker nodes](https://github.com/unity-sds/unity-sps/issues/33) - - [[Task] Migrate the new SPS with Airflow code to unity-sps repository](https://github.com/unity-sds/unity-sps/issues/34) - - [[New Feature] Allow choosing EC2 types when deploying an EKS cluster](https://github.com/unity-sds/unity-sps/issues/35) - - [[New Feature]: Allow propagation of permissions to Docker containers](https://github.com/unity-sds/unity-sps/issues/8) - - [[New feature] Add Terraform parameters to customize the amount of disk available to each Pod](https://github.com/unity-sds/unity-sps/issues/36) + - [[New Feature]: Deploy EKS to MCP venues with Terraform](https://github.com/unity-sds/unity-sps/issues/28) + - [[New Feature]: Deploy Airflow to MCP venues with Terraform (no adaptation yet)](https://github.com/unity-sds/unity-sps/issues/29) + - [[New Feature]: Create a CWL Operator or simply a CWL DAG to execute a CWL workflow](https://github.com/unity-sds/unity-sps/issues/31) + - [[New Feature]: Using shared disk space for inter-task communication](https://github.com/unity-sds/unity-sps/issues/32) + - [[New Feature]: Implement autoscaling of Kubernetes pods on a given set of worker nodes](https://github.com/unity-sds/unity-sps/issues/33) + - [[Task] Migrate the new SPS with Airflow code to unity-sps repository](https://github.com/unity-sds/unity-sps/issues/34) + - [[New Feature] Allow choosing EC2 types when deploying an EKS cluster](https://github.com/unity-sds/unity-sps/issues/35) + - [[New Feature]: Allow propagation of permissions to Docker containers](https://github.com/unity-sds/unity-sps/issues/8) + - [[New feature] Add Terraform parameters to customize the amount of disk available to each Pod](https://github.com/unity-sds/unity-sps/issues/36) - EPIC: `SBG Venue Deployment` - [[New Feature]: Execution of available SBG worflows](https://github.com/unity-sds/unity-sps/issues/38) - [[New Feature]: https://github.com/unity-sds/unity-sps/issues/39](https://github.com/unity-sds/unity-sps/issues/39) @@ -39,76 +42,78 @@ Version 2.0.0 - [[Task]: Update the SPS documentation for administrators](https://github.com/unity-sds/unity-sps/issues/44) ## Docker Containers + - ghcr.io/unity-sds/unity-sps/sps-airflow:2.0.0 - ghcr.io/unity-sds/unity-sps/sps-docker-cwl:2.0.0 - ghcr.io/unity-sds/unity-sps-ogc-processes-api/unity-sps-ogc-processes-api:2.0.0 - ## Documentation + - [SPS EKS Cluster Provisioning with Terraform](https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/admin-guide/sps-eks-cluster-provisioning-with-terraform) - [SPS Airflow Deployment with Terraform](https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/admin-guide/sps-airflow-deployment-with-terraform) - [SPS Airflow Custom Docker Image Build Instructions](https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/admin-guide/sps-airflow-custom-docker-image-build-instructions) - -------- # [Unity Release 23.3] - 2023-09-29 -## Repositories: -- unity-sps-prototype: https://github.com/unity-sds/unity-sps-prototype/releases/tag/1.2.0 -- unity-sps-api: https://github.com/unity-sds/unity-sps-api/releases/tag/1.2.0 -- unity-sps-register_job: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.2.0 -- unity-sps-workflows: https://github.com/unity-sds/unity-sps-workflows/releases/tag/1.2.0 -- ades_wpst: https://github.com/unity-sds/ades_wpst/releases/tag/1.2.0 -- unity-sps : https://github.com/unity-sds/unity-sps/releases/tag/1.2.0 +## Repositories + +- unity-sps-prototype: +- unity-sps-api: +- unity-sps-register_job: +- unity-sps-workflows: +- ades_wpst: +- unity-sps : ## Epics - EPIC: `workflow metadata` - - [unity-sps-prototype #210] [New Feature]: Store arbitrary labels in the Jobs Database - - [https://github.com/unity-sds/unity-sps-prototype/issues/210](https://github.com/unity-sds/unity-sps-prototype/issues/210) - - [unity-sps-prototype #211] [New Feature]: Query the Jobs Metadata by arbitrary labels - - [https://github.com/unity-sds/unity-sps-prototype/issues/211](https://github.com/unity-sds/unity-sps-prototype/issues/211) - - [unity-sps-prototype #217] [Risk]: Evaluate scalability of WPS-T API for querying the Jobs Database - - [https://github.com/unity-sds/unity-sps-prototype/issues/217](https://github.com/unity-sds/unity-sps-prototype/issues/217) + - [unity-sps-prototype #210] [New Feature]: Store arbitrary labels in the Jobs Database + - [https://github.com/unity-sds/unity-sps-prototype/issues/210](https://github.com/unity-sds/unity-sps-prototype/issues/210) + - [unity-sps-prototype #211] [New Feature]: Query the Jobs Metadata by arbitrary labels + - [https://github.com/unity-sds/unity-sps-prototype/issues/211](https://github.com/unity-sds/unity-sps-prototype/issues/211) + - [unity-sps-prototype #217] [Risk]: Evaluate scalability of WPS-T API for querying the Jobs Database + - [https://github.com/unity-sds/unity-sps-prototype/issues/217](https://github.com/unity-sds/unity-sps-prototype/issues/217) - EPIC: `chirp-workflow-execution` - - [unity-sps-workflows #8] [Dependency]: Stub implementation for CHIRP workflow - - [https://github.com/unity-sds/unity-sps-workflows/issues/8](https://github.com/unity-sds/unity-sps-workflows/issues/8) - - [unity-sps-workflows #10] [Dependency]: Docker container for execution of CHIRP rebinning PGE - - [https://github.com/unity-sds/unity-sps-workflows/issues/10](https://github.com/unity-sds/unity-sps-workflows/issues/10) - - [unity-sps-workflows #11] [Dependency]: Full implementation of CHIRP workflow - - [https://github.com/unity-sds/unity-sps-workflows/issues/11](https://github.com/unity-sds/unity-sps-workflows/issues/11) - - [unity-sps-workflows #12] [Dependency]: Docker container for CMR search - - [https://github.com/unity-sds/unity-sps-workflows/issues/12](https://github.com/unity-sds/unity-sps-workflows/issues/12) - - [unity-sps-workflows #13] [Dependency]: Docker container for Cataloging - - [https://github.com/unity-sds/unity-sps-workflows/issues/13](https://github.com/unity-sds/unity-sps-workflows/issues/13) - - [unity-sps-workflows #14] [Risk]: Processing large data volumes with CWL and Docker - - [https://github.com/unity-sds/unity-sps-workflows/issues/14](https://github.com/unity-sds/unity-sps-workflows/issues/14) - - [unity-sps-prototype #192 ] [New Feature]: Add an optional PVC to an SPS deployment - - [https://github.com/unity-sds/unity-sps-prototype/issues/192](https://github.com/unity-sds/unity-sps-prototype/issues/192) - - [unity-sps-prototype #195] [Dependency]: Docker container for stage-in step - - [https://github.com/unity-sds/unity-sps-prototype/issues/195](https://github.com/unity-sds/unity-sps-prototype/issues/195) - - [unity-sps-prototype #227] [New Feature]: Use stage EFS as data temporary location for CHIRP execution - - [https://github.com/unity-sds/unity-sps-prototype/issues/227](https://github.com/unity-sds/unity-sps-prototype/issues/227) + - [unity-sps-workflows #8] [Dependency]: Stub implementation for CHIRP workflow + - [https://github.com/unity-sds/unity-sps-workflows/issues/8](https://github.com/unity-sds/unity-sps-workflows/issues/8) + - [unity-sps-workflows #10] [Dependency]: Docker container for execution of CHIRP rebinning PGE + - [https://github.com/unity-sds/unity-sps-workflows/issues/10](https://github.com/unity-sds/unity-sps-workflows/issues/10) + - [unity-sps-workflows #11] [Dependency]: Full implementation of CHIRP workflow + - [https://github.com/unity-sds/unity-sps-workflows/issues/11](https://github.com/unity-sds/unity-sps-workflows/issues/11) + - [unity-sps-workflows #12] [Dependency]: Docker container for CMR search + - [https://github.com/unity-sds/unity-sps-workflows/issues/12](https://github.com/unity-sds/unity-sps-workflows/issues/12) + - [unity-sps-workflows #13] [Dependency]: Docker container for Cataloging + - [https://github.com/unity-sds/unity-sps-workflows/issues/13](https://github.com/unity-sds/unity-sps-workflows/issues/13) + - [unity-sps-workflows #14] [Risk]: Processing large data volumes with CWL and Docker + - [https://github.com/unity-sds/unity-sps-workflows/issues/14](https://github.com/unity-sds/unity-sps-workflows/issues/14) + - [unity-sps-prototype #192 ] [New Feature]: Add an optional PVC to an SPS deployment + - [https://github.com/unity-sds/unity-sps-prototype/issues/192](https://github.com/unity-sds/unity-sps-prototype/issues/192) + - [unity-sps-prototype #195] [Dependency]: Docker container for stage-in step + - [https://github.com/unity-sds/unity-sps-prototype/issues/195](https://github.com/unity-sds/unity-sps-prototype/issues/195) + - [unity-sps-prototype #227] [New Feature]: Use stage EFS as data temporary location for CHIRP execution + - [https://github.com/unity-sds/unity-sps-prototype/issues/227](https://github.com/unity-sds/unity-sps-prototype/issues/227) - EPIC: `no magic` - - [unity-sps-prototype #132] As a user, i want to be explicit about inputs into my process execution (no magic)! - - [https://github.com/unity-sds/unity-sps-prototype/issues/132](https://github.com/unity-sds/unity-sps-prototype/issues/132) - - [unity-sps-prototype #157] [New Feature]: Pass environment variables to a Docker container execution - - [https://github.com/unity-sds/unity-sps-prototype/issues/157](https://github.com/unity-sds/unity-sps-prototype/issues/157) + - [unity-sps-prototype #132] As a user, i want to be explicit about inputs into my process execution (no magic)! + - [https://github.com/unity-sds/unity-sps-prototype/issues/132](https://github.com/unity-sds/unity-sps-prototype/issues/132) + - [unity-sps-prototype #157] [New Feature]: Pass environment variables to a Docker container execution + - [https://github.com/unity-sds/unity-sps-prototype/issues/157](https://github.com/unity-sds/unity-sps-prototype/issues/157) - EPIC: `sps-improvements-23.3` - - [unity-sps-prototype #221] [Dependency]: Tagging U-SPS resources - - [https://github.com/unity-sds/unity-sps-prototype/issues/221](https://github.com/unity-sds/unity-sps-prototype/issues/221) - - [unity-sps-prototype #222] [Dependency]: Add SPS API URL to the SSM store - - [https://github.com/unity-sds/unity-sps-prototype/issues/222](https://github.com/unity-sds/unity-sps-prototype/issues/222) - - [unity-sps-prototype #230] [Bug]: One SPS deployment can accidentally execute another SPS deployments deployed process containers - - [https://github.com/unity-sds/unity-sps-prototype/issues/230](https://github.com/unity-sds/unity-sps-prototype/issues/230) + - [unity-sps-prototype #221] [Dependency]: Tagging U-SPS resources + - [https://github.com/unity-sds/unity-sps-prototype/issues/221](https://github.com/unity-sds/unity-sps-prototype/issues/221) + - [unity-sps-prototype #222] [Dependency]: Add SPS API URL to the SSM store + - [https://github.com/unity-sds/unity-sps-prototype/issues/222](https://github.com/unity-sds/unity-sps-prototype/issues/222) + - [unity-sps-prototype #230] [Bug]: One SPS deployment can accidentally execute another SPS deployments deployed process containers + - [https://github.com/unity-sds/unity-sps-prototype/issues/230](https://github.com/unity-sds/unity-sps-prototype/issues/230) - EPIC: `workflow-label-inputs` - - [unity-sps-prototype #160] [New Feature]: Pass arbitrary labels when requesting a job execution - - [https://github.com/unity-sds/unity-sps-prototype/issues/160](https://github.com/unity-sds/unity-sps-prototype/issues/160) - - [unity-sps-prototype #181] [Risk]: Define how labels should be specified during workflow submission - - [https://github.com/unity-sds/unity-sps-prototype/issues/181](https://github.com/unity-sds/unity-sps-prototype/issues/181) + - [unity-sps-prototype #160] [New Feature]: Pass arbitrary labels when requesting a job execution + - [https://github.com/unity-sds/unity-sps-prototype/issues/160](https://github.com/unity-sds/unity-sps-prototype/issues/160) + - [unity-sps-prototype #181] [Risk]: Define how labels should be specified during workflow submission + - [https://github.com/unity-sds/unity-sps-prototype/issues/181](https://github.com/unity-sds/unity-sps-prototype/issues/181) ## Docker Containers + - ghcr.io/unity-sds/unity-sps-prototype/hysds-core:unity-v1.2.0 - ghcr.io/unity-sds/unity-sps-prototype/hysds-ui-remote:unity-v1.2.0 - ghcr.io/unity-sds/unity-sps-prototype/hysds-mozart:unity-v1.2.0 @@ -126,14 +131,15 @@ Version 2.0.0 - busybox:1.36.0 ## Documentation + - Tutorial on using the WPS-T API to register an application package and to execute a job - - https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/tutorial-execution-of-the-l1b-cwl-workflow-via-the-wps-t-api + - - SPS API with examples - - https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/users-guide/unity-sps-api + - - Tutorial on pre-warming a U-SPS cluster - - https://unity-sds.gitbook.io/docs/~/changes/TMwRbPjXYqq9MCfmRi31/developer-docs/science-processing/docs/developers-guide/manual-verification-testing-the-sps-prewarm-api + - - Description of the Jobs Database: architecture and usage - - https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/the-jobs-database#how-jobs-are-updated-in-the-database + - ## Deployments @@ -141,48 +147,50 @@ Version 2.0.0 # [Unity Release 23.2] - 2023-07-14 -## Repositories: -- unity-sps : https://github.com/unity-sds/unity-sps/releases/tag/1.1.0 -- unity-sps-prototype: https://github.com/unity-sds/unity-sps-prototype/releases/tag/1.1.0 -- unity-sps-api: https://github.com/unity-sds/unity-sps-api/releases/tag/1.1.0 -- unity-sps-register_job: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.1.0 -- unity-sps-workflows: https://github.com/unity-sds/unity-sps-workflows/releases/tag/1.1.0 -- ades_wpst: https://github.com/unity-sds/ades_wpst/releases/tag/1.1.0 +## Repositories + +- unity-sps : +- unity-sps-prototype: +- unity-sps-api: +- unity-sps-register_job: +- unity-sps-workflows: +- ades_wpst: -## Epics: +## Epics - EPIC #7: `jobs-database` - - [unity-sps-prototype #185] [Epic]: Implement Jobs Database - - [https://github.com/unity-sds/unity-sps-prototype/issues/185](https://github.com/unity-sds/unity-sps-prototype/issues/185) - - [unity-sps-prototype #186] [New Feature]: Send SNS message for job creation task - - [https://github.com/unity-sds/unity-sps-prototype/issues/186](https://github.com/unity-sds/unity-sps-prototype/issues/186) - - [unity-sps-prototype #187] [New Feature]: Send SNS message for job completion task - - [https://github.com/unity-sds/unity-sps-prototype/issues/187](https://github.com/unity-sds/unity-sps-prototype/issues/187) - - [unity-sps-prototype #188] [New Feature]: Consume SNS message for job creation task and job completion tasks - - [https://github.com/unity-sds/unity-sps-prototype/issues/188](https://github.com/unity-sds/unity-sps-prototype/issues/188) - - [unity-sps-prototype #189] [New Feature]: Deploy jobs database - - [https://github.com/unity-sds/unity-sps-prototype/issues/189](https://github.com/unity-sds/unity-sps-prototype/issues/189) - - [unity-sps-prototype #193) [New Feature]: Create SNS topic, SQS queue and Lambda function for Jobs Database as part of U-SPS deployment - - [https://github.com/unity-sds/unity-sps-prototype/issues/193](https://github.com/unity-sds/unity-sps-prototype/issues/193) - - [unity-sps-prototype $194] [Bug]: Prevent duplicate documents in jobs database - - [https://github.com/unity-sds/unity-sps-prototype/issues/194](https://github.com/unity-sds/unity-sps-prototype/issues/194) + - [unity-sps-prototype #185] [Epic]: Implement Jobs Database + - [https://github.com/unity-sds/unity-sps-prototype/issues/185](https://github.com/unity-sds/unity-sps-prototype/issues/185) + - [unity-sps-prototype #186] [New Feature]: Send SNS message for job creation task + - [https://github.com/unity-sds/unity-sps-prototype/issues/186](https://github.com/unity-sds/unity-sps-prototype/issues/186) + - [unity-sps-prototype #187] [New Feature]: Send SNS message for job completion task + - [https://github.com/unity-sds/unity-sps-prototype/issues/187](https://github.com/unity-sds/unity-sps-prototype/issues/187) + - [unity-sps-prototype #188] [New Feature]: Consume SNS message for job creation task and job completion tasks + - [https://github.com/unity-sds/unity-sps-prototype/issues/188](https://github.com/unity-sds/unity-sps-prototype/issues/188) + - [unity-sps-prototype #189] [New Feature]: Deploy jobs database + - [https://github.com/unity-sds/unity-sps-prototype/issues/189](https://github.com/unity-sds/unity-sps-prototype/issues/189) + - [unity-sps-prototype #193) [New Feature]: Create SNS topic, SQS queue and Lambda function for Jobs Database as part of U-SPS deployment + - [https://github.com/unity-sds/unity-sps-prototype/issues/193](https://github.com/unity-sds/unity-sps-prototype/issues/193) + - [unity-sps-prototype $194] [Bug]: Prevent duplicate documents in jobs database + - [https://github.com/unity-sds/unity-sps-prototype/issues/194](https://github.com/unity-sds/unity-sps-prototype/issues/194) - EPIC #10: `chirp-workflow-execution` - - [unity-sps-workflows #8] [Dependency]: Stub implementation for CHIRP workflow - - [https://github.com/unity-sds/unity-sps-workflows/issues/8](https://github.com/unity-sds/unity-sps-workflows/issues/8) - - [unity-sps-workflows #12] [Dependency]: Docker container for CMR search - - [https://github.com/unity-sds/unity-sps-workflows/issues/12](https://github.com/unity-sds/unity-sps-workflows/issues/12) - - [unity-sps-workflows #14] [Risk]: Processing large data volumes with CWL and Docker - - [https://github.com/unity-sds/unity-sps-workflows/issues/14](https://github.com/unity-sds/unity-sps-workflows/issues/14) - - [unity-sps-prototype #192] [New Feature]: Add an optional PVC to an SPS deployment - - [https://github.com/unity-sds/unity-sps-prototype/issues/192](https://github.com/unity-sds/unity-sps-prototype/issues/192) -- EPIC #1: `min/max scaling` - - [unity-sps-prototype #141] As a project Manager, i want to set maximum and minimum limits on scaling for processing at venue creation time (static) - - [https://github.com/unity-sds/unity-sps-prototype/issues/141](https://github.com/unity-sds/unity-sps-prototype/issues/141) - - EPIC #4: `no magic` - - [unity-sps-prototype #132] As a user, i want to be explicit about inputs into my process execution (no magic)! - - [https://github.com/unity-sds/unity-sps-prototype/issues/132](https://github.com/unity-sds/unity-sps-prototype/issues/132) + - [unity-sps-workflows #8] [Dependency]: Stub implementation for CHIRP workflow + - [https://github.com/unity-sds/unity-sps-workflows/issues/8](https://github.com/unity-sds/unity-sps-workflows/issues/8) + - [unity-sps-workflows #12] [Dependency]: Docker container for CMR search + - [https://github.com/unity-sds/unity-sps-workflows/issues/12](https://github.com/unity-sds/unity-sps-workflows/issues/12) + - [unity-sps-workflows #14] [Risk]: Processing large data volumes with CWL and Docker + - [https://github.com/unity-sds/unity-sps-workflows/issues/14](https://github.com/unity-sds/unity-sps-workflows/issues/14) + - [unity-sps-prototype #192] [New Feature]: Add an optional PVC to an SPS deployment + - [https://github.com/unity-sds/unity-sps-prototype/issues/192](https://github.com/unity-sds/unity-sps-prototype/issues/192) +- EPIC #1: `min/max scaling` + - [unity-sps-prototype #141] As a project Manager, i want to set maximum and minimum limits on scaling for processing at venue creation time (static) + - [https://github.com/unity-sds/unity-sps-prototype/issues/141](https://github.com/unity-sds/unity-sps-prototype/issues/141) +- EPIC #4: `no magic` + - [unity-sps-prototype #132] As a user, i want to be explicit about inputs into my process execution (no magic)! + - [https://github.com/unity-sds/unity-sps-prototype/issues/132](https://github.com/unity-sds/unity-sps-prototype/issues/132) ## Docker Containers + - ghcr.io/unity-sds/unity-sps-prototype/hysds-core:unity-v1.1.0 - ghcr.io/unity-sds/unity-sps-prototype/hysds-ui-remote:unity-v1.1.0 - ghcr.io/unity-sds/unity-sps-prototype/hysds-mozart:unity-v1.1.0 @@ -199,60 +207,66 @@ Version 2.0.0 - busybox:1.36.0 ## Documentation + - Tutorial on using the WPS-T API to register an application package and to execute a job - - https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/tutorial-execution-of-the-l1b-cwl-workflow-via-the-wps-t-api + - - SPS API with examples - - https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/users-guide/unity-sps-api + - - Tutorial on pre-warming a U-SPS cluster - - https://unity-sds.gitbook.io/docs/~/changes/TMwRbPjXYqq9MCfmRi31/developer-docs/science-processing/docs/developers-guide/manual-verification-testing-the-sps-prewarm-api + - ## Deployments + - MCP Test: - - Processing Endpoint (WPS-T API): **http://a720fb4de892844bf884f037c17bb583-1070798053.us-west-2.elb.amazonaws.com:5001** - - Scaling Endpoint (SPS API): **http://a7096fc6842e84da688b45586d194498-2116025617.us-west-2.elb.amazonaws.com:5002** + - Processing Endpoint (WPS-T API): **** + - Scaling Endpoint (SPS API): **** - MCP Dev: - - Processing Endpoint (WPS-T API): **http://aa17aedf4454a4cc596a67a1efb73411-1350404365.us-west-2.elb.amazonaws.com:5001** - - Scaling Endpoint (SPS API): **http://a440158f49fab4278bdcf2bcb145082b-625745.us-west-2.elb.amazonaws.com:5002** + - Processing Endpoint (WPS-T API): **** + - Scaling Endpoint (SPS API): **** -------- + # [Unity Release 23.1] - 2023-04-11 -## Repositories: -- unity-sps : https://github.com/unity-sds/unity-sps/releases/tag/1.0.0 -- unity-sps-prototype: https://github.com/unity-sds/unity-sps-prototype/releases/tag/1.0.0 -- unity-sps-api: https://github.com/unity-sds/unity-sps-api/releases/tag/1.0.0 +## Repositories + +- unity-sps : +- unity-sps-prototype: +- unity-sps-api: - unity-sps-register_job: - - MCP-Dev: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.0.0-MCP_Dev - - MCP-Test: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.0.0-MCP_Test -- unity-sps-workflows: https://github.com/unity-sds/unity-sps-workflows/releases/tag/1.0.0 -- ades_wpst: https://github.com/unity-sds/ades_wpst/releases/tag/1.0.0 + - MCP-Dev: + - MCP-Test: +- unity-sps-workflows: +- ades_wpst: + +## Epics -## Epics: - EPIC #130: `ancillary data` - - [unity-sps-prototype #148] Mount EFS partitions on U-SPS cluster - - https://github.com/unity-sds/unity-sps-prototype/issues/148 + - [unity-sps-prototype #148] Mount EFS partitions on U-SPS cluster + - - EPIC #146: `automatic testing` - - [unity-sps-prototype #153] Smoke test to deploy a simple process and execute a job request - - https://github.com/unity-sds/unity-sps-prototype/issues/153 + - [unity-sps-prototype #153] Smoke test to deploy a simple process and execute a job request + - - EPIC #132: `no magic` - - [unity-sps #154]: Pass explicit input parameters to a WPS-T job request - - https://github.com/unity-sds/unity-sps-prototype/issues/154 - - [unity-sps-prototype #159]: Return the input parameters as part of the WPS-T DescribeProcess method - - https://github.com/unity-sds/unity-sps-prototype/issues/159 - - [unity-sps-prototype #167]: The WPS-T method to register a process may time out while building the PGE Docker image - - https://github.com/unity-sds/unity-sps-prototype/issues/167 + - [unity-sps #154]: Pass explicit input parameters to a WPS-T job request + - + - [unity-sps-prototype #159]: Return the input parameters as part of the WPS-T DescribeProcess method + - + - [unity-sps-prototype #167]: The WPS-T method to register a process may time out while building the PGE Docker image + - - EPIC #142: `processing-instance-types` - - [unity-sps-prototype #142]: As a project manager, i want to set default compute types for processing nodes at deploy time, so that i can predict costs for the system (Static) - - https://github.com/unity-sds/unity-sps-prototype/issues/154 + - [unity-sps-prototype #142]: As a project manager, i want to set default compute types for processing nodes at deploy time, so that i can predict costs for the system (Static) + - - EPIC #162: `u-sps-api` - - [unity-sps-prototype #163]: New SPS API with stub pre-warm method - - https://github.com/unity-sds/unity-sps-prototype/issues/163 - - [unity-sps-prototype #167]: Refactor the HySDS workers as a Kubernetes DaemonSet - - https://github.com/unity-sds/unity-sps-prototype/issues/170 - - [unity-sps-prototype #167]: Scale the number of worker nodes in the Kubernetes cluster - - https://github.com/unity-sds/unity-sps-prototype/issues/171 + - [unity-sps-prototype #163]: New SPS API with stub pre-warm method + - + - [unity-sps-prototype #167]: Refactor the HySDS workers as a Kubernetes DaemonSet + - + - [unity-sps-prototype #167]: Scale the number of worker nodes in the Kubernetes cluster + - ## Docker Containers + - ghcr.io/unity-sds/unity-sps-prototype/hysds-core:unity-v1.0.0 - ghcr.io/unity-sds/unity-sps-prototype/hysds-ui-remote:unity-v1.0.0 - ghcr.io/unity-sds/unity-sps-prototype/hysds-mozart:unity-v1.0.0 @@ -269,19 +283,21 @@ Version 2.0.0 - busybox:1.36.0 ## Documentation + - Tutorial on using the WPS-T API to register an application package and to execute a job - - https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/tutorial-execution-of-the-l1b-cwl-workflow-via-the-wps-t-api + - - SPS API with examples - - https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/users-guide/unity-sps-api + - - Tutorial on pre-warming a U-SPS cluster - - https://unity-sds.gitbook.io/docs/~/changes/TMwRbPjXYqq9MCfmRi31/developer-docs/science-processing/docs/developers-guide/manual-verification-testing-the-sps-prewarm-api + - ## Deployments + - MCP Test: - - Processing Endpoint (WPS-T API): http://a720fb4de892844bf884f037c17bb583-1070798053.us-west-2.elb.amazonaws.com:5001 - - Scaling Endpoint (SPS API): http://a7096fc6842e84da688b45586d194498-2116025617.us-west-2.elb.amazonaws.com:5002 + - Processing Endpoint (WPS-T API): + - Scaling Endpoint (SPS API): - MCP Dev: - - Processing Endpoint (WPS-T API): http://aa17aedf4454a4cc596a67a1efb73411-1350404365.us-west-2.elb.amazonaws.com:5001 - - Scaling Endpoint (SPS API): http://a440158f49fab4278bdcf2bcb145082b-625745.us-west-2.elb.amazonaws.com:5002 + - Processing Endpoint (WPS-T API): + - Scaling Endpoint (SPS API): ------------