Skip to content

Commit

Permalink
Add profile levels
Browse files Browse the repository at this point in the history
  • Loading branch information
m-mohr committed Dec 12, 2023
1 parent 0eb198f commit 5c0f536
Show file tree
Hide file tree
Showing 141 changed files with 377 additions and 113 deletions.
50 changes: 29 additions & 21 deletions tests/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ This folder contains test cases for the openEO processes.
- [x] add
- [ ] add_dimension
- [ ] aggregate_spatial
- [ ] aggregate_spatial_window (experimental)
- [ ] aggregate_temporal
- [ ] aggregate_temporal_period
- [x] all
Expand All @@ -18,6 +19,7 @@ This folder contains test cases for the openEO processes.
- [ ] apply_dimension
- [ ] apply_kernel
- [ ] apply_neighborhood
- [ ] apply_polygon (experimental)
- [x] arccos
- [x] arcosh
- [x] arcsin
Expand All @@ -28,9 +30,11 @@ This folder contains test cases for the openEO processes.
- [x] array_concat
- [x] array_contains
- [x] array_create
- [ ] array_create_labeled (experimental)
- [x] array_element
- [x] array_filter
- [x] array_find
- [ ] array_find_label (experimental)
- [x] array_interpolate_linear
- [x] array_labels
- [x] array_modify* (experimental)
Expand Down Expand Up @@ -61,19 +65,24 @@ This folder contains test cases for the openEO processes.
- [x] extrema
- [ ] filter_bands
- [ ] filter_bbox
- [ ] filter_labels (experimental)
- [ ] filter_spatial
- [ ] filter_temporal
- [ ] filter_vector (experimental)
- [x] first
- [ ] flatten_dimensions (experimental)
- [x] floor
- [x] gt
- [x] gte
- [x] if
- [x] int
- [x] is_infinite (experimental)
- [x] is_nan
- [x] is_nodata*
- [x] last
- [x] linear_scale_range
- [x] ln
- [ ] load_geojson (experimental)
- [x] log
- [x] lt
- [x] lte
Expand All @@ -99,6 +108,7 @@ This folder contains test cases for the openEO processes.
- [x] quantiles
- [x] rearrange*
- [ ] reduce_dimension
- [ ] reduce_spatial (experimental)
- [ ] rename_dimension
- [ ] rename_labels
- [ ] resample_cube_spatial
Expand All @@ -120,7 +130,11 @@ This folder contains test cases for the openEO processes.
- [x] text_contains
- [x] text_ends
- [ ] trim_cube
- [ ] unflatten_dimension (experimental)
- [x] variance
- [ ] vector_buffer (experimental)
- [ ] vector_reproject (experimental)
- [ ] vector_to_regular_points (experimental)
- [x] xor

\* = could use some more tests
Expand All @@ -129,10 +143,6 @@ This folder contains test cases for the openEO processes.
See <https://github.com/Open-EO/openeo-processes/issues/480> for details.
Also, several processes would be affected by <https://github.com/Open-EO/openeo-processes/pull/476>.

## Incomplete processes

- [x] is_nodata - actual no-data values depends on context / metadata

## Missing processes

The following processes have no test cases as the results heavily depend on the underlying implementation
Expand All @@ -148,30 +158,14 @@ We don't expect that we can provide meaningful test cases for these processes.
- load_collection
- load_stac (experimental)
- load_uploaded_files (experimental)
- load_url (experimental)
- predict_curve (experimental)
- run_udf
- run_udf_externally (experimental)
- sar_backscatter (experimental)
- save_result
- vector_to_random_points (experimental)

The following processes are in proposal state (i.e. experimental) and may be added later:

- aggregate_spatial_window (experimental)
- apply_polygon (experimental)
- array_create_labeled (experimental)
- array_find_label (experimental)
- filter_labels (experimental)
- filter_vector (experimental)
- flatten_dimensions (experimental)
- load_geojson (experimental)
- load_url (experimental)
- reduce_spatial (experimental)
- unflatten_dimension (experimental)
- vector_buffer (experimental)
- vector_reproject (experimental)
- vector_to_regular_points (experimental)

## Assumptions

The test cases assume a couple of things as they are an abstraction and not bound to specific implementations:
Expand Down Expand Up @@ -203,6 +197,11 @@ properties:
type: boolean
description: Declares that the process is experimental, tests may fail.
default: false
level:
type: string
description: openEO process profile the process is assigned to.
default: L4
pattern: 'L\d([\w-])?'
tests:
description: A list of test cases without a specific order
type: array
Expand Down Expand Up @@ -251,6 +250,15 @@ properties:
- description: Use true if the type of exception is unknown
type: boolean
const: true
level:
type:
- string
- null
description: >-
openEO process profile the test is assigned to.
Defaults to the level of the process.
default: null
pattern: 'L\d([\w-])?'
```
### External references
Expand Down
3 changes: 2 additions & 1 deletion tests/absolute.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "absolute",
"level": "L1",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -56,4 +57,4 @@
"returns": null
}
]
}
}
3 changes: 2 additions & 1 deletion tests/add.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "add",
"level": "L1",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -156,4 +157,4 @@
"returns": null
}
]
}
}
3 changes: 2 additions & 1 deletion tests/add_dimension.json5
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"id": "add_dimension",
"level": "L2",
"tests": []
}
}
3 changes: 2 additions & 1 deletion tests/aggregate_spatial.json5
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"id": "aggregate_spatial",
"level": "L2A",
"tests": []
}
}
5 changes: 5 additions & 0 deletions tests/aggregate_spatial_window.json5
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
{
"id": "aggregate_spatial_window",
"level": "L3",
"tests": []
}
3 changes: 2 additions & 1 deletion tests/aggregate_temporal.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "aggregate_temporal",
"level": "L2",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -51,4 +52,4 @@
}
}
]
}
}
3 changes: 2 additions & 1 deletion tests/aggregate_temporal_period.json5
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"id": "aggregate_temporal_period",
"level": "L2",
"tests": []
}
}
3 changes: 2 additions & 1 deletion tests/all.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "all",
"level": "L2",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -92,4 +93,4 @@
"returns": null
}
]
}
}
3 changes: 2 additions & 1 deletion tests/and.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "and",
"level": "L1",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -65,4 +66,4 @@
"returns": null
}
]
}
}
3 changes: 2 additions & 1 deletion tests/anomaly.json5
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"id": "anomaly",
"level": "L3-Clim",
"tests": []
}
}
3 changes: 2 additions & 1 deletion tests/any.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "any",
"level": "L2",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -92,4 +93,4 @@
"returns": null
}
]
}
}
1 change: 1 addition & 0 deletions tests/apply.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "apply",
"level": "L1",
"tests": [
{
"required": [
Expand Down
3 changes: 2 additions & 1 deletion tests/apply_dimension.json5
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"id": "apply_dimension",
"level": "L1",
"tests": []
}
}
3 changes: 2 additions & 1 deletion tests/apply_kernel.json5
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"id": "apply_kernel",
"level": "L2A",
"tests": []
}
}
3 changes: 2 additions & 1 deletion tests/apply_neighborhood.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "apply_neighborhood",
"level": "L3",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -56,4 +57,4 @@
}
}
]
}
}
5 changes: 5 additions & 0 deletions tests/apply_polygon.json5
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
{
"id": "apply_polygon",
"level": "L3",
"tests": []
}
3 changes: 2 additions & 1 deletion tests/arccos.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "arccos",
"level": "L1",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -68,4 +69,4 @@
"returns": null
}
]
}
}
1 change: 1 addition & 0 deletions tests/arcosh.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "arcosh",
"level": "L2",
"tests": [
{
"arguments": {
Expand Down
3 changes: 2 additions & 1 deletion tests/arcsin.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "arcsin",
"level": "L1",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -68,4 +69,4 @@
"returns": null
}
]
}
}
3 changes: 2 additions & 1 deletion tests/arctan.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "arctan",
"level": "L1",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -68,4 +69,4 @@
"returns": null
}
]
}
}
3 changes: 2 additions & 1 deletion tests/arctan2.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "arctan2",
"level": "L2",
"tests": [
{
"arguments": {
Expand Down Expand Up @@ -149,4 +150,4 @@
"returns": null
}
]
}
}
1 change: 1 addition & 0 deletions tests/array_append.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "array_append",
"level": "L3",
"tests": [
{
"arguments": {
Expand Down
1 change: 1 addition & 0 deletions tests/array_apply.json5
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
{
"id": "array_apply",
"level": "L3",
"tests": [
{
// empty array
Expand Down
Loading

0 comments on commit 5c0f536

Please sign in to comment.