Issue: dataGeneralization , informationWithheld are not consistent for sensitive records

[cha801p]

Description: We have encountered an issue while processing the NSW BIS Weeds data. Specifically, the "Data generalization" field is not being populated as expected in the processed data.

Example: For instance, in the record https://biocache.ala.org.au/occurrences/a31e0a66-1af9-4048-a1ed-7a69fe8c3a03, the original value in the "Data generalizations" field is "Location obscured for privacy." However, this value does not appear in the processed data.

Investigation: Upon further investigation, we identified that this issue is not isolated to a single record but occurs across multiple records in ALA. You can observe similar issues in the following queries:

Query 1
This query shows records where raw_dataGeneralizations has some value, but it is not populated in processed record dataGeneralizations.

Query 2

Hypothesis: It appears that the raw_dataGeneralizations field is not being populated unless the data is marked as sensitive. However, the dataGeneralizations field should still contain information related to obscured locations, which is currently missing.