planetary-computer-tasks

What's Changed

• Document stac-geoparquet and sentinel-2-l2a workflow creation by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/304
• Vendor 3rd-party charts and use ACR images by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/305
• Update Key Vault to use Azure RBAC by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/306
• Updates for network isolation and account key removal by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/309
• Emit structured log events to ApplicationInsights by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/308

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2024.6.1...2024.7.0

What's Changed

• Security patching and image updates by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/302
• Updated ecmwf-forecast image by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/303
• Added RELEASING.md by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/301

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2024.6.0...2024.6.1

What's Changed

• Fixed typo in ecmwf metadata by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/298
• Use vendored nginx-ingress chart and mcr image by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/300
• [ENH]: Allow for matching on the full path by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/299

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2024.5.1...2024.6.0

What's Changed

• Remove Service Principal identities by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/294
• User/tom/fix/s2 pctasks perf by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/291
• Removed task_acr_sp references in deployment by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/295
• Updated azure-cosmos-version by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/296
• Fixed publish function package workflow by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/297

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2024.1.1...2024.5.1

Helm chart update to deprecate cert-manager and instead use the Key Vault secret mechanism for TLS certificates.

What's Changed

• [CI]: Update container images by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/238

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2023.3.0...2023.3.1

What's Changed

• [core]: Remove azure-storage-blob pin by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/193
• Refactor / update item validation by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/173
• Update helm/kind-action version by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/202
• Remove generated docs file by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/203
• [goes-glm]: Updated dependencies by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/204
• Revert "Set PCTASKS_COSMOSDB__TEST_CONTAINER_SUFFIX in Functions" by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/206
• Bump kind version in cicd action by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/205
• Set PCTASKS_COSMOSDB__TEST_CONTAINER_SUFFIX in Functions by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/207
• Move dev deployment stack to shared state. by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/186
• Fix ESA WorldCover collection description links by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/200
• Add option to auto-confirm submits in dataset cli by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/197
• Correct gdpcir is now made up of 2 collections by @delgadom in https://github.com/microsoft/planetary-computer-tasks/pull/213
• Migrate GBIF from etl by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/211
• ENH: Allow globstring in local.path template by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/216
• Migrate ecmwf-forecast from etl by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/215
• Set username for CI/CD deployment by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/217
• Fixed CI Deployment by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/218
• Migrate landsat from etl by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/208
• Added terraform variable to set API Management sku_name by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/219
• Migrate sentinel-1 from etl by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/210
• [dataset] Gracefully handle all-None Chunkset by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/194
• Migrate MODIS from etl by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/212
• update sentinel-1-grd to use stactools package by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/221
• Update sentinel-3 to use stactools package by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/220
• update sentinel-5p to use stactools package by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/222
• [sentinel-1-grd]: Write out STAC items by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/223
• Fixed s1-grd item writing by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/224
• migrate goes-cmi by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/214
• Tom/fix/goes glm timeout error by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/225
• [modis]: Adjust splitting by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/227
• Error loudly in s1-grd by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/229
• [dataset]: Added create-splits command by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/226
• [ci]: Fixed typing issues by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/231
• [s1-grd]: Fixed relative paths in Blob Storage by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/233
• [dataset]: Fixed update workflow with multi-input by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/228
• Various workflow updates by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/234
• [dataset]: Include since in the workflow paths by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/236
• Bump azurite to 3.24.0 by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/237
• Added stac-geoparquet workflow by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/232

New Contributors

• @delgadom made their first contribution in https://github.com/microsoft/planetary-computer-tasks/pull/213

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2023.2.0...2023.3.0

What's Changed

• Use service principal in deployment by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/154
• Fix docs build - remove deleted package by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/155
• Add proper logging to pctasks-server by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/156
• Change kv access settings by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/157
• Change kv access settings by @gregoriomartin in https://github.com/microsoft/planetary-computer-tasks/pull/153
• Fixes to logging by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/159
• CI/CD engagement with the Key Vault Firewall by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/162
• Kv firewall by @m-cappi in https://github.com/microsoft/planetary-computer-tasks/pull/160
• Upgrade pypgstac to 0.7.1 by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/158
• Upgrade pgstac 0.7.3 by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/165
• Add Impact Observatory Biodiversity Intactness by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/164
• Add ESA WorldCover by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/163
• Check for msft:region in collections by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/166
• [core]: Update azurite version by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/171
• [goes-glm]: Updated workflow definition by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/174
• [core]: Add helper to rewrite blob storage urls by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/168
• [core]: Retry on IncompleteReadError by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/175
• [core/dev]: Update queue settings by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/172
• [packaging]: Fixed install_requires by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/177
• [goes-glm]: Bump container image by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/178
• Remove unused(?) smart-open by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/180
• [core]: Models, containers for items & events by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/169
• [goes-glm]: Bump image in deployed workflow by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/181
• Add a script for building distributions by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/139
• [core]: Avoid PyZipFile in code upload by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/179
• [goes-glm]: Try to fix with socket timeout by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/183
• Added naip (2020, 2021) by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/184
• [dataset]: Added tracing to create_item by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/185
• [naip]: Updates for production by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/187
• Update license link for NSIDC MODIS datasets by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/192
• Add noaa-cdr datasets by @gadomski in https://github.com/microsoft/planetary-computer-tasks/pull/82
• Update Sentinel-5P by @pjhartzell in https://github.com/microsoft/planetary-computer-tasks/pull/167
• NAIP updates by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/188
• [sentinel-5p] added update workflow by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/196
• Updated ms-buildings by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/195
• [cil-gdpcir] Fixed listing for cc-by by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/198
• Sentinel-3 by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/182

New Contributors

• @gregoriomartin made their first contribution in https://github.com/microsoft/planetary-computer-tasks/pull/153
• @m-cappi made their first contribution in https://github.com/microsoft/planetary-computer-tasks/pull/160

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2023.1.2...2023.2.0

What's Changed

• [CI]: Mount the azure directory in deploy by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/137
• Add IO LULC 2022 data by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/142
• [goe-glm]: Increase chunk size by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/143
• [goes-glm]: Updated goes-glm update job by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/144
• No target item updates by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/141
• Fix status --watch poll rate; reduce the number of ComosDB client connections by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/145
• [goes-glm]: Set a timeout by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/146
• Consolidate Batch client usage and decrease API hits by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/147
• [goes-glm]: Update to Python 3.11 by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/148
• Add USDA CDL license link by @gadomski in https://github.com/microsoft/planetary-computer-tasks/pull/149
• [dataset] added collection validator by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/83
• Avoid multiple threads creating the same batch job by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/150
• Tom/fix/ms buildings by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/133
• [ci]: Use azure cli credentials for deployment by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/140
• [CI]: Fixed env mapping by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/151
• Update deploy to avoid az login by @lossyrob in https://github.com/microsoft/planetary-computer-tasks/pull/152

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2023.1.1...2023.1.2

Hotfix to 2023.1 release allowing server Helm Chart to supply imagekey table name to container.

What's Changed

• [goes-glm]: Added goes-18 by @TomAugspurger in https://github.com/microsoft/planetary-computer-tasks/pull/135
• Allow imageKey table name override via settings by @mmcfarland in https://github.com/microsoft/planetary-computer-tasks/pull/134

Full Changelog: https://github.com/microsoft/planetary-computer-tasks/compare/2023.1.0...2023.1.1

⛄Winter '23 PC Tasks, v1