aws-otel-test-framework

What's Changed

• Add case-insensitive regex support by @willarmiros in https://github.com/aws-observability/aws-otel-test-framework/pull/195
• Added period escapes to all trace templates by @willarmiros in https://github.com/aws-observability/aws-otel-test-framework/pull/196
• Remove error / fault from springboot template by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/197
• Remove another missed error/fault by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/198
• fix grpc test with add healthcheck route by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/199
• Remove nested subsegment for AWS SDK call by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/200
• Remove JS trace validation template by @KKelvinLo in https://github.com/aws-observability/aws-otel-test-framework/pull/201
• Fix the canary test for gRPC by @shaochengwang in https://github.com/aws-observability/aws-otel-test-framework/pull/202
• Update get-performance-model.md by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/203
• Add canary test README by @shaochengwang in https://github.com/aws-observability/aws-otel-test-framework/pull/204
• added ecs support for prometheus static and mock by @amanbrar1999 in https://github.com/aws-observability/aws-otel-test-framework/pull/205
• Update OpenTelemetry Dependencies for Sample App and Data Emitter by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/206
• modified url to resolve aws-request-signing-apache-interceptor package by @bhautikpip in https://github.com/aws-observability/aws-otel-test-framework/pull/207
• add soaking test validation metrics by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/208
• revert image repo to the testing repo by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/209
• Expand ec2 test for more amis and arm by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/210
• Rollup the soaking metrics for the dashboard by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/211
• fix the family of ami for amazonlinux and amazonlinux2 by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/212
• fix the iptables command for ami centos6 by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/213
• change OTEL SDK to 12.0 to match auto-instr-agent by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/214
• Metric integ test enhancement by @shaochengwang in https://github.com/aws-observability/aws-otel-test-framework/pull/215
• support patching on soak and canary by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/216
• reduce checking patch time to 5 minutes by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/219
• Add new enhancedExpectedMetric template and keep original default template by @shaochengwang in https://github.com/aws-observability/aws-otel-test-framework/pull/220
• Add statsd sample app, statsd test cases by @gavindoudou in https://github.com/aws-observability/aws-otel-test-framework/pull/217
• update vpc to large one by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/222
• update vpc name by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/223
• enlarge vpc by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/225
• Set service.name for spring boot app too. by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/226
• Add jib configuration for validator. by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/230
• Add workflow for running :validator:jib to push the docker image on m… by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/231
• create codescan workflow by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/229
• add plugin version back in module build.gradle since docker build fai… by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/232
• Removed http subsegment name to generalize template for all SDKs by @lupengamzn in https://github.com/aws-observability/aws-otel-test-framework/pull/233
• Changed OTLP default port to 4317. by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/234
• Fix AMI filter and docker installation by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/237
• tf: Use latest AL2 AMI and right Debian 10 by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/238
• tf: Fix ami for canaray and soaking by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/239
• Update New Relic config by @alanwest in https://github.com/aws-observability/aws-otel-test-framework/pull/240
• Fix soaking_data_type parsing issue by @gavindoudou in https://github.com/aws-observability/aws-otel-test-framework/pull/243
• Fix New Relic integration tests. by @a-feld in https://github.com/aws-observability/aws-otel-test-framework/pull/241
• Add UDP endpoint to StatsD soaking test command by @gavindoudou in https://github.com/aws-observability/aws-otel-test-framework/pull/244
• [ECScontainerReceiver]Update the config file for the new resources by @JohnWu20 in https://github.com/aws-observability/aws-otel-test-framework/pull/245
• Remove jcenter by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/246
• Bump OTel Java SDK to 1.0.x for sample apps by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/248
• Install SSM agent for all AMIs by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/254
• Fix AMI setup for canary/soaking test. by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/256
• Fix nil string issue in remote-exec by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/257
• Add AppMesh metric integration test by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/247
• Update SSM agent for AMIs by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/259
• Conform to the folder naming convention by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/260
• Restrict kubernetes version to be installed by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/262
• Update run-mock-test.md by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/263
• Add structured log validation for CloudWatch sample workloads by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/251
• Add Jaeger and Zipkin integration test by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/261
• Add integration test for HAProxy, Memcached, Nginx, Java/JMX by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/250
• Add SSM package test for ADOT Collector in ec2 test by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/264
• tf: Format tf files using terraform fmt and checks format on PR by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/266
• sample: Add jmx prometheus metrics with tomcat by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/252
• aotutil: Init go util for monitor ec2 instance patching via ssm by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/267
• Add http prefix for ECS and EKS OTLP receiver endpoint by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/268
• Fix EKS test by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/270
• Code refactor structured log validator by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/271
• patch: Use aotutil for check patch and wait report by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/269
• Fix validate build with gradle v7.0' by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/272
• Lock to Gradle 6 in docker build to fix integration test by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/273
• Bugfix prometheus container insight validation by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/274
• Remove patching setting for SSM package test by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/275
• tf: Add ssm policy for ecs ec2 instances by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/277
• tf: Allow using large vpc by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/278
• Avoid conflicts when running multi CI jobs concurrently by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/279
• add integration tests for eks container insight by @pxaws in https://github.com/aws-observability/aws-otel-test-framework/pull/276
• Add example workload to jmx by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/283
• Fix dpkg lock issue in Debian AMI by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/284
• Add resource cleaner for ec2 and efs by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/285
• fix zipkin, jaeger, ecsmetric testcases by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/286
• Fix newrelic exporter configuration changes by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/288
• Wait more dpkg locks by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/287
• tf: Fix ignore error flag position for ec2 patch report by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/290
• Increase timeout for cloud-init and SSM operations by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/291
• Update container insights validators for reuse by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/289
• reduce the canary testing cycles due to long running time by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/292
• Use SSM package version name start with 'v' by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/293
• Add canary test support to SSM pakcage testcase by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/294
• Fix jaeger & zipkin perf & soaking tests by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/296
• Emit canary metrics for SSM package test by @vastin in https://github.com/aws-observability/aws-otel-test-framework/pull/297
• Modularize EKS terraform workflow by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/280
• Merge container insights prometheus and eks by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/281
• Fix integration test failure by @bjrara in https://github.com/aws-observability/aws-otel-test-framework/pull/299
• support local path template for validation by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/295
• Add StatsD test metrics for timer/histogram by @gavindoudou in https://github.com/aws-observability/aws-otel-test-framework/pull/301
• add region in Prometheus_mock config to bypass the endpoint edit check by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/303
• allow empty template path by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/304
• update test for container insights by @pxaws in https://github.com/aws-observability/aws-otel-test-framework/pull/306
• Update validtor readme with working example by @NathanielRN in https://github.com/aws-observability/aws-otel-test-framework/pull/309
• [ecs][prometheus] Add ContainerInsight ECS Prometheus by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/308
• Fix EC2 AMI lookup filter issue by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/311
• Fix the ec2 ami arch setup by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/312
• Add integration test for ecs ec2 container insight instance metrics by @JohnWu20 in https://github.com/aws-observability/aws-otel-test-framework/pull/298
• [ecs] Add dummy cloudwatch_context.json for ecs prometheus by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/313
• ecs: Increase retry for Container Insight ECS Prometheus by @pingleig in https://github.com/aws-observability/aws-otel-test-framework/pull/314
• Update JS Trace template for Upstream 0.23.0 by @NathanielRN in https://github.com/aws-observability/aws-otel-test-framework/pull/315
• Add AMP Validator by @KKelvinLo in https://github.com/aws-observability/aws-otel-test-framework/pull/316
• Add ADOT Operator to ADOT test framework by @Saber-W in https://github.com/aws-observability/aws-otel-test-framework/pull/318
• Modify terraform configurations to pass the test cases by @Saber-W in https://github.com/aws-observability/aws-otel-test-framework/pull/319
• Fix For Gradle 7 by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/320
• Added testcases for the resource detection processor by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/317
• Removed log group and stream attributes from expected ECS trace. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/322
• Bumped up sample app SDK versions. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/321
• Removed EKS k8s cluster name attribute from expected trace. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/323
• Bumped up load generator Otel SDK versions. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/326
• Changed resource detection EC2 test to override attributes. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/328
• Updated soaking test load generator image. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/330
• Add the cloudwatch context file by @JohnWu20 in https://github.com/aws-observability/aws-otel-test-framework/pull/329
• Comment out one nginx metric/log from containerinsight_eks_prometheus… by @straussb in https://github.com/aws-observability/aws-otel-test-framework/pull/335
• Disable Counter metrics in Prom Sample App by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/331
• Add OTLP Metric ADOT Operator Test by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/332
• Add dependency on STS so validator can use federated login (web ide… by @anuraaga in https://github.com/aws-observability/aws-otel-test-framework/pull/344
• Update otel configs to set log level to debug via config instead of CLI flag by @Aneurysm9 in https://github.com/aws-observability/aws-otel-test-framework/pull/345
• Fix the breaking changes on TLS config by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/346
• Fix Operator test case to use the AOC image form the latest commit by @mxiamxia in https://github.com/aws-observability/aws-otel-test-framework/pull/347
• update design doc by @wyTrivail in https://github.com/aws-observability/aws-otel-test-framework/pull/348
• Update AWS SDK Trace mustache to match spec by @NathanielRN in https://github.com/aws-observability/aws-otel-test-framework/pull/349
• Add Dependabot Support by @aateeqi in https://github.com/aws-observability/aws-otel-test-framework/pull/350
• Reduced number of retries for soaking test alarm validation by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/381
• Make isCanary Boolean To Remove Compilation Error by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/382
• Add Performance Max Stats by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/385
• Update SSL Cert For Mock Server by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/394
• Added Makefile to handle certificate updates. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/396
• Refactored nodejs mock_servers to go by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/395
• OTel Template adds aws.* bc it represents X-Ray expected data by @NathanielRN in https://github.com/aws-observability/aws-otel-test-framework/pull/383
• Fixed https mocked server /put-data* endpoint. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/406
• Add Otlp To AMP Test by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/405
• Add Alarm State Reason On Failure by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/407
• Add integration tests for EKS Fargate Container Insights by @rltoSD in https://github.com/aws-observability/aws-otel-test-framework/pull/424
• Add Initial Support For EKS Fargate Testing In Terraform by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/425
• Dynamic Assume Role Creation by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/426
• Disabled AppMesh portion of EKS test. by @jefchien in https://github.com/aws-observability/aws-otel-test-framework/pull/432
• Use New Fargate Profile For Each Run And Allow More Than One Tests At… by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/430
• Only Create Fargate Profile On Deployed Fargate Task by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/437
• Fix Looking For Old Metrics For EKS Fargate Container Metrics by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/436
• Avoid having null pointers error when the context is missing by @khanhntd in https://github.com/aws-observability/aws-otel-test-framework/pull/438
• Support testcase for ec2 based on ecs when using otlp to send metrics to amprometheus xray cloudwatch by @khanhntd in https://github.com/aws-observability/aws-otel-test-framework/pull/412
• Upgrade Log4j (#439) by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/441
• Create Fargate Cluster With Terraform by @sethAmazon in https://github.com/aws-observability/aws-otel-test-framework/pull/435
• Remove invalid comma in json testing template by @NathanielRN in https://github.com/aws-observability/aws-otel-test-framework/pull/448

New Contributors

• @anuraaga made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/197
• @gavindoudou made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/217
• @lupengamzn made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/233
• @vastin made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/234
• @pingleig made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/238
• @alanwest made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/240
• @bjrara made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/247
• @pxaws made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/276
• @Saber-W made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/318
• @sethAmazon made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/320
• @jefchien made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/317
• @straussb made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/335
• @Aneurysm9 made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/345
• @aateeqi made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/350
• @rltoSD made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/424
• @khanhntd made their first contribution in https://github.com/aws-observability/aws-otel-test-framework/pull/438

Full Changelog: https://github.com/aws-observability/aws-otel-test-framework/compare/v0.4.0...v0.5.0

1. Add trace validation

The Collector integration test framework

• End to end testing and verification on OpenTelemetry Metrics and Traces data with CloudWatch/X-Ray backend
• Support setup testbed in
  • EC2
  • ECS
  • EKS