marathon

Cross-platform test runner

GPL-2.0 License

Stars
577

Bot releases are hidden (Show)

marathon - 0.6.1

Published by Malinskiy over 3 years ago

New:

  • Expose vendor-adam granular timeout configuration (#443)
  • Add failed test list + CLI report for failed and incomplete tests (#452)

Bug fixes:

  • Uncompleted tests should fail after uncompletedRetryQuota is depleted (#439)
  • Fix ddmlib test output timeout logic (#451)
  • Fix adb daemon kill after test run (#438)
  • Stabilise adam vendor (#426)
  • Rotate screen capture based on initial device rotation
  • Proper timeout handling for test (defaults to 5 minutes now) (#451)
  • Proper timeout handling for test batch (30 minutes now) (#451)
  • allure-kotlin with Android API 29 permissions fix

Other:

  • Upgrade to gradle 6.8 and kotlin 1.4.20, kluent 1.64
  • Upgrade adam to 0.2.3
  • Update ddmlib to 27.1.2 (#438)
  • Add docs clarification about simultaneous usage of testApplicationPmClear and autoGrantPermission (#435)
marathon - 0.6.0

Published by Malinskiy almost 4 years ago

New:

  • adam: new Android stack implementation. See docs (#352)
  • Add Graphite support as an alternative to InfluxDB for storing test metrics (#406, #408)
  • Allure-kotlin integration (#418)
  • Update ddmlib to 27.0.0 to enable ANDROID_ADB_USER_MANAGED_MODE support and AGP 4.0 (#377)
  • Make adb serialNumber second option after marathonserialprop (#395)

Bug fixes:

  • Add configs for device initialization timeouts (#389)
  • Add finally block to stop koin once started (#351)
  • Allow configuring screenRecordingPolicy in gradle plugin (#361)
  • Refactor screen recording configuration (#374)
  • Bugsnag (#368, #385, #394, #415)

Deprecations:

  • Replace blacklist and whitelist with blocklist and allowlist (#407, #409)
  • ddmlib vendor is deprecated and will be disabled in 0.8.0 (#421)

Other:

  • Merged documentation into the main branch to keep everything in sync
  • Add some logs for device initialize error (#396)
  • Update kotlin-version to 1.4.10 and coroutines version 1.3.9 (#404)
  • bump gradle wrapper version to 6.6.1 (#405)
marathon - 0.5.2

Published by tagantroy over 4 years ago

Configuration:
Introduce ScreenRecordingPolicy
Fix SerialStrategy configuration for YAML and Gradle configuration
Explicitly specify retention policy in queries

Optimizations:
Check if batch fully ignored before clean and execution to reduce overhead for empty batches

Bug fixes:
Support both xTest and xTests as default class name
Close Bugsnag at the end to prevent hanging due to internal thread pool
Fix synchronization problem in the state machine and LogCat listeners
Fail build if a test failed in strict mode

Gradle plugin:
Fix fox 3.6.X Android Gradle Plugin

marathon - 0.5.1

Published by tagantroy about 5 years ago

Reporting hotfix

marathon -

Published by tagantroy about 5 years ago

Improvements:

  • Ignored test results from DdmLib with null method name #200
  • Increase max video duration from 60 to 180 seconds #204
  • Use DdmLib API to obtain external storage directory #205
  • Screenrecord workaround #207
  • InfluxMetricsProvider cache multiple sets of data #216
  • Skip installing/uninstalling APK if there are no tests after filters #221
  • AndroidDeviceTestRunner now checks if test contains the @Ignore #226
  • Basic @Parameterized support for Android #230
  • Always fail execution when no devices are connected #237
  • Fix wrong time and timestamp for ignored tests #240
  • Add uncompleted tests retry quota enhancement #247
  • Uncompleted tests should be reported in any case #267
  • Multiple health improvements #269

Configuration:

  • Add install options configuration #191
  • Feature/Add preferable recorder type config #190
  • Add support for configurable serial provider for Android #231
  • Add strict mode #236
  • Disallow custom flakiness + sharding #241
  • Allow to disable HostKey verification for iOS #265
  • Support include/exclude serial regex #246
  • Fix retention policy configuration in YAML #249

Gradle plugin improvements:

  • Ignore failures configuration fix #211 #256
  • Gradle plugin should mark output folder as Gradle task output enhancement #217

Docs:

  • Docs redesign #188

Other:

  • Refactor analytics #252
  • Tracker refactoring #209
  • Extract Sharding and Flakiness Strategies from DevicePoolActor #202
  • Remove NonNull annotations from kotlin class #206
marathon -

Published by tagantroy over 5 years ago

Add preferable recorder type config (#190)
Add install options configuration (#191)

marathon -

Published by tagantroy over 5 years ago

Features:
#178 Add support for clearing package data between batches for Android
#176 Reverse probability sorting
#125 Add visually device initialization time and device not healthy to timeline
#149 Print simple report in CLI
#137 Add Allure report
Bugfixes:
#134 Progress report is broken (shows more than 100%)
#170 CLI progress report is broken 0.3.5
#153 Marathon has to continue work if InfluxDB isn't available
#143 #144 CLI stuck
Improvements:
#157 Use lazy variants API from Android Gradle Plugin 3.3

marathon -

Published by Malinskiy over 5 years ago

marathon - 0.3.4 CLI Report Hotfix

Published by tagantroy over 5 years ago

Fixed CLI report

marathon -

Published by tagantroy over 5 years ago

Fixed CVE-2018-14732 #159
Added CLI report #149

marathon -

Published by tagantroy almost 6 years ago

Added -r adb install param
Fixed ignoreFailures
Added analytics

marathon - 0.3.1

Published by Malinskiy almost 6 years ago

marathon - 0.3.0

Published by Malinskiy almost 6 years ago

Lot's of fixes and features including:

  • Increase stability of test runs
  • Screenshots composition into GIF on Android when video recording is not supported
  • Upgrade of Gradle 5, Kotlin 1.3, stable Coroutines 1.X
  • Add simple scenario tests to check basic test run behaviour
  • Composition filter
  • Fix ssh issues on iOS
  • Add support for stable (in terms of reconnects) serial number parameter in Android marathon.serialno
  • Last mile optimization for batch execution to parallelize the last batch of tests even more
  • Fixed batching now has upper time bound
  • Support android library modules testing

Kudos to @memega , @cdsap and @tagantroy

marathon - https://github.com/MarathonLabs/marathon/releases/tag/0.2.1

Published by Malinskiy about 6 years ago

marathon -

Published by Malinskiy about 6 years ago

Fix problem with video
Fix retry logic
Fix influxdb problem
Add Test class regex check
Add no active devices check

marathon - https://github.com/MarathonLabs/marathon/releases/tag/0.1.8

Published by Malinskiy over 6 years ago

marathon -

Published by tagantroy over 6 years ago

CLI interface
Fix Junit report

marathon -

Published by tagantroy over 6 years ago

Fix test drops
Fix Filters groovy config

marathon -

Published by tagantroy over 6 years ago

added Video recorder
fixed kts sharding config
fixed auto grant permissions

marathon -

Published by tagantroy over 6 years ago

Bugfix release.
Fixed:

  1. Incorrect progress
  2. Cannot round NaN value bug
  3. Empty InfluxDb problem
Package Rankings
Top 16.5% on Repo1.maven.org
Badges
Extracted from project README
GitHub release Slack Telegram PRs Welcome
Related Projects