flank

v21.02.0

Bug Fixes

• #1547 IT test fix ()
• #1540 Dummy var for pr (Sloox)
• #1546 Fix flaky FilesTest (pawelpasterz)
• #1526 Windows Integration tests (Sloox)
• #1521 Fix NPE and logging (pawelpasterz)
• #1506 Improve Sentry logging for tests (adamfilipow92, piotradamczyk5)
• #1470 Resolve Fails on Windows (Sloox, pawelpasterz)
• #1490 Fix incorrect method usage on master (pawelpasterz)
• #1465 CI failures on performance tests (piotradamczyk5)

CI Changes

• #1537 Integration Test for all OS's (Sloox)
• #1534 Added Windows workflow (piotradamczyk5)
• #1535 Windows integration test (Sloox)
• #1468 Use pointer workflows to preserve run date (pawelpasterz, piotradamczyk5)
• #1456 Update config for CLA (piotradamczyk5)

Tests update

• #1525 Add missing iOS options in IT (pawelpasterz)
• #1514 Update compare file and make url option not required (pawelpasterz, adamfilipow92)

Features

• #1448 Filtering test configurations (iOS TestPlans) (axelzuziak-gogo, jan-gogo)
• #1504 Sending configuration to mixpanel (adamfilipow92, piotradamczyk5)
• #1474 Amend pre-commit hook (Sloox)
• #1471 Migrate from bugsnag to sentry (adamfilipow92)
• #1428 Rewrite pre-commit hook & ktlint apply to idea into Flank Scripts (Sloox)

Documentation

• #1495 Choose analytics tool (adamfilipow92, piotradamczyk5)

Refactor

• #1450 Enable properties file in flank scripts (pawelpasterz, piotradamczyk5)
• #1473 Update picocli to latest version (pawelpasterz, piotradamczyk5)
• #1466 Change packages in the common module (pawelpasterz)

v21.01.1

CI Changes

• #1451 Added CLA assistant (piotradamczyk5)
• #1447 Fix dependency update workflow (pawelpasterz)
• #1443 Add missing step (pawelpasterz)

Bug Fixes

• #1453 Fix problem with test-runner-class (piotradamczyk5)

v21.01.0

CI Changes

• #1439 Remove sanity checks and change full suite IT OS to macOS (piotradamczyk5)
• #1433 Change IT workflow comment (pawelpasterz)
• #1424 Auto update firebase api client (piotradamczyk5)
• #1412 1411 implement version (pawelpasterz)
• #1409 Trigger integration tests from pr comment (adamfilipow92, piotradamczyk5)
• #1385 Get rid of binaries submodule (jan-gogo, piotradamczyk5)
• #1400 Change gradle command (pawelpasterz)
• #1398 Add create google account config step (pawelpasterz)
• #1353 Implement workflow for full suite IT (cron + manual) (pawelpasterz, piotradamczyk5)
• #1378 Update GH API (pawelpasterz)

Features

• #1436 1422 autodetect new gcloud features (pawelpasterz)
• #1429 Change uploading file output (adamfilipow92, piotradamczyk5)
• #1426 Support for iOS gameloop tests (Sloox, jan-gogo, adamfilipow92)
• #1421 Default project Id - use GOOGLE_APPLICATION_CREDENTIALS first, then GOOGLE_CLOUD_PROJECT (pawelpasterz)
• #1404 Add basic gameloop IT for Android (Sloox, adamfilipow92)
• #1393 Upload matrix ids (Sloox, jan-gogo)
• #1362 Add logic to verify xml results (adamfilipow92, piotradamczyk5)
• #1321 IOS support for testplans (axelzuziak-gogo, jan-gogo)
• #1375 Add new output style to print smaller output (adamfilipow92, piotradamczyk5)
• #1370 Add support for "fail fast" feature on FTL (RainNapper)

Refactor

• #1432 Small changes in flank-scripts module (pawelpasterz)
• #1418 Create module with shared utilities (piotradamczyk5)
• #1417 Update firebase_apis module (pawelpasterz)

Bug Fixes

• #1414 Add attempts to performance test (jan-gogo)
• #1410 Fix integration tests on CI. (adamfilipow92, piotradamczyk5)
• #1413 Fix calculate shards test (pawelpasterz, jan-gogo)
• #1405 CancelCommandRuns should works independent (Sloox, adamfilipow92)
• #1395 Print args when iOS tests are not found (jan-gogo, adamfilipow92)
• #1387 Fix NPE (pawelpasterz, jan-gogo)
• #1372 Fix Flank Scripts version verification tasks (piotradamczyk5)

Documentation

• #1401 Update orchestrator version in docs (adamfilipow92)
• #1380 Added documentation about handling #1374 issue (piotradamczyk5)

Tests update

• #1316 [IT] Add test cases (pawelpasterz, adamfilipow92)

v20.12.0

Bug Fixes

• #1369 Add fallback when cannot get reference to avoid failing tests on release (piotradamczyk5)
• #1367 Release job failure (pawelpasterz, piotradamczyk5)
• #1366 Generation of release notes (piotradamczyk5)
• #1357 Fix release Action (Sloox, piotradamczyk5)
• #1333 Publishing Flank snapshot (Sloox, piotradamczyk5)
• #1338 Fix printing supported versions id (adamfilipow92)
• #1329 Uploading performance metrics for multiple matrices (adamfilipow92, piotradamczyk5)
• #1326 Downloading performance Metrics (adamfilipow92, piotradamczyk5)
• #1323 Nested subdirectories in results-dir (piotradamczyk5)
• #1307 Integration tests on windows (pawelpasterz, adamfilipow92)
• #1301 Handling broken token issues (piotradamczyk5)
• #1298 Fix incorrect printed shards number (pawelpasterz)
• #1295 Print formatted message instead of throwing NPE (pawelpasterz)
• #1283 Integration tests on windows (adamfilipow92, piotradamczyk5)
• #1275 Fix getting PR number on pull_request_review (piotradamczyk5)
• #1272 Fix integration test counter and trigger (piotradamczyk5)
• #1219 #842 support for test targets flag in multiple testbundles xctest (axelzuziak-gogo, jan-gogo)
• #1261 Add additional index to matrix when multiple test runs (pawelpasterz, adamfilipow92)
• #1250 Fix running flank workflows on Windows (piotradamczyk5)
• #1247 Flank web documentation link (piotradamczyk5)
• #1243 Disable cache for :test_runner:shadowJar task (pawelpasterz)
• #1233 Fix withClassName filter (pawelpasterz)
• #1221 Always dump shards (pawelpasterz, adamfilipow92)
• #1236 Empty branch name in workflows (jan-gogo)
• #1232 Test_runner:resolveArtifacts task (jan-gogo)
• #1225 Release job missing env (jan-gogo)
• #1188 Revert "feat: Dump shards and upload on every run (#1171)" (pawelpasterz)
• #1177 Fix flank-scripts test (pawelpasterz)
• #1167 Flank action (Sloox)
• #1161 Release notes slack tweaks (Sloox)
• #1164 Dependabot security issues (Sloox)

Refactor

• #1350 Ios test artifacts cleanup #1345 (axelzuziak-gogo, jan-gogo)
• #1339 Simplify beforeRunTests return singature (jan-gogo)
• #1281 Prepare flank codebase for supporting iOS testplans (axelzuziak-gogo, jan-gogo)
• #1246 Rewrite scripts to Kotlin (adamfilipow92, piotradamczyk5)

CI Changes

• #1361 Publishing and downloading flank scripts (piotradamczyk5)
• #1352 Make flank release more automatically (piotradamczyk5)
• #1344 Add directory filter for IT (pawelpasterz)
• #1310 Copy properties from issue to pull request (adamfilipow92, piotradamczyk5)
• #1320 Added pre-commit-hook (Sloox)
• #1286 Update existing bot comment (pawelpasterz)
• #1269 Add build scan for ubuntu workflow (pawelpasterz)
• #1265 Refresh integration tests (piotradamczyk5)
• #1263 Github Action optimizations (piotradamczyk5)
• #1253 Use Github app token for creating release notes (piotradamczyk5)
• #1248 Update deprecated options ::set-env and ::add-path (piotradamczyk5)
• #1240 Add current date to dependecy PR (pawelpasterz)
• #1148 Add scripts for test artifacts managment (jan-gogo, piotradamczyk5)
• #1210 Enable RC versions for gradle (dependency update task) (pawelpasterz)
• #1158 Fix test artifacts url (jan-gogo)
• #1152 Added WSL workflow (Sloox, piotradamczyk5)

Documentation

• #1355 Add documentation about code review by step (jan-gogo)
• #1311 Update documentations & Add Headings (Sloox)
• #1222 Add flank website code (jan-gogo)
• #1229 Update documentation (pawelpasterz)
• #1215 Added documentation about missing options (piotradamczyk5)
• #1190 Added documentation about Cucumber support (piotradamczyk5)
• #1181 Investigation incorrect outcome for flaky tests (pawelpasterz, adamfilipow92)
• #1173 Add FAQ section about sync problems (piotradamczyk5)
• #1131 Investigate flank options (jan-gogo, adamfilipow92)

Features

• #1325 IOS GameLoop addition (Sloox, axelzuziak-gogo)
• #1299 Add test targets for shard (Sloox, pawelpasterz)
• #1292 Added Performance Metrics for Android (piotradamczyk5)
• #1289 Add ios app for gameloop (Sloox)
• #1291 Add --test-special-entitlements for iOS (piotradamczyk5)
• #1266 IOS add directories-to-pull (adamfilipow92, piotradamczyk5)
• #1287 Ios scenario numbers (Sloox)
• #1284 Add Type to iOS (piotradamczyk5)
• #1262 Gameloop addition (Sloox)
• #1273 Add Additional Ipas option to iOS (piotradamczyk5)
• #1267 Add Other Files for iOS (adamfilipow92, piotradamczyk5)
• #1255 Obb file addition (Sloox)
• #1256 Update test shard limits (adamfilipow92)
• #1244 Added scenario-numbers (Sloox)
• #1238 Scenario Labels (Sloox)
• #1230 Add type (Sloox)
• #1186 Grant permissions addition (Sloox)
• #1214 Added printing missing options (piotradamczyk5)
• #1175 Android integration tests run on non wsl windows (Sloox, adamfilipow92)
• #1171 Dump shards and upload on every run (adamfilipow92)
• #1163 Integration tests run when pr is approved and not draft (adamfilipow92, piotradamczyk5)
• #1159 Improve error message on matrix failures (pawelpasterz, adamfilipow92)
• #1133 Auto update dependencies (piotradamczyk5)

Tests update

• #1300 Add flank multi test targets example (jan-gogo)
• #1274 Disable iOS test for Windows (piotradamczyk5)
• #1187 Remove verification test for edge cases of incorrect outcome in flaky tests (adamfilipow92)
• #1174 Added cucumber sample app for testing #1118 (piotradamczyk5)

For internal dogfood use only

Dont use this

v20.09.3

Bug Fixes

• #1151 Update flank-scripts serialization (piotradamczyk5)
• #1149 Flank-scripts next release tag generation (piotradamczyk5)
• #1138 Fix cost report (pawelpasterz)
• #1137 Running Code coverage job (piotradamczyk5)
• #1130 Bump action versioning (Sloox)
• #1124 Reflect gclouds outcome for robo tests (pawelpasterz)
• #1121 Dockerfile fix for slack message send (Sloox)
• #1116 Fixes release workflows (Sloox)

Features

• #1141 Add Java 15 compile support (piotradamczyk5)
• #1126 Allow Flank using different environment variables between test-apks (adamfilipow92)
• #1078 Add proguard initial step into Flank configuration (Sloox)
• #1125 Readded shadowjar minimization (Sloox)
• #1109 Integration tests for Flank (adamfilipow92)

Documentation

• #1139 Optimization docs addition (Sloox)
• #1136 Update documentation related with test-targets-always-run feature (pawelpasterz)

CI Changes

• #1114 Add Windows workflow (Sloox)
• #1095 Add new bash scripts for test artifacts generation (axelzuziak-gogo, jan-gogo)

Refactor

• #1113 Use single settings.gradle for flank projects (jan-gogo, piotradamczyk5)

V1.2-action

Sends a Firebase community Message about new releases

v20.09.2

Features

• #1111 Check if gcs path exist before run (piotradamczyk5)
• #1110 Finialize the slack sending integration with actions (Sloox)
• #1108 Support for robo tests without robo script (pawelpasterz)
• #1104 Send slack message for releases (Sloox)
• #1097 Print the matrices web link at the end of a run (adamfilipow92)

Bug Fixes

• #1107 Running iOS test on Linux (piotradamczyk5)
• #1059 Shards and Tests count do not match (pawelpasterz, adamfilipow92)
• #1067 Matrix path not found in json (adamfilipow92, piotradamczyk5)

v20.09.1

Bug Fixes

• #1100 Fix gcs files validation (pawelpasterz)
• #1093 Flank release bot formatting (Sloox)
• #1091 Add missing authors to release notes (adamfilipow92)

v20.09.0

Bug Fixes

• #1087 Fix release action (adamfilipow92)
• #1080 Flaky Flank-scripts test (Sloox)
• #1079 Fix slack notification in slack (Sloox)
• #1054 Firebase refresh fails when test zip file doesn't exist (#1052) (axelzuziak-gogo, jan-gogo)
• #1070 Avoid fast fail while creating a bucket (adamfilipow92)
• #1066 Bad validation of local-result-dir by Doctor (piotradamczyk5)

CI Changes

• #1058 Post slack message about releases (Sloox)

v20.08.4

Features

• #1056 Added validation of smart-flank-gcs-path to not override different junit results (adamfilipow92)
• #1040 Add test axis value column to summary table (jan-gogo)
• #1043 Add printing messages for MatrixCanceledError and InfrastructureError (pawelpasterz)
• #1042 Added option for default test time and average time for smart shard (piotradamczyk5)

Tests update

• #1055 Added missing test t cover duplicated tests issue (piotradamczyk5)

Bug Fixes

• #1041 Invoking flank yml on gcloud cli (adamfilipow92)
• #1053 Avoid releasing on document changes only (Sloox)
• #1048 Flank finding and running duplicate tests (MatthewTPage)
• #1051 PR check from fork (piotradamczyk5)
• #1044 Master not compiling (Sloox)
• #994 Size annotations support (pgreze)

Refactor

• #1047 MatrixMap immutability (Sloox)
• #1028 Savedmatrix immutability change (Sloox)

Documentation

• #1009 Avoid multiple identical lines printing (adamfilipow92)

v20.08.3

CI Changes

• #1031 Disable publishing snapshot to Github Packages (piotradamczyk5)
• #1022 Publish to GitHub packages (piotradamczyk5)

Bug Fixes

• #1027 OtherNativeCrash NPE (jan-gogo)
• #1023 Release notes message at GitHub release (piotradamczyk5)

Refactor

• #1025 Update kotlin version to 1.4 (pawelpasterz)

v20.08.2

Features

• #1020 Make release notes more organized (piotradamczyk5)
• #1013 Generating docs before release (piotradamczyk5)
• #1012 Add ip-blocks command to test-environment command (pawelpasterz)
• #999 Implement ip-blocks list command (pawelpasterz)
• #996 Auto generate release notes for next release (piotradamczyk5)
• #995 Implement command models describe for ios/android (adamfilipow92)
• #991 Validate orientation and fail fast (Sloox)
• #969 Add locales description command for ios and android (adamfilipow92)
• #992 Update google api (jan-gogo)
• #988 Add versions description command for ios and android (adamfilipow92)

Refactor

• #1018 Fetch artifacts async (pawelpasterz)

Bug Fixes

• #919 Rate limit exceeded (pawelpasterz, jan-gogo)
• #1005 Generation of release notes (piotradamczyk5)
• #1007 Failing tests (piotradamczyk5)
• #990 Exclusion of @Suppress test (piotradamczyk5)

CI Changes

• #1015 Update mergify configuration (piotradamczyk5)
• #1011 Generate release notes for Github release description (piotradamczyk5)
• #989 Check if valid title is used in PR (piotradamczyk5)

Documentation

• #987 Analytics addition to readme (Sloox)

v20.08.1

• #978 Firebaseopensource.com addition (sloox)
• #937 Improve error message on iOS when test or xctestrun-file not found (sloox)
• #952 Fix version printing on Flank release (sloox)
• #950 Fix crash when --legacy-junit-result set. (adamfilipow92)
• #948 Increment retry tries and change sync tag for jfrogSync. (piotradamczyk5)
• #946 Added tests for flank scripts. (piotradamczyk5)
• #935 Process junit xml even when full junit is not enabled. (kozaxinan)
• #962 Make table text left aligned. (pawelpasterz)
• #965 Fast fail when full-junit-result and legacy-junit-result. (adamfilipow92)
• #970 Fixing Flood of snapshot releases. (piotradamczyk5)
• #972 Fix printing release version. (piotradamczyk5)
• #964 Implement network-profiles describe feature. (pawelpasterz)

Stable release for commit 8566004

v20.08.0

• #890 Convert bitrise ubuntu workflow into GitHub actions. (piotradamczyk5)
• #876 Added option to print Android available devices to test against. (piotradamczyk5)
• #895 Added option to print iOS available devices to test against. (piotradamczyk5)
• #894 Added option to print Android available versions to test against. (piotradamczyk5)
• #897 Added option to print iOS available versions to test against. (piotradamczyk5)
• #901 Added option to print Android and iOS available test-environment. (piotradamczyk5)
• #904 Added option to print provided software. (piotradamczyk5)
• #906 Added option to print network profiles. (adamfilipow92)
• #908 Added option to print iOS available locales to test against. (piotradamczyk5)
• #906 Added option to print iOS and Android screen orientations. (adamfilipow92)
• #907 Added option to print Android available locales to test against. (piotradamczyk5)
• #913 Add Gradle Enterprise API example. (pawelpasterz)
• #916 Test artifacts monorepo. (jan-gogo)
• #910 Migrate Bitrise release workflow into GitHub actions. (piotradamczyk5)
• #915 Update virtual devices sharding limit. (adamfilipow92)
• #920 Improve .yml validation on doctor command. (piotradamczyk5)
• #934 Delete incorrect flank snapshot labels. (piotradamczyk5)
• #926 Flank should reflect gcloud exit codes. (adamfilipow92)
• #917 Fix an incorrect outcome. (pawelpasterz)
• #939 Run *list commands when flank.yml not found should display right output. (adamfilipow92)

Stable release for commit 02bca27

v20.07.0

• #857 Added multimodule setup for test app. (piotradamczyk5)
• #837 Added obfuscate option to dump shards. (piotradamczyk5)
• #868 Restored weblinks to all test results, not just failures. (rainnapper)
• #828 Store test results in gcloud bucket. (adamfilipow92)
• #865 Flank needs to respect the timeout value as that's a cap for billing purposes. (adamfilipow92, pawelpasterz)
• #866 Fix printing all matrix links. (piotradamczyk5)
• #862 Added printing outcome details. (piotradamczyk5, jan-gogo)
• #876 Added --directories-to-pull validation and avoid making request with empty toolStepResult. (piotradamczyk5)
• #875 Enhance permission denied exception logs. (adamfilipow92, pawelpasterz)

Stable release for commit 08de9c3

v20.06.2

• #853 Store @Ignore tests in the JUnit XML without sending ignored tests to FTL. (piotradamczyk5, adamfilipow92)
• #853 Handle duplicated apk names. (jan-gogo)

Stable release for commit 6d25735

v20.06.1

• #840 Fix parametrized tests. (jan-gogo, adamfilipow92, pawelpasterz, piotradamczyk5)