megalinter

[4.27.0] 2021-02-16

• Linters

  • Format YAML with prettier

• Core

  • Lint docker image using Dockle

• Fixes

  • Fix ansible-lint test cases for new version
  • Update --help expected return code for shfmt ash formatter and revive go linter
  • Add --write to update files fixed by eslint
  • Pimp Mega-Linter sources by adding newLines when missing (manually and from build.py) + fix logger initialization error + call python3 by default (PR329 by Tom Klingenberg)
  • Increase max line length to 500 in yaml-lint default configuration

• Linter versions upgrades

  • ansible-lint from 4.2.0 to 5.0.0 on 2021-02-09
  • bash-exec from 5.0.17 to 5.1.0 on 2021-02-09
  • cfn-lint from 0.44.6 to 0.44.7 on 2021-02-09
  • hadolint from 1.21.0 to 1.22.1 on 2021-02-09
  • git_diff from 2.26.2 to 2.30.1 on 2021-02-09
  • php from 7.3.26 to 7.4.15 on 2021-02-09
  • phpstan from 0.12.71 to 0.12.74 on 2021-02-09
  • protolint from 0.28.0 to 0.28.2 on 2021-02-09
  • lintr from 2.0.1.9000 to 0.0.0 on 2021-02-09
  • snakemake from 5.32.0 to 5.32.1 on 2021-02-09
  • terragrunt from 0.27.1 to 0.28.2 on 2021-02-09
  • ansible-lint from 5.0.0 to 0.0.0 on 2021-02-09
  • dotnet-format from 4.1.131201 to 5.0.211103 on 2021-02-12
  • stylelint from 13.9.0 to 13.10.0 on 2021-02-12
  • phpstan from 0.12.74 to 0.12.75 on 2021-02-12
  • powershell from 7.0.4 to 7.1.2 on 2021-02-12
  • snakemake from 5.32.1 to 5.32.2 on 2021-02-12
  • coffeelint from 4.1.2 to 4.1.3 on 2021-02-14
  • eslint from 7.19.0 to 7.20.0 on 2021-02-14
  • phpstan from 0.12.75 to 0.12.76 on 2021-02-14
  • black from 19.10 to 20.8 on 2021-02-15
  • snakefmt from 0.2.6 to 0.3.0 on 2021-02-15
  • sqlfluff from 0.3.6 to 0.4.0 on 2021-02-15
  • cfn-lint from 0.44.7 to 0.45.0 on 2021-02-16
  • snakefmt from 0.3.0 to 0.3.1 on 2021-02-16

• Linter versions upgrades
  • shfmt from 3.2.1 to 3.2.2 on 2021-01-30
  • yamllint from 1.25.0 to 1.26.0 on 2021-01-30
  • hadolint from 1.20.0 to 1.21.0 on 2021-02-02
  • checkstyle from 8.39 to 8.40 on 2021-02-02
  • eslint from 7.18.0 to 7.19.0 on 2021-02-02
  • phpstan from 0.12.70 to 0.12.71 on 2021-02-02
  • tflint from 0.23.1 to 0.24.1 on 2021-02-02
  • cfn-lint from 0.44.5 to 0.44.6 on 2021-02-03
  • terrascan from 1.3.1 to 1.3.2 on 2021-02-04

• Fixes

  • Prevent unexpected token error using mega-linter-runner on old versions of node
  • #293 Fix CI for PR from forked repositories
  • #295 Fix crash when .cspell.json is not parseable (wrong JSON format)
  • #311 Add java in salesforce flavor descriptor because it is used by Apex PMD

• Linter versions upgrades

  • phpstan from 0.12.68 to 0.12.69 on 2021-01-24
  • cfn-lint from 0.44.4 to 0.44.5 on 2021-01-25
  • golangci-lint from 1.35.2 to 1.36.0 on 2021-01-27
  • protolint from 0.27.0 to 0.28.0 on 2021-01-27
  • hadolint from 1.19.0 to 1.20.0 on 2021-01-28
  • phpstan from 0.12.69 to 0.12.70 on 2021-01-28
  • clj-kondo from 2020.09.09 to 2021.01.20 on 2021-01-28

• Core architecture

  • Manage remote mega-linter.yml configuration files
  • New property EXTENDS, allowing to inherit from remote mega-linter.yml configuration files
  • Add docker-in-docker management (reuse running docker instance)
  • Allow to skip auto apply fixes with commit or PR if latest commit text contains skip fix
  • Provide new issue link to create a new flavor to improve performances

• Linters

  • Add revive GO linter
  • Add SwiftLint for Swift language
  • New Mega-Linter flavor swift
  • Get correct version for eslint-plugin-jsonc

• Linter versions upgrades

  • snakefmt from 0.2.5 to 0.2.6 on 2021-01-22
  • terrascan from 1.3.0 to 1.3.1 on 2021-01-22
  • eslint-plugin-jsonc from 6.14.10 to 0.9.0 on 2021-01-24

• Linters

  • Add SQL linter sqlfluff

• Fixes

  • #269 eslint: .eslintrc.yml is considered as found whereas it's not located in workspace root

• Linter versions upgrades

  • stylelint from 13.8.0 to 13.9.0 on 2021-01-19
  • markdown-table-formatter from 1.0.1 to 1.0.4 on 2021-01-19
  • terrascan from 1.2.0 to 1.3.0 on 2021-01-19
  • cfn-lint from 0.44.3 to 0.44.4 on 2021-01-19
  • powershell from 7.1.1 to 7.0.4 on 2021-01-19
  • sfdx-scanner from 2.4.0 to 2.5.1 on 2021-01-21
  • terragrunt from 0.26.7 to 0.27.1 on 2021-01-22

• mega-linter-runner --install

  • Create .jscpd.json file if copy-paste detection is activated
  • Display ending message

• Fixes

  • #266: shfmt error in python flavor, and reactivate BASH_SHFMT and DOCKERFILE_HADOLINT for own sources linting)

• Linter versions upgrades

  • powershell from 7.1.0 to 7.1.1 on 2021-01-15
  • eslint from 7.17.0 to 7.18.0 on 2021-01-16
  • eslint-plugin-jsonc from 7.17.0 to 7.18.0 on 2021-01-16
  • scalafix from 0.9.24 to 0.9.25 on 2021-01-16
  • snakemake from 5.31.1 to 5.32.0 on 2021-01-16
  • protolint from 0.26.1 to 0.27.0 on 2021-01-18
  • phpstan from 0.12.67 to 0.12.68 on 2021-01-19

• Linters

  • Add markdown-table-formatter
  • Fix python error when CSpell found no errors

• Linter versions upgrades

  • v8r from 0.4.0 to 0.5.0 on 2021-01-14
  • phpstan from 0.12.66 to 0.12.67 on 2021-01-14
  • psalm from 4.3.1 to Psalm.4.x-dev@ on 2021-01-14

• Fix .cspell.json file updater

• Linter versions upgrades

  • v8r from 0.4.0 to 0.5.0 on 2021-01-14

• mega-linter-runner --install:
  • Fix .mega-linter.yml DISABLE property when nothing in it
  • Add default .cspell.json if spelling mistakes detector is activated

• Core
  • Refactor part of Linter & reporters to manage correctly logs when linter cli_lint_mode is project or list_of_files
    • Generate ConsoleLinter and Text reports based from Linter.files_lint_results instead of at each loop
    • When TAP Reporter active, switch linters with cli_lint_mode == "list_of_files" to "files"
    • Fix linter output when cli_lint_mode == "list_of_files"
  • Decrease number of Dockerfile steps

• Core

  • If the linter is a formatter, errors are not considered as blocking errors by default

• Linters

  • Add prettier to format Javascript and Typescript. standard remains default
  • Add remark-lint to check and fix Markdown files. markdownlint remains default

• Linter versions upgrades

  • golangci-lint from 1.35.0 to 1.35.1 on 2021-01-11
    • golangci-lint from 1.35.1 to 1.35.2 on 2021-01-11
    • golangci-lint from 1.34.1 to 1.35.0 on 2021-01-08
  • cfn-lint from 0.44.2 to 0.44.3 on 2021-01-09
  • tflint from 0.23.0 to 0.23.1 on 2021-01-10
  • dotenv-linter from 2.2.1 to 3.0.0 on 2021-01-11
    • Update Mega-Linter to call dotenv-linter v3 with fix and not --fix anymore
  • phpstan from 0.12.65 to 0.12.66 on 2021-01-11

• Core

  • Improve warning status in logs
  • Remove timestamp at each log line

• Enhance integration with GitLab CI

  • Update configuration generator
  • Update core to clean logs when in GitLab CI context

• Core

  • Allow user to configure custom scripts in .mega-linter.yml to run before and after linting, with variables PRE_RUN and POST_RUN
  • Fix wrong linter status bug
  • Enhance configuration variables performances
  • Rename XXX_FILE_NAME into XXX_CONFIG_FILE

• Linters

  • Add JSONC (json with comments) linting with eslint-plugin-jsonc

• Linters

  • Add misspell spell checker
  • Allow to define cli_lint_errors_regex in descriptors to extract number of errors from linter output stdout
  • Call linters CLIs with list of files instead of once by file, to improve performances
    • eslint
    • markdownlint
    • pylint
    • flake8
    • isort

• Core

  • Implement architecture for Mega-Linter plugins
  • Count number of errors in linter logs with regexes (cli_lint_errors_count and cli_lint_errors_regex in descriptor files)
  • Cleanup unused legacy from Super-Linter

• Reports

  • Better icons for Console, GitHub Comment and Text reporters: ✅ ❌

• Documentation

  • Add Install button for VsCode IDE extensions when available
  • Add Install button for JetBrains IDEs extensions when available
  • Add a new page All linters listing all linters and references to Mega-Linter in their documentation
  • Add json-schema documentation generation and references

• CI

  • Use quick build and TEST_KEYWORDS in commit messages, to improve contributor experience

• Fixes

  • Upgrade .tflint default config to work with new tflint version

• Flavors

  • Add ci_light flavor for only CI config files (Dockerfile,Jenkinsfile,JSON,YAML,XML)
  • Add salesforce flavor for Salesforce projects (DX or Metadata)
  • If all required linters are not in the current flavor, just skip them with a warning message

• Core

  • Add Json Schema for descriptors (allows validation and auto-completion from IDEs)
  • Add Json Schema for .mega-linter.yml configuration files

• Installation

  • Add a yeoman generator in mega-linter-runner to initialize configuration in a repository: npx mega-linter-runner --install

• Linters

  • New linter v8r to validate json and yaml files with schemastore.org

• Core

  • Do not suggest flavors when Mega-Linter validates only the diff files (VALIDATE_ALL_CODE_BASE: false)
  • Fix ConsoleReporter active linters table content
  • Check if linter is able to fix before flagging it as a fixing linter during runtime

• Flavors

  • New flavor: documentation

• Reporters

  • Support GitHub Enterprise for GitHub Comment Reporter
  • Support GitHub Enterprise for GitHub Status Reporter

• Doc

  • Add docker pulls badge in flavors documentation
  • Generate list of references to Mega-Linter

• Core
  • Allow to use remote linters configuration files with LINTER_RULES_PATH
  • Add .jekyll-cache in the list of ignored folders by default
  • Arrange display of Flavor suggestions (text and order) in reporter logs
• Build
  • Dynamically generate (build.py) the list of flavors in github actions workflows
• Doc
  • Reorganize online documentation menus
• Linters
  • Add new linter git_diff to check for git conflicts markers
  • Fix rakudo installation
  • Fix phpstan installation

• Flavored Mega-Linters

  • Generate lightweight docker images to improve Mega-Linter performances on some language based projects
  • During Mega-Linter run, suggest user to use a flavor and write it in reporters
  • Update descriptor YML files to define flavours
  • Update build.py to create one Dockerfile by Mega-Linter flavour & flavors documentation
  • New GHA workflows to build all flavoured Mega-Linters when pushing in master

• Fixes

  • Output reporter problems as warnings
  • Do not make Mega-Linter fail in case GitHubStatusReporter fails

• Doc

  • Rename "index" pages into more meaningful labels

• Add Vue.js linting (eslint-plugin-vue added in dependencies)

• Configuration parameters changes:

  • Change config setting logic: EXCLUDED_DIRECTORIES is now replacing original directory list instead of extending it
  • Add config setting: ADDITIONAL_EXCLUDED_DIRECTORIES extends EXCLUDED_DIRECTORIES directory list
  • Add config setting: <LINTER_KEY>_FILE_EXTENSIONS to override corresponding value from linter descriptor file
  • Add config setting: <LINTER_KEY>_FILE_NAMES_REGEX to override corresponding value from linter descriptor file

• Descriptor yaml schema changes:

  • Rename files_names_not_ends_with to file_names_not_ends_with
  • Rename files_names to files_names_regex and change behavior to expect regular expressions in the list.
    They are applied using full match (i.e. the whole text should match the regular expression)

• Fix error message from Email Reporter when SMTP password is not set

• Fix automerge action yml (skip if secrets.PAT is not set)

• Improve caching of compiled regular expressions

• Override mkdocs theme to make analytics work

• CI

  • Auto update linters and documentation: Create update PR only if linter versions has been updated
  • Build and deploy docker images only when it is relevant (not in case of just documentation update for example)