opengrok

• allow to specify API timeout for the Docker image
• change of opengrok-sync configuration for executable commands

old syntax:

- command: [sudo, foo, bar]

new syntax (dictionary):

- command:
    args: [sudo, foo, bar]
    env: {LC_ALL: en_US.UTF-8}
    limits: {RLIMIT_NOFILE: 2048}

• parallelized index version check during webapp startup

• improved/extended progress reporting
  • applies when running the indexer with --progress
• Python tools now accept already existing directory when creating one

• make the web app liveliness check use cheaper API endpoint
• bump default connect timeout to 10 seconds

• fix timeout handling when checking whether the webapp is live when using the -U indexer option

• fix handling of merge changesets for Git
• fix --checkIndex functionality

NOTE: this release requires reindex from scratch only if you hit the problem with duplicate search results and history cache entries due to mishandling of the Git merge changesets (#4027)

• more thorough checking of web app liveliness when using the -U indexer option
• avoid reporting to Google analytics via Chronicle map
• connectTimeout indexer tunable is now used for all API calls initiated from within the indexer
• smaller Docker image due to removal of extraneous opengrok jar file

• fix repository invalidation not finishing in environment with 1 CPU

• the --indexCheck indexer option now accepts optional argument documents that performs a check for duplicate live documents in the index
• adds debugging (at FINEST level) to the webapp search results

• fix handling renamed directories in Subversion
• handle null input files for xref ctags processing in the webapp

• Lucene 9.5.0
• fix negative LOC counts and duplicate search results for multi-segment indexes (the default)

NOTE: this release requires reindexing from scratch (i.e. wipe out data directory and reindex)

• add check to both indexer and webapp that ctags can actually process files under source root
  • note that the source root directory must be writable by the indexer
• fix repository scan depth handling

• better signal handling in Docker

• support Tomcat 10.1.x

• change the format of annotation cache to Smile
  • requires reindexing from scratch (for the projects that already have the annotation cache created; the annotation cache is off by default)
• more SCMs in the Docker image

• decrease log level for annotation problems
• fix long standing index performance problem
  • in the 2nd phase indexing the CPU was underutilized

• annotation cache
  • disabled by default, as it increases indexing time significantly
    • on the other hand decreases annotation view times in the UI, at least for the current revision of given file
  • can be enabled via indexer option --annotationCache on globally or per project
• constrained Tomcat to 10.0.x (until #4075 is resolved)
• opengrok-mirror Python tool configuration now allows to ignore a project completely
• the /reindex endpoint should work again in Docker image

• attempt to fix broken periodic reindex #4037
• fix the webapp so that it works with newer Tomcat versions (10.1.0, 10.0.26)

• removed the "optimization" (a.k.a. reduction of index segments to 1) step at the end of indexing
  • improves indexer performance
  • one can still perform this operation using the --reduceSegmentCount indexer option
    • Lucene documentation recommends this is only done for indexes that are to be archived and made read-only
    • the option might go away in the future (to be replaced with tunables for Lucene segment merging)
• the Docker image now has SSH client
  • so the repositories can have ssh:// URI
    • one has to make sure the SSH authentication works in the container
• usename/password is now configurable on project level
  • this is currently used only for Subversion repositories
  • the Subversion related environment variables were removed
• thread names now have common prefix
  • this is useful for debugging or observing indexer/webapp (e.g. via jstack or such)
• avoid reopening index directory for various operations
  • should improve performance of the webapp a bit

• added API endpoints for querying project group properties
  • see https://opengrok.docs.apiary.io/#reference/0/groups
• added debug logs (at FINEST level) to the webapp for root causing greyed out history/annotate links in the UI
• made 'H A D' link display (in directory listing and search results) consistent with the minisearch bar
  • so that if History link is greyed out, the 'H' link will not be present; similarly for Annotate and 'A'
• improved incoming changes detection for Git in the opengrok-mirror tool