pgbadger

2016-09-02 - v9.0

This major release of pgBadger is a port to bootstrap 3 and a version
upgrade of all resources files (CSS and Javascript). There's also some
bugs fixes and features enhancements.

Backward compatibility with old incremental report might be preserved.

  - Sources and licences of resources files are now on a dedicated
    subdirectory. A script to update their minified version embedded
    in pgbager script has been added. Thanks to Christoph Berg for
    the help and feature request.

  - Try to detect user/database/host from connection strings if
    log_connection is enabled and log_line_prefix doesn't include
    them.

    Extend the regex to autodetect database name, user name, client
    ip address and application name. The regex now are the following:

        db => qr/(?:db|database)=([^,]*)/;
        user => qr/(?:user|usr)=([^,]*)/;
        client => qr/(?:client|remote|ip|host)=([^,]*)/;
        appname => qr/(?:app|application)=([^,]*)/;

  - Add backward compatibility with older version of pgbadger in
    incremental mode by creating a subdirectory for new CSS and
    Javascript files. This subdirectory is named with the major
    version number of pgbadger.

  - Increase the size of the pgbadger logo that appears too small
    with the new font size.

  - Normalize detailed information in all reports.

  - Fix duplicate copy icon in locks report.

  - Fix missing chart on histogram of session time. Thanks to
    Guillaume Lelarge for the report.

  - Add LICENSE file noting the licenses used by the resource
    files. Thanks to Christoph Berg for the patch.

  - Add patch to jqplot library to fix an infinite loop when trying
    to download some charts. Thanks to Julien Tachoires for the help
    to solve this issue.

  - Script tools/updt_embedded_rsc.pl will apply the patch to resource
    file resources/jquery.jqplot.js and doesn't complain if it has
    already been applied.

  - Remove single last comma at end of pie chart dataset. Thanks to
    Julien Tachoires for the report.

  - Change display of normalized error

  - Remove unused or auto-generated files

  - Update all resources files (js+css) and create a directory to
    include source of javascript libraries used in pgbadger. There is
    also a new script tools/updt_embedded_rsc.pl the can be used to
    generate the minified version of those files and embedded them
    into pgbadger.  This script will also embedded the FontAwesome.otf
    open truetype font into the fontawesome.css file.

2016-08-27 - v8.3

This is a maintenance release that fix some minor bugs. This release
also adds replication command messages statistics to the Events
reports.

• Fix auto-detection of stderr format with timestamp as epoch (%n).
• Fix histogram over multiples days to be cumulative per hour, not
  an average of the number of event per day.
• Fix parsing of remote file that was failing when the file does
  not exists locally. Thanks to clomdd for the report.
• Detect timezones like GMT+3 on CSV logs. Thanks to jacksonfoz
  for the patch.
• Add replication command messages statistics to the Events
  reports. Thanks to Michael Paquier for the feature request.

This is the last minor version of the 8.x series, next major version
will include an upgrade of boostrap and jquery libraries which need
some major rewrite.

2016-08-11 version 8.2

This is a maintenance release that fix some minor bug. There is also
some performances improvement up to 20% on huge files and some new
interesting features:

• Multiprocessing can be used with pgbouncer log files.
• pgBouncer and PostgreSQL log files can be used together in
  incremental mode.
• With default or same prefix, stderr and syslog file can be
  parsed together, csvlog format can always be used.
• Use a modal dialog window to download graphs as png images.
• Add pl/pgSQL function information to queries when available.

See ChangeLog for the complete list of changes.

2016-04-21 version 8.1

This is a maintenance release that fix a major issue introduced with
support to pgbouncer that prevent parsing of compressed PostgreSQL
log files and adds some improvements.

Here are the complete list of changes:

• Fix one case where pid file remain after dying.
• Add requirement of log_error_verbosity = default to documentation.
• Report message "LOG: using stale statistics instead of current
  ones because stats collector is not responding" in events view.
• Remove obsolete days when we are in binary mode with --noreport
• Fix wrong report of statements responsible of temporary files.
  Thanks to Luan Nicolini Marcondes for the report. This patch also
  exclude line with log level LOCATION to be parsed.
• Fix limit on number of sample at report generation and remove
  pending LAST_PARSED.tmp file.
• Update load_stat() function and global variables to support
  pgbouncer statistics. Update version to 2.0.
• Handle more kind or query types. Thanks to julien Rouhaud for
  the patch.
• Fix pgbouncer log parser to handle message: FATAL: the database
  system is shutting down
• Fix whitespace placed in between the E and the quote character.
  Thanks to clijunky for the report.
• Fix a major issue introduced with support to pgbouncer that
  prevent parsing of compressed PostgreSQL log files. Thanks to
  Levente Birta for the report.

This is a major release that adds support to pgbouncer log files. New pgbouncer reports are:

• Request Throughput
• Bytes I/O Throughput
• Queries Average duration
• Simultaneous sessions
• Histogram of sessions times
• Sessions per database
• Sessions per user
• Sessions per host
• Established connections
• Connections per database
• Connections per user
• Connections per host
• Most used reserved pools
• Most Frequent Errors/Events

pgbouncer log files can be parsed together with PostgreSQL logs.

It also adds a two new command line options:

• --pgbouncer-only to only show pgbouncer related reports.
• --rebuild to be able to rebuild all html reports in incremental output directory where binary data files are still available.

This release fixes a major bug introduced with journalctl code that was prevented the use of multiprocess feature.

This is a maintenance release to fix a major bug that was breaking the incremental mode in pgBadger. It also adds some more reports and features.

• Add --timezone=+/-HH to control the timezone used in charts. The
  javascript library runs at client side so the timezone used is
  the browser timezone so the displayed time in the charts can be
  different from the time in the log file.
• Add /tmp/pgbadger.pid file to prevent cron jobs overlaping on
  same log files.
• Add command line option --pid-dir to be able to run two pgbadger
  at the same time by setting an alternate path to the pid file.
• Report information about "LOG: skipping analyze of ..." into
  events reports.
• Report message "LOG: sending cancel to blocking autovacuum" into
  events reports. Useful to look for queries generating autovacuum
  kill on account of a lock issue.

This new release fixes some issues especially in temporary files reports and adds some features.

• Allow pgBadger to parse natively the journalctl command output
• Add new keywords from PG 9.5 for code formating
• Add support to %n log_line_prefix option for Unix epoch (PG 9.6)

There's also some new command line option:

• Adds --journalctl_cmd option to enable this functionality and set the command. Typically to parse output of PG 9.4 log:

  --journalctl_cmd "journalctl -u postgresql-9.4"
  

to parse output of PG 9.4 log through the journalctl command.

See ChangeLog for the full list of changes/fixes.