sitespeed.io

Fixed

• Updated to Browsertime 14.21.1 that disables the new Chrome splash screen by default.

https://github.com/sitespeedio/sitespeed.io/compare/v22.1.1...v22.1.2

• The slim container with only Firefox was broken in last release. It's now re-released with Firefox 96 and Firefox 97 coming soon.

https://github.com/sitespeedio/sitespeed.io/compare/v22.1.0...v22.1.1

Added

• Upgraded to latest Browsertime with Egdedriver 98.
• Upgraded to Edge 98 and Firefox 97 in the (amd64) Docker containers.

https://github.com/sitespeedio/sitespeed.io/compare/v22.0.1-test...v22.1.0

22.0.0 - 2022-02-07

Breaking changes

• If you use the Lightouse plugin there's breaking changes:

In the new version we drop support for the following:

• Running multiple runs with Lighthouse.
• Using scripts to login the user (or whatever you need before you run your tests)
  It's a couple of reasons why I remove those features:
• I been looking for a maintainer of the Lighthouse plugin for +1 year and I haven't found one. For me to be able to maintain it I want the plugin to be as simple as possible.
• I deeply regret merging the PR for adding multiple runs for Lighthouse. That PR goes against everything I know about measuring performance. Lighthouse is not built for getting correct performance metrics, it's built to help (Chrome) developers to get insights how they make the page "faster". Lets stick to the basics and keep it possible to get those recommendations from Lighthouse.
• Maybe someday Lighthouse will have support for user journeys, lets wait until that is officially supported and then I can check if it could be used in the plugin.

With the new release we also break how you configure Lighthouse. People has had problem with that since day 1. With the new version we support two new ways to configure Lighthouse:

• By configuration JSON file. --lighthouse.config config.js
• By Lightouse flags file. --lighthouse.flags flag.json

If you don't need to configure Lightouse you can use the default settings both for desktop and mobile. If you run without any settings, the plugin will use desktop settings. If you run with --mobile, --android or --ios the mobile settings will be used.

Added

• Build Docker containers for both amd64 and arm64 to make containers work on Mac M1. The arm container contains Firefox and Chromium. Thank you whichfinder and Radu Micu for the help! Fixed in PR #3554.
• When plugins is loaded, there's a new extra last step where we try to load the plugin as a globally installed npm module #3546.

Fixed

• Fix so that we do not display the same 3rd party cookie multiple times #3545.
• Updated Coach Core that includes the latest version of third party web and PageXray that find more fonts without mime type.

https://github.com/sitespeedio/sitespeed.io/compare/v21.6.1...v22.0.0

Fixed

• Updated to Browsertime 14.18.1 that makes the summary metric log message use median (instead of mean) and change a log message level to debug.

https://github.com/sitespeedio/sitespeed.io/compare/v21.6.0...v21.6.1

Added

• Updated to Edge stable release in the Docker container.
• Remove Crux distribution table and use pie charts instead #3537
• Add extra sleep time between Crux calls to make sure to not overload the API limit #3536.
• Added extra Crux enable command line --crux.enable to enable Crux #3538. Its default value is true and you also need to supply the Crux key to run Crux. The reason for the new parameter is that you can now configure the key in your configuration JSON and set the enable to false and then you enable it with the CLI parameter when you actually need to run Crux.
• Show Crux-metrics on the Summary page #3540.
• Updated summary metrics tables with headings to make it easier to read #3541.
• Added Browsertime 14.17.0 with new Select and click.byName commands. With that Browsertime version you also need to have ffprobe installed when you run Visual Metrics but that should already be installed.
• Added Browsertime 14.18.0 with a fix for Firefox #1698

Added

• Upgraded to Browsertime 14.15.0 that adds support for --appendToUserAgent for Chrome/Edge/Firefox. Amd then Browsertime 14.16.0 that supports Geckodriver for Raspberry Pi.

https://github.com/sitespeedio/sitespeed.io/compare/v21.4.0...v21.5.0

Added

• Updated to a new build of WebPageReplay in the Docker container
• Updated the Ubuntu base image to latest version and latest NodeJS in the Docketr container.
• Upgraded Browdsertime #3528:
  • Add support for Humble as connectivity engine for mobile phone testing. Make sure to setup Humble on a Raspberry Pi 4 and the choose engine with --connectivity.engine humble and set the URL to your instance --connectivity.humble.url http://raspberrypi.local:3000. Added in #1691.
• Upgraded to Chrome 97 and Edge 97 in the Docker container.
• Upgraded to Chromedriver 97.

Fixed

• Updated Chromedriver library that automatically picks up the Chromedriver if it's installed on Raspberry Pi.

https://github.com/sitespeedio/sitespeed.io/compare/v21.3.0...v21.4.0

21.3.0 - 2022-01-01

Added

• Updated to Browsertime 14.13.0 with the following fixes for the user agent:
  • Append text to Chrome/Edge user agent using --chrome.appendToUserAgent
  • When you use Chrome/Edge and use a "emulated device" that will use the user agent that you provide using --userAgent. Else it will use the user agent from your emulated device setting.
  • You can also use Edge to run emulated mobile with the same settings as Chrome.

https://github.com/sitespeedio/sitespeed.io/compare/v21.2.2...v21.3.0

Fixed

• Fix the error introduced in 21.2.0 for "Include page summary URL in the result JSON"
  #3525.

https://github.com/sitespeedio/sitespeed.io/compare/v21.2.1...v21.2.2

Fixed

• It turns out that Firefox 95 doesn't work with the HAR export trigger and the workaround that worked in Firefox 94 seems to not work in 95 see https://github.com/sitespeedio/browsertime/issues/1671#issuecomment-999412035. That's why we are reverting to Firefox 94 in the Docker containers.

https://github.com/sitespeedio/sitespeed.io/compare/v21.2.0...v21.2.1

Fixed

• The catching of errors in the queue was broken and reported the error x times (x=numbert of plugins). Also when we had an error the result JSON was not stored. #3522.

Added

• Updated to Firefox 95 and Edge 96 in the Docker container.
• Include page summary URL in the result JSON #3523.
  https://github.com/sitespeedio/sitespeed.io/compare/v21.1.0...v21.2.0

Added

• Added possibility choose name for storing a result JSON #3520. We use this for a feature that will be released soon.

https://github.com/sitespeedio/sitespeed.io/compare/v21.0.1...v21.1.0

Fixed

• Updated Browsertime that logs Chrome document request failures on debug log level instead so that the log is not cluttered.

https://github.com/sitespeedio/sitespeed.io/compare/v21.0.0...v21.0.1

Changed

• Updated to Coach Core 7.0.0. This will probably change your Coach score. The new Coach has the following changes:

  • Moved AMP advice to best practice instead of privacy #67.
  • Increased favicon max size advice from 5 to 10 kb #68
  • Renamed the fastRender advice to avoidRenderBlocking #73
  • Remove the third party async advice #74
  • Updated the layout shift advice to use cumulative layout shift #75
  • Changed id of the Google Tag Manager advice #79
  • Updated third-party-web to 0.12.6.
  • Use Chrome(ium) render blocking information to know if a request is render blocking or not #66.
  • Report offending JavaScript assets if the JavaScript max limits kicks in #70.
  • New largest contentful paint advice #76.
  • New first contentful paint advice #77.
  • Added TBT in the CPU longtask advice #80.
  • Report content and transfer size for offending URLs #81.
  • Report offending assets with transfer/content size for page size limit #82.
  • Fix cases when JQuery is undefined. Thank you shubham jajodia for PR #64.
  • A better way to find offending layout shifters. Thank you shubham jajodia for PR #65.
  • Removed mentions aboout server push #69
  • Added more information on how to debug CPU advice #71.

• Updated to sustainable plugin core code to co2 0.8.0. This include a biug fix to the 1byte model that will lower your co2 score #3519.

Added

• Updated to Browsertime 14.12.0 that fixes the FF 94 HAR issue.
• Updated green domains from the Green Web Foundation #3513.
• Updated PerfCascade that support chunks when you use Chrome(ium) #3514.
• Updated to Firefox 94 in the Docker image.

Fixed

• Added missing summary boxes on start page #3515.

Fixed

• Updated to Browsertime 14.10.2 that disables the Edge/Edgeedriver version check.

https://github.com/sitespeedio/sitespeed.io/compare/v20.6.1...v20.6.2

Fixed

• Updated to Browsertime 14.10.1 that disables the Chrome/Chromedriver version check by default.

https://github.com/sitespeedio/sitespeed.io/compare/v20.6.0...v20.6.1

Note: Do your test fails with Firefox 94? See Browsertime #1671. Until that is fixed in Firefox, it seems most use cases is fixed by adding a settle time (the browser rest for a while before we start the test). Try with --browsertime.settleTime 10000 to add a 10 seconds wait time before the test starts.

Added

• Updated to Browsertime 14.10.0 with Chromedriver 96 and Chrome 96 in the Docker container.

https://github.com/sitespeedio/sitespeed.io/compare/v20.5.0...v20.6.0

Added

• Updated to Browsertime 14.9.0 with updated Chrome HAR generator.

Fixed

• Ignore Influxdb and Grafana setup messages when you use the analysisstorer plugin #3508.

https://github.com/sitespeedio/sitespeed.io/compare/v20.4.2...v20.5.0

20.4.2 - 2021-11-07

Fixed

• Updated to AXE core 4.3.5 #3501.
• Use latest npm in the Docker container #3502.
• Fixed the bug that caused so that you couldn't use the analyisstorer plugin together with Graphite #3506.
• Updated to yargs 17.2.1

https://github.com/sitespeedio/sitespeed.io/compare/v20.4.1...v20.4.2