sitespeed.io

Added

• Add isSignificant metric to send to Graphite when using the compare plugin. Will send 0 if there's no siginificant change, else send the Cliffs delta to know how large the change is #4030.

https://github.com/sitespeedio/sitespeed.io/compare/v30.9.0...v30.10.0

Added

• Chrome and Edge 120 in the Docker container #4027.
• Updated to Browsertime 19.2.0.
• For users of the +1 container Lighthouse has been upgraded to 11.4.0.

https://github.com/sitespeedio/sitespeed.io/compare/v30.8.0...v30.9.0

Added

• Use Cliffs delta to know the size of the significant change #4024.
• Show if the graph has a siginficant change or not in the compare plugin #4025.

https://github.com/sitespeedio/sitespeed.io/compare/v30.7.1...v30.8.0

Fixed

• The old settings for MannWhitneyU tests where confusing. We compared the the baseline is less than the current tests. This PR switched so we instead look if the current tests are greater than the baseline. We also added some better explaining text on result page#4023.

https://github.com/sitespeedio/sitespeed.io/compare/v30.7.0...v30.7.1

• Show Axe individual issues on the page summary (not only on each individual run) #4019. Thank you shaqb for pointing that out. The total number of issues is also sent to Graphite under statistics.axe.violationIssues. *

https://github.com/sitespeedio/sitespeed.io/compare/v30.6.0...v30.7.0

Added

• Make sure browser cpu benchmark is included in the baseline #4015.
• Fixed so baseline metrics is linked to graphs #4016.

Fixed

• Fix decimals on Google Web Vitals in baseline #4014.

https://github.com/sitespeedio/sitespeed.io/compare/v30.5.0...v30.6.0

Added

• The new compare plugin can now run without an id. The id will then be generated from the URL. If you don't give it an id, yoiu can only compare pages with the exact same URL #4013.

https://github.com/sitespeedio/sitespeed.io/compare/v30.4.1...v30.5.0

Fixed

• Fix for Firefox when generating the result HTML. It was broken since we where missing CPU data.

https://github.com/sitespeedio/sitespeed.io/compare/v30.4.0...v30.4.1

Fixed

• Upgrade to Browsretime 19.1.0 with a fix for Geckodriver so that the correct ARM version is installed on Mac Arm machines.

Added

• The new compare plugin PR 4009 makes it easy to use Mann Whitney U/Wilcox for support to find performance egressions. Read all about the plugin in the documentation.
• Firefox 120 in the Docker container #4010.
• Button to download the console logs, thank you bairov pavel for PR #4007.

Added

• Upgrade to Browsertime 18.0.0.
• Added suupport to run user journeys with WebPageReplay #4005.

Fixed

• Downgrade puppeteer in the +1 container for Lighthouse, thank you bairov pavel for PR #123.

https://github.com/sitespeedio/sitespeed.io/compare/v30.2.1...v30.3.0

Fixed

• The Docker+1 container got a fix for Lighthouse that didn't work in 30.2.0 (adding dev-shm when starting Chrome).

https://github.com/sitespeedio/sitespeed.io/compare/v30.2.0...v30.2.1

Added

• Updated to Browsertime 17.19.0 with Edgedriver 119 #3998.
• Updated the Docker container with Edge 119.

Fixed

• The Docker+1 container has been upgraded to Lighthouse 11.3.0.
• Add support for getting verbose logs and Chromedriver logs from the recording phase of WebPageReplay #3999.

https://github.com/sitespeedio/sitespeed.io/compare/v30.1.0...v30.2.0

Added

• The Docker slim container uses Debian Bookworm #3996.
• Updated to Chrome 119 in the Docker container.

Fixed

• Fixed analysisstorer trying to save setup messages #3995.
• Updated to Browsertime 17.18.1 #3992.
  https://github.com/sitespeedio/sitespeed.io/compare/v30.0.0...v30.1.0

30.0.0 - 2023-10-25

Breaking changes

• Drop support for NodeJS 16 (security ended in September).

Added

• The Docker container now uses NodeJS 20.
• Updated to Firefox 119 and Edge 118 in the Docker container.
• Updated the base container to use latest tagged Ubuntu 22.04.

https://github.com/sitespeedio/sitespeed.io/compare/v29.9.0...v30.0.0

Added

• Updated Browsertime to 17.18.0:
  • Updated to Chromedriver 119 #2003. 119 works with both Chrome 118 and 119 so it fixes #1197.
  • Add support for network idle method to know when to end a test that uses network logs. Uses Bidi for Firefox and CDP for Chrome to listen on network events to know when to end a test. By default 5 seconds idle network time ends a tests (you could have network responses that hasn't arrived yet) #1960. Potentially this can help SPA users or users where the page uses iframes. You can try it out by adding --browsertime.pageCompleteCheckNetworkIdle true to your command line. This is still some work in progress but feel free to try ut out.
  • The resources script now collects number of resources served from the browser cashe for browser that supports that through the resource timing API #1998
  • Make sure timer always is cleared. There was case of where we do a rase beteween a promise and a timeout where the timeout timer wasn't cleared/removed #2005.
  • Better way to get the url when you use GeckoProfiler.stop for Firefox, thank you Nazım Can Altınova for PR #1999
    https://github.com/sitespeedio/sitespeed.io/compare/v29.8.0...v29.9.0

Added

• Updated to Chrome/Chromedriver 118 in the Docker container #3975.
• Users of the +1 container will get Lighthouse 11.2.0 from this release.

Fixed

• Updated to Axe-core 4.8.2 #3977.
• A better error message when ypu try to measure a navigation without navigating #3980.

https://github.com/sitespeedio/sitespeed.io/compare/v29.7.0...v29.8.0

Added

• Updated Firefox to 118 in the Docker container #3968.
• Users of the +1 container will have Lighthouse version 11.1.0.

https://github.com/sitespeedio/sitespeed.io/compare/v29.6.0...v29.7.0

Added

• Updated Chrome and Edge to 117, also NodeJS 18.18.0 and a latest updated version of Ubuntu 22.04 #3965.
• Updated to Axe core 4.8.1 #3964.

https://github.com/sitespeedio/sitespeed.io/compare/v29.5.0...v29.6.0

Added

• Updated to Firefox 117 and Edge 116 in the Docker container #3958.

https://github.com/sitespeedio/sitespeed.io/compare/v29.4.0...v29.5.0

Added

• Display axe-core version on the summary page (before it was only showed on each run page) #3950.
• Display third-party-web and wappalyzer version in the HTML output (by upgrading to Coach 8.0.0) #3953.
• Display co2 version in the HTML output #3953.