New Features

• GA versioning https://github.com/Azure/WALinuxAgent/pull/2810 https://github.com/Azure/WALinuxAgent/pull/2850 https://github.com/Azure/WALinuxAgent/pull/2860 https://github.com/Azure/WALinuxAgent/pull/2881
• Disabled GA versioning https://github.com/Azure/WALinuxAgent/pull/2909

General Improvements

• Add regular expression to match logs from very old agents #2839
• Remove empty "distro" module #2854
• Enable Python 2.7 for unit tests #2856
• Add check for noexec on Permission denied errors #2859
• Reorganize file structure of unit tests #2894
• Report useful message when extension processing is disabled #2895
• Add log and telemetry event for extension disabled #2897

Bug Fixes

• Check certificates only if certificates are included in goal state https://github.com/Azure/WALinuxAgent/pull/2803
• Redact access tokens from extension's output #2811
• Fix name of single IB device when provisioning RDMA #2814
• Port NSBSD system to the latest version of waagent #2828
• fix daemon version #2874
• Download certs on FT GS after check_certificates only when missing from disk https://github.com/Azure/WALinuxAgent/pull/2907

Test Improvements

• Improve end to end testing pipeline https://github.com/Azure/WALinuxAgent/pull/2795 https://github.com/Azure/WALinuxAgent/pull/2804 https://github.com/Azure/WALinuxAgent/pull/2806 https://github.com/Azure/WALinuxAgent/pull/2817 https://github.com/Azure/WALinuxAgent/pull/2820 https://github.com/Azure/WALinuxAgent/pull/2821 https://github.com/Azure/WALinuxAgent/pull/2822 https://github.com/Azure/WALinuxAgent/pull/2823 https://github.com/Azure/WALinuxAgent/pull/2824 https://github.com/Azure/WALinuxAgent/pull/2826 https://github.com/Azure/WALinuxAgent/pull/2827 https://github.com/Azure/WALinuxAgent/pull/2829
  https://github.com/Azure/WALinuxAgent/pull/2830 https://github.com/Azure/WALinuxAgent/pull/2841
  https://github.com/Azure/WALinuxAgent/pull/2842 https://github.com/Azure/WALinuxAgent/pull/2843
  https://github.com/Azure/WALinuxAgent/pull/2844 https://github.com/Azure/WALinuxAgent/pull/2845
  https://github.com/Azure/WALinuxAgent/pull/2846 https://github.com/Azure/WALinuxAgent/pull/2846
  https://github.com/Azure/WALinuxAgent/pull/2847 https://github.com/Azure/WALinuxAgent/pull/2848
  https://github.com/Azure/WALinuxAgent/pull/2852 https://github.com/Azure/WALinuxAgent/pull/2853
  https://github.com/Azure/WALinuxAgent/pull/2855 https://github.com/Azure/WALinuxAgent/pull/2857
  https://github.com/Azure/WALinuxAgent/pull/2861 https://github.com/Azure/WALinuxAgent/pull/2862
  https://github.com/Azure/WALinuxAgent/pull/2863 https://github.com/Azure/WALinuxAgent/pull/2865
  https://github.com/Azure/WALinuxAgent/pull/2872 https://github.com/Azure/WALinuxAgent/pull/2873
  https://github.com/Azure/WALinuxAgent/pull/2875 https://github.com/Azure/WALinuxAgent/pull/2878
  https://github.com/Azure/WALinuxAgent/pull/2880 https://github.com/Azure/WALinuxAgent/pull/2882
  https://github.com/Azure/WALinuxAgent/pull/2886 https://github.com/Azure/WALinuxAgent/pull/2887
  https://github.com/Azure/WALinuxAgent/pull/2888 https://github.com/Azure/WALinuxAgent/pull/2891
  https://github.com/Azure/WALinuxAgent/pull/2892

Creating this release in case we need to roll forward in USSec/USNat

This release branch is created from v2.2.46 tag

[Marked as a pre-release while it is deployed to production; will be marked as latest when the deployment completes]

General Improvements

• Download certificates when goal state source is fast track https://github.com/Azure/WALinuxAgent/pull/2761
• Increase the max number of extension events by 20% https://github.com/Azure/WALinuxAgent/pull/2785
• Remove version suffix from extension slice https://github.com/Azure/WALinuxAgent/pull/2782
• Support int type for eventPid and eventTid fields https://github.com/Azure/WALinuxAgent/pull/2786
• Improve log for swap counter not found https://github.com/Azure/WALinuxAgent/pull/2789
• Remove cgroup files during deprovisioning https://github.com/Azure/WALinuxAgent/pull/2790
• Log VM architecture in heartbeat telemetry for arm64 adoption monitoring https://github.com/Azure/WALinuxAgent/pull/2818
• Enforce memory usage for agent https://github.com/Azure/WALinuxAgent/pull/2671
• Use common download logic for agent downloads https://github.com/Azure/WALinuxAgent/pull/2682
• Implement Fedora distro https://github.com/Azure/WALinuxAgent/pull/2642
• Report message in handler heartbeat https://github.com/Azure/WALinuxAgent/pull/2688

Bug Fixes

• Remove dependency on pathlib from makepkg https://github.com/Azure/WALinuxAgent/pull/2717
• Do not fetch extensions goal state in log collector https://github.com/Azure/WALinuxAgent/pull/2713
• Update log collector unit file to remove memory limit https://github.com/Azure/WALinuxAgent/pull/2757
• Fix bug in get_dhcp_pid (CoreOS) https://github.com/Azure/WALinuxAgent/pull/2784

Distro Support

• Fetch full distro version for mariner https://github.com/Azure/WALinuxAgent/pull/2773

Test Improvements

• Improve end to end testing pipeline https://github.com/Azure/WALinuxAgent/pull/2691 https://github.com/Azure/WALinuxAgent/pull/2701 https://github.com/Azure/WALinuxAgent/pull/2704 https://github.com/Azure/WALinuxAgent/pull/2707 https://github.com/Azure/WALinuxAgent/pull/2708 https://github.com/Azure/WALinuxAgent/pull/2710 https://github.com/Azure/WALinuxAgent/pull/2714 https://github.com/Azure/WALinuxAgent/pull/2716 https://github.com/Azure/WALinuxAgent/pull/2719 https://github.com/Azure/WALinuxAgent/pull/2722 https://github.com/Azure/WALinuxAgent/pull/2725 https://github.com/Azure/WALinuxAgent/pull/2731 https://github.com/Azure/WALinuxAgent/pull/2733 https://github.com/Azure/WALinuxAgent/pull/2732 https://github.com/Azure/WALinuxAgent/pull/2734 https://github.com/Azure/WALinuxAgent/pull/2739 https://github.com/Azure/WALinuxAgent/pull/2740 https://github.com/Azure/WALinuxAgent/pull/2745 https://github.com/Azure/WALinuxAgent/pull/2747 https://github.com/Azure/WALinuxAgent/pull/2751 https://github.com/Azure/WALinuxAgent/pull/2748 https://github.com/Azure/WALinuxAgent/pull/2756 https://github.com/Azure/WALinuxAgent/pull/2762 https://github.com/Azure/WALinuxAgent/pull/2758 https://github.com/Azure/WALinuxAgent/pull/2764 https://github.com/Azure/WALinuxAgent/pull/2767 https://github.com/Azure/WALinuxAgent/pull/2769 https://github.com/Azure/WALinuxAgent/pull/2771 https://github.com/Azure/WALinuxAgent/pull/2779 https://github.com/Azure/WALinuxAgent/pull/2787 https://github.com/Azure/WALinuxAgent/pull/2788 https://github.com/Azure/WALinuxAgent/pull/2792 https://github.com/Azure/WALinuxAgent/pull/2793
• Update github hosted build runner for Unit tests https://github.com/Azure/WALinuxAgent/pull/2755
• Update test_update to not include agent version number in assert https://github.com/Azure/WALinuxAgent/pull/2799

Deployment Schedule

NOTES:

• This release will be marked as 'latest' once it has been deployed to all regions.
• Pre-release versions may not be available on all the VMs in the regions where they have been deployed,

New Features

• Resource Governance on extensions (CPU monitoring and enforcing & Memory monitoring) https://github.com/Azure/WALinuxAgent/pull/2632 https://github.com/Azure/WALinuxAgent/pull/2581 https://github.com/Azure/WALinuxAgent/pull/2555
• Agent resource governance https://github.com/Azure/WALinuxAgent/pull/2597 https://github.com/Azure/WALinuxAgent/pull/2591 https://github.com/Azure/WALinuxAgent/pull/2546
• monitor system-wide memory metrics (https://github.com/Azure/WALinuxAgent/pull/2610)

General Improvements

• Additional telemetry for goal state (https://github.com/Azure/WALinuxAgent/pull/2675)
• HostGAPlugin usage improvements https://github.com/Azure/WALinuxAgent/pull/2662 https://github.com/Azure/WALinuxAgent/pull/2673 https://github.com/Azure/WALinuxAgent/pull/2655 https://github.com/Azure/WALinuxAgent/pull/2651
• Add logging statements for mrseq migration during update (https://github.com/Azure/WALinuxAgent/pull/2667)
• Logcollector memory usage https://github.com/Azure/WALinuxAgent/pull/2658 https://github.com/Azure/WALinuxAgent/pull/2637
• Update Log Collector default in Comments and Readme (https://github.com/Azure/WALinuxAgent/pull/2608)
• Improve telemetry success and failure markers (https://github.com/Azure/WALinuxAgent/pull/2605) https://github.com/Azure/WALinuxAgent/pull/2604 https://github.com/Azure/WALinuxAgent/pull/2599/

Bug Fixes

• Fix formatting of exceptions on Python 3.10 (traceback.format's etype argument) (https://github.com/Azure/WALinuxAgent/pull/2663)
• Fix UNKNOWN(Zombie) Process in unexpected processes check (https://github.com/Azure/WALinuxAgent/pull/2644)
• SUSE: Fix valid values for DHCLIENT_HOSTNAME_OPTION (https://github.com/Azure/WALinuxAgent/pull/2643)
• Debian - string conversion for systemd service (https://github.com/Azure/WALinuxAgent/pull/2574)
• Do not set a CPU quota on the agent for RHEL and Centos (https://github.com/Azure/WALinuxAgent/pull/2685) https://github.com/Azure/WALinuxAgent/pull/2689 https://github.com/Azure/WALinuxAgent/pull/2693

Distro Support

• support rhel distro (https://github.com/Azure/WALinuxAgent/pull/2620) https://github.com/Azure/WALinuxAgent/pull/2598
• Added support for devuan linux distribution (https://github.com/Azure/WALinuxAgent/pull/2553)

Test Improvements

• Test fixes https://github.com/Azure/WALinuxAgent/pull/2634 https://github.com/Azure/WALinuxAgent/pull/2567 https://github.com/Azure/WALinuxAgent/pull/2552 https://github.com/Azure/WALinuxAgent/pull/2556 https://github.com/Azure/WALinuxAgent/pull/2548 https://github.com/Azure/WALinuxAgent/pull/2547
• Fix No known host error message for DCR v2 (https://github.com/Azure/WALinuxAgent/pull/2554)

Deployment Schedule

NOTES:

• This release will be marked as 'latest' once it has been deployed to all regions.
• Pre-release versions may not be available on all the VMs in the regions where they have been deployed,

Updates

Bug Fixes

• Retry HGAP's extensionsArtifact requests on BAD_REQUEST status #2622
• Use 'ip' instead of 'ifdown/ifup' to restart network interface on RHEL >= 8.6 #2612 #2624

Deployment Schedule

Updates

New Features

• Enabled support for Fast Track (faster processing of extensions) #2475, #2486, #2490, #2477, #2500, #2499, #2508, #2514, #2520, #2523, #2524, #2526, #2525, #2537, #2541, #2542, #2544, #2549, #2558, #2560, #2562 , #2569, #2575, #2576, #2577, #2594, #2615, #2633, #2649

General Improvements

• Add telemetry for VM Size #2462
• Add telemetry for environment variables passed to extensions #2536
• Enforce CPU quota on the Agent on Red Hat and CentOS 7.4+ #2531

Bug Fixes

• Restore all firewall rules needed for communication with the WireServer #2480, #2491, #2509, #2512
• Fix false positives reporting processes in the Agent's cgroup #2522
• Fix false errors when collecting debug logs #2535
• Don't report incorrect CPU usage data #2538
• Fetching a goal state with empty certificates property #2575
• Silence goal state fetch errors after 3 logs #2576
• Change fast track timestamp default from None to datetime.min #2577
• Retry HGAP's extensionsArtifact requests on BAD_REQUEST status #2621

Distro Support

• Support for Rocky Linux #2463
• RHEL 8 #2532
• RHEL 9 #2629 , #2630

Work in Progress

• Preliminary work to enforce CPU quota on extensions #2459, #2464,
• Preliminary work for management of agent self-updates [GA Versioning] #2467, #2479, #2487,

Test Improvements

• Add CentOS 7.9 to end-to-end-tests #2465
• Add Mariner to end-to-end-tests #2517, #2528
• Test fixes #2458, #2471, #2515, #2513, #2518, #2519, #2529, #2539, #2540

Deployment Schedule

NOTES:

• This release will be marked as 'latest' once it has been deployed to all regions.

• Pre-release versions may not be available on all the VMs in the regions where they have been deployed,

This release contains a hotfix for OOM errors on the log collector:

• #2533

General improvements

• Increase time of autoupdates after updates are available #2403
• Send telemetry when upgrade available #2421
• Enable collection of debugging information #2436, #2453, #2510
• Add support for Python 2.6 to the debug info collection code #2452
• Enable CPU/memory data collection on RedHat and CentOS #2450

Bug fixes

• Exclude end-to-end tests from Agent setup #2396, #2402
• Fix log message in cgroups management #2427
• Fix parsing of malformed error.json files #2433
• Allow DNS queries over TCP #2429
• Dont exit extension handler process if unable to fetch first goal state #2440

Distro support

• Improvements for Mariner #2407, #2414
• Add uos support #2420
• Add support for VMware PhotonOS #2431

Work in progress

• Preliminary changes to support Fast Track (added support for the Fast Track pipeline, but still using the Fabric pipeline for goal states) #2394, #2398, #2397, #2399, #2404, #2406, #2411, #2413, #2416, #2418, #2419, #2426, #2430, #2432, #2441, #2442, #2443, #2446, #2451, #2454, #2456, #2466, #2470, #2477, #2482, #2492, #2503
• Preliminary changes to support enforcement of CPU quota for VM Extensions (collect data for pilot extensions) #2391
• Preliminary changes for management of the Agent version during deployments #2428, #2437

Test improvements

• New end-to-end test pipeline #2408, #2409, #2417, #2422, #2436
• Unit test improvements #2401, #2415, #2414, #2434

New Features

• added cloudlinux support (#2344)
• Enable extensions cpu monitoring (#2357, #2384, #2391)
• Support Flatcar Container Linux (#2365)
• Retrieve VmSettings from HostGAPlugin (#2378, #2382, #2386, #2394, #2397, #2404)
• Set Agent's CpuQuota to 75% (#2383)

Bug Fixes

• Use handler status if extension status is None when computing the ExtensionsSummary (#2358) (#2361)
• fix bug with dependent extensions with no settings (#2285) (#2362)
• Create events dir for handlers if ETP enabled (#2366)
• Report status even if goal state cannot be processed (#2370)
• Define ExtensionsSummary.eq (#2371) (#2373)
• Implement ExtensionsSummary.ne in terms of eq (#2375)

Improvements

• Code refactoring (#2350, #2369, #2376)
• Unit test improvements (#2351, #2353, #2354, #2367, #2377, #2380)
• integration test improvements (#2381, #2387, #2396 )
• logging improvements (#2385)

New Features and improvements

• Enable Extension Telemetry Pipeline (#2337, #2339)
• Enable Periodic Log Collection in systemd distros (#2295,#2289)
• Implement InitialGoalStatePeriod parameter + improvements in logging goal state processing(#2332)
• Fix operation name in InitializeHostPlugin event(#2338)
• Mock systemctl stop cmd (#2335)
• Report transitioning when status file not found (#2330)
• Dont create default status file for Single-Config extensions (#2318)
• Do not create placeholder status file for AKS extensions (#2298)
• Save waagent_status to history folder and add additional details to the status file (#2325,#2301,#2270)
• Rename Debug.FetchVmSettings to Debug.EnableFastTrack (#2324)
• Update HostGAplugin headers before fetching vmSettings (#2323)
• Handle HTTP GONE in vmSettings request (#2321)
• Added log statements to debug issues in vmSettings API(#2317)
• Remove reference to re.IGNORECASE (#2316)
• Add and remove extension slice (#2315)
• FastTrack changes (#2314, #2313,#2306, #2304,#2294, #2293)
• Helper to handle exception message(#2305)
• Remove trailing spaces from command name (#2296)
• Add debug info for systemd-run false positives (#2292)
• Move Github Actions VMs to Ubuntu 18 (#2291)
• Onboard redhat82, ubuntu20 (#2290, #2279)
• Allow systemd-run in the Agent's cgroup (#2287)
• Use handler status if extension status is None (#2358)
• Bug Fix :Define ExtensionsSummary.ne (#2371)

Test improvements

• Getting the agent version from the version file (#2346)
• Save the original subprocess.Popen before mocking it (#2340)
• Added message to test_run_latest's assertion (#2334)

New Features and Improvements:

• PA changes to check cloud-init (#2061)
• log collector (#2066)
• cgroups CPU percentage py processor count (#2074)
• Parse InVMGoalStateMetaData from Extension Config (#2081)
• iscsi disk support for agent configs (#2073)
• Add support for VMs with multiple IB devices (#2085)
• Python 3.9 support (#2082)
• Add support for CBL-Mariner distro (#2099)
• Enable Provisioning.MonitorHostName for Ubuntu (#1934)
• Added supportedFeatures flag in status reporting (#2089)
• Parse ext runtime settings (#2087)
• GHA merge validation (#2097)
• Cgroups improvements
• renamed the eventsFolder variable for preview and enabled ETP (#2140)
• Agent slice and custom unit files telemetry (#2150)
• Make IPoIB interface online (#2116)
• Add option to disable NetworkConfigurationChanges (#2156)
• Log network configuration on service start (#2157)
• Setup persistent firewall rules on service restart (#2154)

Bug Fixes:

• switched to using run_command (#2060)
• fixes for chained-comparison and dangerous-default-value pylint warnings (#2072)
• fixed depends on errors (#2059)
• WireIp env variable added (#2078)
• Unstick HGAP channel as default (#2046)
• shellutil.run_command fixes (#2086, #2098)
• unit test fixes (#2090, #2091, #2108, #2153)
• fix distro resolution for RedHat (#2083)
• Read KVP value in binary mode (#2084)
• Redact protected settings in goal state debug files (#2130)
• Modify retry logic for empty goal state (#2140)
• GS no config fix (#2141)
• CommandExecution.log logrototate config -> custom log management (#2143)
• binary file for firewall rules (#2147)
• Refresh host ga plugin periodically (#2155)
• Disabled custom service (#2166)
• update test zips (#2167)

New Features

• Enforce CPUQuota on agent #2222, #2226
• Add support for RequiredFeatures and GoalStateAggregateStatus APIs #2190, #2206, #2209, #2216
• Added fallback locations for extension manifests #2188

Bug fixes

• Add missing call to str.format() when creating exception #2193
• Remove helper network service on deprovision #2191
• Use a helper script to start the network service #2225 #2253
• Initialize published_hostname using /var/lib/cloud/data/set-hostname #2215
• Fix utf logging for persist firewall rules #2237
• Replace firewall-setup unit file if changed #2236

Logging improvements

• Add debug info #2199
• Mark cgroup messages as INFO #2202
• Log a warning when HTTP fetch fails #2205
• Log changes in Extension.Enabled #2208
• Mark messsage as Cgroups Warning #2220

Test improvements

• Set Agent version to 9.9.9.9 for testing #2198
• Fixed get-pip uri #2201
• Use a sample agent zip for update tests #2200
• Add Debug options to disable checks on cgroups #2203
• Add custom trigger for GHA workflows #2214
• Disable pylint warning: "consider using with" #2238

New Features

• Support for Multi config (#2245, #2261)
• Support sles 15 sp2 distro (#2272)

Bug Fixes

• Cleanup history folder every 30 min (#2258)
• Updated _read_status_file to include a fragment of status file in the exception (#2257)
• Fix telemetry unicode errors (Re-add #1937) (#2278)
• Match IPoIB interface with any alphanumeric characters (#2239)
• Fix bug with dependent extensions with no settings (#2285)
• Do not create placeholder status file for AKS extensions (#2298)
• Refactoring of Agent's main loop (#2275)
• Exception for Linux Patch Extension for creating placeholder status file (#2307)
• Dont create default status file for Single-Config extensions (#2318)

Logging improvements

• Fix bad logging (#2241)
• Fixed logging of PeriodicOperation (#2263)
• Log collector broken pipe fix (#2267)
• Improved logging for Multi config (#2246)

Test improvements

• Update test matrix and support (#2234)
• Fix utf-encoding for reporting firewall-setup logs (#2233)
• str -> ustr to fix pfr setup (#2268)
• Disable consider-using-with in pylint (#2231)
• Use venv for Python 2.6 unit tests (#2242)
• Update test-requirements to pin pylint. (#2288) (#2299)

This release contains the revert for reducing the time window where we restart the network interfaces of the VM -

• #2283

This release is for releasing the Extension Telemetry Pipeline as a private-preview feature.

• #2164

This release includes all changes from v2.2.52 plus the ones listed below.

Bug fixes:

• Start exthandler with the same python interpreter (#2007)
• Verify that the extension status is an array (#2010)
• Remove enum _UpdateType and retry fetching goal state (#2018)
• use dd for ext4 as well as xfs (#2042)
• Fix path for error.json (#2044)
• Switch to run command changes, + provisioning changes that need to be reverted. (#2050)
• Fix timestamp for goal state archive (#2051)
• Case insensitive parsing or Plugins and PluginSettings (#2054)
• Revert "Fixed delays for HTTP retries rather than exponential delays (#1967)" (#2065)
• Fixed bug causing "MAC verified OK" message (#2069)
• Revert unicode fix manually (#1937) (#2070)

New features and improvements:

• Recreate handler environment file on service startup (#1960)
• Add log collection tool and thread (#1987)
• Thread interface (#1990)
• Verify that the CPU and Memory cgroups for the agent are properly initialized; disabled cgroups if they are not active. (#2015)
• SUSE config: use Btrfs LZO compression for ResourceDisk (#2055)

Telemetry and logging improvements:

• Extension telemetry pipeline (#1918)
• Reformatted the heartbeat event (#2009)
• Add LIS version to OSInfo.message (#2011)
• One thread for telemetry (#2019)
• Limit description character length sent for health report (#2020)
• Remove Serial Console Logging (#2028)
• Echo log to /dev/console during provisioning (#2043)
• Adding telemetry for logrotate (#2045)
• Report placeholder extension status as an array (#2068)

Documentation updates:

• Fix broken link in readme (#2014)
• Add log collector flags to README (#2029)

Testing and code quality improvements:

• Travis CI improvements (#1989, #1992)
• Test improvements (#1969, #1994, #1988, #2026)
• Enabled pylint (#1975, #1976, #1979, #1980, #1981, #1985)
• Code clean-up, fixes for pylint warnings (#1983, #1986, #1991, #1993, #1995, #1999, #2000, #2001, #2002, #2047, #2049, #2053)