WALinuxAgent

This release is a re-release of v2.2.49.2. There are no new changes in this as compared to the last known good v2.2.49.2

Major bug fixes -

• Do not retrieve users in each goal state (#1935)
• Fix check for systemd-run failure when invoking extensions (#1943)
• Fix telemetry unicode errors (#1937)
• Uninstall unregistered extensions (#1970)
• Use run_command to execute iptables (#1944)
• Use run_command for ip route (#1958)
• Fix handling of gen2 disks with udev rules (#1954)

New features/improvements -

• Add API for uploading logs via host plugin (#1902)
• Fixed delays for HTTP retries rather than exponential delays (#1967)

Documentation changes -

• python3 must be used in Ubuntu (#1932)

Other fixes -

• Resolve undefined variable (#1950)
• Convert owner uid to string (#1949)
• Fix Travis special checks for distro and remove useless cgroup tests (#1959)
• Use tmp_dir instead of data_dir (#1968)

Improvements in cgroups:

• Do not use --unit with systemd-cgls (#1910)
• Report processes that do not belong to the agent's cgroup (#1908)
• Use controller mount point for extension cgroup path (#1899)
• Improvements in setup of cgroups (#1896)
• Remove ExtensionsMetricsData and per-process Memory data (#1884)
• Fix return value of start_extension_command (#1927)

Testing and dev-infra improvements:

• Remove import * (#1900)
• Fix flaky ExtensionCleanupTest class (#1898)
• Fix codecov badge (#1883)
• Changed codecov to run on py3.8 (#1875)

Documentation improvements:

• Update documentation on /dev/random (#1909)
• Mount options are in mount(8) (#1893)

Logging and telemetry improvements:

• Remove ssh host key thumbprint in report ready (#1913)
• Emit AutoUpdate value at service start only (#1907)
• Add logging for version mismatch (#1895)
• Send telemetry event if libdir changes (#1897)
• Add log collector utility (#1847)
• Move AutoUpdate reporting to HeartBeat event (#1919)

Extension workflow improvements:

• Removing infinite download of extension manifest without a new GS (#1874)
• Fix wrongful dir deletion (#1873)
• Fix the cleanup-outdated-handlers to only delete handlers that are not present in the GS (#1889)

Other:

• Expose periods of environment thread in waagent.conf (#1891)
• Added user @kevinclark19a as Contributor. (#1906)

Refactoring GoalState class out of Protocol, making Protocol thread-safe, removing stale dependencies of Protocol and removing the dependency on the file system to read the Protocol info:

• Fetch goal state when creating HostPluginProtocol (#1799)
• Separate goal state from the protocol class (#1777)
• Make protocol util a singleton per thread (#1743, #1756)
• Fetch goal state before sending telemetry (#1751)
• Remove file dependency (#1754)
• Others (#1758, #1767, #1744, #1749, #1816, #1820)

Adding and improving log messages and adding thread names to each logline:

• New logs for goal state fetch (#1797) and refresh (#1794).
• Thread name added to logs (#1778)
• Populate telemetry events at creation time (#1791)
• Periodic HeartBeat to be logged to the file (#1755)
• Add unit test to verify call stacks on telemetry events (#1828)
• Others (#1841, #1842, #1846)

Improving agent status reporting:

• Handling errors while reading extension status files (Limiting Size and Transient issues)(#1761)

Provisioning Agent changes:

• Enable SWAP on Resource Disk as Application Certification Support suggested (#1762)
• Update 'Provisioning' options in default configs ( #1853)

Other fixes:

• Drop Metadata Server Support (#1806, #1839, #1840 )
• Improve documentation of ResourceDisk.EnableSwapEncryption (#1782)
• Removed is_snappy function (#1774)
• Handle exceptions in monitor thread (#1770)
• Fix timestamp for periodic operations in the monitor thread (#1879)
• Fix permissions on the Ubuntu systemd service file (#1814)
• Update hostname setting for SUSE distros (#1832)
• Python 3.8 improvements + support for Ubuntu 20.04 (#1860, #1865, #1738)
• Testing and dev-infra improvements [#1771, #1768, #1800, #1826, #1827, #1833]
• Others (#1854, #1858)

[#1741] Do not update goal state when refreshing the host plugin
[#1731] Fix upgrade sequence when update command fails
[#1725] Initialize CPU usage
[#1716, #1737] Added UTC logging and correcting the format
[#1651, #1729] Start sending PerformanceCounter metrics and additional memory information for Cgroups

[#1654] Add support for Gen2 VM resource disks
[#1677] Use alternate systemd detection
[#1638] Fix /proc/net/route requirement that causes errors on FreeBSD
[#1633] Add cloud-init auto-detect to prevent multiple provisioning mechanisms from relying on configuration for coordination
[#1688] Disable cgroups when daemon is setup incorrectly
[#1686] Remove upgrade extension loop for the same goal state
[#1696] Add container id for extension telemetry events
[#1695] Be more exact when detecting IMDS service health
[#1663] Changing add_event to start sending missing fields

Bug fixes and minor improvements: [#1679, #1680, #1681, #1683, #1685, #1699, #1698, #1701]

[#1642] Remove outdated extension ZIP packages
[#1623] Improved error handling when starting extensions using systemd
[#1619] Reduce provisioning time of some custom images
[#1617] Improve the handling of extension download errors
[#1634, #1640] New API for extension authors to handle errors during extension update
[#1606] Fix handling of errors in calls to openssl
[#1599] Improve logic to determine current distro
[#1567, #1614] Reduce verbosity of several logging statements

Bug fixes: [#1506 #1563 #1568 #1570 #1572 #1573 #1576 #1580 #1583 #1595 #1600 #1606 #1607 #1616 #1625 #1628 #1630 #1641 #1644 #1655 #1664 #1666]

The following release addresses an issue in how the Azure Linux Agent processes goalstates when the extension processing is on hold (either extension processing is disabled in the conf file or the 'on_hold' property is marked as true in the artifact blob).

[#1602] Poll for artifact blob

This release contains the following changes:

• Rewriting the mechanism to start the extension using systemd-run for systems using systemd for managing
  [#1537, #1536]
• Refactoring of resource monitoring framework using cgroup for both systemd and non-systemd approaches [#1530, #1534]
• Telemetry pipeline for resource monitoring data [#1538]

[#1489] Fixed tracking of memory/cpu usage
[#1484] Do not prevent extensions from running if setting up cgroups fails
[#1483] Enable systemd-aware deprovisioning on all versions >= 18.04
[#1419] Add systemd support for Debian Jessie, Stretch, and Buster
[#1412] Support for Linux Openwrt

This release introduced an issue in some custom images. It has been deprecated.

The following release addresses a potential vulnerability that exists in the way the Azure Linux Agent creates swap files on resource disks under some specific conditions. More details here - CVE-2019-0804

[#1485] Add fixes for handling swap file and other nit fixes

Deprecation Note: Encountered agent hangs when updating from the previous release. Fixed in the next release.

[#1463] Improves re-try logic to handle errors while downloading extensions

Deprecation Note: Encountered telemetry issues with this release. Fixed in the next release.

[#1434] Use files instead of pipes to capture stdout/stderr
[#1431] Prevent multiple downloads of zips
[#1418] Add main module to Python's egg
[#1416] Fix UTF-8 encoding for telemetry payload
[#1408] Honor the 'no_proxy' flag
[#1391, #1401, #1441] Azure Stack improvements
[#1384] Write status file in WALinuxAgent lib folder
[#1375] Add support for Redhat
[#1373] Handle different kernel builds on SUSE Linux Enterprise
[#1365, #1385, #1389] Fixes for RDMA

This release also includes improvements in telemetry and bug fixes.

[#1451] Do not utf-8 encode telemetry messages

[#1397] Send events when extensions fail to complete operation
[#1394/#1366] Fix the threshold telemetry issue
[#1298] Implementing extension sequencing in azure Linux agent
[#1340] Allow Clear Linux detection in python2 and python3
[#1345] FreeBSD swap issues fix (#1144)
[#1349] Use append_file in Redhat6xOSUtil.openssl_to_openssh()
[#1355] Ensure 'value' for authorized ssh keys end in "\n"
[#1361] Remove main module

This release also includes improvements in telemetry and bug fixes.

[#1325] Enable cgroups by default on all distros
[#1327, #1347] Allow enforcing of cgroups limits
[#1337] Allow configuration for cgroups
[#1333] Add support for NSBSD
[#1319] Stream extension downloads to disk (do not buffer the download in memory)
[#1303] Fix to support custom DNS servers
[#1306] Log extension stdout and stderr
[#1302] Better of cloud-init configuration during deprovisioning
[#1295] Fix to report the correct extension error code
[#1289] Allow disabling the agent or extensions
[#1290] Use the "ip route" command instead of the "route" comand during network configuration
[#1281] Delete JIT accounts
[#1234] Fix for reading KVP values from host
[#1287] Add UDEV rule in azure disk encryption

This release also includes improvements in telemetry and bug fixes.

This is the 2.2.31 release, which includes the following:

[#1196] Health store integration
[#1199] CGroups support
[#1194] Use host for status reporting
[#1188] Fix for sentinel and signal handlers
[#1182] Telemetry updates
[#1171] Add support for JIT
[#1164] Fix for name resolution in Ubuntu 18.04
[#1154] Set connection close header
[#1143] Remove extension packages after extraction

There are also several other bug fixes and improvements.

Update Debian specific configuration and setup.