Welcome to the first official release of Microsoft Mixed Reality Toolkit version 2!

Getting started

To help you get started using MRTK v2, please see the Documentation Portal.

The Getting Started page covers software requirements and the initial steps required to use MRTK.

Changes since the RC2 releases

There have been some significant changes in this release of MRTK. For those with projects that are currently using one of the RC2 releases, please review the Upgrade Guide.

Release notes

Please see Release Notes for information on new features, known issues and changes.

MRTK Examples Hub App packages

To help you experience various example scenes in MRTK, we added pre-built MRTK Examples Hub app packages for HoloLens (x86), HoloLens 2 (ARM), and immersive headset (x64 PC). Please use Device Portal to install the app package.

MRTK v2 Release Candidate 2.1 provides new stabilization fixes and a few additional features.

This is an incremental release on top of 2.0, which fixes PressableButton usability issues.

Getting started

To help you get started using MRTK v2, please see the Documentation Portal.

RC1 to RC2 Upgrade Instructions

1. Delete all MixedRealityToolkit folders from RC1: MixedRealityToolkit, MixedRealityToolkit.Examples, MixedRealityToolkit.Providers, MixedRealityToolkit.SDK, MixedRealityToolkit.Services
2. Delete your Library folder
3. Import the RC2 unity packages
4. In your scenes, delete and re-add both the MixedRealityToolkit and MixedRealityPlaySpace objects

What's new in RC2

Default HoloLens 2 Profile

We have added a new profile for HoloLens 2 development that includes some of the recommended MRTK configurations for best performance. #4780 #4442

Please note that this profile will only contain MRTK specific settings, you will still need to update Unity settings using recommendations in this doc.

Improved porting experience from HTK to MRTK v2

This change enables side-by-side import of HTK and MRTK to make porting to MRTK v2 easier.

Experimental Attribute

Some features the MRTK team works on appear to have a lot of initial value even if we haven’t fully fleshed out the details. For these types of features, we want the community to get a chance to see them early. Because they are early in the cycle, we label them as experimental to indicate that they are still evolving, and subject to change over time. See Experimental Features for more details

Hand-Attached menu (Experimental)

First experimental feature: a hand-attached menu. Please see #4532 for a description.

MRTK Standard Shader works with Unity’s Lightweight Render Pipeline

An upgrade path to allow developers to utilize Unity's Lightweight Scriptable Render Pipeline (LWRP) with MRTK shaders has been added. To perform the MRTK upgrade select: “Mixed Reality Toolkit -> Utilities -> Upgrade MRTK Standard Shader for Lightweight Render Pipeline” For more information please see #4311.

Input Action Handler

Added an input action handler interface to receive action events regardless of the input source. See #4475 for details.

MixedRealityServiceRegistry

Added the static MixedRealityServiceRegistry class to enable acquiring services when using the MixedRealityToolkit object or a custom service registrar. To acquire a service instance from the registry, call the TryGetService method.

IMixedRealityInputSystem inputSystem = null;  
  
if (!MixedRealityServiceRegistry.TryGetService\<IMixedRealityInputSystem\>(out inputSystem))  
{  
   // The input system has not been registered.  
}

MixedRealityPlayspace

Replaced MixedRealityToolkit’s MixedRealityPlayspace property with a static MixedRealityPlayspace class to simplify accessing and transforming the play space in your applications.

IMixedRealityDataProviderAccess

Added the IMixedRealityDataProviderAccess interface to allow applications to request data provider instances from services which utilize data providers. In this release, the input and spatial awareness systems implement the IMixedRealityDataProviderAccess interface.

To acquire a data provider, use the following pattern.

IMixedRealitySpatialAwarenessMeshObserver meshObserver = (SpatialAwarenessSystem as
IMixedRealityDataProviderAccess)?.GetDataProvider\<IMixedRealitySpatialAwarenessMeshObserver\>();  
if (meshObserver != null)  
{  
    // Perform mesh observer operations.  
}

API Surface Changes

There have been changes to some API surfaces since the last release drop:

MixedRealityToolkit

Removed the MixedRealityPlayspace property. Please use the static MixedRealityPlayspace class to access and transform the play space.

IMixedRealityBoundarySystem

Added BoundaryVisualizationProfile property to enable easy access to the boundary system’s visualization profile.

IMixedRealityDiagnosticsSystem

Added DiagnosticsSystemProfile property to enable easy access to the diagnostics system’s profile.

IMixedRealityInputSystem

Added InputSystemProfile property to enable easy access to the input system’s profile.

IMixedRealitySpatialAwarenessSystem

Added SpatialAwarenessProfile property to enable easy access to the spatial awareness system’s profile.

The GetObserver and GetObservers methods have been marked as obsolete in RC2 and will be removed from a future release of the Mixed Reality Toolkit, To ensure future source code compatibility, please use the MixedRealityDataProviderAccess interface as documented in “What’s new in this update”.

MixedRealityInputSystem

Implements IMixedRealityDataProviderAccess to enable requesting data provider instances.

MixedRealitySpatialAwarenessSystem

Implements IMixedRealityDataProviderAccess to enable requesting data provider instances.

Other issues fixed

Please check out recent PRs for detailed list of changes.

Works with Unity 2018.4 LTS

Works with Unity 2019.1

MRTK v2 Release Candidate 2 provides new stabilization fixes and a few additional features.

Getting started

To help you get started using MRTK v2, please see the Documentation Portal. This is the place to learn to use MRTK, and deep dive into MRTK architecture. We have prepared an initial set of documentation to get you started, but we would also like to hear from you if there's anything else you'd like to see added. If you are up to the challenge, help us improve the documentation by contributing your change! Learn how to contribute on our GitHub Wiki, please follow the documentation guide when you make changes.

What's new in RC2

Default HoloLens 2 Profile

We have added a new profile for HoloLens 2 development that includes some of the recommended MRTK configurations for best performance. #4780 #4442

Please note that this profile will only contain MRTK specific settings, you will still need to update Unity settings using recommendations in this doc.

Improved porting experience from HTK to MRTK v2

This change enables side-by-side import of HTK and MRTK to make porting to MRTK v2 easier.

Experimental Attribute

Some features the MRTK team works on appear to have a lot of initial value even if we haven’t fully fleshed out the details. For these types of features, we want the community to get a chance to see them early. Because they are early in the cycle, we label them as experimental to indicate that they are still evolving, and subject to change over time. See Experimental Features for more details

Hand-Attached menu (Experimental)

First experimental feature: a hand-attached menu. Please see #4532 for a description.

MRTK Standard Shader works with Unity’s Lightweight Render Pipeline

An upgrade path to allow developers to utilize Unity's Lightweight Scriptable Render Pipeline (LWRP) with MRTK shaders has been added. To perform the MRTK upgrade select: “Mixed Reality Toolkit -> Utilities -> Upgrade MRTK Standard Shader for Lightweight Render Pipeline” For more information please see #4311.

Input Action Handler

Added an input action handler interface to receive action events regardless of the input source. See #4475 for details.

MixedRealityServiceRegistry

Added the static MixedRealityServiceRegistry class to enable acquiring services when using the MixedRealityToolkit object or a custom service registrar. To acquire a service instance from the registry, call the TryGetService method.

IMixedRealityInputSystem inputSystem = null;  
  
if (!MixedRealityServiceRegistry.TryGetService\<IMixedRealityInputSystem\>(out inputSystem))  
{  
   // The input system has not been registered.  
}

MixedRealityPlayspace

Replaced MixedRealityToolkit’s MixedRealityPlayspace property with a static MixedRealityPlayspace class to simplify accessing and transforming the play space in your applications.

IMixedRealityDataProviderAccess

Added the IMixedRealityDataProviderAccess interface to allow applications to request data provider instances from services which utilize data providers. In this release, the input and spatial awareness systems implement the IMixedRealityDataProviderAccess interface.

To acquire a data provider, use the following pattern.

IMixedRealitySpatialAwarenessMeshObserver meshObserver = (SpatialAwarenessSystem as
IMixedRealityDataProviderAccess)?.GetDataProvider\<IMixedRealitySpatialAwarenessMeshObserver\>();  
if (meshObserver != null)  
{  
    // Perform mesh observer operations.  
}

RC1 to RC2 Upgrade Instructions

1. Delete all MixedRealityToolkit folders from RC1: MixedRealityToolkit, MixedRealityToolkit.Examples, MixedRealityToolkit.Providers, MixedRealityToolkit.SDK, MixedRealityToolkit.Services
2. Delete your Library folder
3. Import the RC2 unity pagckages
4. In your scenes, delete and re-add both the MixedRealityToolkit and MixedRealityPlaySpace objects

RC1 to RC2 Upgrade Known Issues

Pressable buttons may need to be removed and added

After RC1 to RC2 upgrade, pressable buttons may have incorrect planes. To fix, remove and add back the pressable button component.

API Surface Changes

There have been changes to some API surfaces since the last release drop:

MixedRealityToolkit

Removed the MixedRealityPlayspace property. Please use the static MixedRealityPlayspace class to access and transform the play space.

IMixedRealityBoundarySystem

Added BoundaryVisualizationProfile property to enable easy access to the boundary system’s visualization profile.

IMixedRealityDiagnosticsSystem

Added DiagnosticsSystemProfile property to enable easy access to the diagnostics system’s profile.

IMixedRealityInputSystem

Added InputSystemProfile property to enable easy access to the input system’s profile.

IMixedRealitySpatialAwarenessSystem

Added SpatialAwarenessProfile property to enable easy access to the spatial awareness system’s profile.

The GetObserver and GetObservers methods have been marked as obsolete in RC2 and will be removed from a future release of the Mixed Reality Toolkit, To ensure future source code compatibility, please use the MixedRealityDataProviderAccess interface as documented in “What’s new in this update”.

MixedRealityInputSystem

Implements IMixedRealityDataProviderAccess to enable requesting data provider instances.

MixedRealitySpatialAwarenessSystem

Implements IMixedRealityDataProviderAccess to enable requesting data provider instances.

Other issues fixed

Please check out recent PRs for detailed list of changes.

Works with Unity 2018.4 LTS

Works with Unity 2019.1

MRTK v2 Release Candidate 1 Refresh

MRTK v2 Release Candidate 1 Refresh is an updated version of the RC1 package with stabilization fixes and a few additional features

Getting started

To help you get started using MRTK v2, please see the Documentation Portal. This is the place to learn to use MRTK, and deep dive into MRTK architecture. We have prepared an initial set of documentation to get you started, but we would also like to hear from you if there's anything else you'd like to see added. If you are up to the challenge, help us improve the documentation by contributing your change! Learn how to contribute on our GitHub Wiki, please follow the documentation guide when you make changes.

What's new in the refresh

Sliders - New UI control that allows you to change a value continuously by grabbing and moving a slider on a track.
Slate zooming support - Two-handed content zooming on Slate with min/max values.

Works with Unity 2019.1

API Surface Changes

There have been changes to some API surfaces since the last release drop:

IMixedRealityPointerHandler

The OnPointerDragged was added to this interface, which may cause a build error if you have a class that implements this interface. This can be safely fixed by adding an empty implementation for the new method. Per the discussion in https://github.com/Microsoft/MixedRealityToolkit-Unity/pull/4013, adding this method onto a new interface would have led to an ultimately more complicated pointer API story.

Namespace cleanup

One of the changes that came in RC1 was a refactor of namespaces of classes from deeply nested paths (like Microsoft.MixedReality.Toolkit.Core.Interfaces.InputSystem) to simpler paths (like Microsoft.MixedReality.Toolkit.Input). Several classes were not updated in the previous release, and these were fixed in this release. See https://github.com/Microsoft/MixedRealityToolkit-Unity/pull/4019 for the list of changed classes (along with the new namespaces they now live in).

MRTK v2 Release Candidate 1

MRTK v2 Release Candidate 1 is here for anyone who wants to get started with development for HoloLens 2!

What does release candidate mean? A version of a program that is nearly ready for release but may still have a few bugs and polish issues; the status between beta version and release version.

Why the versioning of our release candidate? Well, we want to let you all get started with the tools for building awesome experiences across all our devices, including HoloLens 2, but we know there is more work to be done before we call MRTK "done".

Getting started

To help you get started using MRTK v2, we are proud to introduce the new Documentation Portal. This is the place to learn to use MRTK, and deep dive into MRTK architecture. We have prepared an initial set of documentation to get you started, but we would also like to hear from you if there's anything else you'd like to see added. If you are up to the challenge, help us improve the documentation by contributing your change! Learn how to contribute on our GitHub Wiki, please follow the documentation guide when you make changes.

What's new in RC1.

In this release we have introduced many exciting new features like articulated hand tracking and eye tracking with HL2; there are also some architectural changes to MRTK in response to community and partner feedback to make MRTK easier to use. Of course, RC1 also supports OpenVR, WMR, and HL1 development.

• MRTK Packages
• Namespace simplification
• Services Provider
• In Editor simulation
• Updated Input System
  • Articulated Hands
  • Eye Tracking
• Interactions and UX Controls (Demo Video)
  • Hand Manipulation Samples
  • Button
  • Bounding Box
  • App Bar
  • Slate
  • Keyboard (OS)
  • Manipulation Handler
  • Interactable
  • Solver
  • Object Collection
  • Tooltip
  • Pointers
  • Fingertip Visualization
  • Eye Tracking Samples
• Spatial Awareness

Supported Platforms:

• UWP (HoloLens, HoloLens 2, WMR Headset)
• OpenVR

Here's the set of known issues in RC1 that we are working on fixing

• Slate panning is not working with Far interaction
• Other issues tagged "RC1 Bug" on the issues list

Overview

Welcome to Beta 2 of the Microsoft Mixed Reality Toolkit version 2 (formerly vNext 2018.x)!

PLEASE NOTE: This release is a significant breaking change from Mixed Reality Toolkit 2018.9.0 (released 2018/10/31) and all HoloToolkit releases.

Documentation for v2 is being written and published to https://github.com/Microsoft/MixedRealityToolkit-Unity/wiki. Please see the sidebar on the right hand of the page for individual links.

Features

• New version numbering system
  • Adheres to Semantic Versioning 2.0.0
• Cross-platform Mixed Reality support
  • Windows Mixed Reality
    • Microsoft HoloLens
    • Immersive Headsets
  • OpenVR
• New, more modular architecture
  • Core
    • Interface definitions
    • Data types
    • Profile system for configuration
    • Mixed Reality Toolkit scene object
    • Unity Input data provider
    • Mixed Reality Toolkit Standard Shader
  • Platform data providers
    • Windows Mixed Reality
    • Windows Voice
    • OpenVR
  • System services
    • Boundary
    • Diagnostics (featuring the Visual Profiler)
    • Input
    • Spatial Awareness
    • Teleportation
  • Features
    • Audio influencer effects
    • Solvers
    • User Experience Controls
    • Standard Assets

Requirements

• Unity 2018.3.x or later
• Microsoft Visual Studio 2017
• Windows SDK 10.0.17134 or later
• Windows 10 1803 or later

The Packages

This release consists of two packages: Foundation and Examples.

Foundation

The Foundation package contains all of the packages defined here. This will enable access to the complete Mixed Reality Toolkit foundational feature set without needing to install any other packages.

Examples

The Examples package contains demonstration scenes and assets used to help get you started using the systems and features of the Mixed Reality Toolkit.

Changes since v2.0.0 Beta2 Release Candidate

• (#3496) Fix air-tap in Holographic Remoting (workaround for Unity issue #1033526)
• (#3502) MixedRealityToolkit Profile Inspector
• (#3503) Small Performance Tweaks Round 2
• (#3506) Read the default profile and default platforms from the ExtensionServiceAttribute
• (#3508) Pre-beta2 spell check pass

Known Issues

The following issues are known and under investigation.

• (#3158) Improve Workflow for Stabilization Plane
• (#3177) The "select" voice command no longer fires an event on Windows Mixed Reality
• (#3217) vNEXT Task: Add Application Pause/Focus from Engine to Service Locator
• (#3308) DeployOptions: Not able to connect to hololens and deploy appx
• (#3322) Unity UI buttons have priority over MRTK buttons
• (#3331) Controller visualization for Windows Mixed Reality
• (#3332) Controller visualization for OpenVR
• (#3359) FocusManager does not compute distance to Canvas correctly
• (#3403) If no camera exists in the scene, MRTK Configure doesn't properly set up the scene
• (#3422) [UWP] Selecting InputFields in the Editor only works outside the center text
• (#3427) Question: UIRayCastCamera Disappearing on click of create new in profiles
• (#3429) How to setup uGUI for MRTK?)
• (#3430) MRTK continually complains about irrelevant joysticks

Breaking Changes

Since the release of Mixed Reality Toolkit v2018.9.0 Beta 1, the number and scope of breaking changes is too large to completely enumerate here. The following is a subset of the most impactful breaking changes.

PLEASE NOTE: Many of the breaking changes involved the modularization of the Mixed Reality Toolkit. Configuration profiles created with the Beta 1 release will need to be updated or recreated.

• (#3074) Refactor Controller Mapping Profile to accept individual controller scriptable objects
• (#3115) Update inconsistent naming of core system implementations
• (#3295) Remove requirement for IMixedRealityInputHandler < T > to be an IMixedRealityInputHandler
• (#3326) Spatial awareness interface changes
• (#3341) Tree layout and assembly restructure to align with packaging
• (#3357) Create separate WindowsMixedReality provider assembly
• (#3358) Create separate OpenVR provider assembly
• (#3387) Add attribute to make sure we can migrate to data provider in V3

Overview

Welcome to the release candidate for Beta 2 of the Microsoft Mixed Reality Toolkit version 2 (formerly vNext 2018.x)!

PLEASE NOTE: This release is a significant breaking change from Mixed Reality Toolkit 2018.9.0 (released 2018/10/31) and all HoloToolkit releases.

Documentation for v2 is being written and published to https://github.com/Microsoft/MixedRealityToolkit-Unity/wiki. Please see the sidebar on the right hand of the page for individual links.

Features

• New version numbering system
  • Adheres to Semantic Versioning 2.0.0
• Cross-platform Mixed Reality support
  • Windows Mixed Reality
    • Microsoft HoloLens
    • Immersive Headsets
  • OpenVR
• New, more modular architecture
  • Core
    • Interface definitions
    • Data types
    • Profile system for configuration
    • Mixed Reality Toolkit scene object
    • Unity Input data provider
    • Mixed Reality Toolkit Standard Shader
  • Platform data providers
    • Windows Mixed Reality
    • Windows Voice
    • OpenVR
  • System services
    • Boundary
    • Diagnostics (featuring the Visual Profiler)
    • Input
    • Spatial Awareness
    • Teleportation
  • Features
    • Audio influencer effects
    • Solvers
    • User Experience Controls
    • Standard Assets

Requirements

• Unity 2018.3.x or later
• Microsoft Visual Studio 2017
• Windows SDK 10.0.17763 or later
• Windows 10 1803 or later

The Packages

This release consists of two packages: Foundation and Examples.

Foundation

The Foundation package contains all of the packages defined here. This will enable access to the complete Mixed Reality Toolkit foundational feature set without needing to install any other packages.

Examples

The Examples package contains demonstration scenes and assets used to help get you started using the systems and features of the Mixed Reality Toolkit.

Known Issues

The following issues are known and under investigation.

• (#3158) Improve Workflow for Stabilization Plane
• (#3177) The "select" voice command no longer fires an event on Windows Mixed Reality
• (#3217) vNEXT Task: Add Application Pause/Focus from Engine to Service Locator
• (#3308) DeployOptions: Not able to connect to hololens and deploy appx
• (#3322) Unity UI buttons have priority over MRTK buttons
• (#3331) Controller visualization for Windows Mixed Reality
• (#3332) Controller visualization for OpenVR
• (#3359) FocusManager does not compute distance to Canvas correctly
• (#3403) If no camera exists in the scene, MRTK Configure doesn't properly set up the scene
• (#3422) [UWP] Selecting InputFields in the Editor only works outside the center text
• (#3427) Question: UIRayCastCamera Disappearing on click of create new in profiles
• (#3428) Airtap\Select not working (Holographic Simulation / Remoting)
• (#3429) How to setup uGUI for MRTK?)
• (#3430) MRTK continually complains about irrelevant joysticks
• (#3456) Selection not working in new vNext project (Holographic Simulation / Remoting)

Breaking Changes

Since the release of Mixed Reality Toolkit v2018.9.0 Beta 1, the number and scope of breaking changes is too large to completely enumerate here. The following is a subset of the most impactful breaking changes.

PLEASE NOTE: Many of the breaking changes involved the modularization of the Mixed Reality Toolkit. Configuration profiles created with the Beta 1 release will need to be updated or recreated.

• (#3074) Refactor Controller Mapping Profile to accept individual controller scriptable objects
• (#3115) Update inconsistent naming of core system implementations
• (#3295) Remove requirement for IMixedRealityInputHandler < T > to be an IMixedRealityInputHandler
• (#3326) Spatial awareness interface changes
• (#3341) Tree layout and assembly restructure to align with packaging
• (#3357) Create separate WindowsMixedReality provider assembly
• (#3358) Create separate OpenVR provider assembly
• (#3387) Add attribute to make sure we can migrate to data provider in V3

This is a zero code change refresh of the 2017.4.3.0 release.

The changes contained within are updates to source comments and documentation.

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/18

Upgrade Guide

Attention!

• This release is targeted for the Unity 2017.x products
  • The recommended Editor version is 2017.4 LTS (Long Term Support)
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • Windows SDK 10.0.17134 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update or later is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

Fixes

• (#2937) Prevent solver targets from rotating when the target is the head
• (#2932) Fix null exception in WorldAnchorManager
• (#2985) Fix QR code building on non-WSA platforms
• (#3181) Delay trying to load controller models to enable Editor loading

Preview Features

• (#1867) Spectator View (share holograms with HoloLens and iOS devices)
  • (#2327) Spectator View multilens support
• (#2872) QR Code Tracking

Import HoloToolkit-Unity-Preview-2017.4.3.0.unitypackage to include SpectatorView or QR Code Tracking in your project.

Release Notes

• This is a pre-release version and is not feature complete.
  • This release is not intended for production use.
  • This release contains many breaking changes from previous HoloToolkit and Mixed Reality Toolkit vNext releases.
• Requires Unity 2018.1 or later
  • Recommended version: 2018.2.14f1
• This product uses C# 6 language features.
  • Use the ".NET 4.x" API Compatibility Level
• To build for Windows Mixed Reality, set
  • Platform == Universal Windows Platform
  • Select Windows Mixed Reality as the Virtual Reality SDK
• To build for Open VR, set
  • Platform== PC, Mac & Linux Standalone
  • Select OpenVR as the Virtual Reality SDK

Getting Started

Link to documents coming soon....

What's New?

• New MRTK Architecture
  • Core / Device Abstraction Layer
  • SDK layer
• Features
  • New profile system to configure Mixed Reality Toolkit systems (Input, Spatial Awareness, etc.)
  • Core systems
    • Camera
    • Input and Interactions
      • Hand, Controller and Voice support
      • Action based (with rules support)
    • Boundary (for Room scale Immersive experiences)
    • Spatial Awareness (mesh support for HoloLens experiences)
    • Teleportation
    • Diagnostics (CPU, Memory , Frame rate information)
  • Registered Extension Services
    • Windows Mixed Reality Device Manager
    • Unity OpenVR Device Manager
    • Unity Joystick Manager
    • Unity Touch Input Manager
    • Windows Mixed Reality Spatial Observer
    • Windows Speech Input Manager
    • Windows Dictation Input Manager
    • Mouse Input Manager
  • Solvers
  • UX Collections
  • Spatial Mouse support
  • Audio Influencers
    • Occlusion
    • Low Fidelity (Lo-Fi)
  • Demo scenes (in MixedRealityToolkit-2018.9.0-Examples.unitypackage)
    • Audio
      • Lo-Fi Effect
      • Occlusion
    • Boundary (room scale immersive experiences)
    • Solvers
    • Spatial Awareness Mesh (HoloLens)
    • Standard shader
      • Material Gallery
      • Standard Material Comparison
      • Standard Material Gallery
    • UX
      • Collections
      • Lines
• Devices Supported:
  • Windows Mixed Reality
    • Microsoft HoloLens
    • Immersive Headsets
  • OpenVR

Known Issues

- (#3004) Boundary components do not align properly with the platform on OpenVR
    - Known issue in Unity 2018.x
- (#3037) If loading a system fails with an exception, no systems are active
- Controller models are not yet loaded from GLTF.
    - Custom models can be specified in the Controller Visualization Profile

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/15

Upgrade Guide

Attention!

• This release is targeted for the Unity 2017.x products
  • The recommended Editor version is 2017.4 LTS (Long Term Support)
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • Windows SDK 10.0.17134 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update or later is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

What's New

• (#2638) Updated drop of UnityGLTF with the correct coordinate space
• (#2872) QR Code Tracking (preview)

Preview Features

• (#1867) Spectator View (share holograms with HoloLens and iOS devices)
  • (#2327) Spectator View multilens support
• (#2872) QR Code Tracking

Import HoloToolkit-Unity-Preview-2017.4.2.0.unitypackage to include SpectatorView or QR Code Tracking in your project.

Fixes

• (#2438) Spectator View Stuck
• (#2487) Resolved rotation issue in TwoHandManipulatable script
• (#2523) The indicator line of the motion controllers does not coincide with the starting point of the ray
• (#2526) ObjectCollection doesn't behave as expected with non-zero rotation
• (#2666) Fix HTK pointer debug rays
• (#2669) Pointing ray doesn't properly disable itself when switching to an unsupported controller model
• (#2670) Fix pointer line visibility when switching the active controller
• (#2898) Add rotated transform to Solvers after glTF coordinate system update

Known issues

The following items are known and currently being investigated.

• (#2123) Cannot build for IL2CPP in 5.6
• (#2126) Invalid IL warnings in UnityEngine.Internal
• (#2163) WACK failure - SpectatorView
• (#2528) Strip Mesh, Instanced Mesh, and Particle System Line Renderers do not properly apply colors

Release Notes

• This pre-release is not feature complete.
• Requires Unity 2018.1 or later
  • Recommended version: 2018.1.9f1
• This product uses C# 6 language features.
  • Use the ".NET 4.x" API Compatibility Level
• To build for Windows Mixed Reality, set
  • Platform == Universal Windows Platform
  • Select Windows Mixed Reality as the Virtual Reality SDK
• To build for Open VR, set
  • Platform== PC, Mac & Linux Standalone
  • Select OpenVR as the Virtual Reality SDK

What's New?

• Features
  • Input and Intereaction system
  • Teleportation
  • Pointing rays (straight and parabolic)
  • Boundary system
    • Automatic floor, tracked area and play area display
    • Optional boundary wall and ceiling display
• Devices Supported:
  • Windows Mixed Reality
  • OpenVR

Release Notes

• This pre-release is not feature complete.
• Requires Unity 2018.1 or later
  • Recommended version: 2018.1.9f1
• This product uses C# 6 language features.
  • Use the ".NET 4.x" API Compatibility Level
• To build for Windows Mixed Reality, set
  • Platform == Universal Windows Platform
  • Select Windows Mixed Reality as the Virtual Reality SDK
• To build for Open VR, set
  • Platform== PC, Mac & Linux Standalone
  • Select OpenVR as the Virtual Reality SDK

What's New?

• New MRTK Architecture
  • Core / Device Abstraction Layer
  • SDK layer
• Features
  • Input and Intereaction system
  • Teleportation
  • Pointing rays (straight and parabolic)
  • Boundary system
    • Automatic floor and play area display
• Devices Supported:
  • Windows Mixed Reality
  • OpenVR

Known Issues

• When teleporting, the play area visualization does not move with the user
• Some controller options do not work correctly on OpenVR
• Actual controller models/GLTF support is not currently provided

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/9

Upgrade Guide

Attention!

• This release is targeted for the Unity 2017.x products
  • The recommended Editor version is 2017.4 LTS (Long Term Support)
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • The recommended minimum Editor version is 2017.1 (we will investigate reported issues on Unity 5.6).
  • Windows SDK 10.0.17134 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

What's New

• (#2228) In Between Solver that keeps an object between two tracked objects/transforms
• (#2314) Better example for custom Icons for AppBar
• (#2327) Spectator View multilens support [preview]
• (#2343) Make the CompoundButtonSpeech.cs available and add CompoundButtonEventTrigger.cs to attach an event to the keyword recognized through speech
• (#2403) Add inscribed rectangle to BoundaryManager
• (#2467) Add "Add the Spatial Mapping Prefab" to the scene configuration window

Preview Features

• (#1867) Spectator View (share holograms with HoloLens and iOS devices)
  • (#2327) Spectator View multilens support

Import HoloToolkit-Unity-Preview-2017.4.1.0.unitypackage to include SpectatorView in your project.

Fixes

• (#1181, #2362) MixedRealityTeleport teleport position is abnormal
• (#1535) Crash calling Dismiss() on PopupMenu if rootAnimator is null
• (#1679) DebugLog of CanShareAnchors is wrong
• (#1712) Slider range not properly working
• (#1879, #2524) OnButtonClicked is triggered twice on an AirTap
• (#2021) TwoHandManipulatable script moves objects even if OneHandMovement option is unchecked
• (#2040) PopupMenu: 'IsModal' and 'CloseOnNonTargetedTap' options don't work correctly
• (#2042) Bounding Box and App Bar not working as expected for Rectangular Holograms
• (#2071) Configuration menu getting reordered after use
• (#2165) Spectator View Build Warnings
• (#2214) If platform is not previously set to UWP, project settings not applied correctly
• (#2217) Fixed a bug where solvers would try to attach to the right hand before it was ready
• (#2225) SpectatorView prevents Standalone (and any other platform where Handheld doesn't exist) builds
• (#2227) Fixing a bug the causes FaceOrigin collections to face the wrong direction when collections are rotated.
• (#2242, #2522) Toolkit keyboard keys and system keyboard logic updates
• (#2276) "Sharing with UNET" example - Anchor isn't shared with Client
• (#2294) Interactive mesh cursor default distance set to 0
• (#2295) Button class does not block events from reaching fallbackInputStack
• (#2300) MoveToPosition.TargetObject continues to target its own game object instead of the target
• (#2303) Hololens Unet client places anchor at headset position
• (#2324) Mesh transform not preserved when used as room model
• (#2348) Fix for choosing closest grabbable object to grab
• (#2349) Fix for dragging of rotation handles of BoundBoxRig
• (#2356) Fixes an InteractionInputSource bug where data was removed too soon
• (#2380) Billboard.cs up vector fix
• (#2394) Misusing of static class ExtensionMethods
• (#2470) Spectator View (Preview) - Can't build for iOS

Known issues

The following items are known and currently being investigated.

• (#2123) Cannot build for IL2CPP in 5.6
• (#2126) Invalid IL warnings in UnityEngine.Internal
• (#2163) WACK failure - SpectatorView
• (#2438) Spectator View Stuck
• (#2528) Strip Mesh, Instanced Mesh, and Particle System Line Renderers do not properly apply colors

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/8

Upgrade Guide

Attention!

• This release is targeted for the Unity 2017.x products
  • The recommended Editor version is 2017.4 LTS (Long Term Support)
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • The recommended minimum Editor version is 2017.1 (we will investigate reported issues on Unity 5.6).
  • Windows SDK 10.0.17134 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

Fixed Since 2017.4.0.0 Release Candidate 2

• (#1940) XAML: HoloToolkit triggers own and system keyboard
• (#2166) Can I Change length of Motion Controller pointing ray when if lost focus from a object?
• (#2208) A few issues with the Build Window
• (#2210) Keyboard dictation input fixes
• (#2215) [Cursor] Properly track sources that were detected before registering as a global listener

What's New

• (#1275, #1277) Motion Controller pointing ray
• (#1918) Dialog and Progress UI
• (#1936) ToolTip UX
• (#1991) Automatically set the default Spatial Mapping Physics Layer (configuration dialog)
• (#1994) ManipulationMode is now public in TwoHandManipulatable
• (#2037) BoundingBox activation events
• (#2043) Materials and Prefabs for additional Selawik font weights
• (#2066) SimpleSinglePointerSelector can connect pointer upon OnSourceDetected

Preview Features

• (#1867) Spectator View (share holograms with HoloLens and iOS devices)

Import HoloToolkit-Unity-PreviewFeatures-2017.4.0.0.unitypackage to include SpectatorView in your project.

Fixes

• (#917, #1169, #1979) Cannot erase all content of KeyboardInputField
• (#1443) Spatial Mapping Physics Layer isn't visible in MRTK project's layer
• (#1790) FadeManager Assertion Failed on Holographic Remoting
• (#1824) Cannot test whether grip position can be obtained from a WSA hand
• (#1887) Button.cs ButtonState is incorrect
• (#1913) FpsDisplay.cs calls InitBuffer every Update
• (#1921) Eliminate deprecated API popups (Unity 2017.x)
• (#1927) Keyboard Input field Backspace/Cursor position incorrect
• (#1935) Headset Adjustment scene
• (#1978) Caret not showing in MRTK Keyboard input field
• (#1983) Cursor.prefab is missing the point light off holograms
• (#1994) Cannot change TwoHandManipulable.ManipulationMode at runtime
• (#2006) remove TextMesh required component in FpsDisplay
• (#2009) BoundingBoxGizmoExample NullReferenceException
• (#2019) HolographicButton: Animator is not playing an AnimatorController
• (#2053) NullReferenceException in ControllerFinder.OnEnable
• (#2062) Update UpgradeGuide.md
• (#2073) Solver Body Lock null refs if the tracked object isn't present
• (#2103) Allow Unsafe Code not auto-checked correctly
• (#2113) Surface Magnetism + Spatial Processing example scene improvement
• (#2120) Set KeyboardAtlas as default (fix symbol characters in MRTK keyboard)
• (#2124) Build warnings with IL2CPP in 2017+
• (#2131) Grip position not reported for in-Editor hands
• (#2157) Tooltip example scene's labels position
• (#2166) Can I Change length of Motion Controller pointing ray when if lost focus from a object?
• (#2170) SpectatorView - HoloLens camera doesn't activate when iPhone tries to join
• (#2208) A few issues with the Build Window
• (#2210) Keyboard dictation input fixes
• (#2215) [Cursor] Properly track sources that were detected before registering as a global listener

Known issues

The following items are known and currently being investigated.

• (#2123) Cannot build for IL2CPP in 5.6
• (#2126) Invalid IL warnings in UnityEngine.Internal
• (#2163) WACK failure - SpectatorView
• (#2214) If platform is not previously set to UWP, project settings not applied correctly

This is the second release candidate for Mixed Reality Toolkit - Unity 2017.4.0.0.

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/8

Attention!

• This release is targeted for the Unity 2017.x products
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • The recommended minimum Editor version is 2017.1 (we will investigate reported issues on Unity 5.6).
  • Windows SDK 10.0.17134 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

Fixed Since 2017.4.0.0 Release Candidate

• (#1790) FadeManager Assertion Failed on Holographic Remoting
• (#2062) Update UpgradeGuide.md
• (#2124) Build warnings with IL2CPP in 2017+
• (#2157) Tooltip example scene's labels position
• (#2170) SpectatorView - HoloLens camera doesn't activate when iPhone tries to join

What's New

• (#1275, #1277) Motion Controller pointing ray
• (#1918) Dialog and Progress UI
• (#1936) ToolTip UX
• (#1991) Automatically set the default Spatial Mapping Physics Layer (configuration dialog)
• (#1994) ManipulationMode is now public in TwoHandManipulatable
• (#2037) BoundingBox activation events
• (#2043) Materials and Prefabs for additional Selawik font weights
• (#2066) SimpleSinglePointerSelector can connect pointer upon OnSourceDetected

Preview Features

• (#1867) Spectator View (share holograms with HoloLens and iOS devices)

Import HoloToolkit-Unity-PreviewFeatures-2017.4.0.0-rc2.unitypackage to include SpectatorView in your project.

Fixes

• (#917, #1169, #1979) Cannot erase all content of KeyboardInputField
• (#1443) Spatial Mapping Physics Layer isn't visible in MRTK project's layer
• (#1790) FadeManager Assertion Failed on Holographic Remoting
• (#1824) Cannot test whether grip position can be obtained from a WSA hand
• (#1887) Button.cs ButtonState is incorrect
• (#1913) FpsDisplay.cs calls InitBuffer every Update
• (#1921) Eliminate deprecated API popups (Unity 2017.x)
• (#1927) Keyboard Input field Backspace/Cursor position incorrect
• (#1935) Headset Adjustment scene
• (#1978) Caret not showing in MRTK Keyboard input field
• (#1983) Cursor.prefab is missing the point light off holograms
• (#1994) Cannot change TwoHandManipulable.ManipulationMode at runtime
• (#2006) remove TextMesh required component in FpsDisplay
• (#2009) BoundingBoxGizmoExample NullReferenceException
• (#2019) HolographicButton: Animator is not playing an AnimatorController
• (#2053) NullReferenceException in ControllerFinder.OnEnable
• (#2062) Update UpgradeGuide.md
• (#2073) Solver Body Lock null refs if the tracked object isn't present
• (#2103) Allow Unsafe Code not auto-checked correctly
• (#2113) Surface Magnetism + Spatial Processing example scene improvement
• (#2120) Set KeyboardAtlas as default (fix symbol characters in MRTK keyboard)
• (#2124) Build warnings with IL2CPP in 2017+
• (#2131) Grip position not reported for in-Editor hands
• (#2157) Tooltip example scene's labels position
• (#2170) SpectatorView - HoloLens camera doesn't activate when iPhone tries to join

Breaking changes

This release re-breaks #1940, in order to restore the keyboard caret (#2132). A fix is being investigated.

Known issues

The following items are known and currently being investigated.

• (#1940) XAML: HoloToolkit triggers own and system keyboard
• (#2123) Cannot build for IL2CPP in 5.6
• (#2126) Invalid IL warnings in UnityEngine.Internal
• (#2163) WACK failure - SpectatorView
• (#2166) Can I Change length of Motion Controller pointing ray when if lost focus from a object?

This is a release candidate for Mixed Reality Toolkit - Unity 2017.4.0.0.

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/8

Attention!

• This release is targeted for the Unity 2017.x products
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • The recommended minimum Editor version is 2017.1 (we will investigate reported issues on Unity 5.6).
  • Windows SDK 10.0.17134 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

What's New

• (#1275, #1277) Motion Controller pointing ray
• (#1867) Spectator View (share holograms with HoloLens and iOS devices)
• (#1918) Dialog and Progress UI
• (#1936) ToolTip UX
• (#1991) Automatically set the default Spatial Mapping Physics Layer (configuration dialog)
• (#1994) ManipulationMode is now public in TwoHandManipulatable
• (#2037) BoundingBox activation events
• (#2043) Materials and Prefabs for additional Selawik font weights
• (#2066) SimpleSinglePointerSelector can connect pointer upon OnSourceDetected

Fixes

• (#917, #1169, #1979) Cannot erase all content of KeyboardInputField
• (#1443) Spatial Mapping Physics Layer isn't visible in MRTK project's layer
• (#1824) Cannot test whether grip position can be obtained from a WSA hand
• (#1887) Button.cs ButtonState is incorrect
• (#1913) FpsDisplay.cs calls InitBuffer every Update
• (#1921) Eliminate deprecated API popups (Unity 2017.x)
• (#1927) Keyboard Input field Backspace/Cursor position incorrect
• (#1935) Headset Adjustment scene
• (#1978) Caret not showing in MRTK Keyboard input field
• (#1983) Cursor.prefab is missing the point light off holograms
• (#1994) Cannot change TwoHandManipulable.ManipulationMode at runtime
• (#2006) remove TextMesh required component in FpsDisplay
• (#2009) BoundingBoxGizmoExample NullReferenceException
• (#2019) HolographicButton: Animator is not playing an AnimatorController
• (#2053) NullReferenceException in ControllerFinder.OnEnable
• (#2073) Solver Body Lock null refs if the tracked object isn't present
• (#2103) Allow Unsafe Code not auto-checked correctly
• (#2113) Surface Magnetism + Spatial Processing example scene improvement
• (#2120) Set KeyboardAtlas as default (fix symbol characters in MRTK keyboard)
• (#2131) Grip position not reported for in-Editor hands

Breaking changes

This release re-breaks #1940, in order to restore the keyboard caret (#2132). A fix is being investigated.

Known issues

The following items are known and currently being investigated.

• (#1900) Problem with InteractionManager and head rotation
• (#1940) XAML: HoloToolkit triggers own and system keyboard
• (#2123) Cannot build for IL2CPP in 5.6
• (#2124) Build warnings with IL2CPP in 2017+
• (#2126) Invalid IL warnings in UnityEngine.Internal

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/7

Upgrade Guide

Attention!

• This release is specifically targeted for Unity Editor-2017.2.1p2
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • Minimum Editor Compatibility for Unity 5.6 for HoloLens development ONLY.
  • Windows SDK 10.0.16299 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

Fixed since 2017.2.1.4 Release Candidate 2

• (#1958) [Unity 5.6] SpriteAtlas cannot be found
• (#1960) [Unity 5.6/2017.1] Fail to build InteractionSourceExtensions
• (#1962) [Unity 5.6] Unable to build BoundingBox
• (#1964) Imersive device: NullReferenceExeption in FocusManager.TryGetFocusedObject
• (#1967) [Unity 2017.1] Two handed manipulation not working as expected

What's New

• (#1799) Send Slider Value on Update
• (#1838) Add LoFi audio effect
• (#1847) Add MixedRealityToolkit/Standard shader
• (#1849) Two hand manipulable
• (#1880) Add Motion Controller haptics in Editor and Add HolographicButton prefab
• (#1882) Update projectversion.txt to match the current recommended Unity release
• (#1914) Bounding Box and App Bar

Fixes

• (#208, #383, #1672) Billboard fixes
• (#1440) Haptics doesn't work when running in-editor
• (#1825) Fix incorrect audio occlusion frequency restoration
• (#1827) UX Button disabled state doesn't prevent clicks
• (#1831) FixedAngularSize flicker
• (#1868, #1885) ObjectCollection does not remove moved GameObject that is no longer a child from NodeList
• (#1928) Add Holographic Button
• (#1949) Address potential NullReferenceException on Select
• (#1951) Build Options disabled on the MRTK Build Window with 2017.2.1.4-RC
• (#1958) [Unity 5.6] SpriteAtlas cannot be found
• (#1960) [Unity 5.6/2017.1] Fail to build InteractionSourceExtensions
• (#1962) [Unity 5.6] Unable to build BoundingBox
• (#1964) Imersive device: NullReferenceExeption in FocusManager.TryGetFocusedObject
• (#1967) [Unity 2017.1] Two handed manipulation not working as expected

Breaking Changes:

• (#1880) MotionControllerModel.dll renamed to EditorMotionController.dll

This is the second release candidate for Mixed Reality Toolkit - Unity 2017.2.1.4.

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/7

Upgrade Guide

Attention!

• This release is specifically targeted for Unity Editor-2017.2.1p2
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • Minimum Editor Compatibility for Unity 5.6 for HoloLens development ONLY.
  • Windows SDK 10.0.16299 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

Fixed since 2017.2.1.4 Release Candidate

• (#1951) Build Options disabled on the MRTK Build Window with 2017.2.1.4-RC
• (#1949) Address potential NullReferenceException on Select

What's New

• (#1799) Send Slider Value on Update
• (#1838) Add LoFi audio effect
• (#1847) Add MixedRealityToolkit/Standard shader
• (#1849) Two hand manipulable
• (#1880) Add Motion Controller haptics in Editor and Add HolographicButton prefab
• (#1882) Update projectversion.txt to match the current recommended Unity release
• (#1914) Bounding Box and App Bar

Fixes

• (#208, #383, #1672) Billboard fixes
• (#1440) Haptics doesn't work when running in-editor
• (#1825) Fix incorrect audio occlusion frequency restoration
• (#1827) UX Button disabled state doesn't prevent clicks
• (#1831) FixedAngularSize flicker
• (#1868, #1885) ObjectCollection does not remove moved GameObject that is no longer a child from NodeList
• (#1951) Build Options disabled on the MRTK Build Window with 2017.2.1.4-RC
• (#1949) Address potential NullReferenceException on Select

Breaking Changes:

• (#1880) MotionControllerModel.dll renamed to EditorMotionController.dll

This is a release candidate for Mixed Reality Toolkit - Unity 2017.2.1.4.

Project board: https://github.com/Microsoft/MixedRealityToolkit-Unity/projects/7

Upgrade Guide

Attention!

• This release is specifically targeted for Unity Editor-2017.2.1p2
  • This release should be compatible for development for both HoloLens & immersive headsets for 2017.2+
  • Minimum Editor Compatibility for Unity 5.6 for HoloLens development ONLY.
  • Windows SDK 10.0.16299 is required for 2017.2+
  • Visual Studio 2017 is required.
  • Fall Creators Update is required.
• When upgrading to this release, delete all toolkit folders before importing the package.

What's New

• (#1799) Send Slider Value on Update
• (#1838) Add LoFi audio effect
• (#1847) Add MixedRealityToolkit/Standard shader
• (#1849) Two hand manipulable
• (#1880) Add Motion Controller haptics in Editor and Add HolographicButton prefab
• (#1882) Update projectversion.txt to match the current recommended Unity release
• (#1914) Bounding Box and App Bar

Fixes

• (#208, #383, #1672) Billboard fixes
• (#1440) Haptics doesn't work when running in-editor
• (#1825) Fix incorrect audio occlusion frequency restoration
• (#1827) UX Button disabled state doesn't prevent clicks
• (#1831) FixedAngularSize flicker
• (#1868, #1885) ObjectCollection does not remove moved GameObject that is no longer a child from NodeList

Breaking Changes:

• (#1880) MotionControllerModel.dll renamed to EditorMotionController.dll