MixedRealityToolkit | components intended to accelerate the development | Augmented Reality library

I want to implement a feature on HoloLens2 app, which allows user to draw/paint on specific surface in every part which was touched by the user.

So we have a flat plane and when I move my hand over this plane, spots below my hand should be coloured. How can I implement such feature keeping in mind, that HoloLens has limited processing power and calling Texture.Apply() every frame is unacceptable?

I tried to adopt a script from Eye tracking Heat map demo scene to use hand touch instead, but didn't success.

I've changed

I used the prefab HandMenu_Large_WorldLock_On_GrabAndPull as a basis for my hand menu. If grabbing the menu and placing it somewhere, I stays there and this behavior is fine for me. But now I want to walk away, looking again at my hand and the menu should reattach to my hand. How to set up HandConstraintPalmUp to achieve that?

What I tried:
I read here that I could set the SolverHandler to true or call the method HandConstraintPalmUp.StartWorldLockReattachCheckCoroutine() but this is actually not setting the SolverHandler to true, it just stays false. If running it via Holographic Emulation and setting the handler to true by clicking in the editor, it works, but not via OnFirstHandDetected or OnHandActivate of HandConstraintPamlUp. Also the documentation says:

When trying to set the hand constrained object to start following your hand again (based on whether it meets the activation criteria), set the SolverHandler's UpdateSolver to true.

But what is the criteria for the solver to set UpdateSolvers to true? What am I missing here?

Menu with default settings:
Why is for example the OnClick-Event on the button BtnClose working and my call on OnHandActiavte not?

I'm trying to make an animated material with the MRTK in Unity. The goal is to make an effect with look like starting with a circle and propagating the texture to rest of the plane.

For now I use the MixedRealityToolkit standard shader and use the round corner option. With an animation I made that :

My problem is that I can't tile the texture to reduce the size of the texture and repeat it. Also for non-square object, the texture is stretched and it's not really nice.

If I try to change the tile setting, the texture is not repeated (texture is well in "Repeat Mode", it works when I untick Round Corners option)

(If I display Unity selection outline, I obtained the repeated texture, but it's not displayed ... )

Does anyone have a good idea to do that with the MRTK shaders or how to write a specific shader for this effect ?

Why does this happen? Has anyone had this happen before? I have tried it numerous times to make sure I am not crazy and I can't find anyone who has had this problem before when I searched le internet.

This is what I am doing:

Step 1:

Put 3-D object on scene view.

Step 2:

Click Save

Edit:

Here is some more information:

Unity Version: 2019.2.21

What I did specifically:

I am following the directions listed here. One of the things that I did, that wasn't listed on the link is try to add a cube onto the scene view.

I did this by right clicking on "MixedRealityToolkit", choosing "3-D" object, and then selecting "cube".

I then hit save and my cube disappeared.

I have tried to get hand mesh data from Hololens2 using MRTK V2 and Unity C#. Now, I can get hand mesh data with turning on Hand Mesh Visualization option and referring MRTK HandTracking guide.

Unfortunately, the visualization(drawing hand CG) is heavy workload. So, I would like to get hand mesh without turning on Hand Mesh Visualization option but OnHandMeshUpdated function is not called due to turning off Hand Mesh Visualization option.

Does anyone know how to get hand mesh data from Hololens2 without turning on Hand Mesh Visualization option?

Hand Mesh Visualization option

slight noob question and I may have missed something in the MRTK2-Unity docs/samples etc but I'm just getting back into Unity with the Hololens 2 and I'm looking for a simple example of dropping holograms onto the world mesh, rather like the original Hololens 1 MR 250 tutorial, using the old HoloToolKit: WorldAnchorManager and TapToPlace approach.

I'm sure this is quite a simple thing to achieve but can't seem to find an example now that the HoloToolKit "Manager Prefabs" approach has been replaced by the MRTK services etc.

I want to update some old HL1 projects to HL2 but the Porting Guide is either a bit unclear, or more likely, designed to be interpreted by clever people who know what they are doing...

cheers

That's it, I'll step on my pride!

I'm using MRTK v2 and working fine except that at some point I want to turn off the line extending from the Motion Controller to the object and that provides input. After looking around and trying to find it in the MRTK documentation (it's gotta be easy, right?), I'm still banging my head on the wall and it's starting to hurt....

The MRTK documentation explains quite well how to configure it here:

https://github.com/microsoft/MixedRealityToolkit-Unity/blob/mrtk_release/Documentation/Input/Pointers.md

But I'm looking to do this in script, enabling and disabling it as I need it in my application.

Any clue how to do this?

Many thanks!

So it would appear that this would be a simple solution, but as I can not find any documentation on how to do exactly this it's effectively the same as brute-force guessing a password.

• Unity Versions: 2019.3.1, 2019.3.4(current)
• Platform: Universal Windows Platform
• MRTK: 2.2, 2.3(current)
• HoloLens 2 OS: Windows Holographic Operating System
  
  

• I push a button and the file browser/explorer appears inside my Unity scene
  
  

• I can not launch the file browser/explorer in HoloLens 2.
  
  

With MRTK 2/HoloLens 2 you are able to launch external apps without exiting the Unity application. Something that HoloLens 1 could not do. Microsoft provides proof of this in their Unity examples package: Assets/MixedRealityToolkit.Examples/Demos/HandTracking/Scenes/HandInteraction.Examples.unity once you have loaded the .Foundation and .Examples external packages into your Unity project.

In the provided scene, out of all the presented object there are two buttons off to the right side that when pressed will launch the Edge Browser or the OS's settings application. This is accomplished with a launch URI attached script that runs .OpenURL on a string provided by the user via the GameObject's inspector.

And the code snippet (provided by Microsoft in MRTK2) that runs the user-inputted string:

I need to change the expanding direction of the VerticalLayoutGroup. With the default behavior the group will expand downstairs. What i want is, that the group will expand upstairs.

The expected behavior is described in this Video. (Link to the answer on stackoverflow https://stackoverflow.com/a/43192904/11236801)

The solution on the link is, to rotate the LayoutGroup about 180°. Now this seems more like a workaround, because all childs have to be rotated as well. The solution suggested by this one will not give the expected behavior shown in the video.

I added the ContentSizeFitter to the LayoutGroup like described in this link in the Unity Answers. Now the LayoutGroup will expand in both directions (upstairs and downstairs).

Is there any solution to accomplish the desired behavior without rotating the LayoutGroup?

Edit: I also noticed a downside from the rotating approach: The Billboard Script from the MixedRealityToolkit will force the LayoutGroup to rotate back to 0°.