GAZE | Turnkey Open Media Center | Continuous Deployment library

I'm looking for some guidance from anyone who maybe has had luck interacting with Unity Terrain and the MRTK.

I'm using Online Maps and I'm trying to port over an app into the Hololens 2. Everything is in place, except I can't seem to trigger a click on the terrain--which is central to what I need to do.

Basically I render a terrain of a set geographic location, and wherever the user clicks on the terrain, I store those coordinates and will generate a 3d model at that location for other users to see.

In the editor during Play, if I click on the terrain with the mouse all is well. However, if I try to use the gaze circle, I can see the gaze collides with the terrain fine, and I can see the circle shrink during a mouse click, but the click event doesn't fire off ( the actual mouse is off the terrain at this point--which is why nothing happens ). Using the space bar, and the hand stand-in, the cast ray doesn't hit the terrain at all--which is exactly what I see when I build and deploy to the headset, the terrain itself acts as if there is no collider, and is all but ignored by all interactions.

I have tried every possible combination of Interactable states and I'm only ever able to generate a very basic state of the terrain was clicked, which ignores "where" the terrain was clicked and is the key to what I need to achieve.

In essence, I need to figure out how to replicate a mouse click by either the ray cast line in the headset, or by actually touching the terrain.

Side note, I've noticed that when I hold the space bar and use the 3d hand in the editor, I can't interact with my buttons either. These are the same button prefabs used in MRTK examples, and can interact in the editor if I use the gaze circle. I don't know, maybe if I can figure out how to make that interact with the buttons, it might start me in the right direction to getting it to interact with the terrain.

I have a dataframe such as this, where most columns contain strings of values; the values in columns A_aoi, B_aoi, and C_aoi denote gaze directions (A, B, and C to speakers, * nowhere/elsewhere); the values in columns A_aoi_dur, B_aoi_dur, and C_aoi_dur denote the durations of these gazes:

As to say this code works but problem that i am facing that only one url it scrape the data afterward it through an error as show below in figure help me out from this . it print only one link after it through session not created error

I have speech data in utterance and gaze data in columns A_aoi, B_aoi, and C_aoi. Some of the utterancerows are duplicated:

I have data with start times and end times of certain events (subjects gazing at an object called Center).

I am working on a function that outputs a data frame that currently omits trials where there is missing data. However, I would like the full trial count to be added back into the file and the other data columns be blank for these instances (reflecting the missing data).

Example Data Frames:

I'm creating a small demo where objects shall move based on the eyetracker data from a FOVE VR headset.

When I try to move my two objects around ("Gaze Responder - Target" and "Gaze Responder - Fixation"): They don't move, and the colliders stop working.

I have the following hierarchy in Unity3d (2017.4.40f1)

The following Code is attached to GazeContingenVisualField

Odd question, but I'm having trouble boiling it down to a coherent question.

I have sampled data (60Hz) from Brekel OpenVR recorder, which includes the following parameters for the HMD itself:

• X, Y, Z positional coordinates
• Euler angles rotX, rotY, rot.

I'm processing the data in python. Overall, what I'm trying to do is to calculate measures of mobility: did someone look around more or less during a segment, and did they move around more or less?

For the positional coordinates that wasn't too difficult, I was able to calculate displacement, velocity, etc., by using the distances between subsequent positions. Now for the Euler angles, I'm having more trouble.

I've searched for the answer to my question, but none of the answer seemed to 'click'. What I think I need, is to convert the Euler angles to a directional vector, and then calculate the angle between the directional vectors of subsequent samples to see how much the gaze direction shifted. Once I have those, I can calculate means and SDs per subject, to see which of them looked around more (that's the idea anyway). I am unclear on the mathematics though. It would have been easier if my coordinates were roll, pitch, yaw, but I'm struggling with the Euler angles.

Suppose the Euler angles for two subsequent samples are:

• (rotX, rotY, rot) = (20°, 25°, 50°)
• (rotX2, rotY2, rot2) = (30°, 35°, 60°)

How can I quantify with what angle the direction of the HMD changed between those two samples?

Possibly related to How can I simulate hand rays on HoloLens 1?

I want to use HoloLens 1 devices to simulate basic near interactions as provided by HoloLens 2.

Specifically, how can I perform the following mappings:

1. Use hand position during "Ready" gesture to control PokePointer?
2. Use hand position during "Tap-and-hold" gesture to control GrabPointer?

Since HL1 does not track hand orientation, I expect these need to be estimated similar to the example with hand rays.

I have tried creating a custom pointer per the answer above, and it works for hand rays but not for poke/grab as far as I can tell.

I've also created a custom poke pointer according to the example for WMR controllers at How to mimic HoloLens 2 hand tracking wIth Windows Mixed Reality controllers [MRTK2]?, and assigned it to the GGV controller in the same fashion, but somehow the hands don't seem to get detected for poke (or grab), only for hand rays.

(I'm using the Grab pose since HL1 does not seem to return index finger pose during Ready gesture, and since pointer pose seems to refer to the gaze pointer for HL1)