augmented-reality | Augmented reality proof of concept project | Augmented Reality library

In ARKit 4 with RealityKit, one could find, for example, left hand transform relatively to skeleton base (hip). With lefthand transform (relative to hip) and hip transform (relative to world), how to calculate the lefthand transform relative to world? Where is the API? It seems that when I figured out the math formula, I could use SIMD api. But I guess there should be a simple API do this kind of math? Thanks.

EDIT: Adding some code to make it clear ..

I managed with the help of the ScrollMagic library to change my background img for my section three-section-container depending on scroll position. Additionally, I managed to add an overlay that will appear only when I am on a certain section of my page.

My issue now is that I would like to animate how background image changes (I want to come from right to left and stay positioned in the middle/ as you can see in code the background is changing 2 times). I tried with `transform: translateY(40px); property in CSS but the result was inconsistent because the image would not be 100% of my screen. Also, I want my overlay to come from left to right, and I am quite confused how.

Is there a markerless AR library that can run on any mobile web browser? Something that does not require a standalone app like Google Article, and can be run on both Android and iOS.

I have an ARSCNView with virtual objects drawn. The virtual objects are drawn on the user's face. The session has the following configuration:

On Apple's ARKit 3 page (https://developer.apple.com/augmented-reality/arkit/) there is fine print reading, "People Occlusion and the use of motion capture, simultaneous front and back camera, and multiple face tracking are supported on devices with A12/A12X Bionic chips, ANE, and TrueDepth Camera."

I read this sentence as a computer scientist, which suggests that the device must have an A12, ANE, and a TrueDepth camera to support any of "people occlusion, motion capture, simultaneous front/back camera, and multiple face tracking." If this is the case, then the only iPad that can use any of these features is the latest iPad Pro, and not an Air, which have an A12, but not a TrueDepth camera. (Sidenote: what is ANE? I can't find documentation on it, but I think it has something to do with the machine learning system.) Is this correct--that only the iPad Pro supports any of these features?

I ask because people occlusion is incredibly important for a multi-user experience around a table.

I am interested in opening a USDZ file in a Safari browser and making sure that it ends up in the QLPreviewer and I was wondering if there is a browser API for safari that can do this. I want to make sure that the link doesn't just open in a new tab.

I have tried just opening a USDZ file but that just gives the appearance of a new tab where you have the option to open into files and stuff like that.

There isn't really any code yet but if that is the best way to achieve this that would make sense.

I see so from what I have read here you need to specify the rel="ar" which I am still not sure if it is working. I have tried it within codepen and nothing is really happening.

I am investigating new ARKit3 features, in particular motion capture. I have an iPhone with A12 chip (so all new features should work), and iPhone is loaded with iOS 13 (beta). I also installed the Xcode 11 beta on my development laptop as recommended.

When I download the tutorial / sample Xcode project here I find that I have errors on compile. I was able to get rid of those by commenting out the references to the AnyCancellable instance, and the program compiles.

When I run it on on my device, I get error messages about the 3D mesh (in USDZ format) saying it is missing certain joint information.

I've tried substituting the USDZ model included with the sample project for other USDZ models provided on the apple site here, to no avail.

The expected behaviour is that the sample app should open in a camera view, track a person that appears in front of the camera and render a skeleton with 3D mesh model overtop, which mimics the person's actions.

I am getting the error in the Xcode console:

we are trying to make a custom 3D configurator with AR capabilities, but we found out that model-viewer from google is too limited for our needs, so we are doing it in three.js

To use the AR we analyzed the source code and found out that there is a redirect to this link when clicking the model-viewer button:

intent://googlewebcomponents.github.io/model-viewer/examples/assets/Astronaut.glb?link=https%3A%2F%2Fgooglewebcomponents.github.io%2Fmodel-viewer%2Fexamples%2Faugmented-reality.html&title=A%203D%20model%20of%20an%20astronaut

(taken from the Google's example page)

Out first tests made a warning in the console like "Inaccessible Navigation" silently failing. Do you have an idea on what are we doing wrong?

I tried to render ARCore stereoscopically through cardboard. Due to the misalignment between the field of view of the ARCore camera and VR, the object appears to be not being tracked.

To sort this out, I referred to this blog and implemented it by using a barrel distortion shader. However, it doesn't render stereoscopically.

Is there any other fix for this problem?