metalkit | tiny set of libraries and a tiny bootloader | Emulator library

I am trying to read frames of a video using the method in the accepted answer in this question: Accesing Individual Frames using AV Player.

I am then trying to display these frames sequentially on a MetalKit MKTView (I tried on a regular UIImage view, and the video doesn't render at all). The problem is that this only works for a few seconds (about 400 frames of the video), after which the app crashes and the video stops playing.

Here is the code in the view controller:

I can't make my MTKView clear its background. I've set the view's and its layer's isOpaque to false, background color to clear and tried multiple solutions found on google/stackoverflow (most in the code below like loadAction and clearColor of color attachment) but nothing works.

All the background color settings seem to be ignored. Setting loadAction and clearColor of MTLRenderPassColorAttachmentDescriptor does nothing.

I'd like to have my regular UIView's drawn under the MTKView. What am I missing?

I'm stuck with SwiftUI and Metal up to the point of being about to give up.

I got this example from https://developer.apple.com/forums/thread/119112?answerId=654964022#654964022 :

I would like to capture a real-world texture and apply it to a 3D mesh produced with a help of LiDAR scanner. I suppose that Projection-View-Model matrices should be used for that. A texture must be made from fixed Point-of-View, for example, from center of a room. However, it would be an ideal solution if we could apply an environmentTexturing data, collected as a cube-map texture in a scene.

Look at 3D Scanner App. It's a reference app allowing us to export a model with its texture.

I need to capture a texture with one iteration. I do not need to update it in a realtime. I realize that changing PoV leads to a wrong texture's perception, in other words, distortion of a texture. Also I realize that there's a dynamic tesselation in RealityKit and there's an automatic texture mipmapping (texture's resolution depends on a distance it captured from).

I have a need for an app, and being a decent(I think) Swift developer, I thought I’d take a crack at it.

The gist of it is simple: I want to

1. Capture a display (CGDisplayStream?)
2. Flip the image vertically
3. Display the flipped stream in a window.

I’m just not sure where to start? Maybe CGDisplayStream or maybe AVFoundation? Does anyone have example code of how to accomplish capturing a display stream and displaying it in a window? Or even a guide of ‘use these classes/interfaces/apis’ to do this? I’ve github searched for CGDisplayStream.init and not really come up with any examples :(

I’m not asking anyone to write it for me, but I could use a: start here, use this, watch out for...

Here's the code I'm currently experimenting with. I think? I have steps 1 & 2 working, but it's hard to tell without #3...

I have a MTKView that is rendering a cube that is sized so that one of its faces fills the entire screen.

I am passing a struct variable (called theuniforms) that contains a random Float to the fragment shader and I want to color each pixel on the screen a different color depending on the float's value.

Right now, it is coloring the entire quad red or blue depending on the Float's value, which is randomized in the draw function.

I think my setup is wrong because at any frame I will only have access to one random Float, and all of the pixels will be colored during that frame (I won't have an array of random floats to determine the pixel color). However, I think I could simply add more variables to the struct variable to overcome this problem.

The main issue is accessing the individual pixel via the fragment function... and if it will be even performant enough to determine a color for every pixel on the screen.

Xcode 11-12, MacOS Catalina, Swift 5 project...

This code is produced "Context leak detected, msgtracer returned -1" error:

Is it possible to programmatically export 3D mesh as .usdz file format using ModelIO and MetalKit frameworks?

Here's a code:

This is a follow up to my previous question here however this question should be able to stand alone. I get the following error when I try to import tensorflow while there exists a file containing from tensorflow import keras.