Clik here to view.
Use case: distance matrix -> 3d protein (biology)
This is another “proof of concept” post. Background: In the first Alphafold model (v1) from Deep Mind (2018) they used a model which output a matrix of distances from each amino-acid to each other...
View ArticleClik here to view.
Use case: galaxy simulation (physics)
How might Sentis be used for physics? - Some afternoon thoughts After going down a rabbit-hole of deep learning in chemistry it got me wondering how can you use it in physics simulations in general....
View ArticleManaging memory when doing operations on tensors
I’m executing a model about once every frame which works well so far, but I want do some processing on the output tensor on-device. I’m using tensor operations with code that looks like this: Summary...
View ArticleHow to Create AI Model NPCs using Sentis
I would like to create a AI model NPC’s for my projects. Where I can find ONNX AI Model for NPC, how to these ONNX AI Models to implement the NPC’s. They should be able to display some text or...
View ArticleQuestion Sentis training possible?
In the docu I see only inference, no output to ONX and no API to modulate weights or API to build model from scratch. Sentis has no training possible? Only consume ONX? Beta discussion should be in...
View ArticleClik here to view.
Load onnx model from bytes
Hello, I’m training the model using Ml Agents on a remote server, and than send it to unity, and when i try to create the ModelAsset i had the following error: NotSupportedException: Format version...
View ArticleClik here to view.
Thread Group Error using Sentis
I got the following error when using sentis: Thread group count is above the maximum allowed limit. Maximum allowed thread group count is 65535. together with a warning : Exceeded safe compute...
View ArticleAccessing the output NCHW in sentis
Hi everyone! I wanted to know how to access and assign the output tensors height, width, channels values to a new variable in unity sentis When I tried to access width I am facing error as:...
View ArticleImport a onnx model with its external files
Hello, I’m trying to import the llama2 model with 7B parameters (25G) into Unity as a model asset. However, when I export the model from pytorch, onnx recommends to export models larger than 2GB with...
View ArticleClik here to view.
Inference running slow refer to ConvTranspose and Upsample2D ops (vs...
Hi Unity team and community: I am trying to implement a Unet model to do denoising work as a post-process for rendering by Senti. Everything works well but the inference (i.e. engine.excute() )...
View ArticleAny Temporary workarounds for torch.nn.functional.grid_sample?
torch.nn.functional.grid_sample is not currently supported in sentis as it is in opset 16. Does anyone have some ideas about a temporary solution for it? 2 posts - 2 participants Read full topic
View ArticleMakeReadable() possible memory leak
I’m running a network every frame with a fairly large output tensor ((56x80x80) - I mention this because the leak is much more apparent with large outputs), and found that outputTensor.MakeReadable()...
View ArticleClik here to view.
Garbage Collection of RAM?
Here is some code which increases the RAM and doesn’t garbage collect it: values = new float[2000*64*64]; for (int i = 0; i < 100; i++) { TensorFloat input = new TensorFloat(new TensorShape(1,...
View ArticleClik here to view.
Possible memory leak in 0-dimensional tensors
While playing around with different models on CPU and GPU, I noticed that in tensors where one dimension is 0, the tensorOnDevice value is sometimes null. I couldn’t reproduce the error reliably (so...
View ArticleClik here to view.
There was a memory leak during multiple forward inference in the same frame
My model is autoregressive, but there was a memory leak during multiple forward inferences in the same frame. How to solve it? Thanks in advance! The code is below: public TensorFloat...
View ArticleClik here to view.
Got an error while importing an onnx model for segment anything
Hi, I am trying to use a segment anything model in unity. I have installed the latest version of sentis package and Unity. I have tested the onnx model in the python environment outside unity and it...
View ArticleHow to find inputs for model
Hi, I wanted to play around with the Sentis. First I loaded a sample for one input and one output and read the data back. Then I downloaded the GPT2 language model but I do not know how to set inputs...
View ArticleClik here to view.
Minor outdated code comments
In the 1.3.0-pre.1 manual, under https://docs.unity3d.com/Packages/com.unity.sentis@1.3/manual/run-a-model-a-layer-at-a-time.html the code comments refer to a do-while loop but the code is “just”...
View ArticleThread group count limit - error when running mobilesam
Using this model from here for example. When running with a GPUCompute backend I get a warning and then an error: Warning: Exceeded safe compute dispatch group count limit per dimension [1, 65536, 1]...
View ArticleClik here to view.
Strange execution of some layers on the CPU instead of GPU
In some models I have observed that many layers are executed on the CPU even though I use the GPUCompute runtime and all operations should be supported by the GPU. I built models to reproduce the...
View Article