Clik here to view.
Implement MobileSAM with Unity Sentis
Hi, Unity Sentis users, I have successfully running segmentation by the MobileSAM with Unity Sentis and will share a sample project. It can segment object area at the clicked position. GitHub GitHub -...
View ArticleClik here to view.
I try to use Sentis with EmotionFerPlus and I encounter problem with no error
I try to use Sentis with EmotionFerPlus and I encounter problem with no error. github.com //github.com/onnx/models/tree/main/validated/vision/body_analysis/emotion_ferplus And here is my project....
View ArticleClik here to view.
ImporterWarning: Mode 'cubic' is not supported for type Resize
I ran into this unsupported resize mode two times recently. Once with the depth-anything model found here. The other time with part of the TripoSR model (image_tokenizer.onnx): huggingface.co...
View ArticleClassification model not work on sentis 1.2.0
Helllo,i am using yolov5 classifcation to identify whether person wearing safety horness corretly. After trainning the model,tested in python.it works fine. After exporting to onnx,it comes out...
View ArticleClik here to view.
Use ONNX in Application.persistentDataPath folder
Hi everyone, I would like to use an onnx file external to the build so I can update it remotely without republishing the app (iOS and Android). ONNX works perfectly if I import it into Unity with drag...
View ArticleClik here to view.
Struggling with audio spectrogram tensors
Hi there ! I recently had a lot of fun playing with tinyWhisper, jets, and tinyStories models you put on huggingface (amazing work btw), and running them in a Quest2 headset. I am now attempting to...
View ArticleHas anyone developed an img2img example using Sentis?
I am hoping to create an app that runs a image generation model to run an img2img effect directly in unity, similar to how you would do i in stable diffusion. 2 posts - 2 participants Read full topic
View ArticleModelLoader should use UnityWebRequest instead of FileStream
FileStream is unable to load the files in StreamingAssets on Android with FileStream. But the UnityWebRequest is working. 1 post - 1 participant Read full topic
View ArticleClik here to view.
Image similarity using openclip
Hi I am try to do imaga similarity on unity using openclip model. After I export onnx from python and import in unity. When I capture texture2d and try to declare tensorfloat variable. I found error...
View ArticleConversational AI
Hello there, I was wondering if there is open sourced and pre-trained conversational model available and compatible with Unity Sentis. Basically I’d like to be able to have NPC be able to dialogue...
View ArticleDoes Sentis work on Android mobile?
Hi there, saw Sentis in the Unity6 video @ GDC and am trying it out. It seems like a hand tracking model I set up works on my computer, but not on my android devices. So just wanted to check if Sentis...
View ArticleRun CPU jobs single threaded (or limit thread usage)
I am trying to make a sentis STT/TTS model run on Android (Quest 3) I tried async readback, but when it is on the GPU it is causing many lag spikes. When I use it on the CPU the lag spikes are a lot...
View ArticleRunHandLandmark.cs(205,31): error CS1061: 'Ops' does not contain a definition...
Hello, I am trying to get hand tracking working but am running into this error in Unity version 2022.3.14f1. Am I running an incompatible version of Unity or is this problem caused by something else?...
View ArticleBetter documentation
The documentation right now is great at explaining the data pipeline on a high level, and then directly dives into low level. It would be great if the bridge between C# and the LLM would be elaborated...
View ArticleONNX conversion of BLIP Captioning
I’d like to convert BLIP Captioning to ONNX format so that I can use it with Unity Sentis. Here’s where I’m at: -I’m using the Exporting a Model from PyTorch to ONNX method -Using GitHub -...
View ArticleRun a single layer of an existing model
What would be my options if I wanted to run a specific layer of a model? I know that I can get the output of any layer and that I can manually schedule a model to run a layer at a time. But I think...
View ArticleClik here to view.
Sentis Roadmap
Hi everyone, I am excited to share our Sentis roadmap with you . Our goals with this are: 1. Transparency: Share the “What?” and “Why?” we are building. The “How?” will come with actual releases...
View ArticleClik here to view.
Yolov8n-pose asynchronously solution
After struggling with yolo-pose for months, I finally got some idea of how the Sentis works on the CPU, and got a solution of how to make it run asynchronously in 1.3.0-pre3(It might have a better way...
View ArticleHow to add a new Class in YoloV8 example
Hello, Thanks for providing Sentis to the community and providing this example for giraffe detection : unity/sentis-YOLOv8n · Hugging Face This works great ! I wanted to know if instead of Giraffe i...
View ArticleHow to find out if model execution is finished
Is there a way to find out (e.g. a method to call) whether the scheduled model layers have finished executing on the selected backend? 2 posts - 2 participants Read full topic
View ArticleClik here to view.
Could you please explain how is the original whisper tiny model exported to...
Could you please explain how is the original whisper tiny model exported to sentis format? Thank you. huggingface.co unity/sentis-whisper-tiny · Hugging Face We’re on a journey to advance and...
View Article3d Body pose in Sentis?
Are there any examples in C#/Sentis for determining a body pose from a picture? For example Mobile-Human-Pose-3D - GitHub - ibaiGorordo/ONNX-Mobile-Human-Pose-3D: Python scripts for performing 3D...
View ArticleBlaze Palm detector in Unity Sentis WebGL Build Error
Hi, I tried the Blaze Palm detector model, but when I tried to run it in WebGL I got this error Uncaught RuntimeError: divide by zero. I use WebCam as Input Type You can try the build here:...
View ArticleTensor Operations with 1.4
I’m currently checking out the new 1.4 version of Sentis. Some promising stuff in there! So far I’ve heavily used Ops to process tensor data that I’m now looking to port to IBackend. issue with...
View ArticleUpgrade to Sentis 1.4
Is there a way to upgrade from Sentis v1.3 to v1.4 without removing the package from Package manager? 5 posts - 3 participants Read full topic
View Article
