Trying to get VR passthrough work with sentis
I have an ONNX model that takes an image as input, transforms it using a computational model, and outputs a transformed image. I can explain more what the model does if anyone wants to know more! But...
View ArticleUnity Sentis inference different result from pytorch
I am trying to run a simple classification model via unity sentis. The model runs fine, but I get different result from when I run the model natively in pytorch (or via the onnx runtime in python). I...
View ArticleClik here to view.
Errors trying to get input shape from ONNX model: AssertionException: Cannot...
I’m getting an error trying to run this code to create an input tensor from the model data: TensorShape shape = new TensorShape(runtimeModel.inputs[0].shape.ToTensorShape()); Tensor inputTensor = new...
View ArticleAutomatic Speech recognition using Unity Sentis
I want to create an Automatic Speech Recognition implementation in unity. I want to use the unity sentis for creating this implementation. The main objective of this implementation is that the speech...
View ArticleTrying to get BlazeFace example work in smartphone
I have tried to add mobile camera support to the BlazeFace example, as follows: public AspectRatioFitter fit; public enum InputType { Image, Video, Webcam, Mobile }; in SetupInput(): void SetupInput()...
View ArticleClik here to view.
Introduction of Image Recognition Packages Project that based on Sentis
About Hi Unity Sentis users, We have released an image recognition packages that implemented based on Unity Sentis. You can easily to use class classification, object detection, and other with this...
View ArticleClik here to view.
Piper.unity - open, fast and high-quality TTS
piper.unity is a port of Piper text to speech library. It provides fast, local, and high-quality speech generation for multiple languages. Powered by Sentis, it runs very fast and can generate speech...
View ArticleFailure of createworker?
Hi, I noticed that my object detection model is not stable. No error messages. It is simply that the model cannot detect anything sometime. After investigation, I found that the failure cases took...
View ArticleHow to use sentis in real world with video streaming from camera?
Hey guys, I need help with using object detection on real time camera capture. Can someone please help me with this? 1 post - 1 participant Read full topic
View ArticleObject Detection model poor performance
Can someone please help me? When I use my yolov8n model, the performance is very poor. It has two classes: upstair and downstair. Am I doing something wrong here? using System.Collections.Generic;...
View ArticleYOLOv8 object recognition model not suitable for mobile?
Hello, I’m using the Unity Yolov8 example on Hugging Face Found Here to create a real-time mobile object recognition application, this was a great starting point. I connected a video of my own to the...
View ArticleExporting models to ONNX to be usable with Sentis
Hello! I’m aware that there are existing models for this (unity/sentis-whisper-tiny · Hugging Face), but I’d like to export my own model. The last few days I was trying to do this with...
View ArticleClik here to view.
Deberta zeroshot classification
Hello I have converted a deberta model and made it run with Sentis for those who are interested. huggingface.co Pippe/sentis-deberta-v3-zeroshot · Hugging Face We’re on a journey to advance and...
View ArticleTraining using Sentis
Santis now stable enough, it’s time to expand and make our life easier. Work with the ML agent team to integrate it for training. 2 posts - 2 participants Read full topic
View ArticleClik here to view.
BlazeFace Keypoints Not Working With GPUPixel
As a follow-up to this thread about the blaze face template from hugging face, when setting the backend to be GPUPixel, the 6 keypoints don’t occupy their expected positions (eyes, nose, etc.), they...
View ArticleCan I use Sentis to create animations?
Can I use Sentis to create animations? 2 posts - 2 participants Read full topic
View ArticleAdvice on data preprocessing and exporting
Hello! I’m attempting to export a custom Pytorch model to Unity which includes a pre-trained ResNet encoder and some dense layers for regression. To do inference inside Unity, I embedded all the data...
View ArticleSerializationException: Unable to load layer type on iOS
Hi, what could be causing the following exception, when running an app with Sentis on iOS? The same app runs fine on MacOS. SerializationException: Unable to load type Unity.Sentis.Layers.Resize...
View ArticleError on specific ONNX model
Hi there, I am trying out Sentis on an object detection project and I am facing an issue with a specific onnx model. This model works fine when loaded using onnxruntime in python but triggers the...
View ArticleYOLOv7 Model Performance Degradation with Increased Classes and Slow...
I’ve implemented a YOLOv7 model for object detection within data center racks, integrating it into AR applications for both Android and iOS platforms. Initially, the model performed satisfactorily...
View Article