My model is autoregressive, but there was a memory leak during multiple forward inferences in the same frame. How to solve it? Thanks in advance!
The code is below:
public TensorFloat sample(TensorFloat original_data, TensorFloat x_t)
{
for (int i = 15; i >= 0; i–)
{
Dictionary<string, Tensor> inputTensors = new Dictionary<string, Tensor>()
{
{ “original_data”, original_data},
{ “x_t”, x_t },
};
worker.Execute(inputTensors);
x_t = worker.PeekOutput(“output”) as TensorFloat;
}
return x_t;
}
Unity report is:
3 posts - 2 participants