Hello,
I’m trying to import the llama2 model with 7B parameters (25G) into Unity as a model asset. However, when I export the model from pytorch, onnx recommends to export models larger than 2GB with external data files, which contains weights and bias in it. So I got a smaller .onnx model and its weight files.
I wonder if there is a solution to import .onnx model with these external files. If not, what do you recommend me to do?
Looking forward to your respond.
16 posts - 3 participants