Skip to content

Initial Nitro-AR#15

Open
jdluzen wants to merge 1 commit intoTensorStack-AI:masterfrom
jdluzen:feat/nitroar
Open

Initial Nitro-AR#15
jdluzen wants to merge 1 commit intoTensorStack-AI:masterfrom
jdluzen:feat/nitroar

Conversation

@jdluzen
Copy link

@jdluzen jdluzen commented Mar 15, 2026

I somehow missed new Nitro-AR models, and I know you've been concentrating on the Python pipelines, so I thought I'd try and see how I'd do.
Mixed results, so far it completes without crashing, but the image isn't great. You can tell that it tries though. Thoughts?
Models: https://huggingface.co/jdluzen/nitro-ar
288505953

_environment = OrtEnv.CreateInstanceWithOptions(ref _environmentOptions);
try
{
_environment = OrtEnv.CreateInstanceWithOptions(ref _environmentOptions);
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure what is going on here, it could just be a me problem: [ErrorCode:RuntimeException] OrtEnv singleton instance already exists, supplied options would not have effect

@saddam213
Copy link
Member

saddam213 commented Mar 16, 2026

The new OnnxRuntime(WinML) does not work on my OS (Windows Server 2022) so its the end of the road for the ONNX part of the TensorStack library, I no longer have the ability to compile, convert or test ONNX models :(

Moving forward I think OnnxStack is still the better library for ONNX as its has been battle tested in the Amuse and AMD Chat applications

The Lemonade SDK is another option, that is made by AMD so should have the most support and I would assume it supports Nitro out of the box
https://lemonade-server.ai/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants