Core Features
Browsing
To browse all available models on OpenGradient, you can go to OpenGradient Model Hub, our frontend for the Model Hub:
You can find models of various types and use cases, including LLMs, Risk models, Dynamic Fee models, Image Generation, and more. There are no restrictions on the types of models you can upload and find.
Pre-Deployed Models
Below, we compiled a list of LLMs we pre-deployed to OpenGradient. You might find these useful for generic tasks:
Model Name | Task | Model CID |
---|---|---|
Meta-Llama-3-8B-Instruct | Text Generation | meta-llama/Meta-Llama-3-8B-Instruct |
Llama-3.1-70B-Instruct | Text Generation | meta-llama/Llama-3.1-70B-Instruct |
Llama-3.2-3B-Instruct | Text Generation | meta-llama/Llama-3.2-3B-Instruct |
Hermes-3-Llama-3.1-70B | Text Generation | NousResearch/Hermes-3-Llama-3.1-70B |
Mistral-7B-Instruct-v0.3 | Text Generation | mistralai/Mistral-7B-Instruct-v0.3 |
Playground
Given the correct format, all models uploaded to the Model Hub are accessible for inference through OpenGradient. The playground feature makes it easy to do so by extracting ONNX input and output metadata and auto-populating input names and values.
Model authors are able to customize these auto-populated values and add additional descriptors.
For Developers
Using Models
Models uploaded to our Hub can be used directly on the OpenGradient network either through native smart contracts or through our Python SDK.
When you want to use a specific model, the first step is to obtain its unique CID from Portal. The CID needs to point to an executable (i.e. ONNX) model file, e.g., dynamic_fee_model.onnx
.
You can see SDK and CLI code examples on the model's "About" page (example here).
Markdown Support
We support most GFM (GitHub Flavored Markdown) syntax, LaTex, and captions! See this guide for additional help.
Captions
Captions are enabled for tables, images, and blockquotes. Prefix the caption text with Caption:
, like below:
![some image](https://www.example.png)
Caption: Image Caption Example
| Header 1 | Header 2 | Header 3 |
| ------ | ----- | ------ |
| Data 1 | Data 2 | Data 3 |
| Row 2-1 | Row 2-2 | Row 2-3 |
Caption: Table Caption Example
> some blockquote here
Caption: Blockquote Caption Example
Note that for tables, there needs to be a new line between the table and Caption:
line.