Hosted and Local Compiler User Guide

Documentation User Guides
1

Compilation of PyTorch Checkpoints Using DeGirum Hosted Compiler UI

Since PyTorch checkpoints do not contain the model structure, they cannot be compiled directly. To address this, we have enabled direct compilation from PyTorch checkpoints for models generated from commonly implemented repositories such as Ultralytics and YOLOv5.

Steps to Compile PyTorch Checkpoints

  1. Visit our Compiler UI: Go to cs.degirum.com and log in with your credentials.
  2. Create a New Model Zoo: Click on “New Model Zoo” to create your model zoo.
  3. Navigate to Models >> Compiler: Go to the compiler section in the UI.
  4. Upload Your PyTorch Checkpoint:
    • Choose the appropriate compiler (YOLOv5 or YOLOv8 (Ultralytics)) based on your model architecture.
    • Upload your model checkpoint along with the necessary compiler input options.
  5. Select Output Model Zoo: Choose the model zoo you created in Step 2 as the destination for the compiled model.
  6. Press Compile: Click Compile and wait a few minutes for the process to complete.

Once the compilation process is finished, your model will be available in your model zoo. You can test it out on hosted inference or use it through the PySDK. For examples of how this can be done, visit our PySDK Examples.

Compilation of ONNX Models Using Our Local Compiler

Compiling ONNX models is done using the provided Docker on your local machine. For detailed instructions on using this Docker, refer to the link below:

Once compiled, you can upload the model (zip file) directly to your hosted model zoo.

1 Like