Issue while running custom model

General
, ,
21

hi @shashi
i used that but
hailortcli_monitor only working while running using hailortcli run …

22

Hi @stephan-degirum

Can you please help @jinomathew42 get the hailortcli_monitorworking?

23

Hello @jinomathew42

To get the Hailo Monitor to be enabled for a running application, the environment variable ‘HAILO_MONITOR=1’ must be set in the same process as the application.

So, set the environment variable:
export HAILO_MONITOR=1

and run your application in the same terminal.

Then, in a different process you just run:
hailortcli monitor

Hope this helped!

24

hi @stephan-degirum @shashi
thankyou for the response,

I’ve loaded model like this in my python script

model_spec = ModelSpec( 

model_name="damoyolo_tinynasL35_M--640x640_quant_hailort_hailo8l_1",

zoo_url="/home/gama/ai_projects/model_zoo/zoo/c",

inference_host_address="@local",

model_properties={"device_type": \["HAILORT/HAILO8L", "HAILORT/HAILO8"\]}) 

model = model_spec.load_model()

while doing this npu usage not showing, usage monitor is just blinking all the time

but while loading via hailortcli run command npu usage showing in hailortcli monitor

I’ve done the exporting method

”You’ll need the variant with HAILO runtime enabled. This usually comes from DeGirum’s private wheels or container images, not from PyPI.”

is this true?

(env) root@pi5:/zoo/c# degirum sys-info
Devices:
HAILORT/HAILO8L:

  • ‘@IndexIndex’: 0
    Board Name: Hailo-8
    Device Architecture: HAILO8L
    Firmware Version: 4.22.0
    ID: ‘0001:01:00.0’
    Part Number: HM21LB1C2LAE
    Product Name: HAILO-8L AI ACC M.2 B+M KEY MODULE EXT TMP
    Serial Number: “HLDDLBB243203534\x10HM21LB1C2LAE”
    N2X/CPU:@Index
  • ‘@Index’: 0
    TFLITE@IndexCPU:
  • ‘@IndexIndex’: 0
  • ‘@Index’: 1
    Software Version: 0.18.2
25

Hi @jinomathew42

After loading the model, are you running any continuous inferences on the model? Just loading the model does not really cause any load. The hailortcli runcommand also runs the model.

26

hi @shashi

this is my code snippet

while running this code the monitor shows nothing, while iam using hailo_platform instead of deGirum monitor shows the usage

27

Hi @jinomathew42

Thanks for sharing. We will investigate and keep you posted.

28

hi @shashi

thank you for the update. I’ll wait to hear back from you

29

Hi @jinomathew42

We published a guide on this topic and tested the code in the guide to confirm that we see the NPU utilization. Please try it and let us know if it works for you: How to make sure “hailortcli monitor” picks up your inference