Does holoscan add benefit to my application?

Healthcare & Life Sciences Holoscan SDK
,
1

Hello, I’m a bit confused as to what Holoscan actually helps with. I have an AGX Orin and ZEDX camera connected with the zed capture card on the CSI port of the orin. It looks like Holoscan is primarily an SDK and it helps with accelerating data transfer, but the documentation is vague. Can I/how would I use it here?

Thanks

2

Hi Alsozatch

Thank you for your interest in Holoscan SDK and using AGX orin. It is great that you already have you system up and running. The main goal of Holoscan sdk is to help developers build real time pipelines with low latency through reusable operators.
Lets say you have an AI model for object detection and you would like to run it in an optimized way. It would be simple to get it to work. However, It would take some effort to figure out your latency, for different input size and frame rates. Debugging your code and profiling it could also be challenging specially as you have multiple AI models running in parallel. it is typical to have stereo input from 2 camera that need to run in parallel.
The workflow gets even more complicated if you have conditions in your DAG. as run model A if input X >0 otherwise run model B. Also if you inputs are not synchronized as 1 input has x fps and the other has y fps and you would need to wait or do some logic. As you can see your system can get complicated very fast as you have more inputs and models

Holoscan provides out of the box:

  1. Built in Operators that you can reuse in your pipeline to run inference. You can also reuse operators from any application in HoloHub.
  2. supports python for fast prototyping then easily convert to c++ for performance
  3. Multiple schedulers to pick from.
  4. Profiling tools as Data flow tracking
  5. Benchmarking tools These tools will run your application multiple times and report statistics on each operator in your DAG.
  6. Easily allow you to run a distributed application across different devices
  7. Profiling using Nsight systems Holoscan will to all the annotation using NVTX for you so you only need to run the cli command
  8. Debugging applications using vscode. See this video
  9. Gather GXF statistics
  10. Simplifies using Holohub Operators in External Applications

Please note that there are 80+ examples in Holohub repo to show different features

Hope this clarifies features in Holoscan SDK. Please let us know if you are looking for other features.