Memory and swap fills up and process dies when running darket_ros with Yolo v3 on Jetson TX1

I installed Robotics Operating System and used the package darknet_ros[https://github.com/leggedrobotics/darknet_ros] to run Yolo v3 with ROS on Jetson TX1. The input image topic was created using the package video_stream_opencv[https://github.com/ros-drivers/video_stream_opencv/].
After loading the weights in memory, the output from darknet_ros runs for some time, I visualized the memory usage using System Monitor, while the output video running the memory keeps filling and further the process dies when the memory is full.

This issue is referenced to - https://github.com/leggedrobotics/darknet_ros/issues/124