PENet: A Joint Panoptic Edge Detection Network

One-sentence Summary

The paper introduces PENet, a network combining semantic edge detection and instance perception for effective panoptic edge segmentation on the Cityscapes dataset.


In recent years, compact and efficient scene understanding representations have gained popularity in increasing situational awareness and autonomy of robotic systems. In this work, we illustrate the concept of a panoptic edge segmentation and propose PENet, a novel detection network called that combines semantic edge detection and instance-level perception into a compact panoptic edge representation. This is obtained through a joint network by multi-task learning that concurrently predicts semantic edges, instance centers and offset flow map without bounding box predictions exploiting the cross-task correlations among the tasks. The proposed approach allows extending semantic edge detection to panoptic edge detection which encapsulates both category-aware and instance-aware segmentation. We validate the proposed panoptic edge segmentation method and demonstrate its effectiveness on the real-world Cityscapes dataset.



  title={PENet: A Joint Panoptic Edge Detection Network},
  author={Zhou, Yang and Loianno, Giuseppe},
  journal={arXiv preprint arXiv:2303.08848},

Download PDF

Up next Multi-robot Collaborative Perception with Graph Neural Networks
Latest posts PENet: A Joint Panoptic Edge Detection Network Multi-robot Collaborative Perception with Graph Neural Networks Autonomous Drone Inspection with Deep Reinforcement Learning Ubuntu and ROS Setup on M1 MacBook Air Extrinsic Calibration Algorithm between a Stereo Visual System and a 3D LiDAR FENet: Fast Real-time Semantic Edge Detection Network