Smart Zone Scene Semantic Segmentation In Development Expected by end of Q2 2023
What it does:
Allows you to search for events or create or suppress alerts based on semantic understanding of the scene and its objects. The segmenter locates and labels areas as road, sidewalk, building, wall, fence, pole, traffic light, traffic sign, vegetation, terrain, and sky.
This requires some visuals to explain:
Smart Zone: Vehicles leaving roadway
Getting a vehicle detection for vehicle in a roadway is not going to be especially valuable. That's where you expect to see vehicles, but a vehicle who leaves the roadway is of concern. As you can see in the next image, the smart zone semantic segmenter has located the roadway area (highlighted in blue). This additional data point can allow you to receive suppress vehicle alerts when the vehicle is on the roadway, and instead allow for the valuable "vehicle not on roadway" alert, or be able to search your event database vehicles on different areas (vehicle in grass, on sidewalk, person in road, etc) .
Smart Zone: Intrusion
Another way you might use smart zones is to perform a search for people on the driveway, grassy area, or fence. As you can see in this image, the segmenter has understood these areas from the visual image.
None. Runs when a camera is added to survail.
Semantic Segmentation is only available for outdoor cameras; it will not work for indoor cameras. It will have random results for indoor spaces, as it is trained only on outdoor images and areas, as seen here:
The Semantic segmentation model does not have a separate class for driveway. Visually, it can be difficult for computers to understand the difference between roadways and driveways.
If you reposition the camera, the smart zone map will no longer correspond to what the camera sees. This is especially important for PTZ cameras or motorized varifocal cameras. Eventually, survail will be able to know when a PTZ or motorized varifocal camera changes its viewport and then re-run the semantic segmentation model to develop an up-to-date smart zone scene map, but this will be a different update.
Currently, there is no way to edit the smart zones created by the model, so if it gets it wrong, you can't adjust it. This is a planned feature, but this will be a different update.
This model was made by Intel.