Customize Assessment Rules

Overview

When the Agora Content Moderation cloud service conducts a secondary inspection of the video screenshots, it calculates the probability values of the normal (neutral), pornographic (porn), and sexually suggestive (sexy) categories and selects the category corresponding to the maximum value of the three probability values as the content moderation result. If the default thresholds do not meet your business needs, you can customize them based on the above three probability values.

Implemention

When enablingContent Moderation service, set different types of thresholds in the score_threshold field according to your actual business scenarios. The threshold value range is [0, 1], and a maximum of two thresholds can be set.

Set 1 threshold

"score_threshold": [
    {
        "scene": "category",
        "threshold": 0.8
    }
]

• If the probability value is greater than the threshold, the image is determined to be of this category.
• If the probability value is less than or equal to the threshold, take the larger value of the probability value in the remaining two categories, and determine that the result is the category corresponding to the probability value.

Set 2 thresholds

"score_threshold":
[
    {
        "scene": "category1",
        "threshold": 0.8
    },
    {
        "scene": "category2",
        "threshold": 0.7
    }
]

• If the probability value of category 1 is greater than the threshold 1, the image is determined to be of category 1.

• If the probability value of category 1 is less than or equal to threshold 1, the probability value of category 2 is determined; if the probability value of category 2 is greater than threshold 2, the image is determined to be category 2.

• If none of the above conditions are met, the image is judged to be category 3.