ai_recipe_validations_image_safety
Validates uploaded images on the Media: Image bundle using a vision-capable AI provider. Blocks content that falls outside the "Safe" tier of Flickr-style safety levels — nudity, sexually suggestive material, gore, graphic violence, and graphic medical imagery — at upload time, across the admin UI, JSON:API, and programmatic saves.
Recipes Applied
Modules and Themes Installed
- AI (Artificial Intelligence)
- AI Validations (submodule of AI)
- Field Validation
Requirements
- Drupal 10.3 or newer
- AI module 1.3 or newer (provides the
verifySetupAiconfig action) - A configured default provider for the
chat_with_image_visionoperation type at/admin/config/ai/settings→ Default Providers. Any vision-capable provider works (OpenAI GPT-4o, Anthropic Claude 3.5 Sonnet, Google Gemini 1.5 Pro, etc.).
If chat_with_image_vision has no default model configured, the recipe apply will abort cleanly with a message from the AI module's preflight check.
Installation
Add the recipe with the following Composer command:
composer require drupal/ai_recipe_validations_image_safetyWhat it does
- Creates a Field Validation rule set on the Media: Image bundle's
field_media_imagefield. - Runs the AI image constraint on every image upload, classifying the image into Safe / Moderate / Restricted tiers.
- Blocks anything outside the Safe tier with a clear error message to the editor.
- Catches uploads from the admin UI, the Media Library, JSON:API posts, migrations, and programmatic
$entity->save()calls.
Adjusting the threshold
The default behavior blocks both Moderate and Restricted content. To allow Moderate content (mature but not explicit) and block only Restricted (explicit / graphic), edit the ai_image_safety rule at Structure → Field Validation → AI image safety (Media: Image) and update the prompt's decision block. Full instructions are in the project README.
Cost note
Every image upload triggers one vision-model API call. Bulk migrations, imports, or high-volume user upload flows will incur proportional cost. Test with your provider's pricing before rolling out to production.
Bugs and Feedback
If you encounter any bugs or have feedback about this recipe, please file an issue in the project issue queue.
Credits
Developed as part of the AI Initiative. See the originating issue: #3585696.