Auto-Tagging Images

Once asset auto-tagging has been enabled, you can also enable image auto-tagging. Image auto-tagging tags images uploaded to the Documents and Media Library.

Tip

Currently, tags applied automatically are English only.

By default, image auto-tagging is disabled by default. In addition to enabling auto-tagging in DXP, you must also configure an image tagging provider. Three providers are available:

  1. TensorFlow: An open-source library that provides machine learning capabilities. TensorFlow image auto-tagging in DXP is based on TensorFlow’s LabelImage sample for Java, and uses the Inception5h model. Use this with caution, since its accuracy is limited.

  2. Google Cloud Vision: Uses the Google Cloud Vision API to automatically tag images.

  3. Microsoft Cognitive Services: Uses Microsoft Cognitive Services to automatically tag images.

The tags freight car and electric locomotive were automatically applied to this image.

Configuring TensorFlow Image Auto-Tagging

  1. Open the Global Menu and click System Settings under Control Panel.

    Navigate to the System Settings.

  2. Click Assets under Content and Data.

    Click on Assets.

  3. Under VIRTUAL INSTANCE SCOPE, click TensorFlow Image Auto-Tagging.

  4. Fill out the form.

  5. Click Save when finished.

The form asks for this information:

Enable TensorFlow Image Auto-Tagging: Check this box to select whether image auto-tagging is enabled by default in any instance that has asset auto-tagging enabled.

Confidence Threshold: TensorFlow assigns a confidence level between 0 and 1 for each tag, where 1 is the highest confidence and 0 is the lowest. This field sets the minimum confidence level that TensorFlow needs to apply a tag. Higher values yield fewer tags because TensorFlow needs more confidence before it applies a tag. Lower values yield more tags.

Configure TensorFlow image auto-tagging for your portal instances.

Optimizing TensorFlow Auto-Tagging Performance

  1. Open the Global Menu and click System Settings under Control Panel.

  2. Click Assets.

  3. Under SYSTEM SCOPE, click TensorFlow Image Auto-Tagging Process.

  4. Fill out the form.

  5. Click Save to apply the settings.

The form asks for this information:

Maximum Number of Relaunches: The maximum number of times the process is allowed to crash before it is permanently disabled.

Maximum Number of Relaunches Time Interval: The time in seconds after which the counter is reset.

You can fine tune the process that runs the TensorFlow image auto-tagging in the portal.

The TensorFlow provider has been configured.

Configuring Google Cloud Vision

  1. Open the Global Menu and click System Settings under Control Panel.

  2. Click Assets.

  3. Under VIRTUAL INSTANCE SCOPE, click Google Cloud Vision Image Auto-Tagging.

  4. Enter your Google Cloud Vision API Key. For more information, see Google’s documentation on API keys.

  5. Check the Enabled box to enable Google Cloud Vision.

    The Google Cloud Vision provider requires an API key.

  6. Click Save when finished.

Configuring Microsoft Cognitive Services

  1. Open the Global Menu and click System Settings under Control Panel.

  2. Click Assets

  3. Under VIRTUAL INSTANCE SCOPE, click Microsoft Cognitive Services Image Auto-Tagging.

  4. Fill out the form.

  5. Check the Enabled box.

    The Microsoft Cognitive Services provider requires an API key and an endpoint.

  6. Click Save when finished.

The form asks for this information:

API Key: Your API key for the Computer Vision API V2.

API Endpoint: The endpoint for the Computer Vision API v2.0.

The Microsoft Cognitive Services provider has been configured. For more information, see the Microsoft Cognitive Services documentation.

If you have more than one virtual instance, you can configure each instance individually. Navigate to the Control PanelInstance Settings. Click Assets then configure the provider there.

Ask

Capabilities

Product

DXP

Contact Us

Connect

Powered by Liferay
© 2024 Liferay Inc. All Rights Reserved • Privacy Policy