Multimodal Machine Learning

This course prepares students to explain the representation of text, image and audio data in machine learning, design and implement models that combine several data modalities, and evaluate the reliability and security of multimodal models. Study materials: Data Management (DM), Artificial Intelligence (AI).

Topics

1. Concepts of multimodal machine learning
2. Representation of text, image and audio data
3. Management and preprocessing of multimodal data
4. Modality fusion techniques
5. Multimodal models for classification and retrieval
6. Performance evaluation of multimodal models
7. Reliability and security of multimodal models

Each course outcome derives from one programme outcome.

1. CPMK-KSMI-02

   Students are able to evaluate security by appropriately applying defence strategies to infrastructure and mobile devices.

   CPLP02
2. CPMK-KSMI-01

   Students are able to design and implement modern computing architectures by making use of artificial intelligence, multimedia and data integrity

   CPLP02

CPLP02

Design and evaluate modern computing system architectures that integrate artificial intelligence, multimedia and data integrity, and apply cyber defence strategies to infrastructure and mobile devices.