Big Data

This course prepares students to explain the characteristics of big data and distributed storage and processing architectures, implement distributed data processing with Hadoop and Spark, and apply data analysis and machine learning to large-volume data. Study materials: Data Management (DM), Artificial Intelligence (AI).

Topics

1. Characteristics and ecosystem of big data
2. Distributed file systems
3. The MapReduce programming model
4. Distributed data processing with Hadoop
5. Data processing with Spark
6. NoSQL databases for big data
7. Data analysis and machine learning on big data

Each course outcome derives from one programme outcome.

1. CPMK-AIDE-02

   Students are able to build an applied decision basis by optimising computing performance through simultaneous processing, and apply the principles of computing ethics

   CPLP03
2. CPMK-AIDE-01

   Students are able to design and implement advanced artificial intelligence modelling to analyse diverse large-volume data through the management of structured data storage infrastructure.

   CPLP03

CPLP03

Develop advanced artificial intelligence models and manage big data, and build applied decision support with attention to optimal performance and computing ethics.