COMP 7003 Big Data
Credit Points 10
Legacy Code 301046
Coordinator Rodrigo Neves Calheiros Opens in new window
Description "Big data" is the label for the ever-increasing gigantic amount of data with which humanity has to cope. The availability of data and the development of cloud computing architectures to process and analyse these data have made data analytics a central tool in our endeavours. This unit will introduce students to the realm of "big data", covering the important principles and technologies of retrieving, processing and managing massive real-world data sets. It is designed to provide the basic techniques required by any discipline that needs to make sense out of the growing amount of data, and to equip students with the knowledge and key set of skills set to be competitive in the growing job market in the analytics field.
School Computer, Data & Math Sciences
Student Contribution Band HECS Band 2 10cp
Check your HECS Band contribution amount via the Fees page.
Level Postgraduate Coursework Level 7 subject
It is expected that students enrolled in this subject should have basic programming skills in any programming language and working knowledge in elementary probability and statistics, including the concepts of random variables, basic probability distributions, expectations, mean and variance.
- Explain the major trends in technology, business, and science behind big data
- Analyse and compare a selection of major big data management techniques in use today, including parallel databases, NoSQL, MapReduce, cloud services
- Evaluate the relative strengths and weaknesses of MapReduce and parallel database systems and apply the appropriate technique to tackle relevant big data problems
- Apply proper methods of data pre-processing and cleaning for big data analysis
2. Parallel database management systems
3. Data parallelism and the MapReduce framework
4. NoSQL databases and cloud services
5. Data processing and manipulation for big data analysis
The following table summarises the standard assessment tasks for this subject. Please note this is a guide only. Assessment tasks are regularly updated, where there is a difference your Learning Guide takes precedence.
|Practicals||2 hours per Practical (10 in total at 2% each)||20||N||Individual|
|Report and Presentation||A report of 2000 words + final presentation 10 minutes including question time. Final mark is made up of 70% (or 28 out of 40) for the written component and 30% (or 12 out of 40) for the presentation||40||N||Individual|
|End-of-session Exam||90 minutes open book exam including reading time||40||Y||Individual|
2022 Semester 1
Parramatta - Victoria Rd
Subject Contact Rodrigo Neves Calheiros Opens in new window