Skip to main content
Unit outline_

QBUS6810: Statistical Learning and Data Mining

Semester 2, 2023 [Normal day] - Camperdown/Darlington, Sydney

It is now common for businesses to have access to very rich information data sets, often generated automatically as a by-product of the main institutional activity of a firm or business unit. Data Mining deals with inferring and validating patterns, structures and relationships in data, as a tool to support decisions in the business environment. This unit offers an insight into the main statistical methodologies for the visualization and the analysis of business and market data. It provides the tools necessary to extract information required for specific tasks such as credit scoring, prediction and classification, market segmentation and product positioning. Emphasis is given to business applications of data mining using modern software tools.

Unit details and rules

Academic unit Business Analytics
Credit points 6
Prerequisites
? 
(ECMT5001 or QBUS5001 or STAT5003) and (a mark of 65 or greater in BUSS6002 or COMP5310 or COMP5318)
Corequisites
? 
None
Prohibitions
? 
None
Assumed knowledge
? 

None

Available to study abroad and exchange students

Yes

Teaching staff

Coordinator Alison Wong, a.wong@sydney.edu.au
Lecturer(s) Bradley Rava, bradley.rava@sydney.edu.au
Type Description Weight Due Length
Supervised exam
? 
Final exam
Written exam, closed book.
45% Formal exam period 2 hours
Outcomes assessed: LO1 LO2 LO3 LO4
Small continuous assessment Engagement
A regular low stake quiz/homework to support continuous engagement.
5% Multiple weeks Short homework quiz
Outcomes assessed: LO1 LO2 LO3 LO4
Supervised test
? 
Mid-semester exam
Written exam, closed book. Exact data will be announced on Canvas.
20% Week 07
Due date: 16 Sep 2023 at 18:00
1 hour
Outcomes assessed: LO1 LO2 LO3 LO4
Assignment group assignment Group project
Data analysis project and report.
30% Week 13
Due date: 05 Nov 2023 at 23:59
15 pages
Outcomes assessed: LO1 LO2 LO3 LO4 LO5 LO6 LO7 LO8
group assignment = group assignment ?

Assessment summary

  • Engagement: this assessment is designed to support your sustained and continued engagement across the full semester. By engaging in regular short quizzes on Canvas, you will be able to track your learning progress and allow your teachers to better support your development across the unit.
     
  • Group project: The group project will examine your understanding of the concepts presented in the unit. The assignment task will measure your knowledge of supervised learning methods, your skill in applying and evaluating these methods using Python, and your ability to communicate the results and conclusions in a professional way. This assignment will help you develop valuable communication and collaboration skills and allow you to contextualise your statistical learning skills on real applied problems.

  • In-semester and final exams: the exam questions will test your understanding of the essential characteristics and theoretical properties of the methods covered. They will also test your ability to make informed comparisons of the methods,  correctly interpret and analyse statistical results and to formulate substantive conclusions based on these results.

Further information for each assessment will be provided on Canvas.

Assessment criteria

The University awards common result grades, set out in the Coursework Policy 2014 (Schedule 1).

As a general guide, a high distinction indicates work of an exceptional standard, a distinction a very high standard, a credit a good standard, and a pass an acceptable standard.

Result name

Mark range

Description

High distinction

85 - 100

Awarded when you demonstrate the learning outcomes for the unit at an exceptional standard, as defined by grade descriptors or exemplars outlined by your faculty or school. 

Distinction

75 - 84

Awarded when you demonstrate the learning outcomes for the unit at a very high standard, as defined by grade descriptors or exemplars outlined by your faculty or school.

Credit

65 - 74

Awarded when you demonstrate the learning outcomes for the unit at a good standard, as defined by grade descriptors or exemplars outlined by your faculty or school.

Pass

50 - 64

Awarded when you demonstrate the learning outcomes for the unit at an acceptable standard, as defined by grade descriptors or exemplars outlined by your faculty or school. 

Fail

0 - 49

When you don’t meet the learning outcomes of the unit to a satisfactory standard.

For more information see guide to grades.

Late submission

In accordance with University policy, these penalties apply when written work is submitted after 11:59pm on the due date:

  • Deduction of 5% of the maximum mark for each calendar day after the due date.
  • After ten calendar days late, a mark of zero will be awarded.

Academic integrity

The Current Student website provides information on academic integrity and the resources available to all students. The University expects students and staff to act ethically and honestly and will treat all allegations of academic integrity breaches seriously.

We use similarity detection software to detect potential instances of plagiarism or other forms of academic integrity breach. If such matches indicate evidence of plagiarism or other forms of academic integrity breaches, your teacher is required to report your work for further investigation.

Use of generative artificial intelligence (AI) and automated writing tools

You may only use generative AI and automated writing tools in assessment tasks if you are permitted to by your unit coordinator. If you do use these tools, you must acknowledge this in your work, either in a footnote or an acknowledgement section. The assessment instructions or unit outline will give guidance of the types of tools that are permitted and how the tools should be used.

Your final submitted work must be your own, original work. You must acknowledge any use of generative AI tools that have been used in the assessment, and any material that forms part of your submission must be appropriately referenced. For guidance on how to acknowledge the use of AI, please refer to the AI in Education Canvas site.

The unapproved use of these tools or unacknowledged use will be considered a breach of the Academic Integrity Policy and penalties may apply.

Studiosity is permitted unless otherwise indicated by the unit coordinator. The use of this service must be acknowledged in your submission as detailed on the Learning Hub’s Canvas page.

Outside assessment tasks, generative AI tools may be used to support your learning. The AI in Education Canvas site contains a number of productive ways that students are using AI to improve their learning.

Simple extensions

If you encounter a problem submitting your work on time, you may be able to apply for an extension of five calendar days through a simple extension.  The application process will be different depending on the type of assessment and extensions cannot be granted for some assessment types like exams.

Special consideration

If exceptional circumstances mean you can’t complete an assessment, you need consideration for a longer period of time, or if you have essential commitments which impact your performance in an assessment, you may be eligible for special consideration or special arrangements.

Special consideration applications will not be affected by a simple extension application.

Using AI responsibly

Co-created with students, AI in Education includes lots of helpful examples of how students use generative AI tools to support their learning. It explains how generative AI works, the different tools available and how to use them responsibly and productively.

WK Topic Learning activity Learning outcomes
Week 01 Introduction to statistical learning Lecture (2 hr) LO1 LO2 LO3 LO4
Python basics Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 02 Linear regression Lecture (2 hr) LO1 LO2 LO3 LO4
Numpy and pandas Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 03 Regression modelling and k-nearest neighbours Lecture (2 hr) LO1 LO2 LO3 LO4
Regression modelling Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 04 Model selection Lecture (2 hr) LO1 LO2 LO3 LO4
Linear regression and k-nearest neighbours Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 05 Maximum likelihood estimation. Subset selection methods in linear regression. Lecture (2 hr) LO1 LO2 LO3 LO4
Statistical learning fundamentals Tutorial (1 hr) LO4
Week 06 Variable selection and regularization in linear regression Lecture (2 hr) LO1 LO2 LO3 LO4
Model selection Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 07 Classification methods I Lecture (2 hr) LO1 LO2 LO3 LO4
Variable selection and regularisation in linear regression Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 08 Classification methods II Lecture (2 hr) LO1 LO2 LO3 LO4
Naive bayes and sentiment analysis Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 09 Classification methods II Lecture (2 hr) LO1 LO2 LO3 LO4
Classification methods Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 10 Nonlinear modelling Lecture (2 hr) LO1 LO2 LO3 LO4
Regression splines Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 11 Tree-based methods I Lecture (2 hr) LO1 LO2 LO3 LO4
Tree-based methods for classification Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 12 Tree-based methods II Lecture (2 hr) LO1 LO2 LO3 LO4
Boosting and model stacking Tutorial (1 hr) LO1 LO2 LO3 LO4 LO5 LO6 LO7
Week 13 Ensemble learning and discussion Lecture (2 hr) LO1 LO2 LO3 LO4
Statistical learning methods Tutorial (1 hr) LO3 LO4

Study commitment

Typically, there is a minimum expectation of 1.5-2 hours of student effort per week per credit point for units of study offered over a full semester. For a 6 credit point unit, this equates to roughly 120-150 hours of student effort in total.

Required readings

You can access all readings for this unit through Canvas.

Primary textbook

James, G., Witten, D., Hastie, T. and Tibshirani, R. (2021). An Introduction to Statistical Learning (Second Edition). New York: Springer.

Required reading

Domingos, P. (2012). A Few Useful Things to Know about Machine Learning. Communications of the ACM, 55(10), 78-87.

Huyen, C. (2022). Designing Machine Learning Systems. O'Reilly Media, Inc.

Advanced textbook

Students with sufficient background in statistics and mathematics can consider progressing to more advanced reading. 

Murphy, K.P. (2022). Probabilistic Machine Learning: An Introduction. MIT Press.

Learning outcomes are what students know, understand and are able to do on completion of a unit of study. They are aligned with the University's graduate qualities and are assessed as part of the curriculum.

At the completion of this unit, you should be able to:

  • LO1. Recognise how machine learning can help organisations optimise business processes and make effective decisions at scale.
  • LO2. Formulate business decision problems as predictive machine learning problems.
  • LO3. Select relevant machine learning algorithms and tools to solve a range of business prediction and data mining problems.
  • LO4. Evaluate machine learning algorithms and techniques according to their statistical and computational properties.
  • LO5. Extract business insights from large volumes of data using machine learning and data mining methods.
  • LO6. Apply machine learning and data mining techniques using industry-standard computational tools.
  • LO7. Collaborate effectively within data teams.
  • LO8. Communicate data-driven results and insights effectively to a business audience.

Graduate qualities

The graduate qualities are the qualities and skills that all University of Sydney graduates must demonstrate on successful completion of an award course. As a future Sydney graduate, the set of qualities have been designed to equip you for the contemporary world.

GQ1 Depth of disciplinary expertise

Deep disciplinary expertise is the ability to integrate and rigorously apply knowledge, understanding and skills of a recognised discipline defined by scholarly activity, as well as familiarity with evolving practice of the discipline.

GQ2 Critical thinking and problem solving

Critical thinking and problem solving are the questioning of ideas, evidence and assumptions in order to propose and evaluate hypotheses or alternative arguments before formulating a conclusion or a solution to an identified problem.

GQ3 Oral and written communication

Effective communication, in both oral and written form, is the clear exchange of meaning in a manner that is appropriate to audience and context.

GQ4 Information and digital literacy

Information and digital literacy is the ability to locate, interpret, evaluate, manage, adapt, integrate, create and convey information using appropriate resources, tools and strategies.

GQ5 Inventiveness

Generating novel ideas and solutions.

GQ6 Cultural competence

Cultural Competence is the ability to actively, ethically, respectfully, and successfully engage across and between cultures. In the Australian context, this includes and celebrates Aboriginal and Torres Strait Islander cultures, knowledge systems, and a mature understanding of contemporary issues.

GQ7 Interdisciplinary effectiveness

Interdisciplinary effectiveness is the integration and synthesis of multiple viewpoints and practices, working effectively across disciplinary boundaries.

GQ8 Integrated professional, ethical, and personal identity

An integrated professional, ethical and personal identity is understanding the interaction between one’s personal and professional selves in an ethical context.

GQ9 Influence

Engaging others in a process, idea or vision.

Outcome map

Learning outcomes Graduate qualities
GQ1 GQ2 GQ3 GQ4 GQ5 GQ6 GQ7 GQ8 GQ9

This section outlines changes made to this unit following staff and student reviews.

No changes have been made since this unit was last offered.

Python and Jupyter Notebook

Python is the computational engine that will allow us to bring the content of the unit into practice in a sophisticated way. Python is a free and open source general purpose programming language that has become the language of data science (together with R). It has powerful data manipulation, statistics, machine learning, data visualisation, and scientific libraries. Python is simple to learn and use and is supported by a large community of users in industry and academia.

You can find more information on Canvas. 

Disclaimer

The University reserves the right to amend units of study or no longer offer certain units, including where there are low enrolment numbers.

To help you understand common terms that we use at the University, we offer an online glossary.