COMP810 Data Warehouse and Big Data

Table of Contents

1.

Assessment tasks……………………………………………………………………………………………………………………….. 2

2.

Topics……………………………………………………………………………………………………………………………………….. 2

3.

Layout for Research Report…………………………………………………………………………………………………………. 3

4.

General guidelines……………………………………………………………………………………………………………………… 3

5.

What to submit………………………………………………………………………………………………………………………….. 3

6.

When to submit…………………………………………………………………………………………………………………………. 4

7.

How to submit…………………………………………………………………………………………………………………………… 4

8.

Big Data Research Report Rubric ……………………………………………………………………………………………….. 51. Assessment tasks

The objective of this assignment is to conduct preliminary research on big data using the techniques

delivered in this paper. To achieve this objective, you need to follow the steps below:

1. This is an individual assignment.

2. Select a big data-related topic based on the use cases of big data stated in Section 2: Topics,

OR you can come up with your own.

3. Read and analyse peer-reviewed papers (minimum of 8 including reference) on your

specific topic.

4. From your research, identify at least two themes and discuss these themes by comparing them

from the various papers in your research. Some examples of themes are listed below:

• Approaches/algorithms to solve the problem.

• Scientific results from experimentation

• Perspectives on an issue

• Advantages/disadvantages

• Effects of an issue

• Challenges/opportunities

5. Express your opinions, e.g., new ideas, proposed approaches/models, how to extend the

existing work, etc. Your opinions about big-data related issues should be presented.

6. Select/download an online dataset and conduct preliminary analysis using the existing tools

or writing a program. Please try to use the techniques delivered in this paper. You can use

any programming language if you want to write programs to conduct data analysis.

7. Write pseudo-code/explain the idea of how to apply MapReduce to the specific problem.

8. Write the report using LaTex / Word. Minimum 6 pages (including references) in 2

columns IEEE proceedings format

2. Topics

You can pick one of the following topics or come up with your own. The details of the following

topic will be explained in the slides of Lecture 7 Introduction to Big Data.

• Post-disaster Analytics

• News Analytics

• Product Recommendation

• Social Influence Diffusion Analysis

• Customer Churn Analysis

• Customer Segmentation

• Sentiment Analysis

• Anomaly Detection in Online Social Networks

• Market Basket Analysis

Page | 23. Layout for Research Report

The research report should include:

• Title

• Abstract

• Introduction

• Background/Motivation

• Related Work – comparison of related work from peer-reviewed sources

• Your Opinion – new ideas, proposed approaches/models, how to extend the existing work

• Data and Analysis – data set details, initial analysis, visualisation and MapReduce pseudo

code

• Conclusion and Future Issues

• References

4. General guidelines

• Your submission must be individual work.

• Minimum 6 pages (including references) in 2 columns IEEE proceedings format – the word

and LaTex template is available on Canvas.

• Minimum 8 full and consistent electronic references from peer-reviewed sources.

• References must be clickable (important for efficient marking).

• Your opinion section is a very important part of the report. In this section, you will present

your own thoughts about the existing works. Based on this you will give your opinions on

how the existing work can be improved further. Your opinions about big-data-related issues

should be presented. This section should consist of at least one page.

• The data and analysis section requires you to select/download data online using Google

Dataset Search or from other sources. The source and link of the dataset need to be

incorporated. The initial analysis can be conducted using the existing tools or writing a

program. Please try to use the techniques delivered in this paper. There is no requirement for

specific programming languages if you want to write programs. Namely, you can use any

programming language if you want to write programs to conduct data analysis. Figures

should be inserted into the research report.

• Write pseudo-code/explain the idea of how to apply MapReduce to the specific problem.

• For your convenience, a sample research report will be available on Canvas under the

assessment module.

5. What to submit

• Research report in a PDF file.

• Note: the above file should be named with your family name and student ID, e.g.,

Smith_12345.

Page | 36. When to submit

• Due date: The end of Week 13 (Friday, 11:59 P.M)

• Late penalty: maximum late submissions time is 24 hours after the due date. In this case, 5%

late penalty will be applied.

• Incorrect Paper Format: 10% penalty if the format of the paper doesn’t conform to the

required format – 2 columns IEEE proceedings format

• Penalty for Failure to Meet the Required Paper Length: 5 – 5.5 pages -5%, 4-5 pages –

10%, 3-4 pages -20%, 1-3 pages -50%.

• Late submission with SCA: no penalty if the assignment is submitted within the SCA

period.

• Plagiarism: If the assignment is classified as plagiarism (the overall similarity score is

above 25%), all the items will be given 0. Do check your similarity report after

submission. Please revise the report and resubmit it if it doesn’t meet the requirement. If

a particular section has a very high similarity score, a penalty for that section will be

applied. Copying data analysis from online resources, e.g., Kaggle, will be considered

plagiarism.

7. How to submit

• All assessments should be submitted through Canvas.

• NOTE: If you are using any material or figures in the assessment that is not your own, do

remember to cite/reference the source.

• All assessments will be assessed through the Turnitin system. In case of plagiarism, the

University policy against plagiarism will be applied.

Page | 4Page | 5

8. Big Data Research Report Rubric

Weight

Report Components and

Requirements

Excellent

(80%-100%)

Good

(60% – 80%)

Satisfactory

(40%-60%)

Unsatisfactory

(0%-40%)

10%

Title and Abstract

• The title summarises the main

idea of the study and gives a

reasonable scope of the

research.

• The abstract should be one

paragraph (200-250 words),

and it should cover the whole

theme of the report.

➢ The title reflects the main

idea of the study. It

contains the fewest

possible words needed to

describe the research

paper’s content and

purpose adequately.

➢ The scope of the research

is reasonably described

based on the title.

➢ The length of the abstract

is adequate. States clearly

question being asked in

200-250 words.

➢ Highlight the most

important findings with

enough information to

understand the research.

➢ States the major findings

and conclusions.

➢ The title reflects the main

idea of the study but

gives a broad scope.

➢ The abstract is written in

a scientific style but is

relatively well organised

or concise.

➢ The abstract includes

a

concise summary of

questions and findings.

➢ The title is not tailored to student’s research.

➢ The abstract does not give an overview that

leads directly to the reader being able to state

the study’s major findings.

➢ The length of the abstract appears not adequate,

i.e., either too long or too short.

➢ The abstract is not written in a scientific style.

Even some references are included in the

abstract.

20% Introduction and Background

• The introduction part should

introduce the topic and its

importance. It should also

include at least one diagram

related to the topic. One page

is sufficient for the

introduction section.

➢ The introduction is

engaging, states the main

topic and previews the

structure of the paper.

➢ The background of the

research is well structured.

It also explains the specific

reasons for conducting a

study. The motivations are

explicitly presented. Two

➢ The introduction states

the main topic and

previews the structure of

the paper.

➢ The background of the

research is relatively well

structured. The

motivation of the study is

not strong. The reasons

for the study are given

➢ The introduction states

the main topic but

does not adequately

preview the structure

of the paper.

➢ The background of the

research is not well

structured. The

motivation of the

study is not strong.

➢ There is no clear

introduction or main

topic, and the

structure of the paper

is missing.

➢ The background of

the research is not

well structured. The

motivation of the

study is not strong. Page | 6

• The background is important

to understand the topic in

depth, while motivation

presents the importance of the

topic statement of objectives;

two themes identified for the

report should be clearly

stated.

• One page is sufficient for the

background section.

themes identified for the

report are clearly stated.

but appear a bit too

general.

➢ It also explains the

reasons for conducting a

study. The motivations

are explicitly presented.

Two themes identified

for the report are clearly

stated.

Two themes are

identified for the

report but not clearly

explained.

Missing themes

identified for the

report.

20% Related Work/Literature

Review

• Related work should comprise

the reviews of the current

state of knowledge relevant to

the topic.

• Comparison and contrast

between different

authors/approaches should be

clear.

• Page length is 1 to 2.

➢ The literature reviewed

closely relates to the main

topic and sets up the

rationale for the study

aim/purpose by clearly

identifying a gap in the

literature.

➢ Literature covers the

relevant and current

articles in detail. Only

scholarly articles are used

to build the argument for

the need for the study.

➢ The comparison and

contrast between different

authors or approaches are

very clear.

➢ The page length meets the

requirements.

➢ The literature reviewed

relates to the study topic.

All major sections of the

literature are included

but may not be covered

in-depth, or a few areas

of the relevant literature

are not covered.

➢ The comparison and

contrast between

different authors or

approaches are clear.

➢ Most articles/sources

reviewed are from

scholarly sources, but a

few are not.

➢ The page length meets

the requirements.

➢ The literature reviewed has weak or no

connection to the topic under study.

➢ A clear rationale for the study aim/purpose (the

gap in the literature) is not identified.

➢ Major sections of literature are omitted, or the

literature review is not from scholarly sources.

➢ The comparison and contrast between different

authors or approaches are not clear.

➢ The page length does not meet the requirements.

20% Your Opinion

• This is an important section in

which the student will critique

the existing work and will

➢ The existing works are

very well critiqued.

➢ The opinions are presented

in a logical manner. Strong

evidence is given to

➢ The existing works are

commented. The

opinions are presented in

a logical manner. Some

evidence is given to

➢ The existing works are

stated but not well

critiqued.

➢ The opinions are

presented in a logical

➢ The existing works

are stated but

without any critical

comments.

➢ The opinions are not Page | 7

present his/her own opinion

about how to improve it

further?

• This section should reflect

some research insight

developed by the student.

• Your opinions about big-data

related issues should be

presented.

support the opinions. The

opinion also presents

creativity and innovation,

shedding light on future

research directions. The

research insights are also

reflected.

➢ Opinions associated with

Big Data related issues are

well presented.

support the opinions. The

research insights are also

reflected.

➢ Opinions associated with

Big Data related issues

are well presented.

manner.

➢ Very little evidence is

given to support the

opinions.

➢ No opinions are

associated with Big

Data related issues.

well structured.

➢ Lack of evidence for

supporting the

opinions.

➢ The research insights

are missing.

➢ No opinions are

associated with Big

Data related issues

20% Data and Analysis

• Select/download a dataset

using Google Dataset Search

or from other sources, and

source/links are included.

• Conduct an initial analysis and

visualise the results.

• Write pseudo-code/explain the

idea of how to apply

MapReduce to the specific

problem.

➢ Moderate size

10MB+/10K+ records

➢ The link and the source of

the datasets are clearly

explained.

➢ The data statistics are

listed in the report.

➢ The big data tools taught in

this paper are utilised as a

part of the data analysis.

➢ Initial analysis, including

basic statistical analysis

and aggregation results, is

well presented.

➢ MapReduce pseudo-codes

(to address the problem

stated in the report) are

well designed with

excellent explanations.

➢ Moderate size

10MB+/10K+ records

➢ The link and the source

of the datasets are clearly

explained.

➢ The data statistics are

listed in the report.

➢ Appropriate tools are

selected for conducting

data analysis, but the big

data tools taught in this

paper are NOT used.

➢ Initial analysis, including

basic statistical analysis

and aggregation results,

is well presented.

➢ MapReduce pseudo

codes (to address the

problem stated in the

report) are well designed

with excellent

explanations.

➢ The dataset is small, with less than

10MB+/10K+ records.

➢ The link and the source of the datasets are

missing.

➢ The data statistics are listed in the report.

➢ Appropriate tools are selected for conducting

data analysis, but the big data tools taught in

this paper are NOT used.

➢ Initial analysis, including basic statistical

analysis and aggregation results, is presented.

➢ MapReduce pseudo-codes are missing or not

well designed. Page | 8

10% Conclusion and References

• In this section, students will

draw conclusions on the given

topic. In other words, it is a

brief summary of the work

presented in the research

report. You also need to

discuss at least two future

issues on the topic.

• All references should be from

peer-reviewed journals and

conferences. They must be

clickable in the document.

Each report should include at

least 8 peer-reviewed

references.

➢ The conclusion captures

the focus of the research

paper.

➢ The conclusion

summarises the main

points/aspects of the

research paper by

paraphrasing the paper

statement, where the

conclusions drawn from

the research are clearly

explained.

➢ The conclusion provides at

least two future issues, and

all of them are reasonable

and well presented.

➢ References are peer

reviewed professional

journals and conference

papers. The reader is

confident that the

information and ideas can

be trusted.

➢ The number of references

meets the requirement, and

the APA format is used

accurately.

➢ The conclusion captures

the focus of the research

paper.

➢ The conclusion

summarises the main

points/aspects of the

research paper by

paraphrasing the paper

statement.

➢ The conclusion provides

at least two future issues,

and all of them are

reasonable and well

presented.

➢ Most references are peer

reviewed professional

journals and conference

papers, but some of them

are not.

➢ The number of

references meets the

requirement, and the

APA format is used

accurately.

➢ The conclusion does

not capture the focus

of the research paper

well.

➢ The conclusion repeats

the introduction

instead of

summarising the main

points/aspects of the

research paper.

➢ The conclusion

provides only one

future issue.

➢ The future issues

appear not reasonable.

➢ Most references are

peer-reviewed

professional journals

and conference

papers, but some of

them are not.

➢ The number of

references meets the

requirement, and the

APA format is used

accurately.

➢ The conclusion fails

to capture the focus

of the research

paper.

➢ The conclusion

repeats the

introduction instead

of summarising the

main points/aspects

of the research

paper.

➢ The future issue is

missing.

➢ Most references are

not peer-reviewed

professional journals

and conference

papers.

➢ The number of the

references doesn’t

meet the requirement

-0%

to

-100%

Others

• Incorrect Paper Format

• Fail to Meet the Required

Paper Length

• Late Submission

• Plagiarism

➢ Incorrect Paper Format: 10% penalty if the format of the paper doesn’t conform to the required format – 2

columns IEEE proceedings format

➢ Fail to Meet the Required Paper Length: 5 – 5.5 pages -5%, 4-5 pages -10%, 3-4 pages -20%, 1-3 pages –

50%.

➢ Late submission penalty: 5% penalty.

➢ Late submission with SCA: no penalty if the assignment is submitted within the SCA period.

➢ Plagiarism: If the assignment is classified as plagiarism (the overall similarity score is above 25%), all

the items will be given 0. Do check your similarity report after submission. Please revise the report and resubmit it if it doesn’t meet the requirement. If a particular section has a very high similarity score, a

penalty for that section will be applied. Copying data analysis from online resources, e.g., Kaggle, will

be considered plagiarism.

Page |

此图片的alt属性为空;文件名为428a5d076a5c26765b1d9471292d46cb.jpg

担心学业?你还有其他选择!

KJEssay 学年守护计划!

我们是全网首家积极根据新政策优化应对方案的论文服务机构!

全面升级给你最好的防护!

1、远程代劳,资料下载,作业提交,有需要全程代劳!

KJEssay已对目前主流的教学系统Blackboard、ReCap,以及各校的ePortfolio,对全体老师做过专项培训,这方面有困难的学生,可直接授意老师代劳,我们将为你全面服务!

2、考核考试,老师提前充分备考,同程协助,助力满分!

KJEssay 保障学业提供全面服务!专业老师团队先学习了解课程内容,做充足应对,设计方案,

考试时,老师,专业应急团队,客服,同时待命!

老师快速反应,迅速做出最佳答案以及思路!

应急团队集思广益可对重难点迅速突破!

客服居中,全面负责协调沟通,提高效率!

给予及时而效率的全面帮助!

3、远程上课,录屏打卡课程讨论一个不落!

针对目前在线网课,KJEssay做出专项研究,对包括Autodesk、Azure、Skype、Zoom等视频教学软件有着充分熟悉。上网打卡一个不落。

4、保障隐私安全,全程一人全面追踪服务!所有人均签有隐私合同!

全面服务将主要安排在一位老师全面负责,做好对信息情况的充足了解掌握,不假他手!更因为全程彻底的参与,对情况以及考试有更彻底的把握!更能依据情况做出应对!也更易获取更高分!

客服以及第三方,时刻追踪,定期反馈情况。

5、一举一动全面反馈!时刻监控,看得到的全过程!24小时客服待命!

我们一直把沟通反馈,放在重中之重!尤其是代理服务,最了解的肯定还是客户,所以KJEssay会反馈所有的情况,没有客户允许下,不擅专!不乱动!

以最安全的形式,保障拿到最好的成绩!

在上半年的全面代理中,现已取得了优异的成绩与效果。

此图片的alt属性为空;文件名为35bbe3364a2ce7c2de4d6716ce45b0aa.jpg
此图片的alt属性为空;文件名为d578155fe7f87334ab9d272e80498c2f.jpg
此图片的alt属性为空;文件名为2f1a120444c69fe7a267ab20060348ec.jpg
此图片的alt属性为空;文件名为21d615ec4d8503ac2380cc30732bee21.jpg
此图片的alt属性为空;文件名为200b367966acea40ae507d5cf05e1975.jpg
此图片的alt属性为空;文件名为74dfb41160baebf4cc5f10bdbc4a78bf.jpg
此图片的alt属性为空;文件名为5de508126b22823e6b5b8210a3dca3cf.jpg
此图片的alt属性为空;文件名为6622ac43c8ef56a4c3bdf5cd61fadc69.jpg
此图片的alt属性为空;文件名为6a29689ca0b185e515c419046ec22d0b.jpg
此图片的alt属性为空;文件名为30c701ceae69f917e42864927b0be21a.jpg
此图片的alt属性为空;文件名为12559bac08b9eea12ca431b874504d93.jpg
此图片的alt属性为空;文件名为fcfb0df3fc9bea3e620604f3b628b4a9.jpg
此图片的alt属性为空;文件名为aabedf10bb2cc61671dc64c733ef3b72.jpg
此图片的alt属性为空;文件名为83d41a3f3b3be772e336c842211ed29f.jpg
此图片的alt属性为空;文件名为1b7aff9f394e28fe9016715e48d344eb.jpg
此图片的alt属性为空;文件名为aed4df7939da959d2df596fc6aa534ac.jpg
此图片的alt属性为空;文件名为635115284cf3fb723f9dd2152a8f825f.jpg

新学期,我们应对留学网课,更有经验,更加从容!

关于KJEssay

我们是KJEssay,31639人的选择!

此图片的alt属性为空;文件名为1e348b0dbfb0fe9bc770d4fd66bf5ea4.jpg
此图片的alt属性为空;文件名为7e7391e590eccaf19579cfa2fce375fe.jpg
此图片的alt属性为空;文件名为50c979b700996121b378e00463d9a33c.jpg
此图片的alt属性为空;文件名为15c412569e730f451ed57fe6212af2ec.jpg

现在就可联系我们

此图片的alt属性为空;文件名为c7bcbc86b3a922d4b4fea9d23e58059b.jpg

微信->添加朋友->添加企业微信联系人:13262280223

官网:https://www.kjessay.com

邮箱:kaijiewrite@163.com  service@kjessay.com

WhatsApp:+44 7410496844(推荐添加)

QQ:1483266981

立即联系我们参与活动吧~

了解 KJESSAY历史案例 的更多信息

立即订阅以继续阅读并访问完整档案。

继续阅读