National Big Data Analytics (BDA) Initiative Delivering new values to the public and private sectors

By Peter Kua

Special Projects, Big Data Analytics

Multimedia Development Corporation (MDeC)

Agenda

• The Initiative

• Open Data

• National Big Apps Challenge 1.0

The Initiative

Strategic Intent

Short Term

(1-2 years)

Kick start

• Framework

• Government pilots

• Private sector projects

Medium Term

(3-4 years)

• Grow BDA usage

• Talent development

• Sustain initiative

Long Term

(5-7 years)

• Public - private collaboration

• BDA leadership

• Data-driven economy

3 Key Focus Areas

Proliferate BDA Usage in All Sectors

Catalyze Adoption in the Public Sector

Industry Building

2020 Desired Outcomes

Focus Areas

Proliferate BDA Usage in All Sectors

Catalyze Adoption in the Public Sector

Industry Building

Desired Outcomes National Impact

National Competitiveness

Living Standard

Improved Service Delivery

Enhanced Productivity

More competitive public & private

sectors

BDA Market Growth

New Services, Innovation & Tech

Data-Driven Economy

Wealth

APeJ Big Data MaturityScape Assessment 2013 (N= 643 APeJ Private Organizations) © IDC

Where is Malaysia? APEJ BDA Maturity: Private Sector

BDA Maturity: Ad-Hoc

Advanced Starter

APeJ Big Data MaturityScape Assessment 2013 (N= 643 APeJ Private Organizations) © IDC

Where is Malaysia?

Holistic BDA Framework

Macro Level Directions, Oversight & Leadership of

National BDA initiative.

BDA Steering Comm ( Chair : KKMM )

Framework

Private Sector Projects & User

Generated Content Government Projects

Private Sector BDA ecosystem players

( Lead : MDeC )

Public Sector BDA ecosystem players ( Lead : MAMPU )

BDA Task Force

Advisory Panel

Facilitate BDA steering comm meetings and

appointment of members

High-level policy-making platform

Digital Malaysia Steering Comm

KKMM Secretariat

Advise & share knowledge, best practices, linkages &

expertise

Meeting : Half Yearly

Working Committee focusing on development of BDA framework and ecosystem, programme ideation, coordination & monitoring

Meeting : Monthly

Meeting : Monthly

Governance Structure & Scope

Public Sector

KKMM, MAMPU, MCMC, MIMOS,

DoSM, AIM, SMECorp

Academia

UM, USM MMU, Sunway

Committee consisting of members from 4 Groups: Public Sector, Private Sector, Associations and Academia Membership

New members will be added as and when required

Chairman MDeC

Associations

PIKOM, NEF, TEAM

Private Sector

IBM, Intel, Dell, HP Teradata, SAS, Pulse,

Fusionex, TM

Taskforce Structure & Initial Members

Special Interest Group (SIG) Members

PUBLICITY INDUSTRY DEVELOPMENT

• AIM - Ng Mun Hon • Fusionex – Ivan Teh • HP - Chew Kai Peng, Shyam Srinivasan • Redtone - Andy Yau Chee Keong • SAS – Quinnie Wong • TERADATA – Craig Morrison • UPM – Dr Ali Dehghantanha

• MAMPU – Baharim Bin Saleh • MIMOS – Dr. Ettikan • MMU – Prof. Dr. Ho Chin Kuan • NEF – Abdul Razak Ahmad • Sunway Uni. – Dr. Lim Tong Ming

POLICY

• Google - Lih Shiun Goh • IBM – Hasnul Nadzrin Shah Abdul Halim • MAMPU – Baharim Bin Saleh • NEF – Abdul Razak Ahmad • SKMM – Bawani Selvaratnam

PRICE WATCH

SENTIMENT ANALYSIS

WHY?

To reduce profiteering due to policy changes

OUTCOME:

Predict optimal pricing and

maintain a price position by

analysing price and demand

elasticity

WHY?

To quickly gauge the public

perception and feedback on a certain topic

OUTCOME:

Government makes well-

informed decisions to address well

being of rakyat

WHY?

Crime root cause and trend analysis,

optimise law enforcement

resources

OUTCOME:

Reduced crime rate

WHY?

To predict outbreak

probability and locations

OUTCOME:

Reduced disease outbreak

incidences and fatalities

Public Sector Pilots

Fusionex TESS International Verve

Technologies N2N Connect Data Micron

CORAL™ Intelligent

Sensor for Fraud

Detection (iSEF) is an

end-to-end intelligent

fraud analysis,

detection and

investigation solution

with minimal human

intervention.

Design, test and

implement your very

own customized pair

trading system. The

system allows for the

import of over 100k

tradable instruments

from stock markets

and will look for the

best pair

combinations.

Development of a

multi-node in-memory

aggregation engine

with high performance

GPU for 'Big Data'

processing. It is also

scalable, making it a

'disruptive technology'

for Data Warehouse

and Business

Intelligence for Big

Data.

GIANT is a state-of-the

art product that handles

huge amounts of data in

an accelerated manner,

manages a variety of

unstructured data in a

seamless and user-

friendly way. It has the

ability to help companies

derive business value

through insights and

actionable items.

An automated online

recommendation

engine for e-

commerce that

predicts and

personalises product

recommendations and

deals either on a

single or multiple e-

commerce sites.

Emerging Private Sector BDA Solutions

BigDataAnalytics.my

facebook.com/dataanalytics.my

Awareness & Publicity

Thought Leadership

Open Data

Programs & Events

White Papers & Case Studies

Talent, Tech & Funding

Open Data

Open Data

UK: Reduced Mortality for Heart Surgery UK heart surgeon Sir Bruce Keogh persuaded his-colleagues to publish comparable data on their

individual clinical outcomes – a global first. 7 years later, dramatic improvement in survival rates are reported in all, there are 1,000 fewer deaths in

English heart surgery units each year than there were.

Canada Tax Status Misuse Open Data exposed $3.2bn of tax evasion

via illegal charities in Canada

http://eaves.ca/2010/04/14/case-study-open-data-and-the-public-purse/

Bus Stops in the UK UK released data on location of 300,000 bus-stops; Community (Open Street Map) corrected 18,000 of

them, improving official data accuracy

Finnish geo data study SME’s grow 15% more with free geo data as opposed to

paid data. Effect visible after 1yr, stronger after 2yrs.

Real-time train movements Sweden published real-time data on train departure and arrival times. Third parties have created apps that allow travelers to

visualize the train movements in real-time

Freely Used Freely Reused Freely Redistributed

Open Data: Top 10 Countries

Source: Open Knowledge Foundation

Our Open Data Journey

As of Sept 2014: 121 datasets from 12

ministries and 10 sectors

More than 80% datasets are PDF files

Government Data Limited in Malaysia. Why?

(1) whoever discloses any information or matter which has been obtained by him in the performances of his duties or the exercises of his functions under any written law shall be punished with of not more than one million ringgit or with imprisonment for a term which may extend to one year or with both (2) Whoever has any information on matter which to his knowledge has been disclosed in contravention of subsection (1) who discloses that information or matter to any other person shall be punished with fine of not more than one million ringgit or with imprisonment for a term which mat extend to one year or with both

Penal Code Section 203A

Power Distance

Ho

ng

Kon

g

UK

Sin

gap

ore

Au

stri

a D

enm

ark

Mal

aysi

a

USA

Ph

ilip

pin

es

Ch

ina

A High PD Means…

Accept and expect unequal power

distribution

Resigned attitude toward right to access

information

Power Distance vs Open Data

National Big Apps Challenge 1.0

Tang Siak Kwan

National BIG APPS Challenge 1.0

Malaysia’s first Big Application driven challenge that empowers the

sharpest minds in business and technology to solve Malaysia's challenges pertaining to public issues and societal well-being

through OPEN DATA

17 Sept 2014 – 30 Oct 2014 DURATION

DATASETS

THEME Public and Societal Well-Being

OPEN FOR REGISTRATION http://BigApp.my

Tentative Government Open Data - Healthcare - Price of Goods - Weather

National BIG APPS Challenge 1.0

MDeC National Big Data Analytics Initiative Program

Use open data to solve Malaysia’s toughest challenges!

MDeC Big Data Sessions

Start your FREE Azure account ($200) from http://aka.ms/azuretry

Need help? Go to InfoTrek at Kristal Hall 2!

MDeC Big Data Program registered developers will get special Azure with over

70GB of storage!

* HDInsight requires laptop running Win7/WS2008R2 and up. Macs can use

HDP Sandbox.

11.30 am MDeC Big Data

Multi-Platform Track Session 2 (Office Space @ Level 1)

1.30 pm Azure Machine Learning & HD Insight Apache Hadoop

Cloud Track Session 3 (Auditorium @ Level LG)

2.30 pm Hands on Lab Workshop Clinic

MDeC Big Data BYOL* (Meeting Room 1 @ Level 2)

Call to Action

Join the Big App Challenge BigApp.my

Attend the Azure Machine Learning Workshop

Participate in the Initiative Info: BigDataAnalytics.my

1

2

3

Thank You