University of Malaya 1
ICT Initiatives at
University of Malaya
Dr. David Asirvatham
Director of IT Centre
University of Malaya
Kuala Lumpur
Email: david.asirvatham@um.edu.my
University of Malaya 2
2
University of Malaya
Singapore
(April 1949)
University of Singapore
(later known as National
University of Singapore)
UNIVERSITY OF MALAYA
KUALA LUMPUR
Raffles College
Singapore
(1928)
King Edward Vii College
Of Medicine, Singapore
(1905) 1 January 1962
Introduction to University of Malaya
University of Malaya 3
• Located in Kuala
Lumpur
• 428 blocks building
• 922 acres
• ~ 27,000 students
Introduction of UMIntroduction to University of Malaya
University of Malaya 4
Total 27,000
Undergraduates 13,000
Postgraduates 12,000
International 3,000
Student Population
University of Malaya 5
Total 6,000
Academic 2,500
Non-Academic 3,500
Staff Population
University of Malaya 6
Network Infrastructure
6
No Description
1 Access Points 1800
2 No of Devices
connected during
peak (WiFi)
20,000
3 Internet Access
Speed
5 Gbps
4 Intranet Backbone 40 Gbps,
10 Gbps &
1 Gbps
5 PC 8,000
6 Data Points 10,000
7 Switches 900
University of Malaya 7
• Total Servers: 280 Servers
• Physical servers: 150
• Virtual Servers: 130
• Network Attached Storage (NAS): Usage: 30 TB
• Central Backup System
• Data Centre Network Switches, LB, Firewall, etc.
Data Centre Facilities
University of Malaya 8
Review
UM Campus Network Development
University of Malaya 9
Aging network equipment &
End of Support
Outdated network design &
Network architecture
bottleneck
Network management
Difficulties
No visual network overview
Old Network Design
University of Malaya 10
Seksyen RangkaianOld Network Design
University of Malaya 11
Old Network Design
University of Malaya 12
Year 2008, Campus Wireless (1000 AP, 54Mbps)
Old Wireless Design
University of Malaya 13University of Malaya 13
University of Malaya
ICT Strategic Plan
2015 - 2017
Master Plan
University of Malaya 14
Master Plan & Strategies
University of Malaya 15
ICT Framework for UM
Enterprise Platform
Network Infrastructure
(Leased Lines, Gigabit Ethernet, Security, SAN storage,, etc.)
Uni
DB
Uni
DB
Uni
DB
Uni
DB
UMStandards
(Policies,Guidelines,Specifications,XMLStandards,etc)
Uni
DB
MOHE
UsersPresentatio
n
ApplicationPlatformDatabas
e
Infra
Presentation Layer
(Browser-based, client-server, SMS, PDA, 3G, etc.)
Uni
DB
Digital
Library
System
Smart Card
System
R & D
Information
System
e-Learning
System
e-Academics
Human
Resource
Information
System
Inventory/
Asset
Management
System
Financial
System
e-
Procurement
System
Staff
Information
System
Scholarship/
Loan System
Student
Information
System
Document
Management
System
e-Governance
Student Staff Administr
ators
Others
University of Malaya 16
Year 2013, 40G Resiliency Cloud Backbone Upgrade
New Network Design
University of Malaya 17
Year 2014, Student Residential Wireless Upgrade (802.1ac)
VALUE: To improve wireless service for student
New Wireless Project
University of Malaya 18
• Upgrade all aging network switches
(access & distribution) – On going
• Upgrade Internet bandwidth to 5Gbps -
Done
• Improve Internet Security with new IPS – On
going
• Improve Internet bandwidth usage
management with Ruijie 10G ACE
(Bandwidth Manager) - Done
Current Network Status
University of Malaya 19
Ruijie & UM’s Journey
toward
Service Oriented Campus
University of Malaya 20
• New Architecture Design for future
expansion
• High Performance price value
• Reliable & High Availability with VSU
(No single point of failure)
• Better Network Protection
• Centralized Network Management with
SNC
• Centralized Services Monitoring with
RIIL
University of Malaya 21
1G Port1G Port
Link 1-2
Link 3-4 Link 1-2
Link 3-4
SW 1
Convergence Timer
milliseconds
1 - 4
VSL
SW 2
VSU 3.0
XSwitch Failure
AP AP
Redundancy in Core Network
University of Malaya 22
Visualisation of UM Key ICT services
University of Malaya 23
RIIL helps to visualize UM Key ICT services
Visualisation of UM Key ICT services
University of Malaya 24
SNC helps monitor and troubleshootingVisualisation of UM Key ICT services
University of Malaya 25
SNC helps monitor and troubleshootingVisualisation of UM Key ICT services
University of Malaya 26
SNC helps monitor and troubleshootingVisualisation of UM Key ICT services
University of Malaya 27
Alerts for quick actions
University of Malaya 28
 Better architecture design and built-in network protection
 Helps to prevent many common network attacks issues
Network Security
University of Malaya 29
Project Implementation
University of Malaya 30
Project Implementation
University of Malaya 31
Project Implementation
University of Malaya 32
2013: Cloud Campus Network Forum
University of Malaya 33
2013: Cloud Campus Network Forum
University of Malaya 34
Current Situation
University of Malaya 35
10 Years Ago 5 Years Ago Now
Several Hundreds Thousands
Paperless
office
ERP/OA/
SAP
“Cloud”/
BYOD/
Big Data
Scale of IT
(Networks)
IT
Application
Future
Few Some Limited ?
IT Staffs
(Resources)
High Demand, Complex Network, Limited resources
Applications are getting complex & high volume
University of Malaya 36
How to improve these
situations ?
University of Malaya 37
UM toward Service Oriented Campus
Simplify the complex operations
Focus on Service & Value
* Based on the Gartner IT Maturity Model
University of Malaya 38
Future Plan
University of Malaya 39
1. Full campus wireless coverage
2. Unified authentication for wired & wireless
3. Improved intranet & internet service quality
4. Improve operation & maintenance efficiency
5. Featured rich Mobile Apps for campus user
Future Plan
University of Malaya 40
2016: New Data Centre
University of Malaya 41
Internet Billing and Utilisation
University of Malaya 42
Big Data Initiatives @ UM
University of Malaya 43
Big Data Initiatives @ UM (Phase I)
Log files
are
collected
from
various
source
Structured
data are
collected
from
various DB
Central Log
Server
DB Staging
Server
Cloudera
Manager
Hadoop
Node 1
Hadoop
Node 2
Hadoop
Node 3
Hadoop
Node 4
University of Malaya 44
UM Hadoop Cluster
cloudera-node1
•192.168.112.161
•Data Node
•Task Tracker
cloudera-node2
•192.168.112.162
•Data Node
•Task Tracker
cloudera-node3
•192.168.112.163
•Data Node
•Task Tracker
cloudera-node4
•192.168.112.166
•Data Node
•Task Tracker
cloudera-node5
•192.168.112.165
•Data Node
•Task Tracker
cloudera-
master
• 103.x.X.X
• Name Node
• Data Node
• Job Tracker
• Task Tracker
•Central
Services (Hive,
Hue,…)
44
UMHadoopProject
University of Malaya 45
Flume for Server Logs
Web Servers
UM Hadoop Cluster
Flume
University of Malaya 46
Hadoop Cluster
• Cluster Configuration
• 1 NameNode
• 5 DataNodes
• High-Risk without Secondary NameNode
• Data Ingestion
• Flume Agents
• MapReduce Job to Ingest data
• Total Storage
• 6 TB ( ~ 1 Month of Log Data)
• Data is replicated 3 times to ensure fault-tolerance
University of Malaya 47
Overall Status
UMHadoopProject
47
University of Malaya 48
Hosts
UMHadoopProject
48
University of Malaya 49University of Malaya 49
Structured data : Sample Analytic
Generated from Student Info System
University of Malaya 50University of Malaya 50
Structured data : Sample Analytic
Generated from Student Info System
Significant
increase in
admission
via
Matriculations
Programmes
University of Malaya 51University of Malaya 51
Structured data : Sample Analytic
Generated from Student Info System
University of Malaya 52University of Malaya 52
For Big Data Analytics, there is a
need for a resilient and excellent
Network environment
University of Malaya 53
Again,
We work together with
Ruijie towards
service oriented campus
University of Malaya 54
Ruijie-UM
showcase in
APAN
University of Malaya 55
Live demo…
University of Malaya 56
THANK YOU
david.asirvatham@gmail.com

ICT initiatives @UM

  • 1.
    University of Malaya1 ICT Initiatives at University of Malaya Dr. David Asirvatham Director of IT Centre University of Malaya Kuala Lumpur Email: david.asirvatham@um.edu.my
  • 2.
    University of Malaya2 2 University of Malaya Singapore (April 1949) University of Singapore (later known as National University of Singapore) UNIVERSITY OF MALAYA KUALA LUMPUR Raffles College Singapore (1928) King Edward Vii College Of Medicine, Singapore (1905) 1 January 1962 Introduction to University of Malaya
  • 3.
    University of Malaya3 • Located in Kuala Lumpur • 428 blocks building • 922 acres • ~ 27,000 students Introduction of UMIntroduction to University of Malaya
  • 4.
    University of Malaya4 Total 27,000 Undergraduates 13,000 Postgraduates 12,000 International 3,000 Student Population
  • 5.
    University of Malaya5 Total 6,000 Academic 2,500 Non-Academic 3,500 Staff Population
  • 6.
    University of Malaya6 Network Infrastructure 6 No Description 1 Access Points 1800 2 No of Devices connected during peak (WiFi) 20,000 3 Internet Access Speed 5 Gbps 4 Intranet Backbone 40 Gbps, 10 Gbps & 1 Gbps 5 PC 8,000 6 Data Points 10,000 7 Switches 900
  • 7.
    University of Malaya7 • Total Servers: 280 Servers • Physical servers: 150 • Virtual Servers: 130 • Network Attached Storage (NAS): Usage: 30 TB • Central Backup System • Data Centre Network Switches, LB, Firewall, etc. Data Centre Facilities
  • 8.
    University of Malaya8 Review UM Campus Network Development
  • 9.
    University of Malaya9 Aging network equipment & End of Support Outdated network design & Network architecture bottleneck Network management Difficulties No visual network overview Old Network Design
  • 10.
    University of Malaya10 Seksyen RangkaianOld Network Design
  • 11.
    University of Malaya11 Old Network Design
  • 12.
    University of Malaya12 Year 2008, Campus Wireless (1000 AP, 54Mbps) Old Wireless Design
  • 13.
    University of Malaya13University of Malaya 13 University of Malaya ICT Strategic Plan 2015 - 2017 Master Plan
  • 14.
    University of Malaya14 Master Plan & Strategies
  • 15.
    University of Malaya15 ICT Framework for UM Enterprise Platform Network Infrastructure (Leased Lines, Gigabit Ethernet, Security, SAN storage,, etc.) Uni DB Uni DB Uni DB Uni DB UMStandards (Policies,Guidelines,Specifications,XMLStandards,etc) Uni DB MOHE UsersPresentatio n ApplicationPlatformDatabas e Infra Presentation Layer (Browser-based, client-server, SMS, PDA, 3G, etc.) Uni DB Digital Library System Smart Card System R & D Information System e-Learning System e-Academics Human Resource Information System Inventory/ Asset Management System Financial System e- Procurement System Staff Information System Scholarship/ Loan System Student Information System Document Management System e-Governance Student Staff Administr ators Others
  • 16.
    University of Malaya16 Year 2013, 40G Resiliency Cloud Backbone Upgrade New Network Design
  • 17.
    University of Malaya17 Year 2014, Student Residential Wireless Upgrade (802.1ac) VALUE: To improve wireless service for student New Wireless Project
  • 18.
    University of Malaya18 • Upgrade all aging network switches (access & distribution) – On going • Upgrade Internet bandwidth to 5Gbps - Done • Improve Internet Security with new IPS – On going • Improve Internet bandwidth usage management with Ruijie 10G ACE (Bandwidth Manager) - Done Current Network Status
  • 19.
    University of Malaya19 Ruijie & UM’s Journey toward Service Oriented Campus
  • 20.
    University of Malaya20 • New Architecture Design for future expansion • High Performance price value • Reliable & High Availability with VSU (No single point of failure) • Better Network Protection • Centralized Network Management with SNC • Centralized Services Monitoring with RIIL
  • 21.
    University of Malaya21 1G Port1G Port Link 1-2 Link 3-4 Link 1-2 Link 3-4 SW 1 Convergence Timer milliseconds 1 - 4 VSL SW 2 VSU 3.0 XSwitch Failure AP AP Redundancy in Core Network
  • 22.
    University of Malaya22 Visualisation of UM Key ICT services
  • 23.
    University of Malaya23 RIIL helps to visualize UM Key ICT services Visualisation of UM Key ICT services
  • 24.
    University of Malaya24 SNC helps monitor and troubleshootingVisualisation of UM Key ICT services
  • 25.
    University of Malaya25 SNC helps monitor and troubleshootingVisualisation of UM Key ICT services
  • 26.
    University of Malaya26 SNC helps monitor and troubleshootingVisualisation of UM Key ICT services
  • 27.
    University of Malaya27 Alerts for quick actions
  • 28.
    University of Malaya28  Better architecture design and built-in network protection  Helps to prevent many common network attacks issues Network Security
  • 29.
    University of Malaya29 Project Implementation
  • 30.
    University of Malaya30 Project Implementation
  • 31.
    University of Malaya31 Project Implementation
  • 32.
    University of Malaya32 2013: Cloud Campus Network Forum
  • 33.
    University of Malaya33 2013: Cloud Campus Network Forum
  • 34.
    University of Malaya34 Current Situation
  • 35.
    University of Malaya35 10 Years Ago 5 Years Ago Now Several Hundreds Thousands Paperless office ERP/OA/ SAP “Cloud”/ BYOD/ Big Data Scale of IT (Networks) IT Application Future Few Some Limited ? IT Staffs (Resources) High Demand, Complex Network, Limited resources Applications are getting complex & high volume
  • 36.
    University of Malaya36 How to improve these situations ?
  • 37.
    University of Malaya37 UM toward Service Oriented Campus Simplify the complex operations Focus on Service & Value * Based on the Gartner IT Maturity Model
  • 38.
    University of Malaya38 Future Plan
  • 39.
    University of Malaya39 1. Full campus wireless coverage 2. Unified authentication for wired & wireless 3. Improved intranet & internet service quality 4. Improve operation & maintenance efficiency 5. Featured rich Mobile Apps for campus user Future Plan
  • 40.
    University of Malaya40 2016: New Data Centre
  • 41.
    University of Malaya41 Internet Billing and Utilisation
  • 42.
    University of Malaya42 Big Data Initiatives @ UM
  • 43.
    University of Malaya43 Big Data Initiatives @ UM (Phase I) Log files are collected from various source Structured data are collected from various DB Central Log Server DB Staging Server Cloudera Manager Hadoop Node 1 Hadoop Node 2 Hadoop Node 3 Hadoop Node 4
  • 44.
    University of Malaya44 UM Hadoop Cluster cloudera-node1 •192.168.112.161 •Data Node •Task Tracker cloudera-node2 •192.168.112.162 •Data Node •Task Tracker cloudera-node3 •192.168.112.163 •Data Node •Task Tracker cloudera-node4 •192.168.112.166 •Data Node •Task Tracker cloudera-node5 •192.168.112.165 •Data Node •Task Tracker cloudera- master • 103.x.X.X • Name Node • Data Node • Job Tracker • Task Tracker •Central Services (Hive, Hue,…) 44 UMHadoopProject
  • 45.
    University of Malaya45 Flume for Server Logs Web Servers UM Hadoop Cluster Flume
  • 46.
    University of Malaya46 Hadoop Cluster • Cluster Configuration • 1 NameNode • 5 DataNodes • High-Risk without Secondary NameNode • Data Ingestion • Flume Agents • MapReduce Job to Ingest data • Total Storage • 6 TB ( ~ 1 Month of Log Data) • Data is replicated 3 times to ensure fault-tolerance
  • 47.
    University of Malaya47 Overall Status UMHadoopProject 47
  • 48.
    University of Malaya48 Hosts UMHadoopProject 48
  • 49.
    University of Malaya49University of Malaya 49 Structured data : Sample Analytic Generated from Student Info System
  • 50.
    University of Malaya50University of Malaya 50 Structured data : Sample Analytic Generated from Student Info System Significant increase in admission via Matriculations Programmes
  • 51.
    University of Malaya51University of Malaya 51 Structured data : Sample Analytic Generated from Student Info System
  • 52.
    University of Malaya52University of Malaya 52 For Big Data Analytics, there is a need for a resilient and excellent Network environment
  • 53.
    University of Malaya53 Again, We work together with Ruijie towards service oriented campus
  • 54.
    University of Malaya54 Ruijie-UM showcase in APAN
  • 55.
    University of Malaya55 Live demo…
  • 56.
    University of Malaya56 THANK YOU david.asirvatham@gmail.com