Copyright © 2014, Oracle and/or its affiliates. All rights reserved.1
NoSQL, growing up at Oracle
Robert Greene, product management
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.3
Webcast Agenda
 Modern data management workload
 Lessons learned and applied
 System architecture is key
 Feature convergence on essentials
 A lasting NoSQL technology
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.4
modern data management workload
1. Write Intensive
2. Concurrent
3. Available
NoSQL, growing up at Oracle
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.5
Modern Workloads
Amazon constructs each custom user web page by sending requests to 150 different
services and data stores. Over 500 individual key-value lookups per page server.
Write & Read intensive
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.6
Modern workloads
Concurrent
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.7
Modern Workloads
 Built-in, always on
Available
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.8
system architecture is key
1. Linear scaling
2. Replicated
3. Asynchronous
4. Data local
NoSQL, growing up at Oracle
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.9
Architecture
 Elastic Auto Sharding
(split, add, contract)
Store
Shard
M
Shard
M
R
R R
Application
NoSQL Driver
R
 Writes to elected
node on ACID
 Reads from any
node in system
Shard
M
R
R
Expand and Rebalance
Shard
M
R
R
Linear scaling & replicated
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.10
Architecture
Asynchronous
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.12
Architecture
Data local
Pkey A Value A
F1 F2 F3 V1 V2 V3
Pkey B Value B
F1 F2 F3 V1 V2 V3
Skey A Pkey A
V2 V3 F1 F2 F3
Skey B Pkey B
V2 V3 F1 F2 F3
Skey A Pkey A
V1 F1 F2 F3
Skey B Pkey B
V1 F1 F2 F3
Primary Records
Secondary Indexes
Shard 1
Writes
Reads
Shard 2
Shard N
Index on (V1)
Index on (V2, V3)
Value V1
V1a V2b V3c
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.13
lessons learned and applied
1. Non-web retail
2. Integrated
3. Use cases unknown
NoSQL, growing up at Oracle
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.14
Lessons learned
Non-Web Retail
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.15
Lessons learned
Authorization
DW Rules
Publisher
Rule
Manager
Customer
Rules
Fraud
Alerts
Rules Storage/Retrieval
RiskService
Ext Service Ext Streams
Integrated
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.16
Lessons learned
 New application: Retrieve all data for a TV
series (seasons, episodes, actors, and so on)
 Perfect for a NoSQL database
– One simple retrieval returns all information
– Much simpler than relational database; no joins
Future use cases unknown
 And then, a new feature request: Retrieve all data
for a given actor
 Incompatible with original NoSQL document model
 ‘Actors’ cannot be retrieved separately
 Simple feature to add with relational database
 Just another SQL query on the same schema
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.17
feature convergence on essentials
1. Transactions
2. Standards : SQL, Indexes
3. Secure : Auth, Roles, Audit
4. HA : Data Centers
NoSQL, growing up at Oracle
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.18
Feature Convergence
 Ease of use
– The 5% case
– Development simplification
– Process improvement
– Prevent index divergence
– Data consistency
Transactions
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.19
Feature Convergence
 Ease of use
– Data Modeling
– Integration
– SQL Query
 Late Binding (soft-schema)
 Indexes
 Easy JSON representation
Tables
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.20
Feature Convergence
Secure & Highly Available
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.21
A lasting NoSQL technology
1. Simple key : value access
2. Concurrent capable
3. Integrated
4. Manageable
NoSQL, growing up at Oracle
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.22
advanced key-value database
1. Don’t care what the value is
Tables: Primary key – Shard key
Data locality and indexing
BASE & Transactions
1. Don’t care what the value is
2. JSON API
1. Don’t care what the value is
2. JSON API
3. Table API
Oracle NoSQL Database
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.23
Join NoSQL Database Community
Twitter
https://twitter.com/#!/OracleNoSQL
LinkedIn
http://www.linkedin.com/groups?gid=4147754
Oracle’s NoSQL DB blog
https://blogs.oracle.com/nosql
Oracle Technology Network
http://bit.ly/1f0d8wU
Developer Webcast Series
http://bit.ly/1doV2jl
Oracle.com/BigData
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.24
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.25

NoSQL, Growing up at Oracle

  • 1.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.1
  • 2.
    NoSQL, growing upat Oracle Robert Greene, product management
  • 3.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.3 Webcast Agenda  Modern data management workload  Lessons learned and applied  System architecture is key  Feature convergence on essentials  A lasting NoSQL technology
  • 4.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.4 modern data management workload 1. Write Intensive 2. Concurrent 3. Available NoSQL, growing up at Oracle
  • 5.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.5 Modern Workloads Amazon constructs each custom user web page by sending requests to 150 different services and data stores. Over 500 individual key-value lookups per page server. Write & Read intensive
  • 6.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.6 Modern workloads Concurrent
  • 7.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.7 Modern Workloads  Built-in, always on Available
  • 8.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.8 system architecture is key 1. Linear scaling 2. Replicated 3. Asynchronous 4. Data local NoSQL, growing up at Oracle
  • 9.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.9 Architecture  Elastic Auto Sharding (split, add, contract) Store Shard M Shard M R R R Application NoSQL Driver R  Writes to elected node on ACID  Reads from any node in system Shard M R R Expand and Rebalance Shard M R R Linear scaling & replicated
  • 10.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.10 Architecture Asynchronous
  • 11.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.12 Architecture Data local Pkey A Value A F1 F2 F3 V1 V2 V3 Pkey B Value B F1 F2 F3 V1 V2 V3 Skey A Pkey A V2 V3 F1 F2 F3 Skey B Pkey B V2 V3 F1 F2 F3 Skey A Pkey A V1 F1 F2 F3 Skey B Pkey B V1 F1 F2 F3 Primary Records Secondary Indexes Shard 1 Writes Reads Shard 2 Shard N Index on (V1) Index on (V2, V3) Value V1 V1a V2b V3c
  • 12.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.13 lessons learned and applied 1. Non-web retail 2. Integrated 3. Use cases unknown NoSQL, growing up at Oracle
  • 13.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.14 Lessons learned Non-Web Retail
  • 14.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.15 Lessons learned Authorization DW Rules Publisher Rule Manager Customer Rules Fraud Alerts Rules Storage/Retrieval RiskService Ext Service Ext Streams Integrated
  • 15.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.16 Lessons learned  New application: Retrieve all data for a TV series (seasons, episodes, actors, and so on)  Perfect for a NoSQL database – One simple retrieval returns all information – Much simpler than relational database; no joins Future use cases unknown  And then, a new feature request: Retrieve all data for a given actor  Incompatible with original NoSQL document model  ‘Actors’ cannot be retrieved separately  Simple feature to add with relational database  Just another SQL query on the same schema
  • 16.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.17 feature convergence on essentials 1. Transactions 2. Standards : SQL, Indexes 3. Secure : Auth, Roles, Audit 4. HA : Data Centers NoSQL, growing up at Oracle
  • 17.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.18 Feature Convergence  Ease of use – The 5% case – Development simplification – Process improvement – Prevent index divergence – Data consistency Transactions
  • 18.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.19 Feature Convergence  Ease of use – Data Modeling – Integration – SQL Query  Late Binding (soft-schema)  Indexes  Easy JSON representation Tables
  • 19.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.20 Feature Convergence Secure & Highly Available
  • 20.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.21 A lasting NoSQL technology 1. Simple key : value access 2. Concurrent capable 3. Integrated 4. Manageable NoSQL, growing up at Oracle
  • 21.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.22 advanced key-value database 1. Don’t care what the value is Tables: Primary key – Shard key Data locality and indexing BASE & Transactions 1. Don’t care what the value is 2. JSON API 1. Don’t care what the value is 2. JSON API 3. Table API Oracle NoSQL Database
  • 22.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.23 Join NoSQL Database Community Twitter https://twitter.com/#!/OracleNoSQL LinkedIn http://www.linkedin.com/groups?gid=4147754 Oracle’s NoSQL DB blog https://blogs.oracle.com/nosql Oracle Technology Network http://bit.ly/1f0d8wU Developer Webcast Series http://bit.ly/1doV2jl Oracle.com/BigData
  • 23.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.24
  • 24.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved.25