QNAP and Real World

Apr 2016

By Amir Ghorbanali

In the world of Information Technology

The asset is Data

File System, Permissions, AuditIDS/IPS, Data Encryption, ACL

Management Console, OS, Configuration, Upgrades

HA, FT, RAID Protection

Storage tiers, architecture and Data migration plans

IOPS, Auto Tiering, iSCSI, FC, 40Gb, 10Gb

Snapshots, Deduplication, Thin Provisioning

On Site Backup, Off Site BackupRecovery, Disaster Sites

IOPS Data Processing Connection Speed

iSCSI, FC, 40Gb, 10GbCPU, Memory, OS, File SystemDisk types, Deduplication,

Auto tiering

Ease of Management

• Knowledge and Complexity should be equal • Access to management console from anywhere • User friendly OS and management console• Easy to setup and upgrade

• Operation Speed• Maintenance Speed• Setup Speed

• Upgrade Speed• Recovery Speed• Service Delivery Speed

Safety is always the first

Stay Focused on

Reports

• High Availability (HA)• Fault Tolerance (FT)• RAID Protection

• On site and off site backup• Disaster Sites• Cloud Backup• Recovery

• IDS/IPS• Data Encryption • ACL

Make sure all options are enabled

DAS vs NAS vs SAN

DAS NAS SAN

Speed High High High

Network Connectivity N/A High Low

Network Connectivity Cost N/A Low High

Administration Easy Easy Hard

Accessibility Hard Easy Hard

Capacity Low Medium High

Device Cost Low Medium High

When should I choose DAS, NAS or SAN

A typical company or organization storage needs

• Virtualization : Using VMware, Microsoft Hyper-V, Citrix, etc.• Advanced features, need a fast and reliable shared storage• Some VMs need very high speed storage• Some VMs need very large storage space• Virtual application and desktop

• File storage and file sharing• All users must store their files in a safe place• They use shared folders with various permissions

• Backup and data archiving• Organizations want to keep their data backups• Some organizations store long-term archives

A typical company or organization storage needs

• Data security• Data protections against hackers and thieves• Detect and block intruders• Data Leakage and Audit

• Surveillance systems• Store and view IP camera videos

• Data display for visitors • Digital Signage Stations and solutions• Pictures and films archive solution

• Employee care and satisfaction • Music and Video Library• Download management• Application and game library

QNAP Solutions

The QNAP SolutionWe do Support your needs based on advanced storage technologies

• Shared Storage for virtualized environments• iSCSI and NFS (iSCSI multi-path, multiple initiators)

• 40Gb, 10GbE, 10Gb SFP+ and port trunking , Thunderbolt 2

• NVMe, SSD array, SAS, SATA and SSD Caching

• Q-Tier : Storage Auto-tiering (4 storage tiers) free license

• Shared Storage for data sharing• SMB folder sharing

• NFS

• AFP (Apple file protocol)

• Huge storage space• Up to 1216TB raw space (8TB hard drives)

• Safely detach Expansion units and attach them again

The QNAP Solution contd.• Data Protection

• RAID protection (Linux RAID, online level migration and online expansion, device replacement, mdadm command via SSH)

• Built-in IP filtering and IDS/IPS

• Antivirus

• Data encryption (256-bit AES)

• NAS to NAS real-time remote replication

• Local, AD, RADIUS authentication and ACL

• Surveillance system• Install “Surveillance Station” and add IP Cameras (a wide range of cameras are

supported)

• Live view via HDMI and LAN

• On-Display advertisement and data display• Install “Signage Station” , create multimedia ads using iArtist Lite in windows and show

them using qnap NAS

Raid levels and Linux raid

implementation in QNAP • RAID (Redundant Array of Independent Disks) : A disk subsystem that increases

performance or provides fault tolerance or both

• RAID levels• Standard RAID levels

• Degraded array

• Rebuild array (bitmap)

• Hot spare

• Linux RAID and QNAP• Software RAID by Linux kernel

• Configuration command : mdadm

• RAID level migration and RAID group expansion

• Data Recovery

QNAP data protection techniques

• RAID implementation

• Another disk failure in degraded mode, data is gone?

• QNAP device failed? Move disks to another QNAP device

• Another QNAP device not available? Attach hard drives to a Linux

server and retrieve data

QNAP security

• Encryption : AES-256 bit

• Access lists and attack detection/prevention

• Antivirus

• https connections

Replication and file copy

• Samba shared folders (AD integration, windows ACLs, …)

• rsync

• Qsync

• NAS-to-NAS copy

• RTRR

• One-Touch copy and external devices

• iSCSI

QNAP IP-SAN

• iSCSI multi-path

• iSCSI multiple-access (Cluster access)

• VMware sample configuration

• SSH and Linux commands

Suitable Hard Drives

• Designed for 24x7

• raid-specific functions in firmware

• Vibrations control

• Tuned for various uses

QTS and QES

• QTS : QNAP Turbo NAS operating system

• Debian-based, apps installable

• Ext4 file system

• QES : QNAP Enterprise System

• Based on FreeBSD

• ZFS file system

SMB/Enterprise products

• Powerful processor and more RAM

• All apps can be installed (Qsirch, …)

• PCI-Express slots for installing optional PCIe cards

• Various I/O port types: 10G Copper, 10G SFP+, Thunderbolt and

40GB

• NIC teaming

• SSD Caching (SATA, mSATA) and SSD Array

• QNAP Qtier™ Storage tiering and optimization

SMB/Enterprise sample• TVS-1282T

• Built-in M.2 SATA 6Gb/s slots & 2.5” SSD slots• Qtier technology and SSD cache enable 24/7 optimized

storage efficiency• The Network & Virtual Switch app assists network traffic

distribution, and re-routes dedicated bandwidth for diverse applications

• Triple HDMI output (including one HDMI 2.0) for smooth 4K video playback

• Thunderbolt™ 2 (20Gbps) and 10GbE dual network for on-the-fly video editing and speedy sharing

• 4 available combinations with Mac/PC and JBOD for flexible attaching, sharing and expansion

• Scalable up to 448 TB with the Thunderbolt™ 2 storage expansion enclosures TX-800P/ TX-500P

• Virtual JBOD (VJBOD) allows to use QNAP NAS to expand the TVS-1282T’s storage capacity

• Supports QPulse™ unified remote server management, QvPC technology, virtual machine and container applications, and storage for virtualization

Home/SOHO products

• Multimedia Apps (music station, photo station, video station)

• HDMI output (HD Station and related apps like chrome)

• Transcoding, iTunes Server, CloudLink, QvPC, Surveillance station

• Remote control and Qremote

• Mobile apps

• Download station

• Access permissions

• DVBT dongle installable

• USB WiFi dongle installable

Home/SOHO sample• TS-451+• Centralize your file storage, sharing and backup with

excellent performance• Run multiple Windows®, Linux®, UNIX® and Android™

based virtual machines with the Virtualization Station• Operate multiple isolated Linux® systems as well as

download containerized apps with Container Station• Play 1080p videos with the bundled remote control and

multi-channel audio pass-through via HDMI• Transcode Full HD videos on-the-fly or offline*• Stream multimedia files via DLNA®, AirPlay®,

Chromecast™ and Bluetooth® with multi-zone multimedia control

• Quickly find specific files by real-time, natural search with Qsirch

• Scale up to 12 drives with QNAP UX-800P expansion enclosure

QNAP Naming rules

• 1st part: SS, IS, TS, TVS, TAS, TBS, TDS, ES / REXP, UX, TX, EJ

• 2nd part: EC

• 3rd part: number of drives + CPU class

• 4th part: T, S, U, RP, SAS, dc

• 5th part: other configurations (-i3-4G or –i5-16G)

• Current CPU classes: 89, 80, 79, 71, 63, 53, 51, 31, 28, 68, 12P

Expansion Units

• UX series : USB3

• TX series : Thunderbolt2

• REXP series : SAS wide port

• EJ series : mini SAS dual channel redundant design

Part III

Enterprise Model

Evolution Platform of QNAP NAS

4th• HDMI with QvPC technology, evolution from XBMC !

• 4K UHD support• Virtualization platform

Generation NAS

File Server

1st 2n

d

3rd

Pure storage

Cross-platform storage

•iSCSI•Surveillance

•Install-on-demand apps• HDMI (XBMC)

generation

NASgeneration NAS

generation NAS

An Over view on Enterprise

Products

• Enterprise NAS

• Expansion

• ZFS Series

• TDS Series

What is the Next?

Application Extensibility Business Continuity

Data efficiency

FILEBLOCK

Unified Storage Virtualization

VMware ESX VMware ESX

disaster recovery

High Availability

Dual Active-ActiveData

Integrity

Model Naming Definition

Chassis Type:

TS = 3.5”/2.5” HDD

TVS = 3.5”/2.5” HDD

optimised for

Virtualisation Station

SS = 2.5” HDD only

HS = Fan less

IS = Industrial

REXP = SAS Expansion

UX = USB Expansion

Enterprise :

TDS

ZFS/ES

ECC RAM:

EC = With ECC RAM

Empty = Without ECC RAM

# of disk bays:

e.g.

16 = 16 disk bays

1 = single disk bay

Product series:

Generally, the higher

number is higher spec.

All models in same series

will have similar spec.

Redundant Power/SAS:

RP = Redundant PSU

SP = Single PSU, can support

redundant PSU

Empty = No redundant PSU

SAS = Supports SAS interface

Suffix Code:

U = Rackmount

L = Low cost (reduced spec)

Pro = Improved H/W spec

II = 2nd generation

+ = Improved H/W spec

P = No meaning

S = 2.5” HDD only (from 2015)

TS - EC 16 80 U - RPTS - 4 79 PTS - 2 51 L

Special Features

Innovation

• Global Hot Spare• TLER & ERC

(Time-limited error recovery)(Error Recovery Control)

Fast Recovery- Not pushing NAS to rebuild

OS Kernel

File System

QESQTS

ODX

Offload data transfer

Pool / IP

Server Server Server

NAS NAS NAS

A B A B A A

Server-Side Copy Server-Side Copy + ODX(Fast Clone)

Meta Data

No Offload Offload (ODX) What We Done

Real-time Compression

Compression

Traditional storage

20-50%Less

capacity

ES NAS

Data Deduplication (DE duplicated data is cached for much better performance by reducing disk access.)

• over 90% duplicate data from OS images and applications

C A B C D

B A B A A

D B B C A

A B

C DDeduplicati

on

Deduplicated data is

cached for much

better performance by

reducing disk access!

NVRA

M

Cache

Repeatability

Enterprise NAS Series

TVS-EC2480U-SAS-RP R2

TVS-EC1680U-SAS-RP R2

TVS-EC1580MU-SAS-RP R2

TVS-EC1280U-SAS-RP R2

TVS-EC2480U-SAS-RP

TVS-EC1680U-SAS-RP

TVS-EC1580MU-SAS-RP

TVS-EC1280U-SAS-RP

TVS-EC1080+

TVS-EC1080

TVS-EC880

TS-EC2480U R2

TS-EC1680U R2

TS-EC1280U R2

TS-EC880U R2

TS-EC2480U

TS-EC1680U

TS-EC1280U

TS-EC880U

SS-EC2479U-SAS-RP

SS-EC1879U-SAS-RP

SS-EC1279U-SAS-RP

Over view• Memory : ECC DDR3 Series

• Xeon Processors or Quad Core

– High Performance

– High Reliability

– High Stability

– Rich Business Application

• High IOPS

• 4 * Gb/s Ethernet Interface

• 10Gb/s Ready(optional)

• m.sata Support( Cache Accelerator )

For Example: TS-EC2480U R2

Up to 700TB

CPUTS-EC2480U-E3-4GE-R2: Intel® Xeon® E3-1246 v3 Quad-core processorTS-EC2480U-i3-4GE-R2: Intel ® Core i3-4150 processorTS-EC2480U-i3-8G-R2:Intel® Core i3-4150 processor

Memory

memory slots: 4TS-EC2480U-E3-4GE-R2/ TS-EC2480U-i3-4GE-R2:System memory: 4 GB DDR3 ECC RAM (Pre-installed: 2 GB x2)Memory expandable up to: 32 GB (8GB x4)TS-EC2480U-i3-8G-R2:System memory: 8 GB DDR3 (Pre-installed: 4 GB x2)Memory expandable up to: 32 GB (8GB x4)

LAN PortBuilt-in 2 x 10 GbE (SFP+) + 4 x GbE40GbE is optional

USB4x USB 3.0 port (rear)4x USB 2.0 port (rear)

Form Factor 4U, Rackmount

SS-x79U-SAS Series

12 x 2.5-inch:

SAS/SATA 6Gb/s,

SAS/SATA 3Gb/s

or SSD

On line transaction processing

CPUQuad Core Intel® Xeon® E3-1245 v2 Processor 3.4 GHz

MemorySystem memory: 8 GB DDR3 ECC RAMMemory module pre-installed: 4 GB x2Total memory slots: 4

Hard Drive12 x 2.5-inch SAS/SATA 6Gb/s, SAS/SATA 3Gb/s hard drive or SSD hard drive

LAN Port4 x Gigabit RJ-45 Ethernet port(Expandable up to 8 x 1 Gb LAN or 4 x 10 Gb + 4 x 1 Gb /dual-port 10 Gb and 1 Gb network card)

USB2x USB 3.0 port (rear)4x USB 2.0 port (rear)

Storage Expansion Port 1 (rear)

SS-EC1279U-SAS-RP

TVS-EC1080+ CPU Intel® Xeon® E3-1245 v3 3.4 GHz Quad Core Processor or above

Hard Drive10 x 3.5-inch SATA 6Gbps/3Gbps hard drive or 2.5-inch SATA, 6Gbps/3Gbps hard drive SSD hard drive

LAN Port2 x 10 Gigabit RJ-45 Ethernet port ( Pre-installed in PCIe slot)4 x 1 Gigabit RJ-45 Ethernet port (on board)

USB 3x USB 3.0 port (1 front, 2 rear) / 6x USB 2.0 port (rear)

eSATA Port x2

TVS-EC1580MU-SAS-RP R2 15-bay 12Gbps SAS-enabled hybrid NAS supporting 3.5” & 2.5” drives &

NAS/iSCSI/IP-SAN with dual built-in 10GbE

9 x 3.5-inch SAS12Gbps, SAS/SATA 6Gbps/3Gbps hard drive or 2.5-inch

SAS/SATA SSD hard drive

6 x 2.5-inch SAS/SATA SSD hard drive

Built-in 256GB mSATA

3,800+ MB/s throughput and 238,000+ IOPS

Auto Tiering for optimal storage efficiency

How easy to create an auto-tiered storage pool!

– TVS-EC1580MU-SAS-RP

with Qtier™ enabled

• 6x SAS-SSD : SEAGATE 1200.2 SSD 200GB (SAS) - RAID5

• 9x SATA drives : SEAGATE NAS-HDD 2TB (SATA) - RAID6

Total capacity : 14 TB

Test software : Iometer & login VSI

• 4K , 100% random read IO

• server is a server with Windows 2012 R2, only 8 GB RAM to avoid memory cache-hit

• ~130,000 IOPS with average latency lower than 0.5ms!

Expansion Units

Expansion Model View

Expansion Units• EJ1600 (High-performance, dual-controller SAS RAID expansion enclosure)

– Ideal for the dual-controller Enterprise ZFS NAS

– (support maximum 1024TB raw capacity)

REXP-1620U-RP (12Gbps SAS RAID Expansion Enclosure : Max 1216 TB)

REXP-1220U-RP (12Gbps SAS RAID Expansion Enclosure : Max 960 TB)

REXP-1000 Pro (12Gbps SAS RAID Expansion Enclosure : Max 240TB)

• UX-1200U-RP (support maximum 288TB raw capacity)

• UX-800U-RP (support maximum 192TB raw capacity)

• UX-800P (support maximum 192TB raw capacity)

• UX-500P (support maximum 144TB raw capacity)

TX-800P (Thunderbolt expansion enclosure ,MAX : 448 TB )

TX-500P (Thunderbolt expansion enclosure ,MAX : 304 TB )

Maximum storage pool size 308TB

How it is possible!Cascading

Back to Back Connection

Expansion Units

• Smart power design

– The UX-800P automatically powers on and off with your Turbo NAS, allowing for total convenience and energy saving.

• Automatically detect

• Missing mode protection

– If your UX-800P is accidentally disconnected, the Turbo NAS enters missing mode and blocks I/O access to protect the stored data. The system can then recover from the missing mode to the normal state with data staying intact.

Enterprise ZFS NAS

ES1642dc / ES1640dcFor mission-critical tasks and intensive virtualization applications• QES

Enterprise Operating System(Open ZFS / Free BSD Core)

• ZFS (Zettabyte File System)

• 40GbE NIC support (dual-port QSFP+ 40GbE NIC )

• Dual active controllers,dual mini-SAS channel backup

• Data deduplication & compression

• NVRAMw/Copy-to-Flash

• HPE Helion support (hybrid cloud solutions)+ Open Stack (Cloud Computing)

• Block-level

• SnapSyncfor disaster recovery

HPE cloud management and automation software / cloud strategy around hybrid management

Intel Xeon E5-2420 v2 series processor

Active-Active HA

Dual controller

Uninterrupted operation and high data availability

Field-replaceable unit

The Essentials of QNAP ES NAS• Built for Business

• BBU (Battery backup unit for SSD caching) (NVRAM w/ Copy-to-Flash)

• capacity to over 1 PB

• ZFS File system– Copy on write

– Data Integrity

– Raid-Z

• Critical Applications

• Disaster Recovery (remote disaster recovery)– fully supports VMware vCenter Site Recovery (SRM) technology, provides Storage Replication Adapter

(SRA) for SRM, and provides enterprise-class remote backup & disaster

• Both the software and hardware architecture were built from the ground up to completely support virtualization

• It is easy to use, has a low learning curve, and the fastest deployment speed.

• Microsoft ODX to increase performance by offloading server loading

• Intel Xeon E5-2400v2 Series

• Dual Path Mini -SAS JBOD

• Capacity to over 1PB with expansion

Logical View

QTS vs QESQES

QNAP Enterprise SystemQTS

QNAP Turbo NAS System

Hardware platformEnterprise ZFS NASES series NAS

QNAP Turbo NASTS / TVS / TAS / TDS series

Operating system kernel FreeBSD LinuxApp Station No YesContainer Station No YesDual active controller Yes NoNVRAM (Write to cache) Yes No40G Ethernet network Yes YesSnapshot upper limit 65535 1024Deduplication Yes No

Real time data compression Yes No

End-to-End Data Integrity Yes No

Remote disaster backup & recovery SnapSync Snapshot Replica

TDS Series

Application Server + Storage Server

Hyper Converge

Specification

Specification

TDS Series

• Dual Intel Xeon E5-2600 V3

• 4 * 2.5” SSD (Dedicated flash cache)

• 4*10 GBE SFP+

• IPMI : Remote ManagementIntelligent system management monitoring control and alert( To reduce administration cost )

– Remote power Control

– Hardware Sensor Monitoring

– Temperature + Voltage +Fan Speed

– Hardware event logs

– Administration

– KVM

• GPU path-through (AMD Radeon R7&R9)New Graphic Card installation + 3D and Transcoding +Dedicated graphics to VM

• SDN

• 300 Vm– Desktop:– Windows 10– Office 2010– 2 vCPU– 4 GB of RAM

TDS Series

10 GbE SFP+ x 4

IPMI Management

port

IPMI VGA

IPMI console

USB 3.0x 4

PCIeslot x 4

RedundantPower supply

GigaLANx 2

2.5” HDD/SSD x 4

TDS Series

TDS Throughput

3800 MB/s

260 000 IOPS

Big data analytics

• NVMe(SSD PCIe interface for caching)

• Qtire

• Such as Hadoop & apache Spark

8-10 times faster (Based on Hadoop/YARN)

The Apache™ Hadoop® project develops open-source software for reliable, scalable,

distributed computing.

The Apache Hadoop software library is a framework that allows for the distributed

processing of large data sets across clusters of computers using simple programming

models.

• Deduplication data at block level(Even across multi TDS)

• QPLUS : (Server Management Solution not mean vcenter)

Auto Discovery

• Container :Docks / LXC (Internal Bus)

• Support :– AD

– DNS

– SQL

– Exchange 2016

– Php

– Mysql admin

Container

Platform as a service ( Paas)

• Docker / LXC

• Application can be run without VM.(Fast, low over Head , No need

OS)

• Application can be uploaded(Pushed) from NAS to a public

cloud.

• Isolation Supported

VMs support directly

(HA & Migration + Double Take AV)

ReplicaBy Virtualization Station create a

passive backup virtual machine for

a primary physical server, or

establish two virtual machines and

make one active system and the

other passive system. The backup

virtual machine supports failover for

the primary system whenever

needed to enable data protection

and continuous services. The

backup environment using Double-

Take replicates incremental data in

real-time

Expansion

Max Capacity

1152TB

Any questions, please?