Project Zipline


[PDF]Project Zipline - Rackcdn.comhttps://146a55aca6f00848c565-a7635525d40ac1c70300198708936b4e.ssl...

0 downloads 124 Views 6MB Size

Open Source Innovation to enable Intelligent Cloud 

Danny Ting, CTO of Microsoft Taiwan

4

Works with popular tools and frameworks

Linux

>95% of Fortune 500 use Microsoft Azure

Azure provides best in class performance

Microsoft & OCP Joined Open Compute Foundation Open Cloud Server (OCS) spec Cloud SSD M.2 spec

SONiC Network Switch Software Project Olympus spec

Local Energy Storage – Server UPS Switch Abstraction Interface (SAI)

Project Denali spec

Project Olympus expansion– Intel/AMD/ARM64, GPU, JBOD, JBOF Project Cerberus spec

PROJECT OLYMPUS CONTRIBUTIONS ACCEPTED BY OCP Rack Architecture Chassis Power & Management Distribution Universal PDU Airflow Blocker Management

Motherboards Intel® Xeon® Scalable Processor Motherboard and BIOS

Server Chassis 1U & 2U Power Supply I/F

Motherboard Specifications Universal Motherboard AMD EPYC Cavium ThunderX2 ARMx64

Cerberus Master/Slave architecture Specification augmented to extend Root of Trust domain to peripheral components

BMC

Cerberus

Motherboard CPU

NIC

SSD

Accelerator

Cerberus

Cerberus

Cerberus

• • •

Data cacophony

Where is the data coming from? Generated at the Endpoints Collected and pre-processed at the Edge Analyzed, stored, archived at the Core

Data propagates from endpoints to core and back Source: IDC’s Data Age 2025 study, sponsored by Seagate

Large datacenters including private & public cloud

Data growth projections IDC predicts Global DataSphere will grow from 33 Zettabytes (ZB) in 2018 to 175 ZB by 2025 180

175 ZB

Figure 1: Annual size of the Global DataSphere

160

Zettabytes

140 120 100 80 60 40 20

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

0

Zettabyte Exabyte Petabyte Terabyte Gigabyte Megabyte 000000000000000000000000 Kilobyte 111111111111111111111111

Source: Data Age 2025, sponsored by Seagate with data from IDC Global DataSphere, Nov 2018

Storage capacity growth projections 5.0

Tape

Optical

NVM-Other

NVM-NAND

SSD

HDD

4.5 4.0

Zettabytes

3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 2010

• •

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2022

2023

Supply capacity not sufficient to keep up with 6x projected growth in storage demand Need new radical solutions for data processing improvements to address this supply/demand gap

2024

2025

Project Zipline

Project Zipline compression gains Cloud Data Set #1

Cloud Data Set #2

100%

100%

8% Uncompressed

Cloud Data Set #3

Zipline

100%

5% Uncompressed

Zipline

4% Uncompressed

Zipline

Open sourcing Project Zipline Interoperability across endpoints (edge to cloud)

Hardware architecture specifications High bandwidth, low latency implementation

Verilog RTL source and test suite Open sourced IP – Industry first for OCP contributions Enabling faster adoption in the silicon ecosystem

Project Zipline – Usage model examples

Project Zipline - Ecosystem partners

Video https://vimeo.com/plancreatedestroy/download/323999895/d88cc899a9 PW: OCP

A Project Zipline ASIC Compression without compromise: • • • •

High compression ratio Low latency Inline encryption, authentication High total throughput of 100Gbps

Disk write latency with Corsica System and network overhead

Corsica does the work

SSD read/write

Corsica is 15-25 times faster than the CPU

System and network overhead

CPU does the work

Compression | Encryption | Authentication | Data integrity

Disk write latency today

SSD read/write

Running cloud scale is challenging

SONiC facilitates innovation

SONiC

Software for Open Networking in the Cloud

New

More apps

SNMP

BGP

DHCP

IPv6

TeamD

LLDP

RedisDB

SYNCD

New

OCP ecosystem enriched by SONiC SW components

3rd party module

Build Your Own application

Solution Provider

ODCC(Open Data Center Committee) - China Phoenix Project (

Powering data center ToR/Leaf

More industry adoption

Commercial support

Powering bare metal service

Powering AI/gaming service

THANK YOU