Transcription
Cloudera EnterpriseReference ArchitectureA PSSC Labs Reference Architecture GuideMarch 201820432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788
IntroductionPSSC Labs continues to bring innovative compute server and cluster platforms to market. Focusing onspecific applications where performance and reliability are critical, highlights PSSC Labs strengths. TheApace Hadoop data framework requires substantial compute and storage capabilities coupled tightlytogether. Cloudera Enterprise adds layers of unification, security and management.PSSC Labs is the first manufacturer to design a server platform specifically for Hadoop. Introducing theWorld’s highest density, lowest power consuming, Enterprise Ready Big Data server platform designedspecifically for Hadoop workloads. The CloudOOP 12000 offers the absolute highest possible computeand storage density combined with high performance Data IO throughput. PSSC Labs already deliversthe CloudOOP 12000 for small POC to large production clusters spanning hundreds of nodes. To date,over 100 PB of Hadoop storage has been deployed on the CloudOOP 12000.Key Features: Reduce Data Center Footprint By 50%Reduce Power Consumption By 40%Nearly 50% Greater Data IO RatesPatent Pending Tool Free MaintenanceTechnical Specifications: Up to 12 x 3.5” SATAIII or 14 x SSDs in 1U Rack Spaceo 120 TB using twelve x 10 TB Hard Driveso Optional 2 x NVMe SSDs Supports UP to 2 x Intel Xeon Scalabe Processors Supports Up to 5112 GB ECC Enterprise Memory 10 GigE, 40 GigE, 100GigE & Infiniband NetworkSupport Red Hat , CentOS, Ubuntu, MS Windows Compatible20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788
CloudOOP 12000 Sample ConfigurationsEvery organization or use case requires different computing needs. The CloudOOP 12000 offers thegreatest flexibility possible. Below are three different proposed architectures for different workloads:high density storage, high computational requirements and a balanced configuration.CloudOOP 12000 High Density 72 TB Total Storage20 Xeon Scalable CPU Cores128 GB ECC Memory2 x 10GigE Network Ports2 x GigE Network PortsRemote IPMI ManagementCentOS Linux OSPower Draw Estimate215 Watt Idle / 275 Watt Full LoadCloudOOP 12000 High Compute 24 TB Total Storage40 Xeon Scalable CPU Cores512 GB ECC Memory2 x 10GigE Network Ports2 x GigE Network PortsRemote IPMI ManagementCentOS Linux OSPower Draw Estimate265 Watt Idle / 380 Watt Full LoadCloudOOP 12000 Balanced 48 TB Total Storage24 Xeon Scalable CPU Cores256 GB ECC Memory2 x 10GigE Network Ports2 x GigE Network PortsRemote IPMI ManagementCentOS Linux OSPower Draw Estimate230 Watt Idle / 315 Watt Full LoadA Sample of Organizations Currently Using PSSC Labs CloudOOP 12000 Servers20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788
CloudOOP RAX: Cloudera Enterprise Validated Turn Key ClusterPSSC Labs offers a complete, turn-key cluster that is ready to run on delivery. PSSC Labs understandseverything that is necessary for a successful deployment. All necessary hardware including servers,network equipment, power and infrastructure are included. PSSC Labs Cluster Engineers preconfigurenetwork, storage, operating system and BIOS settings to the end user’s specifications. ClouderaEnterprise is installed at PSSC Labs factory. The final step is the running of sample data sets to ensureproper functionality and performance. Below is an overview of each different server platform PSSC Labsoffers for Cloudera Enterprise turn-key deployments. Depending on the complexity of theenvironment, some software resources can be installed on different server platforms.CLOUDOOP 12000 DATA NODETech SpecsKey FeaturesSoftware Resourceo 1U High Density Form Factoro 2 x Intel Scalable Processorso 12 x SATAIII or SAS Hard Drivesor 14 x SSDso 24 TB to 120 TB Storageo 64 GB to 512 GB ECC Memoryo 2 x GigE Network Adapterso Optional 10 GigE, 40 GigE,Infiniband Supporto Dedicated IPMI / iKVMo Enterprise Platformo Redundant Power Supplyo Improved Data IO Throughputo 40% Reduction in PowerConsumptiono 2 x the Density of StandardServero Flexible Configuration Optionso 3 Year Warranty Included(24 x 7 x 365 NBD Available)o DataNode Daemono Ganglia Monitoro Region Servero Node Managero SupervisorCLOUDSEEK 1000xR MANAGEMENT NODE (NAME NODE & SECONDARY NAME NODE)Tech SpecsKey FeaturesSoftware Resourceso 2 x Intel Xeon Scalable CPUso 1 TB to 24 TB SATA III, SAS, SSDHard Driveso 64 GB to 512 GB ECC Memoryo 2 x GigE Network Adapterso Optional 10GigE, 40GigE,Infiniband Supporto Dedicated IPMI / iKVMo Enterprise Platformo Redundant Power Supplyo Redundant Storageo Raid Levels 0,1,5,6,10,50o Flexible Configuration Optionso 3 Year Warranty Included(24 x 7 x 365 NBD Available)o App Timeline Servero DRPC Servero Ganglia Monitoro HDFS Cliento NameNode / Secondary NNo Oozie Server / Cliento Yarn Cliento Zookeeper Server / Cliento HDFS Cliento MySQL Server20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788
CLOUDSEEK 1000xR EDGE NODETech SpecsKey FeaturesResourceso 2 x Intel Xeon Scalable CPUso 1 TB to 24 TB SATA III, SAS, SSDHard Driveso 64 GB to 512 GB ECC Memoryo 2 x GigE Network Adapterso Optional 10GigE, 40GigE,Infiniband Supporto Dedicated IPMI / iKVMo Enterprise Platformo Redundant Power Supplyo Redundant Storageo Raid Levels 0,1,5,6,10,50o Flexible Configuration Optionso 3 Year Warranty Included(24 x 7 x 365 NBD Available)o Hive Server / Cliento Tez Cliento Nimbuso Nagios ServerCLOUDOOP Rax Turn-Key Cluster Sample ConfigurationsHDP Rax 150 150 TB Total Storage2 Name Node6 Data Nodes120 Xeon Scalable CPU Cores768 GB ECC Memory10 GigE Network BackplaneRemote IPMI ManagementCentOS Linux OSHDP Installation ServiceHDP Validation ServiceHDP Rax 500 500 TB Total Storage2 Name Nodes1 Edge Node12 Data Nodes240 Xeon CPU Cores1536 GB ECC Memory10GigE Network BackplaneRemote IPMI ManagementCentOS Linux OSHDP Installation ServiceHDP Validation Service Rack & Roll ServiceHDP Rax 1500 1500 TB Total Storage2 Name Nodes1 Edge Node30 Data Nodes600 Xeon Scalable CPU Cores3840 GB ECC Memory10GigE Network BackplaneRemote IPMI ManagementCentOS Linux OSHDP Installation ServiceHDP Validation Service Rack & Roll Service“We believe strongly in our ability to deliver thehighest performance, highest reliability serverplatforms to Cloudera end users. Our experiencedelivering clusters ranging from several hundred TBsto several dozen PBs ensures a successful ClouderaEnterprise deployment.”Larry LesserPSSC Labs, CTO20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788
Total Cost of Ownership ComparisonPSSC Labs goal is to offer solutions with the absolute lowest total cost of ownership. The below chart compares different server manufacturer’ssolution for a 1 Petabyte (raw) Hadoop environment. PSSC Labs CloudOOP Rax 1000 requires 50% less rack space and consumes 40% less powerRequired Data CenterFootprintPower ConsumptionEstimate*Required PowerCircuitsPre-installation andValidation ofCloudera Enterpriseat FactoryOnsite PhysicalInstallationCluster ManagementTrainingDedicated RemoteMonitoringCapabilitiesHardware WarrantyPSSC Labs CloudOOP Rax1000 for 1PB Total StorageSpaceSingle x 42U RackDell Configuration for1PB Total StorageHP Configuration for 1PBTotal StorageLenovo Configuration for1PB Total StorageTwo x 42U RackTwo x 42U RackTwo x 42U Rack4300 Watts Total @ Idle5500 Watts Total @ LoadTwo x 30 Amp / 208V /Single PhaseYes. Cloudera Enterprisepreinstalled and tested.5800 Watts Total @ Idle8500 Watts Total @ LoadFour x 30 Amp / 208V /Single PhaseNo. Additional servicesand fees required.6000 Watts Total @ Idle8800 Watts Total @ LoadFour x 30 Amp / 208V / SinglePhaseNo. Additional services andfees required.5700 Watts Total @ Idle8700 Watts Total @ LoadFour x 30 Amp / 208V /Single PhaseNo. Additional servicesand fees required.Yes. Cluster arrives preracked, cabled and labeled.Yes.No. Additional servicesand fees required.No. Additional servicesand fees required.Yes.No. Additional services andfees required.No. Additional services andfees required.Yes.No. Additional servicesand fees required.No. Additional servicesand fees required.Yes.3 Year NBD ServiceAvailable.3 Year NBD Service Available.3 Year NBD ServiceAvailable.Yes. IPMI 2.0 NetworkStandard3 Year NBD ServiceAvailable.*Dell, HP and Lenovo power estimates based on manufacturers website power draw estimates.20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788
Cloudera Enterprise Reference Architecture A PSSC Labs Reference Architecture Guide March 2018 20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788 Introduction PSSC Labs continues to bring innovative co
