WHAT'S NEW IN SAS - Na.eventscloud

Transcription

WHAT’S NEW IN SAS 9.4PLATFORM, HPA & SAS GRID COMPUTINGMICHAEL GODDARDCHIEF ARCHITECTSAS INSTITUTE, NEW ZEALAND

SAS 9.4 WHAT’S NEW IN THE PLATFORMPlatform updateSAS Grid Computing updateHadoop supportHigh Performance Analytics (HPA) updateDeployment patterns

SAS PLATFORM UPDATE

SAS 9.4EnableProvide quick,precise answers;reduce time to valueCORE THEMESSimplifyRemove barriers ofanalytical knowledgeand complexity;reduce riskInnovateMake analyticsapproachable andeasy to integrate;support Cloud

SAS 9.4 PLATFORM UPDATESAS Metadata ServerSAS Middle-TierSAS Environment ManagerBase/Foundation SAS enhancements Security Web Infrastructure Platform Data Server ODS, DS2 Hadoop

SAS 9.4METADATA SERVER CLUSTERINGWhat is a Metadata Server Cluster? Coordinated set of connected metadata servers Appear as a single standard metadata server toclientsBenefits of Metadata Server Clustering Provide failure recovery for high availability Provides scalable performance for largedeployments

SAS 9.4METADATA HOW DOES CLUSTERING WORKA cluster is three or more metadataserver nodesEach node is a full metadata serverwith a complete copy of all metadataOne node is designated the masterto coordinate the clusterAll other nodes are slave nodesClients connect to slave nodesOnce connected it looks like astandard single server to the client

SAS 9.4MIDDLE-TIERSAS WEB APPLICATION SERVERReduce Cost Removal of third party application server requirement and associated costs Reduce Cost &ComplexityDeliver HigherAvailabilityExpand AdminCapabilitiesSoftware SupportReduce ComplexitySimplified Support – SAS provides enterprise-level support of your entireSAS deployment Simplified deployment and non-disruptive maintenance Expand Management Capabilities Increased ability to monitor and manage SAS servers, solutions and usersDeliver Higher Availability Cloud-enabledPlatformAlternative to Remote Services Automated Clustering SupportDeploy cloud-enabled SAS platform

SAS 9.4MIDDLE-TIERSAS WEB APPLICATION SERVERBenefits of being “embedded” Reduce Cost &Complexity Deliver HigherAvailabilityExpand AdminCapabilitiesCloud-enabledPlatformNo additional costAutomated deploymentDefault clustering supportBuilt-in integration supportNon-disruptive maintenanceGood Fit with Virtualization and CloudTechnologiesEverything you need to build and run web andcloud applications is included in the box!

SAS 9.4MIDDLE-TIERFEATURESAutomated Deployment SAS Web ServerSAS Web Application ServerSAS Web ApplicationsMiddle Tier ClusteringBuilt in support for Proxy server integrationSecurity IntegrationLoad Balancer IntegrationSingle Point of Support for SAS Middle TierTuning Guide for SAS Middle TierSAS Middle Tier Scripting Framework

SAS 9.4SAS ENVIRONMENT MANAGER Embedded operational monitoring solutionProactive monitoring of platform health andavailabilityAgent based, auto-discovery of resourcesMonitoring of log events and configurationchangesAlerting and actions

SASENVIRONMENT OVERVIEWMANAGER

SASENVIRONMENT ARCHITECTURE OVERVIEWMANAGERPlatform 1 ( machine )Management ServerMid-TierTcServersAgentObjectSpawnerGUI Administration,Provisioning, Groups,Metrics, Alerts, Events,Logs, AgentsCLIOpen APIRESTfulWeb GUIDashboardControl CenterPlatform 2 ( machine 2 )Upgradeablevia plug-insMetadatatc SserverObjectSpawnerAgentCMDB ServiceDatabaseInventory, Events,Alerts

SAS 9.4BASE SASSECURITYLock-down Restrict access to only those host paths and files that are included in thatserver’s list of permitted resourcesNOTE: Lock-down is not fully supported by all SAS tools and solutions.Metadata-bound libraries Universally enforce metadata-layer permission requirements for physicaltables—regardless of how a user requests access from SASSAS/SECURE Automatically delivered with Base SAS at no additional cost*Advanced Encryption Standard (AES) withSAS/SECURE Encrypt SAS data on disks* United States export regulations on encryption software restrict access toSAS/SECURE software and related technical shtml/shr/z0354312.htm

SAS 9.4PLATFORMUPDATES SAS 9.4 added support: SAS 9.4 does not support: Java 7RDBMS- POSTGRES (Web Infrastructure Platform Data Server)Windows 8, Windows 8.1Windows Server 2008 SP2Google Chrome Web BrowserInternet Explorer 11 (IE11) - on Windows 7, Windows 8, Windows 8.1Framework Data Server (Firebird)HP-UX PA-RISC (per HP’s lifecycle)Linux 32-bitWindows: XP, Vista, Windows Server 2003No direct migration from SAS 9.1.3 to SAS 9.4SAS 9.4M1 is available now!

SAS 9.4BASE SASNEW OUTPUT DELIVERY SYSTEM(ODS) - DESTINATIONSODS EPUB - Create SAS reports as e-books thatcan be read with Apple iBooks e-book reader on iPadand iPhone.ODS POWERPOINT – Create Microsoft PowerPointslides that combine text and SAS reports.ODS HTML5 – Create HTML5 output for SAS reportsto support delivery to any web browser that isHTML5-compatible.

SAS GRID COMPUTING UPDATE

SAS GRID SUMMARY OF NEW FEATURES GRID OPTION SETSWorkspace Servers launched using the gridLogging facilitySASGSUB enhanced wait

SAS 9.3 MANAGING USERS AND APPLICATIONSSpecific usersUsing specific applicationsNeeding specific grid options One set of grid options per SAS application server context Multiple SAS application server contexts

SAS 9.3 AN EXAMPLE

SAS 9.4 GRID OPTION SETSDISDIS GRID OPTIONSRiskSASGSUBSAS Options: -memsize 256Resources: none Grid Options: queue normalSASGSUB OPTIONSDISFinanceSASGSUBSAS Options: -memsize 0Resources:GSUBGrid Options: queue night

OPTION SETS THE SAME DEPLOYMENT IN 9.4Using GridOptions Sets

OPTION SETS LOGICAL GRID SERVER DEFINITIONDefault options

SAS GRID WORKSPACE SERVERS LAUNCHEDSAS 9.4 ImplementationSAS 9.3 ImplementationEGWORKSPACESERVEREG/AMO Grid MacrosGRIDGRID SERVEREGGRIDWORKSPACESERVER

HADOOP SUPPORT

HADOOPSAS SUPPORT Support for Cloudera and HortonWorks SAS/ACCESS to Hadoop Cloudera CDH 4.1.2, Hortonworks HDP 1.3 or 2.0Basic FILE/INFILE connectivityLIBNAME (DATA and OUT connectivity)PROC HADOOPSAS/ACESS to Cloudera ImpalaScoring acceleratorCode acceleratorHPASPD Engine with HadoopCloudera Impala is an open source Massively Parallel Processing(MPP) query engine that runs natively on Apache Hadoop.

HADOOP SAS WITH HADOOP ECOSYSTEMUserInterfaceSAS UserSAS EnterpriseGuide SAS VisualAnalyticsSAS MetadataMetadataDataAccessSAS EnterpriseMiner SAS DataIntegrationBase SAS & SAS/ACCESS Interface to Hadoop HBasePigIn-MemoryData AccessHiveSAS LASR AnalyticServer & SAS HighPerformanceAnalyticsDataProcessingMapReduceMPI BasedFileSystemHDFS

SAS 9.4SAS AND HADOOPUse SPD Engine with Hadoop Read, write, and update data through the HadoopDistributed File System (HDFS). Submit configuration properties to the Hadoop server.Why it matters Customers can take advantage of the benefits ofHadoop HDFS to store and access SAS data setsstored across their Hadoop clusters.

HIGH PERFORMANCE ANALYTICS

SAS HPA New product bundles ENHANCEMENTSSAS High-Performance StatisticsSAS High-Performance Data MiningSAS High-Performance Text MiningSAS High-Performance ForecastingSAS High-Performance EconometricsSAS High-Performance OptimizationTwo operating modesSAS High-Performance Analytics “Alongside” mode SAS High-Performance Analytics “Next to” mode No longer need a dedicated appliance, “HPA Appliance” Asymmetric (“next to” mode) and SMP HPA Procs

SAS HPAASYMMETRIC MODELCLIENTAsymmetric Data Loading direct into SAS In-Memory from DatabasesHADOOP“SAS Rack”GREENPLUMTERADATASAS In-Database embedded processing engines –-For pulling data into the SAS HP Analytics nodes (directly throughAsymmetric loading or indirectly using Hadoop as caching layer)Improved features for processing large data volumeUsed also for deploying models directly into Database for operational useORACLEExadata

DEPLOYMENT PATTERNS

SHAREDPLATFORM A SHARED INTEGRATED PLATFORMShared environment for all users (analytics and VA)Distributed and non-distributed VASAS Grid and non-grid environmentsSAS High Performance Analytics

SHAREDPLATFORMA SHARED INTEGRATED PLATFORM From SAS 9.4 it has been possible to have a truly shared platform Distributed HPA proc execution supports RHEL and SUSE – so only appliesto SAS Grids on RHEL and SUSECompute / GRIDEnvironmentShared MetadataCompute / GRIDEnvironmentShared Middle-tierShared Middle-tierSAS VisualAnalytics (SMP)EnvironmentShared MetadataSAS HPA Products(Asymmetric Model)SAS Visual Analytics (Distributed)Environment* Non-distributed or SMP VA is supported on Linux and Windows.Big Data ClusterHadoopTeradataGreenplumOracle

HIGH LEVELARCHITECTSAS VISUAL ANALYTICS 6.2 AND SAS (E)BI SERVERSHARED METADATA SERVER FOR 9.4 ENVIRONMENT ONLYSAS VISUAL ANALYTICS ENVIRONMENTVA CLIENTSVA Server (LAX)LASR ClusterDesktopMid-Tier(SAS App Server)SAS LASR AnalyticServerWorkspace ServerCo-Located DataStorageWebMobileHadoopRDBMSShared Metadata ServerNonrelationalMetadata ServerERPEBI CLIENTSDesktopSAS (E)BI Middle TierServer (LAX* recommended)Mid-Tier(SAS App Server)SAS (E)BI Compute ServerWorkspace ServerClick StreamStored Process ServerWeb(*) non-distributed VA can also bedeployed on WindowsOLAP ServerPC Files

HIGH LEVELSAS GRID & HPAARCHITECTURESERVER 0SERVER 1SERVER 2SERVER 3SERVER 4SERVER nSAS WebApplication ServerSAS Grid ControlServerSAS Grid ComputeNodeSAS Grid ComputeNodeSAS Grid ComputeNodeSAS Grid ComputeNodeSAS WebApplicationsSAS Workspace Server / SAS Stored Process Server(SAS Analytics Products)SAS MetadataServerSAS WebInfrastructurePlatformSAS EnvironmentManagerSAS WebInfrastructure DataServerSAS LASRTM ANALTIC SERVER(SAS High-Performance Analytics Products)SAS HighPerformanceAnalyticsProducts(Root Node)SAS HighPerformanceAnalyticsProducts(Worker Node)SAS HighPerformanceAnalyticsProducts(Worker Node)SAS HighPerformanceAnalyticsProducts(Worker Node)SAS HPADeployment ofHadoop(Name Node)SAS HPADeployment ofHadoop(Data Node)SAS HPADeployment ofHadoop(Data Node)SAS HPADeployment ofHadoop(Data Node)

Questions

THANK YOU

SAS 9.4 MIDDLE-TIER SAS WEB APPLICATION SERVER Reduce Cost Removal of third party application server requirement and associated costs Software Support Reduce Complexity Simplified Support -SAS provides enterprise-level support of your entire SAS deployment Simplified deployment and non-disruptive maintenance Expand Management Capabilities .