Critical Capabilities For Network Performance Monitoring .

Transcription

Gartner ReprintLICENSED FOR DISTRIBUTIONCritical Capabilities for Network Performance Monitoring and DiagnosticsPublished: 21 February 2018 ID: G00326771Analyst(s): Vivek Bhalla, Sanjit Ganguli, Pankaj PrasadSummaryNPMD tools enable organizations to measure and improve IT services. To choose the correct tool, I&O leadersresponsible for network performance should determine which of the popular NPMD products are best-suitedto their requirements and maturity level.OverviewKey FindingsThe profiles of key users of network performance monitoring and diagnostics (NPMD) tools are diversifying,with three out of five primary stakeholders residing outside of network operations.NPMD tools are increasingly positioned to provide insight into the usage of applications and the activities ofend users, including their impact on business objectives.Navigational search, contextual workflow and analytics-based functionalities continue to become morebroadly available in NPMD tools, but their degree of sophistication varies widely among vendors.An increasing number of vendors focus on non-NPMD functions, such as infrastructure availabilitymonitoring and network fault management, at the expense of the core performance capabilities that mostI&O organizations require.RecommendationsTo optimize IT operations and DevOps to drive business value, I&O leaders should:Ensure solutions are applicable beyond a NetOps 2.0 context by collaborating with stakeholders and expertsfrom outside I&O when evaluating an NPMD tool.Support bandwidth-intensive services (such as VoIP and UCM) by deploying NPMD technology to monitornetwork demand and manage capacity planning.Cultivate collaboration across IT operations by using the analytics and contextual user interface drill-downworkflows embedded in NPMD tools to share data across domain groups.Strike a cost-effective balance by using packet-based inspection for mission-critical, granular insight, as wellas flow collection techniques for holistic, infrastructurewide coverage.Strategic Planning es%202018.htm[14/03/2018 10:02:57]

Gartner ReprintBy 2023, 50% of buyers of NPMD tools will reside outside traditional network operations organizations,increasing from 20% in 2018.What You Need to KnowThis document was revised on 21 February 2018. The document you are viewing is the corrected version. Formore information, see the Corrections page on gartner.com.NPMD tools support many roles within IT and, increasingly, also support business initiatives. Measuring andreporting on network performance is crucial to ensure that the proper steps are taken so performance stays atan acceptable level. It can also highlight opportunities to improve business outcomes for internal end usersand external customers through improved network and application delivery. Finally, NPMD tools enableimproved network capacity management, thereby lowering capital investment for networking equipment andservices.Gartner has identified five key capabilities for NPMD tools: endpoint, component and link monitoring; servicedelivery monitoring; diagnostics; analytics; and integration and interoperability. These capabilities are critical tothe success of five different types of stakeholders commonly involved in this endeavor: network operator,network architect, IT operations manager, IT operations generalist and the line-of-business user. Note howthree of the five stakeholders are roles beyond traditional network operations. These capabilities serve as theprimary basis of this analysis and together play a key role in network and IT operations. This research focuseson the competitiveness of NPMD solutions themselves, as opposed to the strengths and cautions of thesupplying vendors that are covered in the companion Magic Quadrant research. Readers can use this CriticalCapabilities research and role-centric perspective to inform their own analysis and determine the best fit fortheir objectives and organization.This analysis complements the "Magic Quadrant for Network Performance Monitoring and Diagnostics," whichdefines the market and highlights a broad set of factors, including the corporate viability, vision, marketing andgeographic focus of the vendors that offer these NPMD products. We strongly recommend that organizationsuse this research in conjunction with the Magic Quadrant, inquiries with Gartner analysts and other Gartnerresearch to define their requirements and select the solutions that match their needs.AnalysisCritical Capabilities Use-Case GraphicsFigure 1. Vendors' Product Scores for the Network Operator Use 018.htm[14/03/2018 10:02:57]

Gartner ReprintSource: Gartner (February 2018)Figure 2. Vendors' Product Scores for the Network Architect Use 018.htm[14/03/2018 10:02:57]

Gartner ReprintSource: Gartner (February 2018)Figure 3. Vendors' Product Scores for the IT Operations Generalist Use 018.htm[14/03/2018 10:02:57]

Gartner ReprintSource: Gartner (February 2018)Figure 4. Vendors' Product Scores for the IT Operations Manager Use 018.htm[14/03/2018 10:02:57]

Gartner ReprintSource: Gartner (February 2018)Figure 5. Vendors' Product Scores for the Line-of-Business User Use 018.htm[14/03/2018 10:02:57]

Gartner ReprintSource: Gartner (February 2018)VendorsAccedian (Performance Vision) Performance Vision 4.2Founded in 2004, Performance Vision is a privately owned subsidiary of Accedian. Performance Vision isheadquartered in Paris, France. Performance Vision's NPMD offering, Performance Vision v4.2, was evaluatedfor this research. This product is an on-premises hardware and software offering.Performance Vision is delivered as a lightweight capture appliance and a data store appliance. The captureappliance is focused on data collection, traffic analysis and sending metrics to the data store appliance. Thedata store appliance provides the data visualization and reporting capabilities, while also assisting with datacollection. Performance Vision demonstrates granularity and performance at scale, with significant attention tothe visualization of data to facilitate easier diagnosis of performance anomalies. Performance Vision relies onpassive data collection methods for monitoring. The tool provides transaction visibility across webapplications, databases, name services, file transfer and storage, and VoIP. The emphasis of the %202018.htm[14/03/2018 10:02:57]

Gartner Reprintrelease focused on scalability and distributed environments. The latest release, in April 2017, delivered furthersupport for a distributed deployment model with the introduction of a new hardware microappliance, designedfor smaller remote sites. Additional enhancements include support for Citrix performance analysis andNexthink integration.Gartner's survey of end users rated Performance Vision strongly for its ease of implementation and upgrade,and maintenance and reliability. The same survey rated Performance Vision poorly in terms of integration withthird-party tools and analytics. When asked what other vendors were considered when selecting their NPMDsolution, Performance Vision end users cited SolarWinds most frequently, followed by Riverbed.This product is well-suited for midsize enterprises that require a small deployment model footprint withvisibility across applications and the network layers. Based on Gartner's analysis, the product is best aligned tothe line-of-business user role.Note: Performance Vision was acquired by Accedian in December 2017. The change in ownership occurredafter the analysis conducted for this research took place.AppNeta Performance Manager 10.8Founded in 2011, AppNeta is a privately owned company headquartered in Boston, Massachusetts. AppNeta'sNPMD product, AppNeta Performance Manager 10.8, was evaluated for this research. This product is a SaaSand on-premises offering.AppNeta Performance Manager consists of three components: delivery, experience and usage. Together, thesecomponents have several functions, including synthetic transaction monitoring that has been developed tomonitor SaaS-based applications in addition to traditional on-premises applications. Also included is pathanalytics, employing active monitoring and diagnostics. Finally, application usage analytics is done using deeppacket inspection capabilities. Enabling these use cases are physical, virtual or software monitoring points thatmust be installed at each remote location. Preconfigured VM and software monitoring points can bedownloaded, or preconfigured hardware can be supplied by AppNeta. Pricing has been simplified compared toearlier offerings, with customers paying an annual fee per monitoring application and location, with additionalone-time charges for monitoring points.AppNeta's NPMD solution focuses on ease of implementation, low total cost of ownership and visibility ofapplications irrespective of where they may be deployed or hosted. The solution is a modular public- andprivate-cloud-hosted service, with the majority of end users on the public cloud offering.Gartner's survey of end users rated AppNeta among the highest in terms of ease of upgrading as well asendpoint, component and link monitoring. The same survey indicated that AppNeta was rated poorly in termsof satisfaction with the cost of maintenance and integration with third-party tools. When asked what othervendors were considered when selecting their NPMD solution, AppNeta end users cited Riverbed andSolarWinds.This product is well-suited for highly distributed enterprises, or those organizations with a significant number ofapplications deployed in cloud or hybrid environments. Based on Gartner's analysis, the product is best alignedto the line-of-business user role.CA Technologies Network Operations and AnalyticsFounded in 1976, CA Technologies is a public company headquartered in New York, New York. The 8.htm[14/03/2018 10:02:57]

Gartner ReprintTechnologies NPMD product, Network Operations and Analytics v3.2, was evaluated for this research. Thisproduct is an on-premises software offering.CA Technologies' product suite has been built through both acquisition and organic development, and iscurrently being offered as part of the Network Operations and Analytics platform. This is an attempt to unifythe NPMD solution into a single portal that joins data from multiple sources. The Network Operations andAnalytics platform is based on CA Performance Management as its foundation.The Network Operations and Analytics platform is composed of CA Performance Management forinfrastructure monitoring, CA Network Flow Analysis for traffic monitoring, CA Unified CommunicationsMonitor for voice and video monitoring, and CA Application Delivery Analysis, which is focused on packet-levelinspection for applications. This is rounded out by CA Virtual Network Assurance, for the monitoring andmanagement of modern network architectures. New to CA's portfolio is the SaaS-based Digital ExperienceInsight solution, which is a full-stack monitoring and analytics service offering that provides analysis acrosscustomer experience, application performance, and infrastructure and network management. Support forNPMD workflows remains limited to date, but additional integration is on the roadmap. Gartner has observedsome overlapping capabilities across products and shifting product and integration roadmaps.Gartner's survey of end users indicated the company's ability to commit and deliver requested enhancementswas above average, and also saw a marked increase in user satisfaction of CA's peer user community over theprevious year. End users rate business transaction monitoring and ease of integration and deployment amongthe weakest. When asked what other vendors were considered when selecting their NPMD solution, CATechnologies' end users cited Riverbed and SolarWinds most frequently, followed equally by Cisco, LiveActionand NetBrain.This product is well-suited for large enterprises and service providers that require multitenancy and a focus onflow and Simple Network Management Protocol (SNMP) monitoring. Based on Gartner's analysis, the productis best aligned to the network operator role.Cisco Prime Infrastructure, NAM and Tetration AnalyticsFounded in 1984, Cisco is a public company headquartered in San Jose, California. Cisco's NPMD products(Prime Infrastructure v3.2, APIC-EM 1.5, Network Analysis Module [NAM] v6.2.1, and Tetration Analyticsv2.0.2.20) were evaluated for this research. The offering is composed of on-premises software and hardware.Prime Infrastructure has multiple capabilities spanning network configuration, monitoring and themanagement of Cisco equipment, with comprehensive support for wireless network monitoring. This iscoupled with the Application Policy Infrastructure Controller Enterprise Module (APIC-EM) capability, whichprovides path and performance visibility and a central control point for iWAN. NAM is a hardware appliance ormodule that can be included in many Cisco network devices for handling deep packet inspection (DPI).Tetration Analytics is designed to address data center operations and security-related use cases, usinghardware-embedded network telemetry.New to Cisco's offering is DNA Center 1.0, which aims to deliver a single architecture for managing the LAN,WAN, Campus and Cloud for assurance and automation via an intent-based networking approach. The firstsolutions to ship on DNA Center (Software Defined Access [SDA] and Network Assurance) aim to bringmachine learning and analytics capabilities through the ingestion of a broad set of data sources from thenetwork ties%202018.htm[14/03/2018 10:02:57]

Gartner ReprintGartner's survey noted that Cisco's NPMD solution was frequently considered across all end users,demonstrating brand awareness and profile. The same survey indicated Cisco's NPMD solution was ratedamong the lowest for value for cost of implementation and maintenance, and integration with third-party tools.When asked what other vendors were considered when selecting their NPMD solution, Cisco end users citedSolarWinds most frequently, followed by Micro Focus (HPE Software) and Riverbed.This product is well-suited for enterprises with a heavy investment in Cisco hardware, especially wireless, thatwant to monitor performance. Based on Gartner's analysis, the product is best aligned to the network architectrole.Colasoft UPM, nChronos and CapsaFounded in 2001, Colasoft is a privately owned company headquartered in Chengdu, China. Colasoft's NPMDproducts (UPM v5.2, nChronos v5.3 and Capsa v10.0) were evaluated for this research. The offering iscomposed of on-premises software and hardware.Colasoft UPM delivers a visualization layer that provides business- and service-oriented performance views, fullnetwork path analysis, and proactive performance issue detection, all based upon data collected by nChronos.nChronos provides packet capture and historical and real-time analysis of over 80 application-orientedperformance metrics for every TCP conversation. Capsa is a network analyzer that provides packet sniffingand capture where application decoding and deep domain analysis are required.All metrics can be collected and reported at a one-second granularity rate, a differentiator compared to mostother NPMD vendors. Statistical data compressing storage and packet indexing technology enable rapid drilldown, retrieval and downloading of data. Automatic multisegment analysis is another capability of the solution.Colasoft supports the monitoring of virtual machines and software-defined networking (SDN) infrastructures.UPM also offers user-defined alarming based upon a three-dimensional triangulation across application, serverand network domains. However, abnormal business alarms and analysis require manual configuration.Gartner's survey of end users scored Colasoft strongest in terms of its ability to commit and deliver onrequested enhancements and navigation and workflow, and it is tied with LiveAction for strongest in terms ofcontextual drill-down and troubleshooting. The same survey rated Colasoft below the median in terms of costof maintenance. When asked what other vendors were considered when selecting their NPMD solution,Colasoft end users cited NETSCOUT and Riverbed most frequently, followed by SolarWinds.These products are well-suited for service providers and large enterprises, particularly governmentorganizations, needing to combine packet analysis with multimetric alarm and threshold alerting. Based onGartner's analysis, the product is best aligned to the network operator role.Corvil Analytics 9.2Founded in 2000, Corvil is a privately owned company headquartered in Dublin, Ireland. Corvil's NPMD product,Corvil Analytics v9.2, was evaluated for this research. This product is an on-premises appliance offering.Corvil Analytics is a competitively priced, packet-based NPMD tool that focuses on analyzing high volumes ofin-flight wire data. The latest release includes a focus on improved user interface and workflows, particularly interms of VoIP and application dependency visualization. Automatic comparison and highlighting of keyperformance indicators has also been added, enabling users to define comparison periods and flag deviationfrom previous periods for any performance indicator. Integration with third-party systems, including 202018.htm[14/03/2018 10:02:57]

Gartner ReprintLiveAction and Cisco Tetration, has also been added. Limited support of VDI protocols, such as Citrix's ICA aswell as cloud and virtual environments, continues to be an inhibitor to adoption.Gartner's survey of end users scored Corvil strongly in terms of direction and vision. The same survey ratedCorvil among the weakest in terms of cost and ease of implementation. When asked what other vendors wereconsidered when selecting their NPMD solution, Corvil end users cited NETSCOUT most frequently, followedby Riverbed.The product is well-suited for enterprises in need of short-time scale and high granularity network monitoring,such as in the electronic trading market and other digital businesses. Based on Gartner's analysis, the productis best aligned to the line-of-business user role.ExtraHop Platform 7.0Founded in 2007, ExtraHop is a privately owned company headquartered in Seattle, Washington. ExtraHop'sNPMD product, Extrahop Platform v7.0, was evaluated for this research. The offering is composed of onpremises software, hardware, additional virtual appliances and SaaS components.The ExtraHop Platform consists of ExtraHop Discover, Explore, Command and Trace Appliances alongside anew SaaS offering, ExtraHop Addy. The platform focuses on wire data analytics, providing deep packetinspection and real-time transaction analysis capabilities at scale for packets traversing the network. This deeppacket inspection allows for visibility into a wide range of application data, both at the header and payload level.ExtraHop has expanded its offering with Addy, a SaaS-based, unsupervised machine learning feature forNPMD data, focuse

This analysis complements the "Magic Quadrant for Network Performance Monitoring and Diagnostics," which defines the market and highlights a broad set of factors, including the corporate viability, vision, marketing and geographic focus of the vendors that offer these NPMD products. We strongly recommend that organizations