Transcription
Predix Logging 2020 General Electric Company
ContentsPedix Logging OverviewAbout Predix Logging1Predix Logging Subscription Plans1Getting Started with Predix Logging3Creating Predix Logging Service Instance3Setting up the Predix Logging Kibana Interface4Using Predix Loggingii15Data Persistence and Back for Predix Logging5Migrating from an Existing Service or Plan to a New Service or Plan5Troubleshooting Predix Logging5Predix Logging
Copyright GE Digital 2020 General Electric Company.GE, the GE Monogram, and Predix are either registered trademarks or trademarks of General ElectricCompany. All other trademarks are the property of their respective owners.This document may contain Confidential/Proprietary information of General Electric Company and/or itssuppliers or vendors. Distribution or reproduction is prohibited without permission.THIS DOCUMENT AND ITS CONTENTS ARE PROVIDED "AS IS," WITH NO REPRESENTATION ORWARRANTIES OF ANY KIND, WHETHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TOWARRANTIES OF DESIGN, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. ALL OTHERLIABILITY ARISING FROM RELIANCE UPON ANY INFORMATION CONTAINED HEREIN IS EXPRESSLYDISCLAIMED.Access to and use of the software described in this document is conditioned on acceptance of the EndUser License Agreement and compliance with its terms. 2020 General Electric Companyiii
Pedix Logging OverviewAbout Predix LoggingLearn about the Predix Logging serviceUse the Predix Logging service to collate and view your log files. Predix Logging is the cloud-enabledversion of the ELK stack http://www.logsearch.io/. ELK is a tool for receiving, processing and outputtinglogs. ELK uses Elasticsearch as a back-end datastore, and kibana as a front-end reporting tool to create apowerful pipeline for storing, querying and analyzing your logs.The Predix Logging service is based on several open-source software components:Elastic SearchIndexes and stores the log data.ELKReceives and parses the log data.KibanaProvides a customizable, user-friendly way to visualize your log data.Predix Logging Subscription PlansLearn about your options for using the Predix Logging service.Predix Logging subscription plans offer the following:Dedicated Single NodePreferred for higher memory with non-HA requirements. This could be used for production use casesif the application is designed for resiliency.Dedicated and Highly Available (HA)Best for production usage where fault tolerance in the Predix Logging service is required. These planscan also be used to accelerate read access to data structures as there are two read slaves in thetopology.Details of each plan type follow.Predix Logging Dedicated Single-Node ConfigurationPlan FeatureFeature DescriptionHANot included; the service will be interrupted upon any host reboot.PersistenceElasticSearch indices are writte to local storage.RDB Snapshots are enabled by default. The database will be savedwhen one of the following parameters has been reached: After 900 sec (15 min) if at least 1 key changedAfter 300 sec (5 min) if at least 10 keys changedAfter 60 sec if at least 10000 keys changedBackupsHourly with 24-hour retention.VMDedicated VM with single Predix Logging process; no noisy neighbor issues. 2020 General Electric Company1
Plan FeatureFeature DescriptionRecommendationRecommended for advanced development or testing requirements, or in productionwhere Highly Available configuration is not required.Predix Logging Dedicated Highly Available configurationPlan FeatureFeature DescriptionHASingle Read-Write Master replicating to two Read-Only Slaves; Redis \Sentinelprovides fast, automatic master promotion and client failover when using Sentinelaware clients. See the samples included in this document.PersistenceElasticSearch indices are sharded, replicated, and stored both locally and on a secondnode in the cluster.RDB Snapshots are enabled by default. The database will be savedwhen one of the following parameters has been reached: 2After 900 sec (15 min) if at least 1 key changedAfter 300 sec (5 min) if at least 10 keys changedAfter 60 sec if at least 10000 keys changedBackupsHourly with 24-hour retentionVMDedicated VMs with single Predix Logging process each; clients can connect to slavesto accelerate read performance.RecommendationGood for production environments that require Highly Available configuration. 2020 General Electric Company
Getting Started with Predix LoggingCreating Predix Logging Service InstanceCreate a Predix Logging service instance to collect and mange log files.About This TaskUse this process to determine if Predix Logging is available in the Cloud Foundry Marketplace, and tocreate your Predix Logging service instance.Procedure1. To retrieve the name of the Logging service, list the services in the Cloud Foundry marketplace.cf marketplaceThe service plans are edicated-1-L20*, Dedicated-3HALogging service for the Predix Platform2. Creating a Predix Logging service instance and binding an App is all it takes to start using this service. cf create-service predix-logging plan-name your-serviceinstance-name Note: This step takes about 3 to 9 mins. Check status of service creation using cf servicescommand.For example: cf servicesGetting services in org xxx / space yyy as 20*serviceplanbound appslastpredix-loggingDedicated-1create succeeded3. Bind the Predix Logging service instance to your application.cf bind-service your-app-name your-service-instance-name 4. Restage your application.cf restage your-app-name 2020 General Electric Company3
Setting up the Predix Logging Kibana InterfaceView the application environment to retrieve the Kibana connection information for the Predix Loggingservice.About This TaskProcedure1. View the application environment to get kibana connection information. cf env your-app-name 2. Point a browser to the kibana url and log in with the username/password from the previous step. Hereis an example ENV:"kibana url": assword": "sample password","username": "sample user"Note:When you access Kibana for the first time, you will be required to "Configure an index pattern". Followthese guidelines to define the index: Index contains time-based events - checked (default)Use event times to create index names [DEPRECATED] - unchecked (default)Index name or pattern: logstash-* - (default)Index name or pattern: logstash-* - (default)Time-field name - select @timestamp If @timestamp is not available as an option then it means there are no logs flowing into theservice instance Bind an app to the new service instance and refresh Kibana to see if @timestamp is available inthis drop-down menu Fewer than than 5 minutes will pass from the time an app is bound to Kibana seeing@timestamp in the Time-field name drop-down menuClick on Create 4 2020 General Electric Company
Using Predix LoggingData Persistence and Back for Predix LoggingLearn how to manage your data and perform backups for Predix Logging service.How Data is Persisted for Single-Node Configurations in Predix Logging Elastic Search indices are written to local storage.If a single-node plan is rebooted, or the machine needs to be re-provisioned, data will be recoveredfrom the disk.How Data is Persisted for Highly Aailable Configurations Elastic Search indices are sharded, replicated and stored both locally and on a second node in thecluster.If a data volume becomes corrupted, contact Predix support to initiate a restore from backup.What is Backed Up in Predix LoggingA snapshot of the data volume occurs every hour and will be retained for 24 hours.There is no self-service interface for downloading or restoring backups. You must contact Predix Supportto initiate a restore from a recent backup.Migrating from an Existing Service or Plan to a New Service orPlanQuestions about migrating to a new service or plan. Find the answers here.How do I change plans from one to another? Create a new instance with the desired plan type.Unbind the old service instance from your application.Bind the new service instance to your applications, and restage the app.Is there a way I can migrate my data to a new service instance?Not at this time.Troubleshooting Predix LoggingFind answers to common questions for creating the Predix Logging service instance.Service Instance - Create Service is in progress for a long time.The service instance creation takes about 3 to 9 minutes. If it takes over 20 minutes and if the statusis still in-progress, create a new service instance.Service Instance - Create failed.Create a new service instance. 2020 General Electric Company5
Use this process to determine if Predix Logging is available in the Cloud Foundry Marketplace, and to create your Predix Logging service instance. Procedure 1. To retrieve the name of the Logging service, list the services in the Cloud Foundry marketplace. cf marketplace The service plans are listed: ' service plans description predix-logging Dedicated-1-L20*, Dedicated-3HA-L40* Logging .
