Running Cloud Foundry At Swisscom

Transcription

Running Cloud Foundryat SwisscomCF Summit Europe 2015, November 3thBoban GlisovicCloud Engineer, PaaS CoreDiego ZamboniCloud Architect, Health ManagementCF Summit Berlin 2015 (c) Swisscom 2015

About Swisscom Telecommunication, IT Services and more within Switzerland Fixed network: By the end of 2015, Swisscom will supply 2.3million homes and businesses with ultra-fast broadband.Everythingalways on Mobile network: By 2016, Swisscomwill have extended 4G/LTEcoverage to 99% of theSwiss population.InternetbasedGlobalcompetition 20’000 Employees

Swisscom’sunified approach to cloud infrastructure & servicesBuilding a360 e CloudsameservicesSaaSService CloudPaaSApplication CloudUsed by everybody:For consumingservices, buildingservices, buildingplatformsOpen Standardsà no Lock-inScalable – based onrequirements, timeand budgetIT ArchitectCF Summit Berlin 2015 (c) Swisscom 2015EndUserApplication DeveloperSimple: astandardizedplatform

ProductApplication CloudPublicProductVirtual PrivateLaunch: 2nd of Oct 15Cloud InfrastructureSharedSharedCloud Foundry (PaaS)SharedDedicatedServices (Database etc.)Shared and DedicatedDedicatedServices (3rd Party)Self Service PortalLegacy-Integrations (IdP etc.)OptionalHigh Availability (96.0-99.9% )Dedicated Network (VXLAN)OptionalSecure Datacenter Interconnection (VPN/LAN-I)SupportSupportCommunity & StdProfessional ServicesStandard, 24/7OptionalBusiness ModelPay-per-useContract baseCF Summit Berlin 2015 (c) Swisscom 2015(Minimum Consumption) No base fee At least 1 day Base fee At least 3 months Setup fee included

Cloud Foundry at SwisscomLifecycle?Business ic RouterCloud Controller3rd party integrationIAM federationELB/WAFUAA/LoginHealthmanagerService BrokerDEAAppsUser ProvidedServicesStateful containerbased servicesBuildpacksLogging & MetricsMessaging (NATS)BOSHIaaSOpenstackCF Summit Berlin 2015 (c) Swisscom 2015SDSServicesSDNExternal services

LifecycleLifecycle?Business ic RouterCloud Controller3rd party integrationIAM federationELB/WAFUAA/LoginHealthmanagerService BrokerDEAAppsUser ProvidedServicesStateful containerbased servicesBuildpacksLogging & MetricsMessaging (NATS)BOSHIaaSOpenstackCF Summit Berlin 2015 (c) Swisscom 2015SDSServicesSDNExternal services

LifecycleLifecycle?Busine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HOp e nsta ckS DSIa a SS DNOperations?Busine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HOp e nsta ckS DSBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HIa a SS DNOp e nsta ckS DSIa a SS DNBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaOp e nsta ckDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HOp e nsta ckS DSS DSIa a SS DNBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaIa a SS DNDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HOp e nsta ckBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HOp e nsta ckOp e nsta ckS DSIa a SS DNCF Summit Berlin 2015 (c) Swisscom 2015S DSIa a SS DNS DSOp e nsta ckIa a SS DNBusine ss Inte g ra tio nE xl te nsio nsBilling P o rtaDyna m ic R o ute rClo ud Co ntro llerHe a lthmUAA/Log in a na g e rApp ste ful co nta iner3 r d p a rty inte g ra tio nS taS e rvice Bro ke rS e rvice sIAM fe d e ra tio nE LB/WAFE x te rna l se rvice sABuild pDEa cksUse r LoP roe d& M e trics b a se d se rvice sg gvidinge rvices (NAT S )M eSssag ingBOS HOp e nsta ckS DSIa a SS DNS DSIa a SS DN

Lifecyclemain challenges automated provisioning of PaaS stacks keep things “up-to-date” integrationsCF Summit Berlin 2015 (c) Swisscom 2015

Lifecyclemain challenges automated provisioning of PaaS stacks keep things “up-to-date” integrations spiff / boshworkspace # cat cf-stub.yml wc –l 2200 LOCCF Summit Berlin 2015 (c) Swisscom 2015 SC appcloudbootstrap # cat cf-bs.yml wc –l 300 LOC # cat appcloud.yml wc –l 15 LOC

Lifecyclemain challenges automated provisioning of PaaS stacks keep things “up-to-date” integrationsAddressed by: standardization automation testing layers of abstraction strong CI/CD process an awesome team JCF Summit Berlin 2015 (c) Swisscom 2015

Operations Challenges: Tremendous SLA requirements Proper instrumentation and constant monitoring Fixing problems ASAP Reducing the workload of ops teams Addressed by: Deep instrumentation Loosely-coupled systems (add/remove freely) Automation Aggregation Clear separation of automation vs documentationCF Summit Berlin 2015 (c) Swisscom 2015

The OODA loopAnyinfrastructurecomponentCF Summit Berlin 2015 (c) Swisscom 2015

OODA loops are all over the place(disjoint and incomplete,AKA existing monitoring and management tools)Business IntegrationPortalBillingExtensionsDynamic RouterCloud Controller3rd party integrationIAM federationELB/WAFUAA/LoginHealthmanagerService BrokerDEAAppsUser ProvidedServicesStateful containerbased servicesBuildpacksLogging & MetricsMessaging (NATS)BOSHIaaSOpenstackCF Summit Berlin 2015 (c) Swisscom 2015SDSServicesSDNExternal services

OODA loops are all over the place(disjoint and incomplete,AKA existing monitoring and management tools)Business IntegrationPortalBillingExtensionsDynamic RouterCloud Controller3rd party integrationIAM federationELB/WAFUAA/LoginHealthmanagerService BrokerDEAAppsUser ProvidedServicesStateful containerbased servicesBuildpacksLogging & MetricsMessaging (NATS)BOSHIaaSOpenstackCF Summit Berlin 2015 (c) Swisscom 2015SDSServicesSDNExternal services

Design principle: don’t reinvent the wheelBosh healthmonitorConsul checksCloudFoundryhealth managerPuppet policiesOpenStack healthmonitorsPlumGrid healthmanagementLinux/Unix cronjobsApp-specificinternalmonitoringInfluxDB dataUse existingmechanisms asmuch as possibleCF Summit Berlin 2015 (c) Swisscom 2015

Design principle: aggregate and unifyBuild on top tocoordinate and addmissing informationUse existingmechanisms asmuch as possibleCF Summit Berlin 2015 (c) Swisscom 2015

Design principle: iterative improvementDelegate the harddecisions tohumans, but usethem to improveanalysisBuild on top tocoordinate and addmissing informationUse existingmechanisms asmuch as possibleImage based on a workat hyperboleandahalf.blogspot.com. CC BY-NC-ND 3.0 USCF Summit Berlin 2015 (c) Swisscom 2015

Self testing: Chaos HeidiAutomateddisruption totest automatedresponsesInspiration: Netflix’s Chaos Monkey (https://github.com/Netflix/SimianArmy/)CF Summit Berlin 2015 (c) Swisscom 2015

Logical architectureHeidiagentsConsul checksCheckresultsResponderHealth managerConsul checksStatus andother ConsuleventsResponderConsul checksResponderResults andlogging eventsMessage busEventsAnalysis engineRulesResponder Puppet, mco, scripts, etc.CF Summit Berlin 2015 (c) Swisscom 2015

ConsoleCF Summit Berlin 2015 (c) Swisscom 2015

ConsoleCF Summit Berlin 2015 (c) Swisscom 2015

Conclusions You cannot run CF on a vacuum You can’t always have a green field! Integrations are hard Network integration Security Other legacy systems Health management is indispensable Automate as much as possible Delegate hard decisions to humans Don’t try to solve everything at onceCF Summit Berlin 2015 (c) Swisscom 2015

developer.swisscom.comCloudFoundry From Switzerland: As Tasty as our Chocolate!@Swisscom DevCF Summit Berlin 2015 (c) Swisscom 2015

Thank you!Boban GlisovicDiego Zamboni

Running Cloud Foundry at Swisscom CF Summit Europe 2015, November 3th Boban Glisovic Cloud Engineer, PaaS Core Diego Zamboni Cloud Architect, Health Management CF Summit Berlin 2015 (c) Swisscom 2015. About Swisscom Everything always on Internet-based Global competition Telecommunication, IT Services and more within Switzerland Fixed network: By the end of 2015,