Matthias@nextcloud - Indico

Transcription

Matthias Wobbenmatthias@nextcloud.com working in Berlin, Germany Senior Sales Engineer at NextcloudBefore: 3rd level IT Engineer and Administrator at Systems Providerwith focus on EFSS and collaboration portals

AgendaI.II.III.IV.V.VI.VII.Nextcloud in a nutshellArchitectureDefault DeploymentExample 1 Education: Technical University BerlinExample 2 Industry: SiemensThe idea behind Global ScaleExample 3 Enterprise: Large-Scale Service providerAn insiders look into scaling Nextcloud3

I. In a nutshell: secure, stable, flexible and scalable collaborative workspace and Enterprise File Sync and Share 100% open sourceAn insiders look into scaling Nextcloud4

II. ArchitectureAn insiders look into scaling Nextcloud5

II. Nextcloud server & app code PHP runtime web serverAn insiders look into scaling Nextcloud6

II. Database MySQL/MariaDB orPostgreSQL stores everything exceptthe binary files users, shares settings, An insiders look into scaling Nextcloud7

II. Files user uploaded files versions trash bin previews An insiders look into scaling Nextcloud8

II. Split it upweb serverAuthCachingdatabasestorageAn insiders look into scaling Nextcloud9

II. Capacityup to 50.000 to 100.000 usersload balanced web serverAuthCachingdatabase clusterstorage clusterAn insiders look into scaling Nextcloud10

III. Default DeploymentAn insiders look into scaling Nextcloud11

III. Default Deployment HAProxy Virtual IP KeepalivedAn insiders look into scaling Nextcloud12

III. Default Deployment Apache, mod php/php-fpm PHP 7.1 recommendedAn insiders look into scaling Nextcloud13

III. Default DeploymentAn insiders look into scaling Nextcloud14

III. Default DeploymentAuthenticationNFS/object storeAn insiders look into scaling Nextcloud15

III. Default Deployment cache high level file locking less DB load different servers for locking/cachingAn insiders look into scaling Nextcloud16

III. Default Deployment master - slave MySQL Galera recommendedAn insiders look into scaling Nextcloud17

III. Default Deployment MaxScale or HAProxy writes to master, reads to slavesAn insiders look into scaling Nextcloud18

IV. Example 1: Technical University Berlin2012First Review of Cloud Storage / Sync-n-Share solutions2017migration of 22.000 users to Nextcloud.80.000 of 100.000.000 files are changed/moved on a daily basis70 TB Storage2018/2019Collaboration Features, more partners and universitiesAn insiders look into scaling Nextcloud19

IV. Example 1: Technical University BerlinAn insiders look into scaling Nextcloud20

IV. Example 1: Technical University BerlinAn insiders look into scaling Nextcloud21

IV. Example 1: Technical University BerlinReal world test: DB cluster CPU load (2 weeks before/after migration)ownCloud 9Nextcloud 11An insiders look into scaling Nextcloud22

IV. Example 1: Technical University BerlinPerformance improvements and features by Nextcloud: Response time improvements by 60% Reduced DB cluster CPU load by 40-50% in real world test. Multi bucket object store support Big LDAP performance improvements. Up to 85% faster. Significant performance improvements in external storage handling 60% faster propfinds 60% faster transfer of small filesAn insiders look into scaling Nextcloud23

V. Example 2:Services Integration1. Exchange of large files between customer and support2. Customer provides files - technician notified by ticket system3. Technician can provide data to the customer as wellAn insiders look into scaling Nextcloud24

V. Example 2:Services IntegrationAn insiders look into scaling Nextcloud25

VI. The idea behind Global ScalePitfalls of the default deployment Components and WAN uplink will become bottlenecks Database particularly hard to scale beyond a 4 node Galera Cluster- number of users and files are limited Scaling the storage becomes very expensive when dealing with PB of dataAn insiders look into scaling Nextcloud26

VI. The idea behind Global ScaleAn insiders look into scaling Nextcloud27

VI. The idea behind Global Scale Scalability 500k usersGlobal distributionCost efficiencyIndependent nodesFederated sharing between nodesLookup ServerGlobal Site SelectorBalancerFirst release in Nextcloud 12Refined user distribution logic in 13In production since 6 month for 10M usersAn insiders look into scaling Nextcloud28

VI. The idea behind Global ScaleSolution Many independent application servers No central DB, storage or caching instances Every Nextcloud node can use the default deploymentAn insiders look into scaling Nextcloud29

VI. The idea behind Global ScaleSolution A Node can be hosted in different hosting centers No fast interconnect between the sites is necessary User is local to a node, user data exists only in this local node Sharing via federationAn insiders look into scaling Nextcloud30

VII. Example 3: Large-Scale Service providerRequest: Cloud storage for millions of users Multi-national distributionRequirements: Cost efficiency Independent nodes Single InterfaceAn insiders look into scaling Nextcloud31

VII. Example 3: Large-Scale Service providerAn insiders look into scaling Nextcloud32

VII. Example 3: Large-Scale Service providerAn insiders look into scaling Nextcloud33

Nextcloud supports you!Scale with usContact us atsales@nextcloud.com

Your Questions

Thank you!

Nextcloud supports you!Scale with usContact us atsales@nextcloud.com

load balanced web server database cluster up to 50.000 to 100.000 users Auth Caching. An insiders look into scaling Nextcloud 11 III. Default Deployment . Real world test: DB cluster CPU load (2 weeks before/after migration) ownCloud 9 Nextcloud 11. An insiders look into scaling Nextcloud 23 IV. Example 1: Technical University Berlin