Introduction To The Minnesota Supercomputing Institute PDF Free Download

1y ago

19 Views

1 Downloads

2.74 MB

41 Pages

Report/dmca

Download PDF

Transcription

Introduction to theMinnesota Supercomputing Institutefor Advanced Computational ResearchJim Wilgenbusch & Nancy Rowemsi.umn.edu About Staff 2015 Regents of the University of Minnesota. All rights reserved.

Overview Why: Mission Who: Organization Where: Locations What: Resources and Services How: Eligibility, Access, and Accounts– Getting Started on MSI Systems (Hands On)– Brief Intro to Unix and Useful Commands (Hands On) 2015 Regents of the University of Minnesota. All rights reserved.

Organization MSI is an academic unit of the University ofMinnesota under the Office of the Vice President ofResearch About 40 full time employees and work studystudents support MSI MSI serves more than 600 PI groups with over 3,000users Our current Director is Claudia Neuhauser 2015 Regents of the University of Minnesota. All rights reserved.

OrganizationOffice of the Vice President for ResearchUser GatewayGroup-- User SupportLead-- User Training-- On Boarding-Communications-- cedSystemsOperations-- Optimization-- Benchmarking-- HPC ResearchWorkflow & csresearch-Informaticsservices-Life ScienceComputing- Custom AppDev- SystemProgramming- Common Services- HPC Systems- Storage Systems- Hosted Services 2015 Regents of the University of Minnesota. All rights reserved.

LabsUMN-TC East Bank, Walter Library Scientific Development and Visualization Laboratory (SDVL)– Workstations– Tutorials/Workshops LCSE-MSI Visualization Laboratory (LMVL)– Virtual Reality– Large Screen– Remote Visualization– Escorted Access 2015 Regents of the University of Minnesota. All rights reserved.

LabsUMN-TC East Bank, Nils Hasselmo Hall Basic Sciences Computing Laboratory (BSCL)– Stereoscopic Monitors– Stereoscopic Projection SystemUMN-TC East Bank, 717 Delaware Biomedical Modeling, Simulation, and Design Laboratory(BMSDL)– Stereoscopic MonitorsUMN-TC St. Paul, Cargill Building Computational Genetics Laboratory (CGL)– Tutorials/Workshops 2015 Regents of the University of Minnesota. All rights reserved.

Locations Main Offices – Walter Library, 5th Floor HPC and infrastructure systems are housed in the basement ofWalter Library MSI also has five labs:– Scientific Development and Visualization Laboratory (SDVL)– LCSE-MSI Visualization Laboratory (LMVL)– Basic Sciences Computing Laboratory (BSCL)– Biomedical Modeling, Simulation, and Design Laboratory(BMSDL)– Computational Genetics Laboratory (CGL) 2015 Regents of the University of Minnesota. All rights reserved.

HPC SystemsMesabi: (recent)Cores: 16,848 Intel HaswellMemory: 67 TBAccelerators: 80 K40 Nvidia gpGPUsPeak: 675 TFlopsItasca: Hewlett-Packard 3000BLCores: 8728 Intel Nehalem CoresMemory: 31 TB of memoryPeak: 100 TFlopsHPC systems require Service Units 2015 Regents of the University of Minnesota. All rights reserved.

Interactive HPCEnvironments iSub:NICE:Citrix for WindowsJupyter Notebooks Itasca–––Cores: 8,744Memory: 31.3 TBPeak: 100 TF Mesabi––––Cores: 16,848Memory: 67 TBAccelerators: 80 K40gpGPUsPeak: 675 TF 2015 Regents of the University of Minnesota. All rights reserved.

Storage High Performance Storage– 4.1 PB– 48GB/s read/write– Available on HPC resources Hadoop Cluster– 40 compute nodes– 1.2 PB Hadoop HDFS Tier-2 Storage–––3.1 PBAvailable via Amazon’s S3 interfaceAvailable anywhere in the world Archive Storage––3.5 PB tape-based storageoffline storage 2015 Regents of the University of Minnesota. All rights reserved.

Storage Options at UMNOITDepartment Google DriveIsilonBlock StorageWorkstationDepartmentalServersMSI PanasasTier-2 CEPHLibrary DRUM, DataRepository forthe U of MYou laptopMobile 2009 Regents of the University of Minnesota. All rights reserved.Supercomputing Institutefor Advanced Computational Research

Storage Options at UMNPurposeGoogleDriveBig DataOITIsilonOITBlock ?High PerformanceShare accessMSIPanasasMSITier-2DeptStorage ? ? ?Archival (very long-term) storage ?Access on Campus Laptop/Desktop ? ? ?Access on anywhereLaptop/Desktop/Mobile Access on ServersLegally protected data (Coming) Laptop/Desktop ? ? ? 2009 Regents of the University of Minnesota. All rights reserved.Supercomputing Institutefor Advanced Computational Research

GlobusWhat is it good for? Move data between sites across WANWeb GUI drivenMove LARGE directory trees with drag and dropRuns in backgroundHow to use Get Gobus account: Register your certificate ID with Globus endpoints Use web GUI to drag and drop between endpointswww.globus.org 2009 Regents of the University of Minnesota. All rights reserved.Supercomputing Institutefor Advanced Computational Research

Portals & DatabasesFood Protection and Defense Institute FIDES– ID potentialdisruptions to foodsupply– ID food systemdisruptions usingopen news media FIDES extensionto water supplydata 2015 Regents of the University of Minnesota. All rights reserved.

Software Approximately 400 software applications– msi.umn.edu Resources Software Classified into three service levels– Primary, Ancillary, Minimal msi.umn.edu Resources Software SoftwareService Levels Users may install software locally We can purchase software with justification 2015 Regents of the University of Minnesota. All rights reserved.

Software Restrictions Access Restrictions– User list Contact Help Desk Time Restrictions– Limited Licenses– Calendaring System Check documentation for individual softwarerequirements to see if this applies. Software on limited systems 2015 Regents of the University of Minnesota. All rights reserved.

Consulting Services MSI has 24 consulting staff17 consultants have an advanced degreeWe provide 10-20 workshops and tutorials annually1-2 hour meetings on computational or informatics methodologiesInformational sessions for proposal development 2015 Regents of the University of Minnesota. All rights reserved.

Collaborations Extended involvement with an analyst funded by a grantmechanism 46 projects are supported by MSI annually Collaborations involve staff who have knowledge of:–––––Specific research domainsCurrent analytical methodsStatisticsComputingApplication Development 2015 Regents of the University of Minnesota. All rights reserved.

Service Costs Free for UMN faculty and their associatesFree for other MN academic institutionsFee for hosting UMN faculty systemsFee for software developmentFee for service for external organizations 2015 Regents of the University of Minnesota. All rights reserved.

Account Structure Principle Investigator (PI): Controls everything in thegroup Users: Added by the PI Group Administrators: Users within a group that can doeverything the PI can do except add other GroupAdministrators 2015 Regents of the University of Minnesota. All rights reserved.

PI Eligibility Faculty members at the University of Minnesota University of Minnesota academic professionals withdepartment approval Faculty researchers at other accredited institutions ofpost-secondary education in the state of Minnesota 2015 Regents of the University of Minnesota. All rights reserved.

Account Duration MSI accounts are renewed annually– Renewal period opens the first week of October– Resource allocations must be renewed each year Accounts and allocations are good through the calendar year Additional resources may be requested during the year– HPC Allocations Committee meets four times a year– Below threshold resource allocations are handled through theMSI Help Desk 2015 Regents of the University of Minnesota. All rights reserved.

Access System access information is available at msi.umn.edu Access Sign Up For current users, access through msi.umn.edu MyMSI For building access, visit the MSI reception desk Information can be found in the General Information page foreach lab via msi.umn.edu Resources Labs For help, email help@msi.umn.edu or call x6-0802 2015 Regents of the University of Minnesota. All rights reserved.

Service Units Allocations Three Allocation Requests Group A: 70K - All accounts– Fairshare set to 70K Group B: 70K to 280K - MSI Review– Fairshare set to 280K Group C: 280K - Committee Review,Annually– Fairshare set to approved allocation 2015 Regents of the University of Minnesota. All rights reserved.

Data Storage Allocations Three Groups Group A (Default 150 GB)–No review Group B ( 5 TB)–––Uses that much now ORProvide specific justificationReviewed by MSI Group C ( 5 TB)–––––Provide specific justification ANDEstimate how much is needed ANDEstimate how much is actively used ANDEstimate how long data will be stored at MSIReviewed by MSI 2015 Regents of the University of Minnesota. All rights reserved.

MSI Web Pages MSI Home Pagemsi.umn.edu Softwaremsi.umn.edu/sw Password Resetmsi.umn.edu/password Tutorialsmsi.umn.edu/tutorial FAQmsi.umn.edu Resources FAQ 2015 Regents of the University of Minnesota. All rights reserved.

Questions? MSI Help Desk is staff Monday-Friday from 9:00 AM – 4:00 PM Walk-in help is available in Walter 587 Call x6-0802 (1-612-626-0802) Email help@msi.umn.edu 2015 Regents of the University of Minnesota. All rights reserved.

Hadoop Cluster - 40 compute nodes - 1.2 PB Hadoop HDFS Tier-2 Storage - 3.1 PB - Available via Amazon's S3 interface - Available anywhere in the world Archive Storage - 3.5 PB tape-based storage - offline storage