Transcription
Office of the Chief Technology OfficerJune 25, 2020https://octo.dc.gov/node/1310836DC GovernmentJune 30, 2020Interagency DataTeam
AgendaData Use Agreement for OCTO & Agency CollaborationMatthew Sokol, Big Data & Data Integration Program Manager (OCTO)Smruti Radkar, General Counsel (OCTO)COVID-19 Tracking Metrics & Phase Openings with ReOpen DC DashboardTashrik, Ahmed, COVID-19 Epidemiologist (DC Health)Michael Bentivegna, Data Visualization and Analysis Program Manager (OCTO)Web Map Visualizations in Tableau Using Esri Feature ServicesElena Semenova, Senior Business & Data Analyst (OCTO)Data Report & COVID-19 Priority DatasetsMario Field, Data Curation & Governance Program Manager (OCTO)June 30, 2020DC GovernmentOffice of the Chief Technology OfficerWelcome, News & UpdatesBarney Krucoff, Chief Data Officer (OCTO)Michael Bentivegna, Program Manager for Data Visualization & Analysis (OCTO)
Office of the Chief Technology OfficerBarney KrucoffChief Data OfficerOffice of the Chief Technology OfficerDC GovernmentJune 30, 2020Welcome
TableauInternalProductionTableau OCOVID ResponseDashboards:9 Agencywebsites inproduction with 76 embeddedTableauReports/DashboardsTableau SiteAdministratorquarterlymeetingMicroStrategyas a webconnectorNext meeting:est. July 9, 20202020.1.2District Gov. & OCTOOperationHSEMA Daily BriefHSEMA RecoveryJune 30, 2020SharePoint listtesting withMFADC GovernmentOffice of the Chief Technology OfficerBusiness Intelligence - Tableau Updates
MicroStrategyProduction @version 2020Update 1LowerMicroStrategyEnvironments2020 Update 1Enterprise/SelfServiceDeployingphysical IS serverfor developmentJune 30, 2020MicroStrategyPublic/SharePointCOVID19 publicdashboard taDC Reopen TrackerCoronavirus StatsMicroStrategyStake HoldersMeetingNext meeting willbe scheduled inest. late Summer2020DC GovernmentOffice of the Chief Technology OfficerBusiness Intelligence - MicroStrategy Updates
ArcGIS ServerProduction @version 10.7.1(upgraded from10.6.1 on June 19th,2020)ESRI DesktopLicense Managersupports 10.8 andbelow.June 30, 2020ArcGIS Portal @version 10.7.1AGOLUsers:CoronavirusData Hub SiteNew secure COVIDserviceREST gservicesESRIGeoEvent Internal10.6.1 External10.7.1Apache Kafka DSPStreaming dataDataFY20 Spring LiDARproject delayed dueto COVID-19. Flightis planned for thisweek.InfoUSA businessdata has beenhelpful with COVIDresponse.https://octo.in.dc.gov/node/40081DC GovernmentOffice of the Chief Technology OfficerGeographic Information Systems - DC GIS
Current and Upcoming Big Data Projects: DCPS Attendance Data DDOT Dockless Trips Data DFHV TNC Data AnalysisCOVID-19 Response Mobility Data from multiple providers – 11 Billion Records AWS Connect Call Center – DHS, DCHR, DOH BarCloud PPE Inventory – Inventory (Assets and Stock), Issued, MovementJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerBig Data and Data Integration Updates
GIS – July 23rd (Via WebEx)contact Eva.Reid@dc.govTopics:*ESRI Conference Roundup*[Open Slot for presentation]Data Science @ DCNext Meeting: July 18th via MS Teamsor WebExTomash.Bukowiecki1@dc.govJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerGIS & Data ScienceUser Groups
Office of the Chief Technology OfficerIntroductory classIntermediate classJuly 16 and 17July 23 and coursesJune 30, 2020DC GovernmentVirtual Tableau Training
Office of the Chief Technology OfficerIntroductory trainingArchitect/Developer training Next training in late summer By invitation onlyVirtual training class will bemade available when gy-introductory-trainingJune 30, 2020DC GovernmentMicroStrategy Training
Office of the Chief Technology OfficerDCHR has cancelled all in person classes.Some direct virtual training will be available to staff on a limited basis.Some online courses available via ESRI Training Portal to employeeswith ArcGIS Online access. For recommendations, please contactEva.Reid@dc.govJune 30, 2020DC GovernmentGIS Training
Office of the Chief Technology OfficerDC GovernmentFree to all DC StaffRegister using DC ArcGIS Online or DC email accountContact Eva.Reid@dc.gov with questionsJune 30, 2020
Office of the Chief Technology OfficerMaking Sharing and Using Data easier since 2020!DC GovernmentJune 30, 2020Data Use AgreementMatthew SokolBig Data & Data Integration Program ManagerOffice of the Chief Technology Officer (OCTO)
If Data is Classified as June 30, 2020Then Level 0 DataNo DUA NeededLevel 1 & Level 2 [Routine Data]No DUA NeededLevel 1 & Level 2 [Non-RoutineData Sharing]Agency & OCTO Review toDetermine if DUA is NeededLevel 3 & Level 4 DataDUA NeededDC GovernmentOffice of the Chief Technology OfficerWhen Needed
1. Multi-Lateral agreements2. Define the Roles of all Parties to the agreement3. Automate workflow and changes4. Incorporate EDI5. Streamline and speed up execution of agreements6. Define Data Use, Misuse, Protections, SecurityJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerThe Goals
Agreement is designed to be executed among:June 30, 2020 Multiple DC Agencies Third Parties such as Universities, Non-Profits, COGsDC GovernmentOffice of the Chief Technology OfficerMulti-Lateral
Agreement creates three roles:June 30, 2020 Data Provider – supplies datasets, determines access, definesextended retention beyond project Data Receivers – defines scope of project, requests datasets,performs analysis Facilitator Agency – Usually OCTO, provides technology forstorage, ingestion, network, and security (e.g. Data Lake, Tableau,DCGov Network)DC GovernmentOffice of the Chief Technology OfficerDefining Roles
Agreement also defines users:June 30, 2020 Authorized User – user that has access to look at and work withdatasets after signing a Data Confidentiality Agreement Data Custodian – user appointed by Data Provider and DataReceivers to: Establish and maintain Authorized Users Add datasets to the agreement within certain Data Classification levels perthe DC Data Policy (e.g. Level 0 through Level 2, but not Level 3 or above) Coordinate between partiesDC GovernmentOffice of the Chief Technology OfficerDefining Roles
Create an application to automate the population andexecution of the agreement Captures project scope, datasets, parties, users and terms Uses existing information about agencies and datasets Creates a completed template for signatures Passes the agreement back and forth between partiesJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerAutomate Workflows
Enterprise Dataset Inventory will be the source of allavailable datasets for use in a project Provides an avenue to get additional datasets not part of theEDI to be added to the EDI before executing Populates agreement template with information about adataset from the EDI – Agency, Classification, Sensitivity FlagJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerIncorporate EDI
Data Use – What’s the scope of use for the data Data Misuse and Unauthorized Disclosure – What can’t weuse the data for and what happens if there is a data breachor authorized disclosure Data Protection – What are we doing to protect and securethe data and respond to breaches Data Classifications – per the DC Data PolicyJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerDefines Data .
Disposition of Data – Defines the terms of data retention ordeletion by Data Provider or extension of access to DataReceivers Use of data and analysis for validation or publication – Defineterms for providing datasets or derivative analysis to thirdparties for validation of results or publication of results withconsent by all parties Applicable Law – Defines applicable DC or US Gov statuesaround PII data (e.g. HIPAA, FERPA – sensitivity flag from EDI)June 30, 2020DC GovernmentOffice of the Chief Technology OfficerOther items of note
Tashrik AhmedCOVID-19 EpidemiologistDC HealthMichael BentivegnaProgram Manager for Data Visualization and AnalysisOffice of the Chief Technology -dataJune 30, 2020DC GovernmentOffice of the Chief Technology OfficerTracking Metrics & Phaseswith ReOpen DC Dashboard
Phase 2 ReopeningThe District of Columbia is closelymonitoring key public health signs toguide reopening the District in a waythat is safe, measured, data-driven,and sustainable.The timing of when to remove orreinstate social (physical) distancingand other policies to slow the spreadof COVID-19 will be determined inpart by the reopening metrics rus-data
Office of the Chief Technology OfficerElena SemenovaSenior Business and Data AnalystOffice of the Chief Technology OfficerDC GovernmentJune 30, 2020Web Maps in TableauWorkbooks with Esri
Web Data Connector: /arcgis-server.html
/941
Office of the Chief Technology OfficerMario FieldData Curation Program ManagerOffice of the Chief Technology OfficerDC GovernmentJune 30, 2020Data Report
Health Planning Neighborhood Health Planning NeighborhoodCensus Tract Main Street Subgrant Parking Zone Restricted Dockless ZoneJune 30, 2020 All available atopendata.dc.gov Published since lastmeeting, 4/23/20 Contributors: DC Health,OCTO, DDOTDC GovernmentOffice of the Chief Technology OfficerNew Datasets
Office of the Chief Technology OfficerBankCamera EnforcementCredit UnionGrocery StoreMoving ViolationNotary PublicParking ViolationPharmacyRecyling Pickup DaySmall Business Robust Retail GrantTrash Pickup DayDC GovernmentJune 30, 2020 Updated Data
June 30, 2020 BarCloud PPE Inventory Stock Movement Corona Virus Overall Numbers DCPS Daily Meal Distribution (EM GISServer) WebEOC Resource Request Line Item WebEOC Resource Request First Responder and Safe WorkplaceSupplyDC GovernmentOffice of the Chief Technology OfficerCorona Virus Data - Examples
DC GovernmentOffice of the Chief Technology OfficerQuestions?Thank you for joining. For notes and presentationmaterial amPresentation and Notes Materialshttps://opendata.dc.govJune 30, 2020
Tableau Public Production . 2020.1.3 . 9 Agency websites in production with 76 embedded Tableau Reports/ Dashboards. Tableau Test/Dev. 2019.2.4. MicroStrategy as a web connector. SharePoint list testing with MFA. Tableau Site Administrator quarterly meeting. Next meeting: est. July 9, 2020. Business Intelligence -Tableau Updates. Tableau Internal
