IBM WebSphere Transformation Extender (TX) High Level And Technical .

Transcription

IBM Software GroupIBM WebSphere Transformation Extender (TX)High Level and Technical Overview IBM Corporation

IBM Software Group WebSphere softwareWhat Does IBM WebSphere TX Do?It takes any kinds of data from their native formsANY DataProcesses them together, natively, with NO CODEMany-to-many IntegrationAnd outputs them into their native target formatsANY DataEx. - Hierarchical Data , Binary Data, Packed Data, Tabular Data, Relational Data, Nested Structures, Mixed-Type Data, and on and on 2

IBM Software Group WebSphere softwareTransformation Vision - Simplified Transform Anything Transform Anywhere Everyone Transforms3

IBM Software Group WebSphere softwareWhat Makes WebSphere TX so Different? Code-Free Design and Deployment In-Process Data Validation High Throughput Execution of ComplexTransformations and Enhancements One Engine, Multiple Deployment Options4

IBM Software Group WebSphere softwareExamples of Complex Transformation Challenges Addressedby WebSphere TX Data Enhancement Lookups Data Logic and Routing Data Validation Context Based Data and Usage Rules Many to Many Transformation Single-Transaction, interdependent data sets, conversions and logic Mixed Data and Source/Target Types Dependent Result Sets, Nested Structure Dependencies Complex Data Transformation Nested, Semi-structured And Hierachical Data Types Dependent Inputs And Outputs Binary, Packed, EBCDIC, ASCII, Mixed Character Data5

IBM Software Group WebSphere softwareOne Engine, Multiple Deployment Options WebSphere TX is the one transformation engine that can be reusedacross all applications and infrastructures in the enterprise Deploy the same WebSphere transformation asset across: ESB Unix 30 Adapters WebSphere Message Broker SOA Linux ETL WebSphere ESB Web Services Windows Data quality WebSphere Process Server SOAP EnterpriseApplications WebSphere Partner Gateway ApplicationServers WebSphere DataStage z/OS EJB– Batch HTTP– CICS Event driven– IMS Batch– USS WebSphere Application Server Java C/C COBOL6

IBM Software Group WebSphere softwareWTX Editions WTX for Application Programming Deploy transformations for Custom programming environment Third party App Servers WTX with Command Server Invoke transformation from command line, shell script or timer WTX with Launcher Activate transformation based on triggers such as – File Creation, DBMS trigger, Message on a queue, timer etc Graphical flow Editor to create Transformation flows. WTX for Integration Servers WTX for Message Broker merged with this edition Supports integration with WESB to build BPM solutions Simplifies installation and provides new bindings for WPS and WESB7

IBM Software Group WebSphere softwareWTX Enterprise Packs Accelerator for key Enterprise Applications WebSphere Transformation Extender Pack for PeopleSoft WebSphere Transformation Extender Pack for SAP R/3 WebSphere Transformation Extender Pack for SAP XI WebSphere Transformation Extender Pack for Siebel8

IBM Software Group WebSphere softwareWTX Industry Packs Financial Services FIX, NACHA, SEPA, SWIFTNet Fin and SWIFTNet Funds Healthcare HIPAA, HL7, NCPDP Insurance ACORD EDI X12, EDIFACT, Eancom, Odette, TRADACOMS9

IBM Software Group WebSphere softwareWTX Extension Pack WTX Design Studio Eclipse based tooling to develop, test, performance tune Transformations and metadata WTX SDK Programming API and documentations to invoke transformations from client application WTX Trading Manager Supports B2B Solution, complements Partner Gateway WTX Launcher Agent Inbound HTTP agent for WebSphere Transformation Extender with Launcher to listenand respond to HTTP requests. WTX Secure Adapter Collection Extends technology adapters of the base edition to encrypt and decrypt data accordingfor popular standards WTX SNMP Collection Enable integration with network management applications10

IBM Software Group WebSphere softwareWebSphere TX –A Long And Storied RoadV .V8.1V8.0Proven .V7.5V6.7Q4 2007Q3 2006*V6.5July 2005V6.0ReliableV8.2June 2004V5.0Jan 2003V2.1Jan 2002V1.4Sept 2001V1.3V1.2InnovativeJune 2000V1.1Dec 1999V1.0Aug 1997June 1996Nov 1995June 1995Jan 1994Mature*-Scheduled11

IBM Software GroupDeveloping a WebSphere TX Solution IBM Corporation

IBM Software Group WebSphere softwareThe Components of a WebSphere TX Solution A WebSphere TX solution is composed of the following:AdapterSourceType TreeRulesMappingType TreeAdapterDestination In other words An adapter is a technical connector which can be―plugged‖ into a source or destination - without parsing! A Type Tree is a graphical representation of meta-data Rules define how a Source structure is transformed toa Destination structure Together these components form a WebSphere TX Map13

IBM Software Group WebSphere softwareThe Components of a WebSphere TX Solution However many to many mapping is also possible:AdapterType TreeAdapterType TreeAdapterSourcesType TreeAdapterType TreeAdapterRulesType TreeMapping A Map can perform many tasks : Validation Enrichment, Content Based Routing etc. SOURCE FILEDestinationsDATABASE UPDATETRANSFORMED MESSAGEON OUTPUTCROSS-REFERENCETABLE14

IBM Software Group WebSphere softwareDeveloping a TX Solution We usually talk about three simple steps: Describe the data. Data that is handled by IBM WebSphere TX, are described in "Type Trees‖that define the data structure and semantics. Transform the data. Data is mapped between the source and destination using drag-and-drop. Deploy the transformation Multiple deployment models Batch Event Driven Tightly-coupled (through APIs) Loosely-coupled (RMI)15

IBM Software Group WebSphere softwareWebSphere TX Design EnvironmentDescribe the Data Properties Structure Validation RulesType DesignerDatabase InterfaceDesignerDefine Transformation RulesInterfaces Structure Formats SemanticsResources Communication AdaptersDeploy and Manage Flows Events MonitoringMap DesignerMessageBrokerLauncherCommandServer16

IBM Software Group WebSphere softwareDEVELOPMENTData Definition SupportsIndustry StandardsDESIGNDEVELOPMENTEXECUTIONData Definition – Built-in andAutomatedcompliance t, BizTalk–X12–Edifact–HIPAAData DefinitionTransformation and Routing RulesReusable Object LibraryData Definition – XMLCOBOLSQL (any ELS17

IBM Software Group WebSphere softwareDescribe the Data. IBM WebSphere TX Type Trees The Type Trees defines the structure of the data to be handled in IBM WebSphere TX. This XML structure is then represented as an IBM WebSphere TX Type Tree.18

IBM Software Group WebSphere softwareIntegration: Metadata Automatic data definitions: Importers Built-in data definitions XML DTDs, Schema– EDI, HL7, SWIFT, ACORD COBOL Copybooks– All definitions aremodifiable through GUI Database Structures Application Definitions SAP: BAPI, Idoc, DXOB, BDC PeopleSoft 7: Business Document, Message Agent PeopleSoft 8: Application Messaging, ComponentInterface Siebel: COM Business Object, EAI, EIM WSDL (Web Services) EJB API Java Class Java Messaging Service Other: Tuxedo, text files19

IBM Software Group WebSphere softwareBuilt-in Validation (Restrictions)Items haveextensive validationoptions Enumerations Exclusions(with substitution) Patterns Ranges20

IBM Software Group WebSphere softwareAdditional Built-in Validation Component Rules allow cross-field validation Incorporates semantic validation directly into the parsing process21

IBM Software Group WebSphere softwareAdditional Built-in Validation Component Rules support aggregate functions Use component rules to specify conditions (business rules) that mustbe met for a particular component to be valid22

IBM Software Group WebSphere softwareTransform the Data. The Type Trees for input and output are added to IBM WebSphere TXMap Designer. For each input and output, or ―card‖, an adapter and a data sourceare defined. IBM WebSphere TX can handle several inputs to one or moreoutputs, and vice-versa. The mapping is a simple drag and drop from the input source to theoutput target. For each field in the output card, rules can be added--for example,mathematical formulas, conversions, etc. More than 150 different rules, similar to MS Excel formulas, areavailable through a self-describing wizard.23

IBM Software Group WebSphere t Design Delivers One Set of LogicObject Design – One set of logic, regardless ofplatform, protocol,communication layer ordatabaseWorld-class transformationwith no 3GL codingRecognized industry leaderwith 140 partners imbeddedData DefinitionTransformation and Routing RulesReusable Object LibraryObject Design – Highly reusableContent-based anddynamic routingMany-to-many in a singlepassScaleable and Efficient24

IBM Software Group WebSphere softwareMap Designer Create maps to: Validate data from data sources Identify data targets Specify data transformation logic (rules)25

IBM Software Group WebSphere softwareIdentifying Data Sources and TargetsIdentify type tree and typetree components that definedata targetIdentify type of data andlocation of data26

IBM Software Group WebSphere softwareWebSphere TX AdaptersCommunicationMessaging CICS COM CORBA E-MAIL FTP/FTPS HTTP/HTTPS JAVA Class JCA Gateway SOAP SOCKET VAN BEA MessageQ & Tuxedo Candle Roma IBM WebSphere MQ(MQSeries) JMS Microsoft MSMQ Oracle AQ TIBCO RendezvousApplicationsSiebel- BIM, EIM, OI COM SAP R/3 & BW- ALE, BDC, DMI, DXOB- BW, EDI, BAPI PeopleSoft- Message Agent API,- Open Query, EDI QualityStageDatabase DB2 Informix ODBC OLE-DB Oracle Microsoft SQL Server Sybase HP NonStop SQL/MX &SQL/MPWebSphereTXDesign StudioExtended AdaptersUtility Archive (ZIP/TAR) Base 64 Batch File GZIP/ZLIB JNDI LDAP MIME Quoted-Printable Shell Script Sink SNMP XMLSecurity S/MIME OpenPGP SSL Module27

IBM Software Group WebSphere softwareCreating transformation rules Drag and Drop No Procedural Coding!! Easily represent complex business rules28

IBM Software Group WebSphere softwareMap Rules Describe how to build an output data object Color-coded for readability Can combine hard-coded values (literals),WebSphere TX functions, object names andfunctional map references Are required for every output object29

IBM Software Group WebSphere softwareBuilding a Map Analyzes logical interfaceswithin map rule Build errors prevent mapfrom being compiled Build warnings alert ofcondition that might beproblematic Creates compiled map file For current platform For selected platform, whichaccounts for byte-order andcharacter set differences onthat platform30

IBM Software Group WebSphere softwareDeveloping a TX Solution –An Example Putting It All TogetherMultiple Deployment Options1. Describe the data2. Transform the data3. Deploy the transformation Batch & Standalone Event Driven WebSphere Message Broker WebSphere ESB WebSphere Process Server WebSphere Partner Gateway WebSphere Application Server WebSphere DataStage, etc.Z/OSAIXDeployMQCOBOL ImporterCopybookMapImporterOracleDesign Studio31

IBM Software GroupWebSphere TX in Eclipse IBM Corporation

IBM Software Group WebSphere softwareEclipse GUI Uses the same Eclipse platform as otherWebSphere Products Ability to plug into other Eclipse WID Take advantage of any Eclipse plug in Application based on Project, making it easier toimport and export all artifacts together Shared Library can be used across projects Invoking maps from WESB Mediation Module Invoking maps from WPS Module33

IBM Software Group WebSphere softwareEclipse GUI With Transformation Extender Perspective34

IBM Software Group WebSphere softwareSharing WID with WESB or WPSWPS ModuleWTX ProjectWTX Library35

IBM Software Group WebSphere softwareWizard to Create Map Template based onBusiness Object36

IBM Software Group WebSphere softwareExecutable Maps are Sharable in Library37

IBM Software Group WebSphere softwareIntegration through Data Binding38

IBM Software Group WebSphere softwareIntegration through Data Binding for JMS, MQ andHTTP exports and imports39

IBM Software Group WebSphere softwareIntegration through Data Handler for FlatFile, FTPand Email imports and exports40

IBM Software Group WebSphere softwareParticipating in WESB Mediation Module41

IBM Software Group WebSphere softwareParticipating in WPS Module42

IBM Software Group WebSphere softwareMap Testing2. Run the Map1. Build the Map3. View Results43

IBM Software Group WebSphere softwareIntegrated Testing2. Fill in the Test Data1. Select Component to Test3. Start the Test44

IBM Software Group WebSphere softwareIntegrated Testing5. Wait for Operation to Complete4. Select DeploymentLocation6. View Output Results from JMS Client45

IBM Software Group WebSphere softwareSecond Implementation Option: Use Java API// Load a mapMMap map new MMap(mapName, workDir , mapBytes);// Get the adapter object handle for input card #1MCard card map.getInputCardObject(1);// Override the adapter in input card #1 to be a streamcard.overrideAdapter(null, MConstants.MPI ADAPTYPE STREAM);// Get the handle to the stream objectMAdapter adapter card.getAdapter();MStream stream adapter.getOutputStream();// Send a single large pagestream.write(inBytes, 0, inBytes.length);// Get the adapter object handle for output card #2card map.getOutputCardObject(1);// Override the adapter in output card #2 to be a streamcard.overrideAdapter(null, MConstants.MPI ADAPTYPE STREAM);// Run the mapmap.run();46

IBM Software GroupWebSphere TX Demonstration IBM Corporation

IBM Software Group WebSphere softwareWebSphere Universal Mapping Tool WTX has become WebSphere’sUniversal Mapping Tool The Same Map can Plug into WebSphereMessage Broker node Plugs into WebSphere Partner Gateway Runs in WebSphere Data Power Data Transformation can now be donewithout any Coding48

IBM Software Group WebSphere softwareChief Value Differentiators of WebSphere TX toalternative transformation methods Powerful Transform capabilities with No Coding Lowers cost to implement, maintain and re-use High-Throughput, Complex Transformations Cost per transaction very low Natively Handles Any Data Type Never resort to ―flattening‖ or ―re-structuring data‖ Data integrity and meaning are never lost In Process Data Validation Greatly reduces development efforts and implementation costs Solve Really Hard problems, in less time, with onecommon design method49

IBM Software Group WebSphere softwareSummary—What WebSphere TX ProvidesInteroperability Connect applications, databases, processeswithin the enterpriseSpeed Easy design and implementation No re-training Partners, processes across enterprises Fast maintenance without coding Powerful transformation and routing Rapid adaptation to changeSimplified ComplexityAdaptability Graphical integration views Leverage your proven IT infrastructure Consistent approach to multiple types of Fully support your choice of IT investmentsintegration Reusable objects(i.e. messaging middleware ) Non-invasive integration ―Snappable‖ modules50

IBM Software Group WebSphere softwareGrazieItalianThaiTraditional ChineseObrigadoRussianMerciBrazilian plified ChineseJapanese51

IBM Software Group WebSphere software 6 One Engine, Multiple Deployment Options WebSphere TX is the one transformation engine that can be reused across all applications and infrastructures in the enterprise Deploy the same WebSphere transformation asset across: ESB SOA Web Services SOAP EJB HTTP Event driven Batch Java