Scribe insight 04 insight 7.9.0

Insight 7.9.0

New Features Deep Dive

4

Session Abstract

This session will cover details around the threading capability of Insight with non-queue based integrations, and how to apply this new feature. During the discussion you will hear detailed information regarding the processor grouping feature, such as, where it is available and how consultants should approach projects where they want to utilize this feature. We will also share best practices around new global connections such as moving from test to prod. During the discussion we will preview new features coming out this fall.

© 2015 Scribe Software Corporation. All rights reserved. 5

Insight 7.9.0 New Features Agenda

• Intro and Overview of New Features

• New Feature Deep Dives

CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 6

Build

• Workbench provides UI for:

◦ Building data and logical transformations

◦ Testing

• Adapters connect and provide:

◦ Access to data and metadata

◦ Application-specific processing

Manage

• Platform provides automated processing but also much more

• It is how you save, manage, and communicate the parameters that define your integration environment.

◦ Source system knowledge

◦ Server resource considerations

◦ Message queueing and delivery

◦ Process multi-threading

◦ Target system knowledge

◦ Error handling and notifications

Insight Overview


Insight 7.9.0 New Features: Overview

• Global DTS connections

• Configure services during install

Usability/Install

• New multi-processor capabilities

Processing Control

• Message Processor Groups

Processing Control: Enterprise Focus

CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved.

Insight 7.9.0 New FeatureGlobal DTS Connections

What’s New?

How it Works

Transporting DTS Files and Connections

What’s Next?


Global DTS Connections: What’s New?

• Connection storage moved from DTS files to internal database

◦ Single point of modification for connection changes

◦ All DTS connections with the same name point to the same set of connection credentials and parameters



• Usage field in the Connection Manager is re-purposed

◦ Differentiate between global connections and DTS connections



• Connection dialogs in the Workbench are reorganized to highlight:

◦ Global connection parameters – required to establish the connection

◦ DTS Connection parameters – options and settings


Global DTS Connections: How it Works3 Questions

• How did we change the storage of connection information?

• How are we handling connection transport for…

◦ DTS upgrades?

• Connection transport from legacy systems

• Conversion from DTS storage to database storage

◦ DTS sharing?

• Connection transport from peer Insight servers

• Movement of connections between Scribe databases


Global DTS Connections: How it WorksStorage

• Connection information is stored in the internal database.

• Two tables:

◦ DATAPROVIDERS – standard Scribe connection properties (username, password, connection type, etc.)

◦ DRSPROPERTIES – connection-specific properties (Dynamics CRM org name, etc.)

• Identifiers (GUID, connection name) stored in the DTS.


Global DTS Connections: How it WorksTransport

• Transporting DTS Files and Connections

◦ From older versions of Insight

• Change in the definition of “unique connection”

• De-duping and merging of connections

◦ From one environment to another (e.g. test to production)

• DTS files no longer contain connection information

• Re-creation of connection list in a new install


System Upgrades• Design Challenge

◦ Changing from unique/DTS to unique/Insight Server

• What makes a connection unique?

◦ Connection Parameters◦ Name

• Supporting Insight UI Changes

• User Technique

◦ “Clean” legacy connections

Environment Migrations• Design Challenge

◦ DTS no longer contains the connection parameters

• What makes a connection unique?

◦ GUID◦ Name

• Supporting Insight UI Changes

• User Technique

◦ Import/Export

Transporting DTS Files and Connections

20

Duplicate Connection Parameters

21

Duplicate Connection Name


Global DTS Connections: What’s Next?

• Connection Substitutions

◦ Unlimited connection substitutions during transport

◦ Target connection substitutions


Insight 7.9.0 New FeatureConfigure Service Credentials During Install

What’s New

How it Works

What’s Next?


Configure Service Credentials: What’s New?

• Ability to set your Scribe service user during install

◦ Prompted for Windows user credentials

◦ One less step to perform after the install


Configuring Service Credentials: How it Works

• Accessible when the internal database is installed using Windows authentication

• Credentials are not tested


Configuring Service Credentials: What’s Next?

• Ability to configure Windows user service log on when internal database installed using SQL authentication

◦ Services still need proper network rights

◦ Best practice is not to have services log on as LocalSystem

• Service user name preserved during upgrade

◦ Dialog auto-populated


Insight 7.9.0 New FeatureMore Multi-Processor Capabilities

What’s New?

How it Works

Tips and Tricks


Multi-Processors: What’s New?

• File-, time-, and query-based Integration Processes

◦ Could previously only run sequentially

◦ Can now run either simultaneously or sequentially

• New field determines if the DTS will run…

◦ Sequentially, through a single process

OR

◦ From the ScribeIn queue: multiple processors can be pulling DTS files out of the queue at the same time


Multi-Processors: How it Works

ScribeInQueue

EventManagerService

PublishersF,T,Q Processes

Serial Processor Group

Default Processor Group

MessageServerService


Multi-Processor: Tips and Tricks

• DTS process initiation is multi-threaded

◦ Row processing is not

• Route around processes with long run-times

◦ Periodic critical data refreshes don’t need to be blockers

• Resource considerations

◦ Feature addresses queueing (not resource) bottlenecks


Message Processor Groups

What’s New?

How it Works

Tips and Tricks


Message Processor Groups: What’s New?

• Available with Enterprise licenses

• Previously

◦ A Single message processor pool pulling from a single queue

• Now

◦ Multiple processor pools pulling from multiple queues

• New UI for defining groups and associated queues


Processor Groups: How it Works

ScribeInQueue

Serial Processor Group

Publishers

Default Processor Group

User Defined Processor Groups


Message Processor Groups: Tips and Tricks

• Guarantee simultaneous processing

◦ Process routing and priority

◦ Isolate processes

• Resource considerations

◦ Similar to multi-threading feature


Q+A


THANK YOU

Scribe insight 04 insight 7.9.0

Education

Transcript of Scribe insight 04 insight 7.9.0