Informatica Checkpoint Recovery

download Informatica Checkpoint Recovery

of 4

Transcript of Informatica Checkpoint Recovery

  • 8/13/2019 Informatica Checkpoint Recovery

    1/4

    Please rate this solution and share your feedback on Marketplace Website.

    Name of Solution:

    Workflow: Session Recovery - Relational Source

    Business Requirement:

    Demonstrates the inbuilt recovery features available in PowerCenter to recover a failedSession with relational source.

    Solution URL:

    https://community.informatica.com/solutions/1865

    Supported Versions:

    PowerCenter 9.1 and 9.5

    Description:

    When a PowerCenter workflow fails, it is the part of the operations teams responsibility totroubleshoot the issue and successfully complete the workflow. A PowerCenter workflowfails when a task (e.g. Session) inside the workflow fails for various reasons. When the rootcause of the issue is understood and fixed the workflow will be recovered.

    When you recover a workflow, the Integration Service recovers the tasks based on therecovery strategy for each task. Depending on the task, the recovery strategy can be failtask and continue workflow, resume from the last checkpoint, or restart task.

    When you configure session recovery to resume from the last checkpoint, the IntegrationService creates checkpoints in $PMStorageDir to determine where to start processingsession recovery. When the Integration Service resumes a session, it restores the sessionstate of operation, including the state of each source, target, and transformation. If themapping uses a non-repeatable and non-deterministic relational source, (i.e. The order ofdata and the number of rows is not guaranteed to be the same during recovery) , thesource data is cached to be used during recovery.

    This block illustrates the session recovery features when the session is configured to resumeand has non-repeatable and non-deterministic relational source.

    Download file contents:

    1. Workflow2. Source File3. Script

    Steps to implement the solution:

    1. Place source file in $PMSourceFileDir folder. Execute the script to create the targettables.

    2. Import workflow using the Repository Manager. Select the appropriate folder fromthe repository and resolve the conflicts by choosing suitable option.

    https://community.informatica.com/solutions/1865https://community.informatica.com/solutions/1865
  • 8/13/2019 Informatica Checkpoint Recovery

    2/4

    Please rate this solution and share your feedback on Marketplace Website.

    3. Open the workflow in Workflow Manager. Assign the integration service in Workflow -> Edit -> Integration Service

    4. Edit session and assign valid connection object for the source and target.

    5. For more details of importing object please visit our YouTube link.

    6. To set up the demo, start the workflow wf_load_relational_source to load the tableT_LINEITEM. Now the source data for the session recovery demo is ready.

    7. Note that the workflow wf_Session_Recovery is enabled for recovery by checkingthe option Enable HA Recovery in the properties tab.

    8. Start the workflow wf_Session_Recovery . After an elapse of 15 seconds, abort the

    workflow wf_Session_Recovery . Observe the workflow monitor a s below.

    9. Before recovering the session or workflow, to verify that cached source data is used

    during recovery, truncate the table T_LINEITEM.

    http://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJhttp://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJhttp://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJhttp://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJ
  • 8/13/2019 Informatica Checkpoint Recovery

    3/4

    Please rate this solution and share your feedback on Marketplace Website.

    10. Recover the workflow or the session task. Observe the workflow monitor after

    completion as below.

    11. After the session is successful use the below query to verify the results

    Select to_char(insert_dt,'YYYYMMDD HH24:MI:SS'), count(*) from T_ORDER_QTY

    Group by to_char(insert_dt,'YYYYMMDD HH24:MI:SS')

    For example, the please review the below result

    We can notice that the 350 rows were created before the session was aborted and

    the rest of the rows were created during the recovery run started after

    approximately 11 minutes

    12. We can also observe that:

    1. The target table was not truncated again during session recovery run.

    2. The target rows already committed to the target were ignored

    3. The source data was read from the recovery cache.

    4. During the complete process you can observe the changes in $PMStorageDir

    folder. After aborting folder looks as below.

  • 8/13/2019 Informatica Checkpoint Recovery

    4/4

    Please rate this solution and share your feedback on Marketplace Website.

    After completing most the checkpoint files will be removed.

    YouTube Video on Importing and Configuring Workflows:

    http://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJ

    Other Useful links:

    Mapping Bundles Workflow Bundles Informatica Tools Bundles Informatica for Social Media Bundles Debugging Tools Bundles

    Visio Templates Bundles B2B Templates and Projects Bundles Data Quality Packs and Plans Bundles Script Bundles

    http://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJhttp://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJhttps://community.informatica.com/docs/DOC-3003https://community.informatica.com/docs/DOC-3003https://community.informatica.com/docs/DOC-3004https://community.informatica.com/docs/DOC-3004https://community.informatica.com/docs/DOC-3032https://community.informatica.com/docs/DOC-3032https://community.informatica.com/docs/DOC-3033https://community.informatica.com/docs/DOC-3033https://community.informatica.com/docs/DOC-3034https://community.informatica.com/docs/DOC-3034https://community.informatica.com/docs/DOC-3035https://community.informatica.com/docs/DOC-3035https://community.informatica.com/docs/DOC-3036https://community.informatica.com/docs/DOC-3036https://community.informatica.com/docs/DOC-3037https://community.informatica.com/docs/DOC-3037https://community.informatica.com/docs/DOC-3005https://community.informatica.com/docs/DOC-3005https://community.informatica.com/docs/DOC-3005https://community.informatica.com/docs/DOC-3037https://community.informatica.com/docs/DOC-3036https://community.informatica.com/docs/DOC-3035https://community.informatica.com/docs/DOC-3034https://community.informatica.com/docs/DOC-3033https://community.informatica.com/docs/DOC-3032https://community.informatica.com/docs/DOC-3004https://community.informatica.com/docs/DOC-3003http://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJ