Friday, 24 September 2021

Abinitio - Partitioning and De-Partitioning Component

There are two types of partitioning components: partition components, which create data partitions, and departition components, which combine multiple flow partitions or multiple straight flows into a single flow:

De-Partitioning Component 

CONCATENATE appends multiple flow partitions of records one after another.

GATHER arbitrarily combines records from multiple flow partitions.

INTERLEAVE combines blocks of records from multiple flow partitions in a round-robin fashion.

MERGE combines records from multiple flow partitions that have all been sorted according to the same key specifier and maintains the sort order.

Partitioning Component

BROADCAST arbitrarily combines all the records it receives into a single flow and writes a copy of that flow to each of its output flow partitions.

PARTITION BY EXPRESSION distributes records to its output flow partitions according to a specified DML expression.

PARTITION BY KEY distributes records to its output flow partitions according to key values.

PARTITION BY PERCENTAGE distributes a specified percent of the total number of input records to each output flow.

PARTITION BY RANGE distributes records to its output flow partitions according to the ranges of key values specified for each partition.

PARTITION BY ROUND-ROBIN distributes records evenly to each output flow.

PARTITION WITH LOAD BALANCE distributes records to its output flow partitions, writing more records to the flow partitions that consume records


No comments:

Post a Comment

how to create dml dynamically in Ab-initio

 $[ begin let int i = 0; let string(int) complete_list = "emp_nm,billable,age,designation,location"; let string(int) file_content ...