7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 1/7

Funnel_Stage

Funnel Stage:

Funnel stage is used to combine multiple input datasets into a single input dataset. This stage canhave any number of input links and single output link.

It operates in 3 modes:

Continuous Funnel combines records as they arrive (i.e. no particular order);

Sort Funnel combines the input records in the order defined by one or more key fields;

Sequence copies all records from the first input data set to the output data set then all therecords from the second input data set etc.

Note:Metadata for all inputs must be identical .

Sort funnel re!uires data must be sorted and partitioned by the same key columns as to be used by the funnel operation.

Hash Partition guarantees that all records "ith same key column values are located in the same partition and are processed in the same node.

7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 2/7

7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 3/7

$)Sequence:

7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 4/7

Note: n order to use sequence funnel !ou need to specif! "hich order the input lin#s !ouneed to process and also ma#e sure the stage runs in sequential mode$

%sually "e use se!uence funnel "hen "e create a file "ith header detail and trailer records.

%)Sort Funnel:

7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 5/7

Note: f !ou are running !our sort funnel stage in parallel& !ou should be a"are of the'ariousconsiderations about sorting data and partitions

Thats all about funnel stage usage in datastage.

7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 6/7

F(NN * S+,- . +H / ,* + M 0,MP*

&ome times "e get data in multiple files "hich belongs to same bank customers information.

In that time "e need to funnel the tables to get the multiple files data into the single file.( table)

For ' ample if "e have the data t"o files as belo"

y bank*e+id e+name e+loc*** tom sydney$$$ renu melboourne333 ,ames canberra--- merlin melbourne

y bank$e+id e+name e+loc

flo"er perth/// paul goldenbeach000 raun 1ucland222 ten ki"i

For Funnel take the ob design as

4ead and 5oad the data into t"o se!uential files.

#o to Funnel stage 6roperties and

&elect Funnel Type 7 8ontinous Funnel

( 9r 1ny other according to your re!uirement )

7/25/2019 Funnel datastage

http://slidepdf.com/reader/full/funnel-datastage 7/7

#o to output rag and drop the 8olumns

( 4emember &ource 8olumns &tucture &hould be same ) Then click ok

#ive file name for the target dataset then

compile and run th ,ob