Append

../../_images/appendNode.png

The Clario Append node is used to append the rows of two or more data streams.

Connecting Sources

  • Primary source: The first source attached. The outgoing stream will have the exact shape (attribute names and types) as the primary source.
  • Append Source: One or more additional sources to be appended to the Primary Source

When connecting a data source to an Append node, the Select Connectors dialog will appear and require the user to specify the Primary Source or an Append Source. The Append Source data will be appended to the end of the Primary Source in the outgoing data stream.

To reassign the sources, remove the connected links and reconnect the data streams.

Configuration

The Append node has a single configuration tab with three sections.

Append Configuration

Primary Attributes

The Primary Attributes List Box displays the attributes of the data stream connected as the primary source. The Primary Source defines the outgoing attributes.

Append Attributes

The Append Attributes List Box displays the attributes of each connected append source. Use the drop down selector at the top to choose which append source to display.

Match By

Select the algorithm to use when appending rows to the primary source. Match by “Name & Type” is the default algorithm.

Name & Type

Append source attributes are matched to the primary source by name and type. Each append source must contain the exact set of attributes as the primary source, but positions can differ. Missing or extra append source attributes are highlighted as errors in the Append Attributes List Box.

Primary Source

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04

Append Source

  • The append source has the same set of attribute names/types as the primary source.
ID BIRTHDATE AGE
S D N
“jkl” 1972-10-05 42
“mno” 1982-08-01 32
“pqr” 1969-09-24 45

Output Stream

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04
“jkl” 42 1972-10-05
“mno” 32 1982-08-01
“pqr” 45 1969-09-24

Name & Type - Lenient

Append source attributes are matched to the primary source by name and type. Append sources can have a different number of attributes than the primary source. Unmatched primary source attributes will be null-filled and extra append source attributes are dropped. Missing or extra append source attributes are highlighted in the Append Attributes List Box.

Primary Source

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04

Append Source

  • Birthdate is missing on the append source so it will be null-filled
  • Gender on the append source is not a primary source attribute so it will be dropped.
ID GENDER AGE
S S N
“jkl” M 42
“mno” F 32
“pqr” F 45

Output Stream

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04
“jkl” 42 null
“mno” 32 null
“pqr” 45 null

Position & Type

Append source attributes are matched to the primary source by row position and type. Each append source must have the same number of attributes and match on type in each position, but names can differ. Missing or extra append source attributes are highlighted as errors in the Append Attributes List Box.

Primary Source

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04

Append Source

  • Each attribute position has the same types (S, N, D) as the primary source (S, N, D).
Id2 age Bday
S N D
“jkl” 42 1972-10-05
“mno” 32 1982-08-0
“pqr” 45 1969-09-24

Output Stream

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04
“jkl” 42 1972-10-05
“mno” 32 1982-08-01
“pqr” 45 1969-09-24

Position & Type - Lenient

Append source attributes are matched to the primary source by row position and type. Append sources can have a different number of attributes as the primary source. Unmatched outgoing row attributes will be null-filled and extra append source attributes are dropped. Missing or extra append source attributes are highlighted in the Append Attributes List Box.

Primary Source

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04

Append Source

  • The types for the first and third attributes (Id_2:S, Bday:D) match the first and third primary source attributes (ID:S, BIRTHDATE:D)
  • The second attribute is now a string so it’s values are null-filled in the output stream
  • The fourth attribute does not exist on the primary source so it is dropped
Id2 age-str Bday Married
S S D N
“jkl” “42” 1972-10-05 0
“mno” “32” 1982-08-0 1
“pqr” “45” 1969-09-24 0

Output Stream

ID AGE BIRTHDATE
S N D
“abc” 24 1990-11-12
“def” 33 1981-07-06
“gji” 12 2002-03-04
“jkl” null 1972-10-05
“mno” null 1982-08-01
“pqr” null 1969-09-24
Output Stream

The data stream sent to the Append node’s outgoing connector contains the attributes and types displayed in the Configuration tab.