Screen

../../_images/screenNode.png

The Clario Screen node is used to drop attributes that do not meet a set of user defined rules.

Connecting Sources

When connecting a data source to a Screen node, the Select Connectors dialog will open and require the user to specify if the data stream is the data source or the univariate source.

The data source is the set of data to which you want to apply the screen. The univariate source provides Univariate statistics which can be used when authoring rules.

To reassign the sources, terminate the connected links and reconnect the data streams.

Configuration

The Screen node has three configuration tabs: Define Rules, Select Attributes, and Write File.

Define Rules Tab

../../_images/screen_defineRulesTab.png

Manage Rules

The Define Rules tab has a default list of commonly used rules. You can use rules from this list or create new rules. At least one rule must be defined for the Screen node to be properly configured.

To create a new rule, click [New] to open the Expression Builder or click [Edit Code] to open the Code Editor.

To edit a rule, double-click on the rule to open the Expression Builder or click [Edit Code] to open the Code Editor.

Rules can be removed by selecting one or more from the the list and pressing [Delete].

Unique ClarioScript/Expression Builder Features

In the Expression Library

  • the [att] tab only contains attributes from the univariate source

In ClarioScript, screen rules are written in the form :SCREEN “name_of_screen_rule” = [screen expression]

Default Rules

  • Drop Attributes Where Coverage < 2%
  • Drop Attributes Where Mode Frequency % > 98%
  • Drop Attributes Where Distinct Values = 1
  • Drop Attributes Where Data Type = STRING
  • Drop Attribute Where Data Type = DATE

Select Attributes Tab

../../_images/screen_selectAttributesTab.png

Screen Attributes lists all attributes in the incoming dataset. Attributes left in this list are dropped/retained based on the rules listed in the Define Rules tab. To bypass rules for any number of attributes and include them in the outgoing dataset, drag and drop them into the Force Keep Attributes list. To bypass rules and drop any number of attributes from the outgoing dataset, drag and drop them into the Force Drop Attributes list.

Write File Tab

The Write File tab allows the Screen node to output the newly created dataset to a delimited file. This dataset contains only the attributes that were kept by the screen rules. See Write File Tab for configuration details.

Results

The Screen node results set contains two tabs: Summary and Keep Statement.

Summary

../../_images/screen_resultsSummaryTab.png

In the top box of the Summary tab is a list of the number of Incoming Attributes, Dropped Attributes, and Outgoing Attributes. Within that box is a table displaying the number and percent of incoming attributes dropped by each rule.

In the bottom box is a table displaying all the incoming attributes and an explanation of why they were dropped or kept. Attributes that were processed using a Force Keep or Force Drop are highlighted in blue or yellow, respectively. Attributes that were unaffected will have no rule listed next to them in the Dropped by Rule column.

Keep Statement

../../_images/screen_resultsKeepStatementTab.png

The Keep Statement tab displays the ClarioScript code for the attributes that were kept by the screen rules, including the Force Keep attributes. This code can be copied and pasted into the Code Editor of a Transform node.