Creating a Text Analytics Dataflow for Surveys

A Text Analytics Dataflow can be created from the Automation Survey page or the Manage page. If a survey has not yet been added to the hub, open the SmartHub application, go to your hub, and add to the hub the survey that is to be analyzed.

1. From the Automation page, click the drop down arrow next to + New Automation and click "Create text analytics dataflow".

The Text Analytics Dataflow setup page opens. Here you select the source from the available surveys in your SmartHub.


Figure 1 - The Automation page

Alternatively: From the survey overview page, click the Create a text analytics dataflow button.



In both cases, the Text Analytics Dataflow setup opens.


Figure 2 - The Text Analytics Dataflow setup

2. Select a source.

Once the source has been selected you must select which text fields from the survey are to be used for analysis.

3. Select one or more fields from the survey by checking the boxes next to them and clicking the +Add button, or you can drag and drop individual questions from left to right. If you have many text fields you can use the search function to narrow your selection.


Figure 3 - Selecting the text fields

From this dialog box you can also remove all text fields from the analysis using the -Remove All button, remove individual fields by selecting them in the right column and clicking the -Remove button, or by dragging and dropping from right to left.

4. Click the Next button to go to the setup screen for the Dataflow. Here you can name your dataflow, select your categorization model from the drop-down menu, employ a Studio filter expression, and select whether the dataflow will run continuously or set to it to manually. You can also store a comment about your dataflow.

The Model Selection box lists all models that you can access. If the list is large you can search by model name or id to narrow your options.

In the filter box you can employ any valid Studio filter expression to limit the data for analysis.


Figure 4 - Setting up the dataflow

5. Click the CREATE button to create your dataflow. The Dataflow overview page opens and if it is set to continuous processing it runs automatically. Setting up the TA dataflow will automatically create the four Custom Data tables where the analysis results are stored. Click here for further details.




Figure 5 - The four custom data tables

Note: If it fails you will get a notification to your email

From the Dataflow Overview page you can delete, edit or run the Dataflow manually by clicking the PROCESS NOW button. You can also select the dropdown and select to run only new or changed records, or process all records.

Note: This will only process all records that matche any filters you have applied.

Important: Verbatim data is kept on the Genius servers for 12 months after it was initially submitted, allowing reprocessing of already submitted data without additional charges. If verbatim data is to be reprocessed after the data has been removed after 12 months, it will be resubmitted, and another charge will incur per verbatim. You can use the date filter in your filter expression to limit on date.

Figure 6 - Example of the Dataflow Overview page

Duplicate Dataflows

It is possible to create a text analytics dataflow with same source and model combo.

If you attempt this, you will be presented with the following dialog:

Clicking the Create Anyway button will proceed with creating the duplicate data flow, or you can press Cancel to exit the operation.