Release Information

Label

About WPS Analytics 4

For a more generalised overview of the current features of WPS not just the 'new' features summarised below, please refer to the Products section.

Release Date

  • WPS Analytics version 4 was released on 27 Mar 2018.
  • WPS Analytics version 4.0.1 was released on 28 Jun 2018.

Related Documents

Please visit the Documentation section to view Documents For WPS Version 4.


Box open

What's New in WPS Version 4.0.1?

  • Updates and Enhancements

    WPS 4.0.1 provides fixes and minor enhancements.

Box open

What's New in WPS Analytics Version 4?

This version includes many innovations and improvements, including the new Workbench Workflow Environment, new and updated procedures, new core functionality, centralised enterprise management and much more. The new and updated features in this version are described in this document.

Workflows

WPS Analytics version 4 introduces visual predictive data modelling tools using the Workbench Workflow perspective for data mining, predictive modelling tasks, and machine learning.

Workflows are ideal for data science tasks including preparation and interactive exploration of data and interactive modelling. The Workflow perspective provides a series of interactive tools through the Workflow Editor that enable access to the machine learning capabilities of WPS Analytics, and the ability to explore data through the Data Profiler.

A workflow is created by combining interactive functional blocks from the palette of drag-and-drop features in the Workflow Editor, using the workflow to connect to data, manipulate that data and use machine learning to discover predictive relationships in your data. The graphical Data Profiler enables deeper investigation of data used in the workflow through its graphical views and predictive insights.

Once created, a workflow is re-usable, so can be used with different input datasets to generate similarly filtered or manipulated output datasets.

While already a powerful set of features, the current version of the Workflow perspective offers a small subset of capabilities from the overall vision of the module. Additional modelling and data handling facilities will be added to future releases.

The Workbench retains the existing SAS Language programming environment for ‘classic’ SAS language programming and output handling, enabling programmatic use of the new features introduced with this release.

New platform support

With Version 4.0, WPS is now also supported on Linux on PowerPC Little Endian architecture.

SAS language support

The SAS language support comprises formats, options, statements, call routines, procedures and other syntax that makes up the language of SAS.

In this release of WPS:

  • New features have been added to the Output Delivery System (ODS)
  • Remote Library Services are now available
  • Libname JSON has been added
  • Various statements, formats, informats, and system options have been added, updated and improved

Output Delivery System

The Output Delivery System (ODS) produces output in various formats. Existing ODS features have been significantly enhanced and augmented in this version of WPS. New features are described in the following sections.

File PRINT ODS

FILE PRINT has been updated for this release. FILE PRINT provides an option that enables ODS to format output from a DATA step. It creates an ODS output object and binds it to a table template, providing a mechanism to map dataset variables to table columns.

The PUT statement now supports the _ODS_ option, which puts all variables referenced in: FILE PRINT ODS COLUMNS = sub-options

See the section File in the WPS Reference for Language Elements.

TEMPLATE procedure

The following new statements affecting the ODS output have been added to the TEMPLATE procedure:

  • DEFINE TABLE
  • DEFINE COLUMN
  • DEFINE FOOTER
  • DEFINE HEADER

These statements are not supported with the ODS LISTING output. For information on these statements, see the TEMPLATE procedure in the WPS Reference for Language Elements.

Note:

Any templates generated with a previous version of WPS and saved in an itemstore must be regenerated with WPS version 4.

ODS ESCAPECHAR

ODS now enables you to insert formatting codes into strings, which when displayed using ODS will be rendered appropriately. To use this feature, specify ODS ESCAPECHAR with an escape character. This escape character is then used to identify lines to be rendered using defined styles.

For example, you could specify ODS ESCAPECHAR = '^', and then prefix the lines to be output with the ^ character:

^{style [color=yellow] 1st} ^{style [font_size=16] row}.^{style [font_weight=bold] BOLD!}

The escape character can be any character not already reserved in the language of SAS.

See the section File in the WPS Reference for Language Elements.

ODS GRAPHICS

The ODS GRAPHICS statement is now available, and is OFF by default

ODS Updates

ODS has been updated:

  • Tagsets now support HTMLSTYLE and HTMLCLASS options.

    HTMLCSS now supports:

    • PRETEXT, PREHTML, POSTTEXT and POSTHTML style attributes on a BODY element.
    • The TEXTDECORATION, WATERMARK, LINKCOLOR, VISITEDLINKCOLOR, FONT_WIDTH, ASIS style attributes.
  • The ExcelXP tagset now supports:
    • The SHEET_INTERVAL=BYGROUP option.
    • Auto-bygroup naming of worksheets.
    • PRETEXT, PREHTML, POSTTEXT and POSTHTML options.
  • ODS PDF now:
    • Provides the attribute CSSOVERFLOW=, which can be set to VISIBLE or CLIP, that controls spilling of cell contents.
    • Provides the attribute OUTPUTBY, which can be set to PAGE or TABLE, that enables long tables to be output more quickly.
    • Supports graphical images stored in multi-page PDF format.
  • TITLE and FOOTNOTE statements now support styling.
  • ODS HTML now supports the TEXTDECORATION attribute.

System options

Updates and additions have been provided for system options:

  • ALTLOG is now available. It can be used to copy all text written to the main log in a specified location.
  • LOGPARM now supports the ROLLOVER and OPEN=REPLACEOLD options.
  • LOG now supports naming directives enabling the creation of a unique log file name.
  • ENCRYPT is now available. It can be used to specify the encryption method when encrypting WPD datasets.
  • ENCRYPTKEY is now available. It specifies the passphrase to be used when reading from or writing to encrypted WPD datasets.
  • TRANSACTEDFILESLOCKINGBLOCKS is now available. It can be used to block potentially conflicting operations on files already in use.
  • USER can now be set both in configuration files and as a start-up option.
  • SOFTCONFIG now has a COMPRESS option; setting this to YES enables intermediate sort files to be compressed using run-length encoding (RLE).
  • The maximum value for LRECL can now be 32767.

See the section System Options in the WPS Reference for Language Elements.

Formats and informats

The following format has been updated:

  • BESTw.d is now a synonym for a DOLLAR informat that has a default width of 12.

The following have been added:

  • DMYAMPM format and informat.
  • MDYAMPM format and informat.

Global statements

The global statement RESETLINE is new at this release. This statement resets the line numbering in the log to 1.

See the section Global statements in the WPS Reference for Language Elements.

Components

The following components have been updated:

  • HITER now supports the PREV and LAST statements.
  • The HASH ADD method now reports an error if the incorrect number or type of variables are specified.

DATA step statements

The following DATA step statements have been updated at this release:

  • SET and MERGE can now use pattern (colon operator) and range parsing with dataset names.
  • WHERE now accepts a name literal.
  • The iterative DO now checks that the loop variable has not already been defined as an array.

See the section DATA step statements in the WPS Reference for Language Elements.

DATA step functions

The following is now available for Windows:

  • WAKEUP – This function suspends the DATA step until a specified time.

See the section Special functions and CALL routines in DATA step functions and CALL routines in the WPS Reference for Language Elements.

The following function has been updated at this release:

  • FOPEN – This function can now open, for read and update, VSAM datasets on z/OS.

See the section External functions in DATA step functions and CALL routines in the WPS Reference for Language Elements.

The following functions have been added at this release:

  • SHA1, SHA256, SHA384, SHA512, CALL_AES256ENC and CALL_AES256DEC - These enable you to create hashes (message digests) using SHA-1 and functions in the SHA-2 family. See the section Cryptographic functions in DATA step functions and CALL routines in the WPS Reference for Language Elements.
  • JSONPP, which enables formatting of JSON code. See the section Miscellaneous functions in DATA step functions and CALL routines in the WPS Reference for Language Elements.

Libname JSON

JSON has been added as an available engine for LIBNAME. This enables you to read and write data in JSON (JavaScript Object Notation) format.

Operational research procedure

The following operational research procedure has been added:

  • SHEWHART - Enables you to specify Shewhart's statistical process control.

Machine learning procedures

The following machine learning procedures have been added:

  • DECISIONTREE - Creates a regression or classification tree that can be used to predict the value of a target variable from one or more input variables.
  • GMM - Fits a Gaussian mixture model to a multivariate distribution where the number of components in the mixture may be unknown.
  • MLP - Creates a Multilayer Perceptron (MLP) neural network – a non-linear machine learning algorithm used for classification and regression.
  • OPTIMALBIN - Determines the best way to group observations according to the value of an input variable, while ensuring that the grouped data can still be used to accurately predict the value of a target variable.
  • SEGMENT - Fits a cluster model to data that might contain discrete variables, and where the number and composition of the clusters is unknown.
  • SVM - Creates a Support Vector Machine that can be used to analyse classification or regression data to predict the value of a target variable.

For information on these procedures, see WPS Machine Learning.

General procedures – new

The following general procedure has been added:

  • TABLEAU - Exports a dataset to a Tableau extract.

General procedures – enhanced

The following general procedures have been enhanced:

  • CIMPORT - Can now read from and write to version 9.4 files.
  • CPORT - Can now read from and write to version 9.4 files.
  • COPY - Can now copy data views in a source library into datasets in a destination library.
  • FREQ - The TABLES statement now includes the TESTF and TESTP options.
  • IMPORT - Now uses name literals to facilitate complex column names and improve import of delimited data sources. Now retains white-space at the end of Excel sheet or range names.
  • MEANS and SUMMARY - Both procedures can now calculate P20, P30, P40, P60, P70 and P80 statistics.

For information on these new procedures, see the section Procedures in the WPS Reference for Language Elements.

Statistical procedures – new

The following statistical procedures have been added:

  • BIN - Bins data.
  • GLMSELECT - Enables effect selection within general linear models.
  • ICLIFETEST - Analyses interval-censored data.
  • MDS - Fits multidimensional scaling models to data.
  • MIANALYZE - Analyses the datasets generated by procedures that have used imputed missing values created by PROC MI.
  • PLS - Fits a partial least squares model to input data, and provides principal component regression and reduced rank regression.
  • POWER - Determines the power function of a distribution.
  • TRANSREG - Fits a specified model to a set of transforms.

For information on these procedures, see the section WPS Statistics in the WPS Reference for Language Elements.

Statistical procedures – enhanced

The following procedures have been updated and enhanced at this release:

  • GENMOD - Now supports the following statements:
    • CONTRAST
    • ESTIMATE
    • DIST=TWEEDIE
  • GLM - Now supports:
    • the following statements:
      • CONTRAST
      • ESTIMATE
      • RANDOM
    • The REF option of the CLASS statement.
  • GLMMOD - Now supports:
    • The REF option of the CLASS statement.
  • LIFEREG
    • Now supports the ESTIMATE statement.
  • LOGISTIC - Now supports:
    • The following option with the PROC LOGISTIC statement:
      • ROCOPTION
      • SIMPLE
    • The following statements:
      • CONTRAST
      • ROC
      • ROCCONTRAST
      • TEST
      • ESTIMATE
    • The following options with the MODEL statement:
      • BINWIDTH
      • CLODDS
      • NOFIT
      • NOODDSRATIO
      • SELECTION=SCORE
  • MI - Now supports:
    • The following statements:
      • FCS
      • CLASS
      • MONOTONE
      • The following option with the MCMC statement:
        • IMPUTE=MONOTONE
  • MIXED - Now supports:
    • The following statements:
      • CODE
      • ID
      • ESTIMATE
      • CONTRAST
      • LSMEANS
    • The REF option of the CLASS statement.
  • PHREG - Now supports:
    • The following statements:
      • BASELINE
      • ESTIMATE
    • The following options with the TIES statement:
      • DISCRETE
      • EFRON
      • BRESLOW
  • PROBIT
    • Now supports the ESTIMATE statement.
  • VARCLUS
    • Now supports ODS graphical output.

For detailed information on these updated procedures, see the section WPS Statistics in the WPS Reference for Language Elements.

Time series procedures – new

The following time series procedure has been added:

  • PROC LOAN -Enables you to calculate various aspects of a loan, such as the principal, repayment amounts, balloon payments, and so on.

For information on this procedure, see the section WPS Timeseries in the WPS Reference for Language Elements.

Time series procedures – enhanced

The following time series procedure has been updated:

  • ARIMA -The OUT option is now available on the PROC ARIMA statement.

For information on this procedure, see the section WPS Timeseries in the WPS Reference for Language Elements.

Graphing

The following graphical procedures have been added:

  • GMAP - Enables you to create maps that contain geographic information. Only France is currently supported in this version.
  • GREMOVE - Enables you to create a map that combines areas into larger regions
  • GREDUCE - Enables you to create a lower-resolution version of a map using a density variable appended to the map dataset.
  • MAPIMPORT - Enables the import of ESRI shapefile data
  • SGSCATTER - Creates a grid of multiple scatter plots, where the number of plots are specified using one of the COMPARE, MATRIX, or PLOT statements.

For detailed information on this new procedure, see the section WPS Graphing in the WPS Reference for Language Elements.

Data engines – multithreaded

In this version of WPS Analytics, and in previous versions of WPS, the data engines have been updated to enable multithreading, which provides performance improvements.

In this version, the multithreaded engines have replaced the previous engines, and have the standard engine name. The old non-threaded engine has the original name with OLD appended; for example, SQLSERVEROLD. Therefore, the multithreaded engines will now be used if you have the standard engine names specified.

The engine names are:

Multithreaded versionPrevious version
NETEZZANETEZZAOLD
ODBCODBCOLD
ORACLEORACLEOLD
SQLSERVERSQLSERVEROLD

Please refer to the release notes available on the documentation page for information about using the Netezza, ODBC, Oracle and SQL Server data engines with WPS Analytics Version 4.

Data engines – new

The following data engines are new at this release:

  • MARIADB – Enables access to MariaDB databases.
  • DUMMY – This engine discards data written to it. The DUMMY engine is assumed for null locations: on Windows any pathname with null as the leaf element, on z/OS any DD name declared with type DUMMY, and on other platforms any location rooted in /dev/null.

Data engines – enhanced

The following data engines are updated at this release:

  • XLSX, which now:
    • Supports unnamed and named ranges, and the LABEL option.
    • Generates an error if it tries to read from a non-existent file.
  • SQLSERVEROLD, which now provides the ability to bulk load and unload data.
  • DB2, for which the SSID connection option can now be provided in mixed case and lower case.

Matrix Programming procedures and functions - new

The following functions and CALL routines have been added:

  • CALL FARMASIM
  • CALL FARMACOV
  • CALL FARMAFIT
  • CALL FARMALIK
  • CALL FDIFF
  • CALL KALCVF
  • CALL KALCVS
  • CALL KALDFF
  • CALL KALDFS
  • CALL TSMLOCAR
  • CALL TSMLOMAR
  • CALL TSPEARS
  • CALL TSPRED
  • CALL TSROOT
  • CALL TSTVCAR
  • CALL TSUNIMAR
  • CALL STL
  • PV
  • RATES
  • YIELD

Arrow curved up

Upgrading to WPS Analytics version 4

SAS program files used with WPS version 3 are compatible with WPS Analytics version 4.

TEMPLATE Procedure: any templates generated with a previous version of WPS and saved in an itemstore must be regenerated with WPS version 4.

Please refer to the release notes available on the documentation page for information about using the Netezza, ODBC, Oracle and SQL Server data engines with WPS Analytics Version 4.

A new WPS Analytics licence key is required to activate version 4 features.

To find out more about upgrading to version 4, please contact our sales team.