SSIS Productivity Pack

Version 6.1 - December 22, 2017

This release comes with the following updates and enhancements:

• New: We added 6 new functions to the Premium Derived Column component, which provide support for various character escaping and unescaping.
• New: We added a Service Endpoint option in the Azure Service Bus Connection Manager which can be used to specify an alternate URI instead of the default one when working with Azure Service Bus.
• Enhancement: Some more high-DPI support improvements.
• Enhancement: Diff Detector now supports comparing numeric keys of different data types.
• Fixed: You may get error "Implicit conversion from data type sql_variant is not allowed" when using SSIS variable in Premium ADO.NET Source component.
• Fixed: Premium ADO NET destination may find no match when using a datetime type field as the matching key.
• Fixed: You may run into "String was not valid DateTime" error when working with Premium ADO.NET Destination component for some special locale regions.
• Fixed: The text mode in the XML destination component's expression editor did not work properly.

Version 6.0 - December 14, 2017

This release comes with the following updates and enhancements:

• New: We added the following new components:
  • Cloud Storage
    • Azure Blob Storage Connection Manager
    • Azure Blob Storage Source
    • Azure Blob Storage Destination
  • Data Quality and Comparison
    • Data Profiler
  • Google Services
    • Google Sheets Connection Manager
    • Google Sheets Source
    • Google Sheets Destination
• New: Premium ADO NET Destination component now supports Bulk Update/Upsert/Delete actions with SQL and Oracle databases.
• New: Premium ADO NET Destination component now supports Custom Command action.
• New: We added a Create Table button in Premium ADO NET Destination component that can be used to create a new table with a default CREATE TABLE statement based on input column metadata.
• New: Premium Flat File Source/Destination component now support Amazon S3 Connection Manager.
• New: We added support of allowing duplicate keys in both Old Data and New Data inputs in Diff Detector component, the corresponding options are "Allow Duplicate Keys in Old Data" and "Allow Duplicate Keys in New Data" in the Advanced Settings page.
• New: OAuth Token Generator now supports specifying the path within the HTTP response (JPath) received to obtain access_token, refresh_token, and expiry.
• New: JSON Destination and XML Destination now support upload byte array content.
• New: We added a new comparison option "Treat Empty String as Null" in both Diff Detector and Duplicate Detector components.
  
• New: Web Service components now support working with repeating elements.
• New: We added an option called "Upload Chunk Size" in OneDrive Connection Manager which helps the support of uploading large files.
• New: PGP Task now supports working with GPG files.
• New: We added support for cloud storage connections (OneDrive, Dropbox, SharePoint, SFTP, FTPS, and potentially more in the future) in Premium Excel components.
  
• New: Google Analytics Source component supports getting specific goals.
• New: We added column/field filtering capabilities in Cassandra Source component and Premium Flat File Source component.
• New: We added new functions in Premium Derived Column to convert between DateTime and Unix timestamps called DateTimeToUnixTimeStamp() and UnixTimeStampToDateTime().
• New: We added new functions in Premium Derived Column to format numbers and datetimes as strings called NumberToString() and DateTimeToString().
• New: We added new functions in Premium Derived Column to replace nested conditionals called IfElse() and SwitchCase().
• New: We added a new function in Premium Derived Column to get the line count of a file called ReadLineCount().
• Enhancement: ReadTextContent() function in Premium Derived Column now supports additional parameters to get specific lines of a file.
• Enhancement: Premium Derived Column has more accurate design time validation and data type detection when using static values.
• Enhancement: Commands in Premium ADO.NET Source and Premium ADO.NET Destination components are now parameterized and prepared once before the execution.
• Enhancement: More robust SSL certificate handling in HTTP Connection Manager, RabbitMQ Connection Manager, Cassandra Connection Manager, MongoDB Connection Manager, and FTPS Connection Manager.
• Enhancement: Improved detection of SOAP versions in Web Service components.
• Enhancement: More robust usage of XML namespaces in Web Service components.
• Enhancement: More detailed reporting when error occurs in Premium Excel Source component.
• Fixed: You may run into "An item with the same key has already been added" error when using non-string type columns as business key in Diff Detector.
• Fixed: Premium ADO.NET Source component reported InvalidOperationException error when opening the Preview window.
• Fixed: You may have trouble opening a Premium ADO.NET Source component when you have a sensitive SSIS parameter specified in the package.
• Fixed: We fixed the automatic truncation of decimal numbers in the Premium ADO.NET Source component.
  
• Fixed: Google Analytics Source component did not save the data type changes made to columns within the Columns page.
• Fixed: Google Analytics Source component ignored the segment setting but always inputting the "New Visitor" segment.
• Fixed: When option "Expire Current Dimension Records not found in New Source" is enabled, Premium Slowly Changing Dimension component would expire rows already in the expired state.
  
• Update: Update of licensing component to better support servers within a clustered environment to minimize potential false licensing errors.

Version 5.0 - October 6, 2017

This release comes with the following updates and enhancements:

• New: We added the following new components:
  • Cloud Storage
    • Amazon S3 Connection Manager
    • Amazon S3 Source
    • Amazon S3 Destination
  • JSON & XML Processing
    • HTML Table Source
  • Message Queue Components
    • IBM MQ Connection Manager
    • IBM MQ Source
    • IBM MQ Destination
  • Google Services
    
    • Google AdWords Connection Manager
    • Google AdWords Source
• New: We added a new documentation generation button to all SSIS components that can be used to generate a Word document which describes the component's metadata including relevant mapping, and so on.
• New: We added Web Services Addressing (WS-Addressing) support in Web Service components.
• New: We added an option called "SOAP Version" in Web Service components, which can be used to specify the SOAP version used by the Web Services.
• New: We added a button called "Add From WSDL" in Custom SOAP Headers page in Web Service components, which supports loading SOAP headers from the WSDL file.
• New: Web Service Source component now supports paging.
• New: We have added an "Export Settings" button in JSON/XML Source component and Destination component, which can be used to export the configurations.
• New: We have added an "Import Settings" button in JSON/XML Source component and Destination component, which can be used to import the configurations.
• New: We added "Client Id" and "Client Secret" options in Google Analytics connection manager, which allows to use your own application to authorize.
• New: We added a new option to the FTPS connection manager - IgnoreCertificateErrors, which can be used to ignore any SSL certificate errors.
• New: We added a new function in Premium Derived Column called RegexFindMatch().
• New: We added a new function in Premium Derived Column called StripHTMLTags().
• New: Duplicate Detector now supports Fuzzy Match and Advanced Comparison Options on business key fields.
• Enhancement: Design nodes can now be reordered in JSON Merge, JSON Destination, XML Merge, and XML Destination
• Enhancement: Premium ADO.NET components connecting to Azure will reconnect and continue execution after a TCP timeout occurs.
• Enhancement: More robust support for complex WSDL files in Web Services components
• Enhancement: Added a new Authentication mode to HTTP Connection Manager: Basic Authentication which adds basic authentication headers to HTTP requests.
• Enhancement: Test Connection in HTTP Connection Manager allows every part of a test http request to be customized, and all parts of the response can be viewed to determine if the test was successful.
• Fixed: At run time throttle rate can be higher or lower than the rate that was actually set in the HTTP Connection Manager
• Fixed: HTTP Connection Manager editor can crash in rare situations.
• Fixed: HTTP Request components may ignore the HTTP Method setting.
• Fixed: HTTP Requester incorrectly retrieves content length.
• Fixed: You may get FormatException if you have unselected the _JSON field from outputting in JSON Source component.
• Fixed: Replace an input DT_NTEXT type column may not work properly in Premium Derived Column component.
• Fixed: Token() function in Premium Derived Column may work improperly to get the last token.
• Fixed: You might get "The given key was not present in the dictionary" error when using Fuzzy Match in Duplicate Detector component.
• Fixed: Client certificate was always required when SSL is enabled in MongoDB Connection Manager.
• Fixed: You may run into "Incorrect syntax near 'SE'" error when all fields are selected as key fields in Premium ADO.NET Destination component with Update/Upsert action.
• Fixed: You may get incomplete results when perform large load to Excel file using Premium Excel Destination component.
• Fixed: You might run into error "One or more of the passed properties are invalid" when sending messages to MSMQ using MSMQ Destination component in some special situations.
• Fixed: You may get "Bad Request" error when Edit Account Information in Dropbox Connection Manager.
• Fixed: You may run into error "Permission Denied" when using Premium Transfer Task to work with SFTP server.
• Fixed: Some updates to the licensing component.

Version 4.0 - July 7, 2017

This release comes with the following updates and enhancements:

• New: We added support for SQL Server 2017.
• New: We added the following new components:
  • Premium Data Flow Components
    • Excel Connection Manager
    • Premium Excel Source
    • Premium Excel Destination
  • Data Pack and Unpack
    • JSON Source
    • JSON Destination
    • OAuth Token Manager
    • XML Source
    • XML Destination
  • NoSQL Components
    • Cassandra Connection Manager
    • Cassandra Source Component
    • Cassandra Destination Component
    • DynamoDB Connection Manager
    • DynamoDB Source Component
    • DynamoDB Destination Component
  • Miscellaneous Components
    • Google Analytics Connection Manager
    • Google Analytics Source Component
    • Google Analytics Token Manager
• New: We added Shared Mailbox and Impersonation support in Email Connection Manager, which is available for Exchange Web Services protocol connection to allow you to access to a shared mailbox or "act as" different user.
• New: We added DB2 data provider support in ADO.NET source and destination components.
• New: We added a Connectivity Mode option in Azure Service Bus Connection Manager, which can be used to specify the underlying wire-level protocol used to communicate with Service Bus.
• New: We added Match Type support in Diff Detector component. This is a breaking change, as a prior version (v3.0 or earlier) would not be able to process an SSIS package that contains a Diff Detector component with "Match Type".
• New: We added a Default to DT_WSTR option in Premium Flat File source component, which can be used to determine whether applying SSIS type DT_WSTR to all string type columns or using DT_STR with corresponding code page for string columns.
• New: OneDrive connection manager now supports listing existing tokens.
• New: We added HTTP Method support in Web Service and HTTP components.
• Enhancement: Performance enhancement when loading a large number of columns at design time in Diff Detector.
• Enhancement: Performance enhancement when loading a large number of columns at design time in Premium Slowly Changing Dimension.
• Updated: We hid some Premium ADO.NET components' properties from listing in the Propertities window. This is a breaking change, as any packages will be automatically upgraded, and the package will not work with a prior version once the upgrade is done.
• Updated: We have updated the XML node types in XML Extract component to support repeating elements. This is a breaking change, and we automatically upgrade when the component is opened, which may not be compatible with prior versions.
• Updated: We have removed the HTTP Method property in HTTP Connection Manager and add HTTP Method support at component level.
• Fixed: You may lose Local File connection manager in Premium File System components.
• Fixed: The FileContent field in Premium File System components was using data type 'ntext'.
• Fixed: The Premium ADO.NET components may fail to get schema information for ODBC connections.
• Fixed: The Diff Detector may not work properly when performing string comparison.
• Fixed: The output results can be incorrect if the target dimension table has no currrent data when using Premium Slowly Changing Dimension.
• Fixed: You may get InvalidCastException error when using DT_IMAGE type columns for comparison in Premium Lookup Component.
• Fixed: Functions Substring(), HexToBytes(), HexToString() were using test value for validation in Premium Derived Column.
• Fixed: JSON Extract component has trouble working with a JSON document contains special characters in the JSON name.
• Fixed: Unselected columns at root level might still get merged in JSON Merge and XML Merge components.
• Fixed: Web Service components failed to load WSDL file when a contained XSD file is inaccessible.
• Fixed: Premium File Transfer Task component may hang when uploading large files (>3GB) to SFTP/FTPS server.
• Enhancement: Improved high-DPI support.
• Enhancement: Some minor GUI improvements.
• Enhancement: We added command line support for License Manager program.
• Update: We no longer deploy Newtonsoft.Json.dll assembly to Windows GAC.
• Fixed: If you have an Ultimate trial license, it may still report as not licensed.

Version 3.0 - March 15, 2017

This release comes with the following updates and enhancements:

• New: We added support for MSMQ, RabbitMQ, and MongoDB connections in SSIS Productivity Pack which come with the the following nine new components:
  • Message Queue Components
    • MSMQ Connection Manager
    • MSMQ Source Component
    • MSMQ Destination Component
    • RabbitMQ Connection Manager
    • RabbitMQ Source Component
    • RabbitMQ Destination Component
  • NoSQL Components
    • MongoDB Connection Manager
    • MongoDB Source Component
    • MongoDB Destination Component
• New: SSIS Integration Toolkit for Microsoft OneDrive and SSIS Integration Toolkit for Dropbox are now included in the SSIS Productivity Pack adding an additional 6 SSIS components as well as a token manager utility for OneDrive. For release notes prior please see the Dropbox Change Log or the Microsoft OneDrive Change Log.
  
  • Dropbox Connection Manager
  • Dropbox Source Component
  • Dropbox Destination Component
  • OneDrive Connection Manager
  • OneDrive Source Component
  • OneDrive Destination Component
  • OneDrive Token Manager
• Other changes have been made to the following components:
  • New: We added an option called "Use Identity Insert" in ADO.NET destination component, which can be used to allows explicit values to be inserted into the identity column of a SQL table.
  • New: We added support for custom Email header fields in Email source component, which can be added as needed in its editor window.
    
  • New: "Expand All" and "Collapse All" support have been added in XML Extract and JSON Extract components.
  • New: We added a ProxyMode option to HTTP connection manager, Dropbox connection manager and OneDrive connection manager, which now supports three types of proxy mode: No Proxy, Auto-detect and Manual.
  • Enhancement: We added a few more properties to SFTP Connection Manager and FTPS Connection Manager, which can be used to improve the performance when uploading/downloading files to/from SFTP and FTPS servers.
  • Update: We changed the default output column name to "DetectedChangeType" in Premium Slowly Changing Dimension (This basically introduces a new SSIS metadata, which is considered as a breaking change - as any packages will be automatically upgraded, and the package will not work with a prior version once the upgrade is done).
    
  • Update: Some minor UI adjustments including renaming "Lookup Type" to "Match Type" in General page of Premium Lookup component.
  • Fixed: Some UI displaying issues under high DPI settings have been fixed.
  • Fixed: HTTP Connection Manager may not authenticate properly.
  • Fixed: The Auto Detect function for surrogate key in Premium Slowly Changing Dimension may not work correctly when the target dimension table is empty.
  • Fixed: In some special case, you may get "The given key was not present in the dictionary" error when using Diff Detector component.
  • Fixed: You may run into "System.ArgumentOutOfRangeException: Index was out of range" error when using Premium Lookup component in some unique situations.
  • Fixed: When removing columns in Unmatched Rows Output in Premium Lookup component, you may get the following error: 'ColumnIndexOutOfRange'.
  • Fixed: XML Merge and JSON Merge components always output the root matching key value even when the field is unchecked.
• Update: We have an updated license agreement.
  

Version 2.0 - January 27, 2017

This release comes with the following updates and enhancements:

• New: The following ten components have been added to the SSIS Productivity Pack:
  • Premium Data Flow Components
    • Premium Lookup
    • Premium Slowly Changing Dimension
  • Azure Service Bus
    • Azure Service Bus Connection Manager
    • Azure Service Bus Source Component
    • Azure Service Bus Destination Component
  • Data Pack and Unpack components
    
    • XML Merge
    • XML Extract
    • JSON Merge
    • JSON Extract
  • Miscellaneous Components
    • Time Zone Conversion
• New : The Premium File Pack is now part of the SSIS Productivity Pack with 2 new components (Premium File System Source and Destination) adding an additional 6 components in total to the SSIS Productivity Pack:
  
  • FTPS Connection Manager
  • SFTP Connection Manager
  • Premium File System Source
  • Premium File System Destination
  • Premium Flat File Source
  • Premium Flat File Destination
  • Premium File Transfer Task
  • Release notes for the Premium File Pack below, for release notes prior to v2.0 please see the Premium File Pack release note archive page.
    • New: We added a new data flow component called Premium File System Source component, which can be used to read / retrieve data from a File System including SFTP, FTPS connections.
    • New: We added a new data flow component called Premium File System Destination component, which can be used to write data to a File System including SFTP, FTPS connections.
    • Enhancement: Some code refactoring for better performance when writing to local flat files.
    • Fixed: Premium Flat File source component does not allow rename column name shorter than 7 characters.
    • Fixed: Premium Flat File source component does not allow rename unselected column.
    • Fixed: Premium Flat File source component may return 0 instead of null for number type columns.
    • Fixed: You might run into error when importing external columns contain datatype DT_TEXT or DT_NUMERIC (Thanks to Henrik for reporting this).
    • Fixed: The ConnectionString property of SFTP connection manager and FTPS connection manager cannot be parameterized.
    • Fixed: The item may not get fully overwritten using Premium File Transfer Task send files to local system when "Overwrite Existing Items" option is enabled.
• The following changes have been made to Diff Detector component:
  • New: We changed the inputs name to "New Data" and "Old Data" for clarity purpose.
    
  • New: We added options to enable both new data columns and old data columns to the Changed Rows output in Diff Detector component.
  • Enhancement: We added support for column level similarity threshold configuration.
    
  • Enhancement: Performance enhancement when loading a large number of columns at design time.
• The following changes have been made to Premium Derived Column component:
  • Fixed: The length detection might be incorrect when using conditional function in Premium Derived Column component.
  • Fixed: The WriteValueToVariable function does not accept using DT_NTEXT type value as its input.
  • Fixed: The LEFT and RIGHT functions were using test value for validation.
  • Fixed: The Premium Derived Column returns empty value for escaped quote value "/"".
  • Fixed: You may get "Invalid expression error" when using Type Cast expressions.
• Other changes have been made to the following components:
  
  • New: We added a Batch Size option in Email source component, which is available for Exchange Web Services protocal connections to allow you to specify how many records you want to retrieve each time.
  • Enhancement: Some minor UI adjustments including positioning "Generate New Key Pair" button to the bottom in PGP Task component.
  • Update: We changed the default chunk size value to 0 in HTTP Connection Manager.
  • Update: We removed the typing function in SMTP destination component.
  • Fixed: Data Spawner source component may return 0 instead of null for number type columns.
  • Fixed: In some special case, you may get "Error reading JArray from JsonReader. Path" error when sending emails using SMTP Task component.