SSIS Productivity Pack

Version 8.1 - August 17, 2018

This release comes with the following updates and enhancements:

• New: We added the following new components:
  • REST Components
    • REST Connection Manager
    • REST Source
    • REST Destination
  • Message Queue Components
    • Amazon SQS Connection Manager
    • Amazon SQS Source
    • Amazon SQS Destination
      
  • Google Services
    • Google Ads Connection Manager
• New: We added the following services to REST components:
  • Act-On
  • Constant Contact
  • Freshdesk
  • Jira
  • MailChimp
  • Slack
  • Square
  • SugarCRM
  • SurveyMonkey
  • Zendesk
    
• New: OAuth Token Generator now supports OAuth 1 authentication type.
• New: We added a Lookup feature in Premium ADO.NET Destination component.
• New: We added a new option called "Prevent Null Overwrite" in Premium ADO.NET Destination component, which can be used to ignore any fields that have a null value. By ignoring a field, the null value will not be sent to the target table.
• New: We added MongoDB change streams support in MongoDB Source component.
• New: We added 7 new functions to the Premium Derived Column component, which provide support computing HMAC.
• New: HTTP Requester data flow component now supports getting custom response header values.
• New: We added a new option called "Row Delimiter" in Premium Flat File Source/Destination components, which can be used to correctly parse files with rows.
• New: Premium Excel Destination component now supports create the file/sheet at the specified location when the file/sheet does not exist.
• New: We added support for "Orphaned Children Error Output" output in the JSON/XML Merge/Destination component. This is a breaking change, as a prior version (v7.1 or earlier) would not be able to process an SSIS package that contains a JSON/XML Merge/Destination component with the "Orphaned Children Error Output" output enabled.
• New: We added Google Analytics v4 API support in Google Analytics components. This is a breaking change, as a prior version (v7.1 or earlier) would not be able to process an SSIS package that contains a Google Analytics Connection Manager using v4 API version.
• New: Fuzzy Match in Premium Lookup component now supports token based match algorithm.
• New: We added a new option called Host Key Algorithm in SFTP Connection Manager, which can be used to set preferred host key (server key) algorithm.
  
• New: We added an Encoding option in SFTP Connection Manager which can be used to decode the file system information on an SFTP server.
• New: We added a Use Streamed Download option in SFTP Connection Manager which can be used to download large files from an SFTP server.
• New: We added a new spawn type/anonymization type called "CountryAbbreviated" in Data Spawner/Data Anonymizer components, which can be used to generate country abbreviation values.
• New: Email spawn type/anonymization type in Data Spawner/Data Anonymizer component now supports providing a static domain value.
• Enhancement: We have updated the license manager program to now report details of distinct connections in use.
  
• Enhancement: Improved UI performance with select/unselect all output columns in Premium Lookup component.
• Enhancement: Some code refactoring for better performance with a large number of lookup rows in Premium Lookup component.
  
• Update: JSON Source component no longer fails when the service call response is empty.
• Update: We updated the default report version to v201806 for Google Ads/AdWords Connection Manager.
• Update: The performance of JSON/XML Destination/Merge components can be significantly improved by sorting the link key columns in the upstream.
• Fixed: Our software may report a connection metering related error during runtime for some specific system environments.
• Fixed: Retry on Intermittent Errors option in HTTP Connection Manager may not work properly.
• Fixed: You may run into "Stream was too long" error when downloading a large file (>10G) from SFTP server using Premium File Transfer Task.
• Fixed: Premium File Transfer Task may report UnauthorizedAccess exception when downloading files from a read-only permission network sharing folder.
• Fixed: PGP Task may fail encrypting file when the encryption key did not have a "publickey user ID".
• Fixed: You may get error "Value cannot be null. Parameter name: bytes" when using POST/DELETE/PUT/PATCH method in HTTP Requester Task component without providing a request body.
• Fixed: You may run into OutOfMemory error in Premium Lookup component when performing fuzzy match with a large number of lookup rows and the lookup data contains empty string values.
• Fixed: Premium Lookup component may report "System.ArgumentOutOfRangeException" error when using a non-string type column as the matching key.
• Fixed: Premium Excel Source component may report "File does not exist" error when using Box Connection Manager with a valid source file path.
• Fixed: You may run into "Folder does not exist" error in Premium Flat File Destination component when using Box Connection Manager with a valid destination file path.
  
• Fixed: You may get "startIndex cannot be larger than length of string" error in OneDrive Destination component when writing to root directory.
• Fixed: Premium ADO.NET Destination component using Update or Upsert action may fail with error "Incorrect syntax near 'W'" when the component was created by version 4.0 or earlier and upgraded to v7.1.
• Fixed: You may get "Invalid column name" error in Premium ADO.NET Destination component when Bulk reporting outputs are enabled while performing Bulk Update/Upsert/Delete and Full Sync actions with column name contains special characters like "-".
• Fixed: Premium ADO.NET Destination component may drop the time part of the input datetime value when writing to Oracle DATE type field.
• Fixed: HTML Merge component may generate "Microsoft.SqlServer.Dts.Pipeline.BlobColumn" value in the merged document when input column is DT_NTEXT/DT_TEXT type.
• Fixed: Google Analytics Source component may drop the millionseconds information when retrieving custom datetime dimension value.
• Fixed: Opening Analytics View dialog in Google Analytics Source component may crash Visual Studio in a very unique situation when the Google Analytics account has no web properties under the account.
• Fixed: Google Sheet Source component may crash if the specified sheet id does not exist.

Version 7.1 - June 1, 2018

This release comes with the following updates and enhancements:

• New: We added Full Sync action support in Premium ADO.NET Destination component, which can be used to synchronize table data when working with Sqlclient Data Provider and Oracle Data Provider for .NET.
• New: We added a Command Timeout option in Premium ADO.NET Destination component.
• New: We added a Batch Size property in Premium ADO.NET Destination component, which can be used to specify how many records you want to send to the target database at a time when option "Use Bulk" is enabled.
• New: We added a Duplicate Handling option in Premium ADO.NET Destination component, which can be used to specify how input duplicates should be handled when "Use Bulk" option is enabled on Update/Upsert/Delete/Full Sync actions
• New: Premium Slowly Changing Dimension component now supports writing to target database table directly through an ADO.NET connection.
• New: OAuth Token Generator component now supports OAuth 2.0 JWT authentication flow.
• New: We added Client Credentials grant type support in OAuth Token Generator.
  
• New: We added Country Match support in Diff Detector, Duplicate Detector and Premium Lookup components, which can be used to match English short country name with country code according to ISO 3166-1 standard.
  
• New: We added US State Match support in Diff Detector, Duplicate Detector and Premium Lookup components, which can be used to match Canada and United States subdivision names with codes according to ISO 3166-2 standard.
• New: We added a FileContent spawn/anonymization type in Data Spawner/Data Anonymizer, which can be used to generate random binary column data based on files stored in a provided folder.
• Enhancement: Improved UI performance with select/unselect all columns in Data Spawner component.
• Enhancement: Premium Lookup now supports comparing numeric keys of different data types.
• Enhancement: Grant Type in OAuth Token Generator component now accepts type-in values.
• Enhancement: Automatically paired fields in Diff Detector component now default to Exact Match match type.
• Update: Bulk option in Premium ADO.NET Destination component when using Update/Upsert/Delete action with Sqlclient Data Provider now has 3 default outputs: Bulk Reporting Output - Deleted Records, Bulk Reporting Output - Inserted Records, and Bulk Reporting Output - Updated Records. This change should be considered as a breaking change, as a prior version (v7.0 or earlier) would not be able to open or process an SSIS package saved by the new version.
• Update: When an email fails to process in Email Source component, the component now reports error log information in SSIS execution result instead of failing the component.
• Fixed: Premium ADO.NET Destination may report pre-execution error "Invalid object name 'xxx'." when destination table name contains "." (dot).
• Fixed: "Use Identity Insert" may work improperly when writing to a SQL table using "Use Bulk" in Premium ADO NET destination component.
• Fixed: You may get "Could not find Access Token" error when creating a new OneDrive Connection Manager.
• Fixed: Duplicate Detector may work improperly when performing First Name/Company Name Match and options "Ignore Case" and "Ignore Leading and Trailing White Spaces" are disabled.
• Fixed: You may run into "Value cannot be null. Parameter name: source" error when querying Google BigQuery table data using Google BigQuery Source component and the source command returns 0 rows.
• Fixed: Test Connection in HTTP Connection Manager may remove "access_token" query parameter which is added manually in Base URL for non-oauth authentication types.
• Fixed: JSON Source/Extract component may output numeric values incorrectly when local system format setting uses "," (comma) as the decimal symbol.
• Fixed: Premium Derived Column component may output "Microsoft.SqlServer.Dts.Pipeline.BlobColumn" value when casting a null DT_NTEXT value to DT_WSTR/DT_STR.
• Fixed: You may get error "System.IO.IOException: The process cannot access the file because it is being used by another process." when uploading local files to Box using Premium File Transfer Task with option "Delete Item From Source Upon Completion" enabled.

Version 7.0 - April 26, 2018

This release comes with the following updates and enhancements:

• New: We added the following new components:
  • Cloud Storage
    • Box Connection Manager
    • Box Source
    • Box Destination
  • Data Quality and Comparison
    • Address Verification Connection Manager
    • Address Verification
  • Google Services
    • Google BigQuery Connection Manager
    • Google BigQuery Source
    • Google BigQuery Destination
  • Miscellaneous Components
    • EDI Source

• New: We added support for Azure-SSIS Integration Runtime (IR) deployment and licensing.
• New: Standard use licensing model, this limits the number of distinct connections to 8 per connection type within a 24 hour period at runtime.
• New: We added a new spawn type/anonymization type called "RandomString" in Data Spawner/Data Anonymizer component, which can be used to generate random strings.
• New: We added a new spawn type/anonymization type called "IncrementalValue" in Data Spawner/Data Anonymizer component, which can be used to generate incremental numbers.
  
• New: We added Move Column and Clone Column capabilities in Data Spawner component.
• New: We added ZipCode format support in Data Spawner and Data Anonymizer components.
• New: We added spawn order support for Custom type in Data Spawner and Data Anonymizer components.
  
• New: We added a new option called "Decimal Places" for numeric types in Data Spawner and Data Anonymizer components, which can be used to control the decimal places for the spawned/anonymized number.
• New: OAuth Token Generator now supports specifying additional Request Header when requesting a token from a service.
• New: We added Password grant type support in OAuth 2 Token Generator.
• New: We added a "Custom" Access Token location option in HTTP Connection Manager when OAuth2 authentication mode is selected, so that OAuth access token can now be inserted in any location of the HTTP requests in whichever way needed for Web Service, and JSON/XML Source/Destination components.
• New: Testing connection in HTTP Connection Manager now reports Request Duration, which can be used for some preliminary benchmarking.
• New: We added PATCH method support in HTTP/Web Services components.
• New: HTTP Requester data flow component now supports outputting HttpStatusCode, HttpStatusCodeName and HttpResponseUrl in default output.
• New: We added optional Request Body and Response Body fields to the Default Output of Web Service Destination component.
• New: XML Source component and Destination component now support importing XML structure and columns from WSDL files.
• New: We added a Bucket option in Amazon S3 Connection Manager, which can be used to specify a particular S3 bucket to work with.
• New: We added Fixed Width text file support in Premium Flat File Source and Destination components.
• New: We added a "Delete Item From Source Upon Completion" option in Premium File Transfer Task, which can be used to delete the source items when file transfer is completed.
• New: We added OneDrive shared files support in OneDrive components.
• New: We added a new option called "Keep Alive Interval" in SFTP Conenction Manager, which can be used to send empty packets to SFTP server periodically to prevent the connection from being closed by the server.
• New: We added two logging related options to SFTP connection manager, so you can now specify a log file to write to, and the log level that is needed.
• New: We added a new option to the Azure Service Bus connection manager - IgnoreCertificateErrors, which can be used to ignore any SSL certificate errors.
  
• New: We added "Add Wrapping Root Node" option in JSON Merge and JSON Destination components, which can be used to generate more JSON structures.
• New: We added a RemoveDiacriticalMarks method to the Premium Derived Column component which can be used to remove some special language accents.
• New: We added multi-select support using keyboard in JSON/XML Destination/Merge components, so you can drag and move within the document structure, including the support of Delete to delete all selected nodes in one key stroke.
• New: Web Service Task and Web Service components now provide a dialog to help enter SOAP headers with ease through a popup window.
• New: MSMQ, RabbitMQ and Azure Service Bus components now support reading/writing binary message data directly.
  
• New: Azure Service Bus components now support encoding for text messages.
  
• New: We added a new "Retry on Intermittent Errors" option in Azure Service Bus Connection Manager.
• New: We added a new "Ignore Certificate Errors" option in Azure Service Bus Connection Manager, which can be used to ignore any SSL certificate errors.
• Enhancement: We added command line support for Google Token Manager program.
• Enhancement: We added command line support for OneDrive Token Manager program.
• Enhancement: Better bulk action support in Premium ADO.NET Destination component to avoid potential SQL Server merge concurrency issues.
• Enhancement: More robust support for complex WSDL files in Web Services components.
• Enhancement: More robust support for different string type parameters in WSDL files in Web Service components.
• Enhancement: Better length detection for certain spawn types in Data Spawner component.
  
• Enhancement: Improved UI performance when loading table metadata in Premium ADO.NET components.
• Enhancement: We improved the error handling when incoming full path is invalid in Amazon S3 Destination component.
• Update: We introduced some new metadata and options to the Google Analytics source component, it now supports any date range. This change should be considered as a breaking change, as a prior version (v6.1 or earlier) would not be able to open or process an SSIS package saved by the new version.
• Update: Premium ADO.NET components now prompt a message when columns are not supported due to their data types.
• Update: Premium ADO.NET components now exclude those system table schemas from being retrieved when working with Oracle.
• Update: HTTP Method in HTTP/Web Services components now accepts type-in values.
• Update: Web Service components now list the namespaces specified in the WSDL file.
  
• Update: Premium File Transfer Task now creates the directory path when sending a file to a path that does not exist in local file system.
• Update: We surfaced some additional advanced SFTP settings in SFTP Connection Manager UI, which used to be only available in its Properties window in v6.1.
• Update: We updated the default report version to v201802 for Google AdWords connection manager.
• Update: We have an updated version of License Agreement that covers the new Azure-SSIS IR licensing model along with many other revisions - the new agreement becomes effective as of today (April 26, 2018).
• Fixed: Data Anonymizer component did not overwrite input values when working with DT_NTEXT and DT_TEXT fields.
• Fixed: For some special WSDL files, the Web Service Task component might create a request message with invalid namespace prefixes which may not be properly processed by the service on the server side.
• Fixed: JSON Destination component may report "Http response body is invalid JSON" error when the service call response is empty.
• Fixed: You may get "One or more of the passed properties are invalid" error when selecting "None" as Encryption Algorithm in MSMQ Destination component.
• Fixed: The mappings in Data Profiler component may get mixed when reopening an existing package. This fix is a breaking change, as a prior version (v6.1 or earlier) would not be able to process an SSIS package that contains a Data Profiler component saved in new versions.
• Fixed: The column mappings in JSON/XML Destination/Merge component may get mixed when reopening an existing package. This fix is a breaking change, as a prior version (v6.1 or earlier) would not be able to process an SSIS package that contains a JSON/XML Destination/Merge component saved in new versions.
• Fixed: Test Connection in HTTP Conenction Manager may add duplicate access_token query parameters in the request URL when using Put Access Token In Query String option with OAuth2 authentication type.
• Fixed: Some UI issues in JSON/XML Destination/Merge component when expanding/collapsing nodes in Input Columns design page.
• Fixed: You may get error "Unexpected character while parsing path indexer: n" when hierarchy grandparent and parent outputs are unchecked in JSON/XML Extract/Source components.
• Fixed: JSON/XML components may report error "Invalid Expression: Invalid character" when SSIS parameter is used in the expressions.
• Fixed: Encoded value "%2F" in URL may get decoded when using HTTP/Web Service components.
• Fixed: Web Service components may throw error "Index was out of range. Must be non-negative and less than the size of the collection" when a selected field is an array but the input is empty.
• Fixed: Some web service endpoints might report a "Couldn't create SOAP message" error when the Web Service component is built upon a SOAP version 1.2 WSDL file.
  
• Fixed: Premium Excel Destination component may write DT_TEXT or DT_NTEXT input string values incorrectly.
  
• Fixed: Premium Excel Destination component may ignore the "First Row has Column Name" setting under "Clear and write new" mode.
• Fixed: Amazon DynamoDB Destination component may write DT_TEXT or DT_NTEXT input string values incorrectly.
• Fixed: You may run into "The given key was not present in the dictionary" error when using SSIS parameter or SSIS varaible in Text Merge mode in XML Destination component.
• Fixed: JSON/XML Destination component may still process the action for 0 incoming rows.
• Fixed: JSON Destination component may not parse response properly when the response is an array of objects.
• Fixed: Premium Flat File Source component may report error "The MaxBufferSize must be greater than 0" when upgrading to a recent version.
• Fixed: In some particular situation, you may run into error "Connection Closed" when downloading files from SFTP server.
• Fixed: You may get "Invalid Request" error when you have a Premium File Transfter task to upload files to OneDrive, and the component is immediately followed by a data flow task that contains an OneDrive destination component which write to the exactly same files using the same connection.
• Fixed: You may get error "SqlCommand.Prepare method requires all variable length parameters to have an explicitly set non-zero Size" when writing to SQL datetimeoffset type column using Premium ADO NET Destination component.
• Fixed: Premium ADO NET Destination component tries to retrieve table schemas when opening an exsiting configured component.
• Fixed: You may run into "Insufficient memory to continue the execution of the program" error when using EncodeBase64() function in Premium Derived Column component to process some large binary contents.
• Fixed: You may receive a "The given key was not present in the dictionary" error when comparing strings contain extended Latin characters in Duplicate Detector component.
• Fixed: Diff Detector/Premium Lookup component may find unmatch for spaces and NULL values when advanced comparison settings "Ignore All WhiteSpaces" and "Treat Empty String as Null" enabled.
• Fixed: You may get error "The value specified for the input parameter, 'parameters_data_type', is not valid" when deploying package with RabbitMQ components.
• Fixed: You may run into "OutOfMemoryException" when reading files in a recursive fashion using Premium File System Source component.
• Fixed: Premium File System Source component may not read file contents properly for some files in some special situations.
• Fixed: API Throttling Rate may work improperly in HTTP Connection Manager.
• Fixed: Files may get transferred to incorrect location when using Premium File Transfer Task to download files from Amazon S3.
• Fixed: Files may get transferred to incorrect location when using Premium File Transfer Task to download files from Azure Blob Storage.