What's New

SSIS Productivity Pack

Detailed changelog for every release of KingswaySoft SSIS Productivity Pack

Version 22.1 - November 2, 2022

This release comes with the following updates and enhancements - Note that this will be our last version that supports SSIS 2008 (SQL Server 2008):

  • General
    • New: We have added support for SQL Server 2022 (SSIS 2022).
    • Enhancement: We have updated the license manager program to make it more resilient in obtaining new license files or renewals should there be intermittent networking issues. The enhancement mainly applies to unattended license requests or updates using command line via Windows script, it is particularly helpful when you run our software on Azure SSIS IR as it involves license activation requests each time when the instance is started or restarted.
    • Update: The entire program has received some major branding updates in various UI elements.
  • New Components
    • Data Warehousing
      • Google AlloyDB Command Task
      • Google AlloyDB Connection Manager
      • Google AlloyDB Source
      • Google AlloyDB Destination
    • Mail Components
      • Email Destination
    • Message Queue Components
      • Azure Queue Storage Connection Manager
      • Azure Queue Storage Source
      • Azure Queue Storage Destination
      • Kafka Connection Manager
      • Kafka Source
      • Kafka Destination
    • New services in the REST framework
      • Auth0
      • Bill.com
      • Calendly
      • Ceridian Dayforce
      • Chargebee
      • Chargify
      • ClickUp
      • Discord
      • Drift
      • Expensify
      • Google Forms
      • Jotform
      • Mailjet
      • Okta
      • PowerBI
      • PrestaShop
      • ShipStation
      • Typeform
  • Big Data
    • New: EDI source component can now import multiple EDI files to create a generic data design for those chosen files, which can greatly improve development productivity when used properly.
    • New: EDI source and destination components now support Filter Nodes on the Design page.
    • New: CDM source component now supports lookup column names at runtime when the data file has no column header.
    • Fixed: Premium Data File destination component was writing deprecated INT97 data type for dates and timestamps.
    • Fixed: Flatten Segment Loops in EDI source may not work properly with some particular X12 files.
    • Fixed: EDI destination component may not generate the target EDI file properly when the child input has multiple rows.
    • Fixed: CDM components may not detect partition properly when dataPartitions has globPattern specified.
    • Fixed: CDM source component may not output number values correctly when system locale setting uses "," as number delimiter.
    • Fixed: You may run into "An existing connection was forcibly closed by the remote host" when working with multiple partition files in CDM source component.
  • Cloud Storage
    • New: We added a new "Download Chunk Size" option in the Google Cloud Storage Connection Manager.
    • New: We added a new "Download Chunk Size" option in the Google Drive Connection Manager.
    • New: Dropbox Connection Manager now supports refreshing access_token.
    • New: We added a Container option in Azure Blob Connection Manager, which can be used to specify a particular Azure Blob container to work with.
    • Update: The Dropbox Connection Manager starts to use a token file going forward for better security and portability.
    • Update: Upload Chunk Size in Box Connection Manager is changed to a checkbox named "Upload Chunk".
    • Update: "WebDAV Host", "Port" and "Use HTTP" properties in WebDAV Connection Manager have been deprecated and they are now replaced with one single property called "Server Url" - Note that this should be considered a breaking change if any of the deprecated properties are used in parameterization.
    • Update: "WebHDFS Host", "WebHDFS Port" and "Use HTTP" properties in Hadoop Connection Manager have been deprecated and they are now replaced with one single property called "WebHDFS Server URL" - Note that this should be considered a breaking change if any of the deprecated properties are used in parameterization.
    • Enhancement: Some UI performance enhancement when listing Azure Blob items.
    • Enhancement: Some UI performance enhancement when listing Amazon S3 items.
    • Fixed: You may receive a "S3 Endpoint is not in correct format" error when testing connection in an Amazon S3 Connection Manager if it has the S3 Endpoint specified.
    • Fixed: You may run into an UnsupportedHeader error in Premium Flat File destination component when writing large flat file to Azure Files using chunk upload.
    • Fixed: You may receive a "System.FormatException" when listing WebDAV items that have no Content-Length.
  • Data Quality and Comparison
    • New: We added a "License" option in Address Verification Connection Manager when working with SmartyStreet service, which can be used to specify the license or licenses (comma separated) to use for the address verification service.
    • New: We added a new "Record Ranking Strategy" feature in Duplicate Detector component, which can be used to define the winning strategy among the duplicate groups.
  • Data Warehousing
    • New: We have added support for RootCertificate, SslCertificate and SslKey parameters in the PostgreSQL Connection Manager.
    • New: Google BigQuery source/destination component and Google BigQuery Command Task now support specifying a new Billing Project option.
    • New: We added an "Authenticator" property in Snowflake Connection Manager when working with Basic Authentication type, this property can be used to specify the URL for SSO providers such Okta.
    • Update: ClientCertificate is no longer supported in PostgreSQL Connection Manager, it's replaced by SslCertificate property.
    • Update: Default Poll Throttle Rate is now set to 1 in Google BigQuery Command Task.
    • Update: Amazon Redshift/PostgreSQL destination and task components will now show an asterisk indicator if pre or post command is specified.
    • Fixed: Google BigQuery Command Task may report the error "Value cannot be null. Parameter name: source" when the query result is empty.
    • Fixed: You may run into "42601: syntax error" in Amazon Redshift/PostgreSQL destination component when the target table name contains space.
  • Encryption and Compression Tasks
    • Fixed: Decrypt action in PGP Task component may not work properly when the private key file contains multiple keys.
  • Google Services
    • General Update: We have updated the redirect url to "http://localhost" in the KingswaySoft App provided in Google Connection Managers when generating a token.
    • General Update: Default Key File Type is now set to JSON when working with Service Account authentication mode in Google Connection Managers.
    • New: We added Shared Drive support to Google Drive components.
    • New: We added PKCE OAuth authorization code flow support when generating Google OAuth token file.
    • New: Google Ads Connection Manager now supports infinite timeout by setting the Timeout value to 0.
    • New: We added FormatString property support in Google Sheets destination component.
    • Update: We updated the default API Version to version v11 in Google Ads Connection Manager.
    • Update: We updated the discovering Customer Id API call to use the Google Ads API when listing Customer Ids in Google Ads Connection Manager.
    • Update: Google Ads source component now uses DT_DECIMAL data type for number fields.
    • Update: We have deprecated Google AdWords API support because the AdWords API is no longer supported by Google.
    • Update: Google Sheets destination component now writes DT_DBDATE value in "YYYY-MM-DD" format.
    • Update: Metadata update in Google Analytics source component for Google Analytics Data API.
    • Fixed: The provided Property Id value may not work properly in Google Analytics source component when working with Google Analytics Data API.
    • Fixed: You may run into a "Batch Loading failed" error when running multiple Google BigQuery destination components in parallel and all of them are performing Bulk actions.
    • Fixed: Google Ads source component may report a 'Fields cannot be used in SELECT' error when reading from the asset report.
    • Fixed: Google Ads source component may not output number values correctly when the system locale setting uses "," as the number delimiter.
    • Fixed: Reset Columns button in Google Sheets destination component may not set precision and scale numbers properly for upstream number type fields.
    • Fixed: Google Sheets source component may report an "Object reference not set to an instance of an object" error when reading from an empty sheet.
    • Fixed: Google Sheets destination component may not write column data properly when the metadata column positions are moved to the Columns page.
    • Fixed: Google Sheets destination was writing empty values to unmapped fields when performing SHEETS_VALUES_UPDATE action.
  • HTTP/Web Services
    • New: Custom Token Authentication Mode in HTTP Connection Manager now supports manually entering the cURL command and saving it in the HTTP Connection Manager.
    • New: We added a new Allow Auto Redirect option in HTTP Connection Manager.
    • New: We added additional algorithms supported in HTTP Connection Manager for JWT authentication mode, including RS384, RS512, ES256, ES384, ES512, PS256, PS384, PS512.
    • New: We added WSSE authentication mode support in HTTP Connection Manager.
    • New: We added PKCE OAuth authorization code flow support in OAuth Token Generator.
    • New: Web Service components now support loading WSDL file from a given HTTP Connection Manager setting, this can be used for services that require authentication when downloading the WSDL file, which would be otherwise impossible to do.
    • New: We added support for working with a certificate file stored in Azure Blob Storage by specifying an Azure SAS URL as the Path to Certificate in AS2 Connection Manager.
    • Enhancement: Better metadata detection when loading WSDL files in Web Service components.
    • Fixed: Loading WSDL in Web Service and XML components may miss detecting repeated elements when the element has an attribute.
    • Fixed: Specifying invalid custom SOAP headers in Web Service Task component may cause Visual Studio to crash.
    • Fixed: Web Service components failed to load WSDL file when the referenced XSD file is specified in a relative path.
    • Fixed: "@Connection[AccessToken]" token may not work properly in Request Headers in HTTP Requester Task when the corresponding HTTP Connection Manager is configured to use Custom Token authentication mode.
    • Fixed: Multipart cURL command may not work properly in HTTP Connection Manager when working with Custom Token authentication mode.
  • JSON & XML Processing
    • Enhancement: Better nodes detection when loading JSON document with a mixed of null value and JObject value in JSON Source/Destination/Merge/Extract component.
    • Update: JSON destination/Merge component no longer outputs empty values when working with empty JSON object values or empty JSON array values while the Null Mode is set to Don't Show.
    • Update: Default Null Mode in XML destination and XML Merge components has been set to Empty String.
    • Update: Component generated _RowIndex and _ParentKeyField fields are now starting from 1. This may be considered as a breaking change if the index base matters.
    • Fixed: Document Designer Diagram View may not work properly in JSON/XML destination/Merge component when working in Visual Studio 2019.
    • Fixed: Encoded "%2f" value in relative path may get decoded at runtime when working in JSON/XML source component.
    • Fixed: Relative URL path ends with a dot character may not work properly in JSON/XML source component.
    • Fixed: JSON/XML destination component may output url-decoded value in the default HttpRequestUrl column.
    • Fixed: You may run into a "Stream was not readable" error in JSON source component when the @[ResponseBody] token is inside of an expression.
    • Fixed: JSON destination component may report an "Input string was not in a correct format" error when the Error Handling is set to Redirect Error Rows.
    • Fixed: JSON Extract component may report an "Object reference not set to an instance of an object" when default output is not attached.
    • Fixed: You may receive a "The buffer is no longer accessible" error in XML Extract component when a very small DefaultMaxBufferRows value is used in the data flow property setting.
    • Fixed: XML Extract component didn't direct the default output rows when an invalid XML document is received.
    • Fixed: You may run into a "For security reasons DTD is prohibited in the XML document" error when importing XSD files that contain DTD lines in XML components.
  • Mail Components
    • New: We added a new "Reply To Address" property in SMTP destination component.
    • Fixed: SMTP Task and SMTP destination component may not dispose attachments after sending email properly when executing the component in a Foreach Loop Container.
  • Marketing Intelligence
    • Update: OAuth scope is updated when generating Bing Ads token per the most recent API changes.
  • Message Queue Components
    • New: We added OAuth 2 authentication mode support in Azure Service Bus Connection Manager.
    • New: We added an Entity option in Azure Service Bus Connection Manager, which can be used to specify a particular queue/topic to work with.
    • New: We added HTTP proxy support in Azure Service Bus Connection Manager.
    • Update: Metadata update in Azure Service Bus source/destination component.
    • Update: Custom fields in Azure Service Bus source/destination component are now prefixed with "Custom.".
    • Update: Custom fields are now retained in Azure Service Bus source/destination component metadata when refreshing the component.
    • Update: SSL Server Name is removed from ActiveMQ/AMQP Connection Manager since it's not needed for configuring the connection.
    • Fixed: Amazon SQS destination component may send "Microsoft.SqlServer.Dts.Pipeline.BlobColumn" value as message body when input column is DT_NTEXT/DT_TEXT type.
  • NoSQL Components
    • New: MongoDB destination component now supports specifying if a field Is Object ID, when the option is set to true, the value will be wrapped in ObjectId() format.
    • New: We added support for setting readConcern to NULL when writing to MongoDB using MongoDB destination component.
    • New: We added HTTP proxy support in CosmosDB Connection Manager.
    • New: CosmosDB source component now supports using variable in the query.
    • Update: We have updated the CosmosDB components to use the latest v3 SDK.
    • Fixed: You may get "Import Failed" error in MongoDB components when importing from a collection and the documents in the collection is larger than the scan number.
    • Fixed: Mongo datetime value "0000-01-01" may not work properly in MongDB components.
    • Fixed: MongoDB destination component may report "A write operation resulted in an error" when performing Delete action if the input matching key value is NULL.
    • Fixed: You may run into "Exception from HRESULT: 0xC020401" when selecting or deselecting a column in DynamoDB source/destination component.
    • Fixed: DynamoDB source component may return invalid JSON documents when working with some special tables if the "Output as JSON" option is enabled.
  • Premium Data Flow Components
    • New: Premium ADO NET destination component now supports "Disable Foreign Key Checks" when performing Bulk Insert action against MySQL/MariaDB database through the MySQL data provider, this option allows to disable foreign key checks while loading data in the target database table during the ETL process.
    • New: Premium ADO NET destination component now supports "Ignore Unique Constraints" when performing Bulk Insert action against Oracle database through the Oracle ODP.NET Unmanaged data provider.
    • New: We added an Update Table button in Premium ADO NET Destination component that can be used to generate delta schema update script for execution.
    • New: We have added renaming output columns support in Premium Lookup component.
    • New: Premium OData source component now supports additional bindings towards a function.
    • New: We added additional bindings support to Premium OData destination component.
    • New: We added OData Actions support in Premium OData source component. Now OData Actions are supported in both Premium OData source and destination components. 
    • Enhancement: Better metadata detection in Premium OData component when working with openType properties and base entity fields.
    • Enhancement: Significant performance improvement when performing Upsert action in Premium ADO NET destination when using Row by Row write mode.
    • Enhancement: Error column name is now reported in Premium ADO NET destination component SQL Bulk InvalidOperationException is hit,
    • Update: Premium ADO NET destination and task components now show an asterisk indicator if pre or post command is specified.
    • Update: Create Table command in Premium ADO NET destination component now defaults to use NUMERIX(p,s) data type for number fields.
    • Update: Create Table command in Premium ADO NET destination component now shows a warning message that reminds developers to review the command before executing in the Create Table dialog.
    • Fixed: You may run into "DatabaseServiceException: 42601: syntax error at or near {column_name}0" error when performing Batch Insert action in Premium ADO NET destination if the target table column name contains space.
    • Fixed: Premium ADO NET destination component may report a "Conversion failed for command parameter[0]" error when working with datetime value through the SQL OLE DB connection
    • Fixed: You may run into a "42601: syntax error" in Premium ADO NET destination component when the target table name contains space while working with MySQL data provider.
    • Fixed: You may get a NULL value output row when Group By operation is used in Premium Aggregate component while there are no input rows.
    • Fixed: You may get an SSIS validation error "The package contains two objects with the duplicate name of "Premium Conversion. Outputs[Error Output].Columns[ErrorCode]" and "Premium Conversion.Outputs[Error Output].Columns[ErrorCode]"." when attaching an error output to Premium Conversion component.
    • Fixed: You may run into error "A value in the 'Column1' column failed to convert" when converting a NULL value to DT_TEXT/DT_NTEXT/DT_IMAGE data type.
    • Fixed: Premium Lookup component may fail with a "The given key was not present in the dictionary" error when upstream metadata has duplicate columns.
    • Fixed: You may receive an "Index was out of range" error in Premium PDF component when the specified SkipTable number is greater than the available table number.
    • Fixed: Excel destination component may not write data properly when "Write Column Header on First row" and "Append at end" both options are enabled.
    • Fixed: "Write Access Password" value in Premium Excel destination may overwrite the "Open Password" value when both password values are provided.
    • Fixed: No file was created when Skip Writing on No Rows is enabled in Premium Excel destination component.
    • Fixed: You may get a "The package contains two objects with the duplicate name" error when opening a Premium Conversion component while the component is linked from an error output.
    • Fixed: Premium Derived Column component may generate duplicate values when using Random() function across multiple columns.
  • Premium File Pack
    • New: We added Move Items operation support in Premium File Transfer Task.
    • New: We added WILD_CARD_MATCH operator support in Filter conditions in Premium File Transfer Task/Premium File Properties Task/Premium File System Source component.
    • New: We added Copy action support in Premium File System Destination component.
    • New: We added Auto Increment Format String support in Premium File System destination component when working with Auto Increment Overwrite Mode.
    • New: An optional Base Path is supported in Premium File System destination component.
    • New: Premium File System destination component now supports Auto Create Missing Folders when the provided PathToParent doesn't exist.
    • New: We added Count Items operation support to Premium File Properties Task component.
    • New: We have added local file system detail properties support to Premium File System source/destination and Premium File Properties Task components when working with a local file.
    • New: We added support of updating column properties for all columns in Premium Flat File Source and Destination components.
    • New: We added encoding support in FTPS Connection Manager.
    • Update: Send Files action in Premium File Transfer Task is renamed to Copy Items operation.
    • Fixed: Local network share folders and files may not sort properly in the tree view file browser in the Premium File Pack components.
    • Fixed: Downloading SFTP files using Premium Transfer Task or Premium File System component may not be downloaded completely when "Use Async Data Transfer" and the server connection is lost
    • Fixed: Files may not be completely downloaded when downloading SFTP files to a network share location using the Premium File Transfer Task.
    • Fixed: Parameterizing SFTP Connection Manager's ConnectionString and executing in a Foreach Loop may not work properly.
  • REST Services
    • General
      • New: REST Connection Manager now provides a tree view UI that is designed to select required scopes before generating an OAuth token.
      • Update: REST Connection Manager no longer has the Show/Hide button to view a sensitive property.
    • Active Campaign
      • New: Active Campaign REST Source component now supports retrieving related link data from the link urls.
    • ADP
      • New: Updated metadata for Time Cards object.
      • Fixed: ADP REST source component may not send the correct request when $expand and $filter parameters are specified while working with the Time Cards object.
    • Asana
      • Fixed: You may receive an "Object reference not set to an instance of an object" error in Asana REST destination component when uploading an attachment.
    • Azure Application Insights
      • Enhancement: Better error handling when an invalid query is provided in Azure Application Insights REST source component.
    • Azure Table
      • New: We added OAuth Authorization Code and OAuth Client Credentials authentication modes support in Azure Table REST Connection Manager.
      • New: We added Create/Delete/Set ACL Table actions support in Azure Table REST destination component.
      • Fixed: You may run into a "The given key was not present in the dictionary" error when parameterizing the Source Object in Azure Table REST source component.
    • Constant Contact
      • New: We added Constant Contact v3 API support.
    • Elasticsearch
      • New: We added a Create Index button in Elasticsearch REST destination component, the button will launch a Create Index dialog, which you can create an index mapping based on the input columns from upstream components.
      • Enhancement: Better data type detection for nested properties.
      • Fixed: You may get a "Sequence contains no elements" error when listing objects in Elasticsearch REST source/destination component if there are indexes with empty mappings.
      • Fixed: Elasticsearch REST Connection Manager may report a "Test connection succeeded" message when the test connection API call fails with 404 Not Found error.
    • Facebook Business
      • New: We added 'System User Access Token' authentication mode support in Facebook Business REST Connection Manager.
      • Update: We updated the default API Version to v14.0.
    • Facebook Messenger
      • Update: We updated the default API Version to v14.0. 
    • Freshdesk
      • New: Metadata update for Contact object.
      • Update: Freshdesk REST source component no longer fails the SSIS data flow, but rather it would report a warning message in SSIS log when the List All Tickets service endpoint reaches the maximum 300 pages API limit.
    • Jira
      • Fixed: Jira REST Source component may send an invalid json request when working with the Issues object if the provided jpl query contains a quote.
    • LinkedIn
      • New: We added PKCE OAuth authorization code flow support when generating a LinkedIn OAuth token file.
      • New: We added Standardized Data API support in LinkedIn REST source component.
      • Update: Metadata update for Organization Follower Statistics and Organization Page Statistics objects.
      • Fixed: You may get an "Object reference not set to an instance of an object" error when generating a token file in an existing LinkedIn REST Connection Manager when the connection manager is saved with Access Token.
      • Fixed: LinkedIn REST source component may send invalid timeIntervals parameter values when working with “Get Page Statistics” endpoint.
      • Fixed: You may run into "syntax error" when working with "Get Comments on Comments" endpoint or "Get Statistics for Specific Shares" endpoint or "Search Creatives" endpoint in LinkedIn REST source component.
    • Magento
      • Update: Magento service has been renamed to Magento/Adobe Commerce to reflect the vendor's recent branding changes.
    • Pipedrive
      • Update: Metadata update.
    • Salesforce Pardot
      • New: We added Pardot v5 API support.
    • ServiceNow
      • Enhancement: Better error handling when the status value in the API response body is "failure".
    • Shopify
      • New: We now support working with Shopify custom fields in Shopify REST source/destination component.
      • New: We added Collection endpoints support in Shopify REST source component when working with Product.
      • Update: Default API version is set to the 2nd most recent version when using <Default> API Version in Shopify REST Connection Manager.
      • Update: We have some updated metadata for Customer Object.
    • Smarsheet
      • New: We have added Row Location properties support when working with discovered sheet object in Smartsheet REST destination component.
      • Fixed: Smarthseet REST source component may not read report data properly when working with discovered report objects.
      • Fixed: Pagination may not work properly when reading from discovered report object in Smarsheet REST source component.
    • Xero
      • New: We added PKCE OAuth authorization code flow support when generating an Xero OAuth token file.
      • Update: Default and maximum Throttle Rate in Xero REST Connection Manager is now set to 60 requests/minute.
    • Zoho CRM
      • New: Zoho CRM REST destination component now supports uploading file content to FileUpload/ImageUpload fields.
      • Update: Zoho CRM API support has now been updated to v3.
      • Update: We updated the paging strategy to use the "page_token" when paging through Zoho CRM records.
    • Zoom
      • New: We added API support to Zoom REST source/destination component, available values are: Zoom Meeting, Zoom Meeting Master Account, Zoom Phone, Zoom Phone Master Account, Zoom Video, Zoom Chat.
      • Update: We have updated the Zoom metadata.
    • Zuora
      • Update: We updated X-Zuora-WSDL-Version header to the latest 115 version when working with Query in Zuora REST source component.
      • Update: Zuora REST source/destination component no longer reports an error at design time when the metadata discovery call fails with permission error.
      • Fixed: Specified Zuora Entity Ids value in Zuora REST Connection Manager may not get set properly in the API request.

For other releases click on the respective year:
2024 - 2023 - 2021 - 2020 - 2019 - 2018 - 2017 - 2016