Having an incremental load or capturing delta changes is crucial for any integration scenario. This increases efficiency and allows to reduce the load during each package execution run by reading only the changes that occurred after the last execution from the Source system. In this blog post, we will show you a simple design using KingswaySoft components that can be applied to almost any data flow requiring incremental load capabilities.

APIs are typically based on either SOAP (XML) or REST (JSON) service calls. However, there are cases where you might receive an XML snippet from a REST service endpoint that primarily serves a JSON document. In such situations, you need a proper strategy for working with the embedded XML snippet. In this blog post, we will show you how this can be achieved effectively.

The components we developed at KingswaySoft generally discover metadata automatically whenever possible - That is, our software retrieves metadata information made available by the API itself in order to properly populate our ETL components. In most cases, the metadata in our components is generally accurate, provided the target system has a reliable metadata API. This includes services like Dataverse/Dynamics 365 CE, Salesforce, SharePoint, etc. Accurate metadata is vital for data integrity in ETL processes. However, there are occasional cases where some ETL metadata fine-tuning may be necessary due to unique situations. For instance, you might encounter cases where a text field contains more data than what is indicated by its metadata, potentially causing the source extraction to fail. In such instances, manual editing of the metadata will be required in order for the ETL process to work. In this blog post, we will show you how such changes can be made properly for your ETL components.

KingswaySoft’s Premium Excel Destination component not only allows you to write values to an Excel file but also supports formulas. By using formulas in your Excel file, it can open up your data flows to many more possibilities. In this blog post, we will demonstrate one example of using formulas to create hyperlinks in an Excel file.

Applications and processes often rely on external resources, which can be expensive to retrieve or obtain. Therefore, modern applications often employ cache strategies to save these external resources in the local file system and achieve improved performance. In some other cases, you might have an application that keeps creating random temporary files to facilitate certain system requirements which cannot be achieved otherwise. However, as every coin has two sides, these caches or temporary files, in the long run, can build up in the system and occupy large disk space, which could have adverse effects and result in volume deficiency in the system. Implementing a scheduled cleanup of the cache folder by removing those files that are older than a certain age can become necessary in your ETL process.

In SSIS, the sensitive credentials have to be handled in a special way to ensure that they get preserved and decrypted while the packages run in an unattended way. There are a few means to do this, and in this blog post, we will discuss some popular ways this can be done.

NetSuite Custom fields are fields that you can add to records and transactions which can be used to save some additional information. This provides quite some flexibility when working with the NetSuite application if we have some special business requirements which cannot be accomplished using those out-of-box fields. Once added, those fields require some special attention in order to use use them in SSIS ETL data flows. In this blog post, we will show you how this can be done easily by using KingswaySoft components.

In this blog post, we will show a simple solution that can be used to generate the JSON structure from database tables which can be sent to CDS/CRM destination components for writing, we demonstrate the use of SQL FOR JSON clause to achieve the purpose.

This post will demonstrate how to perform file existence check in SSIS without writing a single line of code by using KingswaySoft Premium File Properties Task.

In this blog post, we will discuss how to perform file upload using HTTP multipart/form-data format in SSIS without having to write a single line of code.

In this blog post, we will be going through some complex JSON document structures and demonstrate how to configure KingswaySoft JSON Source/Extract component to extract data from those JSON documents efficiently.

In this blog post, we will be going through some of the most common API pagination methods and demonstrate how to configure KingswaySoft JSON Source component to send out the paginated requests in SSIS.

When integrating data between different applications or database systems, what do you do when certain fields hold data in a different format than what the target system is expecting? This blog post will demonstrate how using our latest components within the SSIS Productivity Pack, Composition and Decomposition, you can parse each individual value from a delimited text form with ease.

In a prior blog post, we explained how to migrate quotes from one Dynamics CRM system to another however it only focused on the most recent quote. In this post, we expand on that migration and show you how to use our software to migrate Dynamics CDS/CRM quotes with revisions in SSIS.

Real-time data integration is now essential for immediate decision making by businesses across the world. With modern-cloud based services such as Salesforce and our Integration Gateway solution, integrate your Salesforce data with any application or database system in real-time.

When working with JSON data, a scenario may arise where there could be a format of a JSON Document that makes it challenging to extract the data into a typical tabular form. This blog post will explore using the "Key Value Pivot" Output type found in our JSON Source/Extract Components to parse Key/Value pairs from JSON documents with ease.

It is always crucial for an ETL process to have a change tracking mechanism to identify when a change has happened to any set of data and only process data that has changed. Let's show you how to implement change tracking with our Premium Hash component.