SSIS Chunk Timeout Errors exporting data using CData Snowflake Source - ssis

Anyone run into this error? How do I resolve, not getting much guidance from cdata or snowflake.
Error: 0x0 at ADI_PRODUCT, CData Snowflake Source: Get data error: Retrieved Chunk#0 Timeout.
Error: 0xC0047062 at ADI_PRODUCT, CData Snowflake Source [279]: System.Exception: Get data error: Retrieved Chunk#0 Timeout.
at CData.SSIS.Snowflake.SSISSourceComponent.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)
Error: 0xC0047038 at ADI_PRODUCT, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on CData Snowflake Source returned error code 0x80131500. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.

I am not sure about this, but given the fact that there appears to be a timeout retrieving data (presumably from Azure's cloud storage), it might be worthwhile to verify that you are not encountering a networking issue (eg. firewall) by verifying connectivity via Snowflake's SnowCD utility. Just a thought.

Related

SSIS Package failing in SIT environment

I have an SSIS package that uses ZappySys HTML table source to connect to the web. When I run the package pointing to an environment, it runs successfully, but when I execute the package in SSISDB, it throws error " OnError View Contex df_WeatherData:Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on HTML Table Source returned error code 0x80131500. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
OnError View Context df_WeatherData:Error: System.Exception: Table not found for specified criteria
at ZappySys.PowerPack.Adapter.HtmlTableSource.HtmlTableHelper. (String , WebClient , TableFetchSettings , Boolean , Boolean , List1& ) at ZappySys.PowerPack.Adapter.HtmlTableSource.HtmlTableHelper.GetTableData(String url, WebClient webClient, TableFetchSettings settings, Boolean fetchColInfo, Boolean fetchData, List1& colInfoList, List1& linksTable, List1& imageTable, Int32& rowsAdded)
at ZappySys.PowerPack.Adapter.HtmlTableSource.HtmlDataExtractor.Process(HtmlDataExtractArgs args)
at ZappySys.PowerPack.Adapter.HtmlTableSource.HtmlTableSource.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)"
Please help, I have been trying to debug this issue days now. Thanks
I figured the Environment variables values from my package, does not match with the affected environment values, which is causing the job to fail after deployment.

SSIS Issue Pulling Data From Snowflake - [CData Snowflake Source] Error: Get data error: Received metadata with an incompatible version number

I'm trying to run a simple data flow task in SSIS pulling data from Snowflake to SQL Server using a component from CDATA called Snowflake Source.
Connection works and I can also see a preview of the data but when actually running the package I get the following error message:
[CData Snowflake Source [2]] Error: System.Exception: Get data error: Received metadata with an incompatible version number
at CData.SSIS.Snowflake.SSISSourceComponent.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)
Has anyone experienced this before or know what to do in order to fix it?
Hi I faced this error many time , when i use some custom script component or third party component.
Issue : We do remove or delete some component but some of the reference is not removed from package (it is very tough to debug )
Create fresh package it will work .

Oracle SOA BPEL calling a MySQL Procedure - parameter number 2 is not an out parameter

Currently I have a use case where I need to invoke a Mysql Procedure thorough Oracle BPEL. The adapter configuration is fine and shows me the available In/Out parameters during the configuration and the composite is deployed successfully. However the invocation is failed during the webs service call.
Any idea about the issue particularly in SOA. The weblogic version is 12c & I am using jDev 11g for the composite development.
Below is the error message received during the web service call-
The selected operation process could not be invoked.
A fault occurred while invoking the webservice operation. The fault is : <env:Fault xmlns:env="http://schemas.xmlsoap.org/soap/envelope/">
<faultcode>env:Server</faultcode>
<faultstring>Exception occurred when binding was invoked.
Exception occurred during invocation of JCA binding: "JCA Binding execute of Reference operation 'getUserFirstName' failed due to: Register out parameter error.
Error registering parameter First_Name as an out parameter.
An error occurred when registering parameter First_Name as an out parameter of the getUserName API. Cause: java.sql.SQLException: Parameter number 2 is not an OUT parameter
Check to ensure that the parameter is a valid IN/OUT or OUT parameter of the API. This exception is considered retriable, likely due to a communication failure. To classify it as non-retriable instead add property nonRetriableErrorCodes with value "0" to your deployment descriptor (i.e. weblogic-ra.xml). To auto retry a retriable fault set these composite.xml properties for this invoke: jca.retry.interval, jca.retry.count, and jca.retry.backoff. All properties are integers.
".
The invoked JCA adapter raised a resource exception.
Please examine the above error message carefully to determine a resolution.
</faultstring>
<faultactor/>
<detail>
<exception>Parameter number 2 is not an OUT parameter</exception>
</detail>
</env:Fault>
oracle.sysman.emInternalSDK.webservices.util.SoapTestException: Client received SOAP Fault from server : Exception occurred when binding was invoked.
Exception occurred during invocation of JCA binding: "JCA Binding execute of Reference operation 'getUserFirstName' failed due to: Register out parameter error.
Error registering parameter First_Name as an out parameter.
An error occurred when registering parameter First_Name as an out parameter of the getUserName API. Cause: java.sql.SQLException: Parameter number 2 is not an OUT parameter
Check to ensure that the parameter is a valid IN/OUT or OUT parameter of the API. This exception is considered retriable, likely due to a communication failure. To classify it as non-retriable instead add property nonRetriableErrorCodes with value "0" to your deployment descriptor (i.e. weblogic-ra.xml). To auto retry a retriable fault set these composite.xml properties for this invoke: jca.retry.interval, jca.retry.count, and jca.retry.backoff. All properties are integers.
".
The invoked JCA adapter raised a resource exception.
Please examine the above error message carefully to determine a resolution.
Step wise DB Adapter configuration is here-
https://drive.google.com/open?id=1cei0OFje1dmefDn7PfBIjxW4vb81Ngez
I think you made a mistake while you are selecting in and out parameters, probably you have added more variable than your database are expecting. Please look at the following and if possible send more details like screenshots of your db adapter configurations and db table
java.sql.SQLException: Parameter number 2 is not an OUT parameter

SSIS - exporting multiple resultsets from stored procedure to multiple sheets in an Excel

I have been creating a SSIS package where the procedure I use returns 3 result sets and this needs to be copied over to a single excel with 3 different sheets. I have used a script component to extract the data, defined 3 outputs and used data reader to map results to those outputs. I added paths to 3 different Excel file destination (all pointing to same file but different sheets). When I run the package it works fine once every 5/6 times but mostly it fails with below error.
Could anyone help me why it keeps failing most of the time and how to fix it.
Error: 0xC0202009 at Data Flow Task, Excel Destination 1 [366]: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
Error: 0xC0209029 at Data Flow Task, Excel Destination 1 [366]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "input "Excel Destination Input" (377)" failed because error code 0xC020907B occurred, and the error row disposition on "input "Excel Destination Input" (377)" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Excel Destination 1" (366) failed with error code 0xC0209029 while processing input "Excel Destination Input" (377). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.
Trying to write to all three sheets in parallel can cause contention issues. Redesign your package to force the three dataflows to run in sequence (sheet1, sheet2, sheet3) and the issue will go away.

SSIS: copy tables from MySQL to SQL Server 2008

I'm getting an error while trying to copy 4 tables from a MySQL source to SQL Server 2008.
Here's a photo of the Data Flow, as you can see, 2 of them are OK (the smaller ones)
With an OnError event handler I'm able to see the errors. Here they are.
SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error
code: 0x80040E21. An OLE DB record is available. Source: "Microsoft
SQL Server Native Client 10.0" Hresult: 0x80040E21 Description:
"Multiple-step OLE DB operation generated errors. Check each OLE DB
status value, if available. No work was done.".
There was an error with input column "FechaHoraCorteAgente" (884) on
input "OLE DB Destination Input" (510). The column status returned
was: "Conversion failed because the data value overflowed the
specified type.".
SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "input "OLE
DB Destination Input" (510)" failed because error code 0xC020907A
occurred, and the error row disposition on "input "OLE DB Destination
Input" (510)" specifies failure on error. An error occurred on the
specified object of the specified component. There may be error
messages posted before this with more information about the failure.
SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on
component "OLE DB Destination 2" (497) failed with error code
0xC0209029 while processing input "OLE DB Destination Input" (510).
The identified component returned an error from the ProcessInput
method. The error is specific to the component, but the error is
fatal and will cause the Data Flow task to stop running. There may
be error messages posted before this with more information about the
failure.
The component "ado net conptacto" (1) was unable to process the data.
Exception from HRESULT: 0xC0047020
The component "ADO NET logllamados" (482) was unable to process the
data. Exception from HRESULT: 0xC0047020
SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on
component "ado net conptacto" (1) returned error code 0xC02090F5.
The component returned a failure code when the pipeline engine called
PrimeOutput(). The meaning of the failure code is defined by the
component, but the error is fatal and the pipeline stopped executing.
There may be error messages posted before this with more information
about the failure.
SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on
component "ADO NET logllamados" (482) returned error code 0xC02090F5.
The component returned a failure code when the pipeline engine called
PrimeOutput(). The meaning of the failure code is defined by the
component, but the error is fatal and the pipeline stopped executing.
There may be error messages posted before this with more information
about the failure.
Any idea of what's going on in here?
"Conversion failed because the data value overflowed the specified type." seems pretty obvious, you are trying to insert something where it doesn't fit. I suggest you compare all your source columns with destination columns and make sure that:
lengths are enough
data types are compatible
you can post your tables' structures if you would like a hand on that
Source column has 0000-00-00 in a datetime field. So there was the error.
Created a Derived Column with the expression:
(DT_DBTIMESTAMP)(DAY([FechaHoraCorteAgente]) == 0 ? NULL(DT_DBTIMESTAMP) : [FechaHoraCorteAgente])
It's a failure at source, If the package fails while inserting at the destination, that's easily solvable. I have come across many situations where the source data is larger than what SSIS source is expecting to see.
I think when you create the source, SSIS automatically samples the input data to see the maximum length. But what if that maximum length were to be exceeded? That's where I see most of the problems relating to overflow.
Also, many a times when dealing with poorly handled source data, you would see a character data in a date time field. Such a scenario would also spoil the package.