SSIS Package Failing when called through DTExec - fine through VS - ssis

I have an SSIS package that is running fine when I press the "Start" button in VS, but when I run it via DTExec, it's bombing part way through with the following errors.
Error: 2020-06-10 13:47:20.22
Code: 0xC0047038
Source: JCMAST to SQL SSIS.Pipeline
Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on JCMAST - WA returned error code 0x80004005. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
End Error
Error: 2020-06-10 13:47:20.49
Code: 0xC0047022
Source: JCMAST to SQL SSIS.Pipeline
Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Co, Job Yesterday Sort" (47) failed with error code 0xC0047020 while processing input "Sort Input" (50). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.
End Error
I can see that the package is called properly, as I can see all of the different validation and pre-execution steps. These are the only errors that come up in the entire run.
Everything that I've Googled so far with these errors typically come with some sort of additional error. Not the case here.
What's so confusing to me is why it would run manually, but not through cmd.
EDIT: Full error output
Started: 2:55:09 PM
Error: 2020-06-10 14:55:14.35
Code: 0xC0047038
Source: JCMAST to SQL SSIS.Pipeline
Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on JCMAST - WA returned error code 0x80004005. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
End Error
Error: 2020-06-10 14:55:14.64
Code: 0xC0047022
Source: JCMAST to SQL SSIS.Pipeline
Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Co, Job Yesterday Sort" (47) failed with error code 0xC0047020 while processing input "Sort Input" (50). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.
End Error
Error: 2020-06-10 14:55:20.67
Code: 0xC0047038
Source: EMP Files to SQL SSIS.Pipeline
Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on PREMP - WA returned error code 0x80004005. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
End Error
DTExec: The package execution returned DTSER_FAILURE (1).
Started: 2:55:09 PM
Finished: 2:55:34 PM
Elapsed: 24.343 seconds
SSIS package "D:\SafetyServicesProjects\WebAppsTest2\WebAppsTest2\Package.dtsx" starting.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Warning: 0x80049304 at Data Flow Task, SSIS.Pipeline: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not available. To resolve, run this package as an administrator, or on the system's console.
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Data Flow Task, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Data Flow Task, SSIS.Pipeline: Execute phase is beginning.
Error: 0xC0047038 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on ODBC Source returned error code 0x80004005. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at Data Flow Task, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at Data Flow Task, SSIS.Pipeline: "OLE DB Destination" wrote 0 rows.
Information: 0x40043009 at Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Data Flow Task
Warning: 0x80019002 at Package: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "D:\SafetyServicesProjects\WebAppsTest2\WebAppsTest2\Package.dtsx" finished: Failure.

Well. Figured it out.
Turns out it all came down to versioning. I was using a version of IBM iAccess ODBC that had issues with Windows 10. Upgraded to the latest version and it worked.

Related

Data Flow task error for a source file using SSIS

I'm getting below error while importing data from flat file(.csv) is my source connection and OLE DB is the destination.
SSIS package "C:\Users\Documents\Visual Studio
2010\Projects\Final\Final\Package.dtsx" starting. Information:
0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is
beginning. Information: 0x4004300A at Data Flow Task, SSIS.Pipeline:
Validation phase is beginning. Warning: 0x80049304 at Data Flow Task,
SSIS.Pipeline: Warning: Could not open global shared memory to
communicate with performance DLL; data flow performance counters are
not available. To resolve, run this package as an administrator, or
on the system's console. Information: 0x40043006 at Data Flow Task,
SSIS.Pipeline: Prepare for Execute phase is beginning. Information:
0x40043007 at Data Flow Task, SSIS.Pipeline: Pre-Execute phase is
beginning. Information: 0x402090DC at Data Flow Task, Flat File Source
[2]: The processing of file "D:\Badger\company334563_checkins.csv"
has started. Information: 0x4004300C at Data Flow Task, SSIS.Pipeline:
Execute phase is beginning. Error: 0xC02020A1 at Data Flow Task, Flat
File Source [2]: Data conversion failed. The data conversion for
column "Follow up" returned status value 4 and status text "Text was
truncated or one or more characters had no match in the target code
page.". Error: 0xC020902A at Data Flow Task, Flat File Source [2]:
The "Flat File Source.Outputs[Flat File Source
Output].Columns[Follow up]" failed because truncation occurred, and
the truncation row disposition on "Flat File Source.Outputs[Flat File
Source Output].Columns[Follow up]" specifies failure on truncation.
A truncation error occurred on the specified object of the specified
component. Error: 0xC0202092 at Data Flow Task, Flat File Source
[2]: An error occurred while processing file
"D:\Badger\company334563_checkins.csv" on data row 2. Error:
0xC0047038 at Data Flow Task, SSIS.Pipeline: SSIS Error Code
DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on Flat File Source
returned error code 0xC0202092. The component returned a failure code
when the pipeline engine called PrimeOutput(). The meaning of the
failure code is defined by the component, but the error is fatal and
the pipeline stopped executing. There may be error messages posted
before this with more information about the failure. Information:
0x40043008 at Data Flow Task, SSIS.Pipeline: Post Execute phase is
beginning. Information: 0x402090DD at Data Flow Task, Flat File Source
[2]: The processing of file "D:\Badger\company334563_checkins.csv"
has ended. Information: 0x4004300B at Data Flow Task, SSIS.Pipeline:
"OLE DB Destination" wrote 0 rows. Information: 0x40043009 at Data
Flow Task, SSIS.Pipeline: Cleanup phase is beginning. Task failed:
Data Flow Task Warning: 0x80019002 at Package: SSIS Warning Code
DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but
the number of errors raised (4) reached the maximum allowed (1);
resulting in failure. This occurs when the number of errors reaches
the number specified in MaximumErrorCount. Change the
MaximumErrorCount or fix the errors. SSIS package
"C:\Users\Documents\Visual Studio
2010\Projects\Final\Final\Package.dtsx" finished: Failure.
I've created SSIS package to import the data from Flat file to SQL DB using OLE DB Destination.
You can check
You can open CSV file using Excel and delimit the column in Excel, maybe some data column not having proper value in Excel for example column decimal filled with VARCHAR value
Maybe your csv file only has 5 of 11 columns

SSIS Workflow issue when run by Task Scheduler

I have a SSIS Workflow that is a little unreliable.
The Normal procedure should be as follows: Task Scheduler Job starts batch File. Batch File starts SSIS Job.
This process produces this error:
Error: 2020-12-08 07:10:43.95
Code: 0xC02090F5
Source: Data Flow Task Connect to Impala [2132]
Description: The component "Connect to Impala" (2132) was unable to process the data. ERROR [08S01] [Cloudera][ImpalaODBC] (120) Error while retrieving data from in Impala: [08S01] : SSL_read: error code: 0
End Error
Error: 2020-12-08 07:10:43.95
Code: 0xC0047038
Source: Data Flow Task SSIS.Pipeline
Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on component "Connect to Impala" (2132) returned error code 0xC02090F5. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
End Error
But when I start the Batch File, the SSIS Job is executed successfully. Even when I start the Job within MS Visual Studio there are no issues.
Google makes a hint that there could be an issue with the ODBC connection. I am using an 32 Bit ODBC Driver for Impala (User DSN). Also tried it with 64 Bit but doesn't work either.
I appreciate every answer.
Thanks
Problem solved
Please see this solution: https://community.cloudera.com/t5/Support-Questions/ERROR-SSL-read-error-code-0-with-IMPALA-from-R-programming/td-p/280561
It is about timeout parameters.

SSIS package after execution

New to MS BI, I am getting an error after execution completed.
SSIS package "C:\Users\FirstSSIS\Package.dtsx" starting.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Warning: 0x80049304 at Data Flow Task, SSIS.Pipeline: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not available. To resolve, run this package as an administrator, or on the system's console.
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Data Flow Task, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x402090DC at Data Flow Task, Flat File Source [20]: The processing of file "C:\Users\Sangeet\Desktop\Test1.txt" has started.
Error: 0xC0202071 at Data Flow Task, SQL Server Destination [41]: Unable to bulk copy data. You may need to run this package as an administrator.
Error: 0xC004701A at Data Flow Task, SSIS.Pipeline: SQL Server Destination failed the pre-execute phase and returned error code 0xC0202071.
Information: 0x40043008 at Data Flow Task, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x402090DD at Data Flow Task, Flat File Source [20]: The processing of file "C:\Users\Sangeet\Desktop\Test1.txt" has ended.
Information: 0x4004300B at Data Flow Task, SSIS.Pipeline: "SQL Server Destination" wrote 0 rows.
Information: 0x40043009 at Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Data Flow Task
Warning: 0x80019002 at Package: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (2) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "C:\Users\Sangeet\source\repos\FirstSSIS\FirstSSIS\Package.dtsx" finished: Failure.
The program '[24072] DtsDebugHost.exe: DTS' has exited with code 0 (0x0).
run package as an administrator

ssis package excecution error

I created a package which is used to transfer data from oracle instance to SQL instance
I got following errors
1.[SRC WKF_LOG_HISTORY [63]] Error: Either Table Name or SqlCommand property should be set.
2.[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on SRC WKF_LOG_HISTORY returned error code 0x80004005. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
3.Task DFT Copy Data failed could any one please help to get out from these.
thank you

SSIS DataReader fail from Mainframe

I have an ADO.Net connection using an ODBC data source to connect to our mainframe. When it's connected to a DataReader Source, the Datareader immediately fails. I'm assuming at the very least the connection is working correctly because a Select * From (not that I'm using one) in the SqlCommand will correctly show all of the available columns under column mappings. When trying to dump to a simple flat file, I get this.
SSIS package "MainframeTest.dtsx" starting.
Information: 0x4004300A at Data Flow Task, DTS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Data Flow Task, DTS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Data Flow Task, DTS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Data Flow Task, DTS.Pipeline: Pre-Execute phase is beginning.
Information: 0x402090DC at Data Flow Task, Flat File Destination [191]: The processing of file "C:\Documents and Settings\BBSA322\Desktop\LogFile.txt" has started.
Information: 0x4004300C at Data Flow Task, DTS.Pipeline: Execute phase is beginning.
Error: 0xC02090F5 at Data Flow Task, DataReader Source [1]: The component "DataReader Source" (1) was unable to process the data.
Error: 0xC0047038 at Data Flow Task: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on component "DataReader Source" (1) returned error code 0xC02090F5. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
Error: 0xC0047021 at Data Flow Task: SSIS Error Code DTS_E_THREADFAILED. Thread "SourceThread0" has exited with error code 0xC0047038. There may be error messages posted before this with more information on why the thread has exited.
Error: 0xC0047039 at Data Flow Task: SSIS Error Code DTS_E_THREADCANCELLED. Thread "WorkThread0" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown. There may be error messages posted before this with more information on why the thread was cancelled.
Error: 0xC0047021 at Data Flow Task: SSIS Error Code DTS_E_THREADFAILED. Thread "WorkThread0" has exited with error code 0xC0047039. There may be error messages posted before this with more information on why the thread has exited.
Information: 0x40043008 at Data Flow Task, DTS.Pipeline: Post Execute phase is beginning.
Error: 0xC0047018 at Data Flow Task, DTS.Pipeline: component "DataReader Source" (1) failed the post-execute phase and returned error code 0x8007000E.
Error: 0xC0047018 at Data Flow Task, DTS.Pipeline: component "DataReader Source" (1) failed the post-execute phase and returned error code 0x8007000E.
Information: 0x402090DD at Data Flow Task, Flat File Destination [191]: The processing of file "C:\Documents and Settings\BBSA322\Desktop\LogFile.txt" has ended.
Information: 0x40043009 at Data Flow Task, DTS.Pipeline: Cleanup phase is beginning.
Error: 0xC004701B at Data Flow Task, DTS.Pipeline: component "DataReader Source" (1) failed the cleanup phase and returned error code 0x8007000E.
Information: 0x4004300B at Data Flow Task, DTS.Pipeline: "component "Flat File Destination" (191)" wrote 0 rows.
Error: 0xC0047037 at Data Flow Task, DTS.Pipeline: component "DataReader Source" (1) failed during shut down and returned error code 0x8007000E. A component failed to release its interfaces.
Task failed: Data Flow Task
Warning: 0x80019002 at MainframeTest: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (9) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "MainframeTest.dtsx" finished: Failure.
Found out it was a problem with a .Net framework update. Adding a text file to the error output fixed the problem.
Answer found here.
http://blogs.msdn.com/b/sqlblog/archive/2009/04/09/after-installation-of-net-framework-3-5-sp1-or-net-framework-2-0-sp2-ssis-packages-using-odbc-3rd-party-drivers-may-fail.aspx