CRM 2011 Product Import "Duplicate Reference Found" - duplicates

I've been trying to import some new products to our CRM Organization, although I always seem to get this error for the U of M column.
"A Duplicate Lookup Reference was Found"
Error Log
My CSV File being Used

Related

Failed because truncation occurred, and the truncation row disposition on

I am trying to perform data import for a sample CSV file of 27 records into DB table using SSIS or SSMS import/export wizard. I have given the data length in DB of every column to max. There are many solutions out there for excel file not a CSV file.
It loads all the 26 rows, but at the 27th row, it gives the same error for one particular column, which has the length of just 56.
The data conversion for column "Provider First Line Business Mailing Address" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".
Error: 0xC020902A at Data Flow Task 1, Source - test_csv [679]: The "Source - test_csv.Outputs[Flat File Source Output].Columns[Provider First Line Business Mailing Address]" failed because truncation occurred, and the truncation row disposition on "Source - test_csv.Outputs[Flat File Source Output].Columns[Provider First Line Business Mailing Address]" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.
Error: 0xC0202092 at Data Flow Task 1, Source - test_csv [679]: An error occurred while processing file "C:\Users\test-L8869.csv" on data row 27.
This is the data string value
800 METROPOLITAN DROVE ASSOCIATED LOGICAL PROFESSIONALS

"Bad Request" message from Import Schema of Copy Activity in Azure Data Factory (ADF)

I have to migrate data from CRM Business Central into an Azure SQL database. The source data comes from REST API. I created a linked service related to it. Then I created a copy activity with the following:
The preview works. I get data in a JSON format. For the mapping tab, I tried to import the schema and set the field "value" as an array. I got the following result:
However, on the right side of the mapping, I can only see "#odata.context" proposed as a "sink mapping". I overwrote it by writing the right fields. When I run the pipeline with "debug mode", the pipeline is not triggered and I received a "Bad Request":
The error comes from the mapping. My question is: how does the "Import schema" work in case of JSON data? Do I have to import manually the schema?
Change the sink column #odata.context to other name by excluding the special characters.
I have reproed with a sample rest API and got the same error when I used the special characters (#, .) in the sink column ex :#data.id.
I have changed the sink column name ex: data_id to exclude special characters and the pipeline ran successfully.

Import/Export wizard fails on export to Excel

I am exporting a table from sql server to Excel using the SSIS Import/Export wizard. In Proceed step, I get a warning icon in each record regarding conversion of types. If I ignore then the export fails after clicking Finish in the last screen.
I search in Stack Overflow regarding this but unable to get relevant answer...
SQL table fields and their type are below:
CREATE SomeTable
(
EmpId numeric(9)
, Name varchar(50)
, Address varchar(50)
, ContactNo varchar(50)
);
Error that comes is written below
Copying to tblSSISFlatImport (Error) Messages Error 0xc0202009: Data
Flow Task 1: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has
occurred. Error code: 0x80004005. (SQL Server Import and Export
Wizard) Error 0xc0209029: Data Flow Task 1: SSIS Error Code
DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "input "Destination Input"
(39)" failed because error code 0xC020907B occurred, and the error row
disposition on "input "Destination Input" (39)" specifies failure on
error. An error occurred on the specified object of the specified
component. There may be error messages posted before this with more
information about the failure. (SQL Server Import and Export Wizard)
Error 0xc0047022: Data Flow Task 1: SSIS Error Code
DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component
"Destination - tblSSISFlatImport" (28) failed with error code
0xC0209029 while processing input "Destination Input" (39). The
identified component returned an error from the ProcessInput method.
The error is specific to the component, but the error is fatal and
will cause the Data Flow task to stop running. There may be error
messages posted before this with more information about the failure.
(SQL Server Import and Export Wizard)
I've seen this error before and it could be a result of several things.
1) Make certain that in the Data Conversion Transformation Editor that the fields Name, Address and ContactNo have a Data Type set to "Unicode string [DT_WSTR] with a length of 50 in order to convert from SQL Server to Excel.
2) if you are working on server, make certain that Run64BitRuntime is set to True (otherwise for set it to False). This you can check by right-clicking on the package name (first item under Solution Explorer on the right side of the window), selecting properties and then Debugging under Configuration Properites.
3) Under the Data Flow tab, double-click the source OLE DB item, select Connection Manager and verify that the values are being pulled by selecting Preview at the bottom. It may be possible that you are not pulling the data correctly and that is throwing off the conversion step.
4) Lastly, compare the settings between the Data Conversion Input vs. Data Conversion Output. This is done by selecting the Data Conversion task and selecting the hyperlink for "Show Advanced Editor" under Properties. When the window opens, select the tab "Input and Output Properties." In the left pane, expand the Input columns and Output column folders to view the three fields. By selecting on a field you can view the properites. Make certain that the lengths are correct and that the Data Type Properties are defined correctly. As mentioned before, the output for each should be "Unicoce string [DT_WSTR]" with a length of 50.
Hope this helps.

Error in retrieving data from Excel File

I have an excel file. I wanted to pull the data from excel file to SQL Server table. And the data is successfully transferred. In the excel file, I removed a text from one column named Risk from one row.The text was lengthy one. Now the package execution fails at the source ie from the excel file. The errors are shown as
[Audit [1]] Error: There was an error with output column "Risk" (100)
on output "Excel Source Output" (9). The column status returned was:
"DBSTATUS_UNAVAILABLE".
and
[Audit [1]] Error: SSIS Error Code
DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "output column "Risk"
(100)" failed because error code 0xC0209071 occurred, and the error
row disposition on "output column "Risk" (100)" specifies failure on
error. An error occurred on the specified object of the specified
component. There may be error messages posted before this with more
information about the failure.
the error occurs when I remove this particular text from this row and when I clear the whole data except the column names and reenter a new data. And even if I replace the excel file with the same name and same column names but with different data.
Make sure that the excel is closed before you run the SSIS package. Plus try refreshing the meta data by opening the SSIS package, going to the columns section in the source and destination data flow items. There seems to be no other problems or you have described/observed it in the wrong way.
I just ran into this...don't recall seeing it before in 10+ yrs of using SSIS. Google-ing found a solution. Right-click on the Excel connection>>Advanced Editor>>Input and Output Properties. Open the "Output Columns" in the Excel Source Output treeview, and find the pesky column. Change the ErrorRowDisposition to RD_IgnoreFailure.
This got me part way - I had to go in and change the DataType property and the length afterwards to get it to work. Then I put the ErrorRowDisposition back to fail and ran it only with the changed DataType and length, and it ran.
Play with these options and see if you can get it to work; I'm assuming that the data type change fixed it.

Errorneous Row numbers in a SSIS task

I am importing a text file into SQL server table which has got number of constraints. I have created one package and associated tasks.
At the end of a SSIS package execution, I want to know the erroenous row numbers which were not succefully exported to DB. Is any direct API or variable available in dts namespace to give this information?
Kindly share with me any knowledge to get this information.
Thanks,
Rahul
The error (red line) output of your import step inside the data flow lets you redirect to an error table. This should list the information you are after.
http://msdn.microsoft.com/en-us/library/ms140083.aspx
Error Outputs ( http://msdn.microsoft.com/en-us/library/ms140080.aspx )
Sources, destinations, and transformations can include error outputs. You can specify how the data flow component responds to errors in each input or column by using the Configure Error Output dialog box. If an error or data truncation occurs at run time and the data flow component is configured to redirect rows, the data rows with the error are sent to the error output. By default, an error output contains the output columns and two error columns: ErrorCode and ErrorColumn. The output columns contain the data from the row that failed, ErrorCode provides the error code, and ErrorColumn identifies the failing column.
For more information, see Handling Errors in the Data Flow.
Redirect the error rows on the destination component, pipe them through a count operation and then log that to a log table or whatever.