connection setup to azure SQL database in SSIS lookup transform - ssis

My existing on-prem ssis package has the structure wherein it uses lookup transform to upsert the data...
Since it's being migrated to azure SQL cloud database , I am unable to configure the lookup connection to azure SQL database.
Given that lookup only supports Oledb connection manager ,I am unable to find any another appraoch.
Already tried creating ado.net connection manager but the same doesn't appears in lookup.
Since I cant modify the existing structure of package,
Could anyone suggest the alternative way wherein I can setup the connection to azure SQL database.
Any help appreciated.
Thanks in advance.

OLEDB connection to SQL Azure works perfectly and the lookup connection cannot be other than an OLEDB connection. Therefore you need to update the OLEDB connection as described here to be able to connect to the Azure SQL Database. Provide the SQLAdmin credentials or any login with access to the Azure SQL Database on the OLEDB connection.

Related

How to connect Azure Database for MySQL flexible server in Azure SQL Server Database

I am trying to set up a connection between Azure MySQL flexible server and Azure SQL database mainly to read data from MySQL and store it in the SQL Server periodically (multiple times a day).
I was thinking of creating a stored procedure inside my SQL Server database; however, I cannot seem to get a connection from the SQL Server into the MySQL database.
I know with ODBC you can connect MySQL to on-prem SQL Server, but unfortunately, there is nothing I have found for the same functionality for Azure SQL Server.
Has anyone done this? Is this possible?
I have tried to set up an ODBC connection, but it did not work as the SQL Server is on Azure.
I tried setting up a linked server inside SQL Server straight to MySQL, but it doesn't seem possible as the SQL Server is not on-prem.
I tried creating external database objects based on the following link.
With all these approaches, my expectation was to surface the MySQL tables from Azure SQL Server/SSMS.
Thank you for your help in advance!
MySql Workbench is the perfect option for connecting the azure database for mysql.
for that we need to create flexible server in azure portal. I created flexible server in azure portal.
Image for reference:
I created database in flexible server by clicking add in in database option. it crated successfully.
Image for refence:
I installed MySQL Workbench in my local system.
you can get your required fields to connect the server in connect tab.
Image for reference:
I connected to the server by filling required fields.
Image for reference:
Click on ok. It connected successfully.
Image for reference:
AFAIK Export the data from Azure mysql flexible server in the form of sql script through MySQL work bench and import that file in Azure sql database through SSMS. IN this we can write data into Azure Sql database.
I have had to create an Azure Function App that contains a Timer function that reads the data from the MySQL data and pushes it to SQL Server every 15 minutes (as were the requirements).
Thank you for everyone for commenting.
It seems you can use Data-in replication.

MySQL workbench database import from Azure SQL

I am currently trying to use the MySQL Workbench migration wizard to import a database located on an Azure SQL Managed instance to an on-premise MySQL server, but i have an issue with the wizard: it fails to retrieve the database schema with the following error:
'WARNING: The following catalogs were not found: database_name'
Note: The user i currently use to perform the migration is actually granted on VIEW DEFINITION at the database level but not at the server level (VIEW ANY DEFINITION) , since it is not supported in Azure SQL. Any idea about how to make this wizard work is welcomed.
Like #JeffRamos said before you using MySQL Workbench migration, please check if the user can connect to the Azure SQL Managed instance with SSMS and has the permission to access the Azure MI database. Just from the error message, it's not the firewall issue.
As I know about Azure Managed instance, if we want migrate the database, the user muse be db_owner or admin account.
HTH.

Integration Service Catalog and Linked server

I have SSIS packages in SSIS catalog on SQL Server, Serv1. The packages, while executing, establish connection to SQL Server, Serv2. And they fail while acquiring connection.
I know a little bit about linked server that is to run query from one server on another the latter one has to be a linked server to former one. The above scenatrio looks the same but i didn't find any information related to it. Do i have to add Serv2 as Linked Server for Serv1?
No. Linked server scenario is used when you need to access DB from the outer server inside SQL query run on local server.
SSIS packages are built with goal that it access some DB server, possibly a remote one, fetch data from it, transform and store results somewhere - in files, DB etc. Accessing a remote SQL DB is a normal scenario.
Moreover, using Linked server in SSIS package is a bad practice. You move control of DB access from SSIS catalogue to DB server, in case of any problems - it is more difficult to trace and investigate.
In your case - SSIS packages in SSIS catalogue - check in package execution log which connection string is used to connect to the remote server. Is it an integrated authentication? Does the account under which SSIS package is executed have an access to the DB? If using SQL auth - are login and password valid?

SQL Server data export to mysql using SSIS

I'm trying to export data from SQL Server to MySQL using ODBC and I get an error while trying to form a destination point on SSIS.
What seems to be the problem? The table exists in MySQL
UPDATE I have found that the problem is the missing license key because i am using MySQL Provider MySQL Provider Cherry
Does anyone know any free alternatives for MySQL Providers using SSIS Ole Db? I know that ADO .Net has it, but is there an Ole Db free alternative?

Connecting MySQL to external data source using proprietary ODBC Driver

I have a cloud-based CRM system that provides a proprietary ODBC Driver.
This has been fully configured, set up as a system DSN, and tested with no errors. The system DSN is called 'servicenowdev'.
I also have a local MySQL server, that I would like to connect to the CRM system and download periodic backups. I can connect to the 'servicenowdev' DSN using i-SQL and run queries fine, but I would like to link the server (MS SQL Server "Linked Server" style), but in MySQL.
Where do I start with connecting my MySQL server to this dsn?
I don't know the internal details of the CRM system to provide a database name, host, port or any other details for a FEDERATED SERVER connection.
Can I create views straight to the dsn's tables, or would I have to import data locally?
I have an alternative, albeit not the most efficient, method. In essence I start with MS Access by creating pass through query using the
ServiceNow ODBC. (SELECT * FROM servicenow.table)
I then perform an insert query into a local access table using the pass through query as the source
(INSERT INTO table SELECT * FROM query)
Then I export the table to the MySQL database using the MySQL ODBC.
Hoping you've found a better method but if not then hope this helps.