I am trying to migrate a website from one content management system to another. There is a lot of content related data stored in a MySQL database, which will be stored in a different schema in the new database. I would want to somehow map the old schema onto the new and copy the data accordingly. Is there a free tool for such a task - or is there a native MySQL way of doing this?
By free, I mean free as in free beer.
To map data and migrate between two different schema look at ETL like Talend or Pentaho which are "free".
Related
We are migrating our existing code base to a new robust code base for better performance and reliability. We have a MySQL database with current data. Now we have modified our entities in our spring boot application which will change our schema for the new database structure. I am in search of a tool which will help me migrate all the data from the old MySQL database to a newly created MySQL database with changes according to the latest schema design. I think I will have to write some code to match the new database architecture as no tool will do that refactoring according to my requirement. What tool should be helpful to achieve this?
Footnotes:
I am working in a microservice architecture.
I have integrated liquibase with maven plugin support.
I have seen Apache Spark and ETL, but they need
Provide your feedback if you have any relative experience.
We have done the migration of near about 3000 users data from 160(SQL) to near about 75 tables (MySQL) as per new schema.
As per our experience, I can suggest following things -
1. Prepare mapping sheet of the column in the table to table manner.
2. Migrate them into temporary tables.
3. Test the temporary table's data with the old one. Compare data of each table column by column. You can use ETL tool or excel for comparison.
4. Then write down sp or script for actual migration if no bugs found.
I need to replicate and continuously sync a MySQL database to a graph database, to further query and analyze data from an eCommerce application.
Came across DZone Article which talks about syncing data between oracle and Neo4J. They are using Oracle GoldenGate and Apache Kafka for this.
However, I have a few questions on how this would be implemented -
What about the graph data model? Can I generate graph data model from existing RDBMS data model? Are there any open source ETL solutions to map data models between source and target?
The RDBMS data model may change as part of new features. How to keep data models in sync between a source RDBMS and target graph database?
Are there any other approaches to make this work?
I'm fairly new to SQL to NoSQL replication. Any inputs?
I am new to MS Azure just with some SQL Server Background and now we are facing some design / architecture questions and I am somehow lost.
One the one hand, there is a DataWarehouse and a small SQL-Database in Azure and they store all the structured or not structured incoming data. Works fine!
Now we think of moving the MySQL Database for the first version of the website (we need to stay at MySQL for the web-service) to Azure. In version two of the website, we like to integrate some of the Data from SQL-Database and DataWarehouse so it sounds good to have all the stuff at one place.
As much as possible from all the structured Data, we would like to store at the SQL-Database and not in MySQL. MySQL should stay lightweight. But what will be the beste way to create some interaction between Webservice, MySQL und SQL-Database?
Our Webdesigner asked for some APIs and as the users should be able to change some settings in their account we would need a lot of get and set APIs. And those APIs will just handle traffic within Azure, no external Access is needed. I just discovered the option of external Tables in Azure MySQL but cant find use-cases or best practice of that.
I am looking for a solution, in which I can deliver the necessary data for the Webdesigner / Frontend and they do not need to work with any databases (as they do not like to do that).
The traffic between MySQL and SQL-Database will be low (our stream goes into Datawarehouse, some analysis in there and we save the results as structured Data in the SQL-Database) and up to now we do not need a connection between Datawarehouse and MySQL/Webservice.
Any suggestions? How would you design such a connection?
Using Azure Data Factory you can maintain both databases and transfer (called as COPY in Data Factory) from SQL DB to Azure DB.
I have two database. One is FileMaker database and another one is mysql. I want to use this database in mysql.I created odbc data base connection so that I can sync both database e.g when I maker changes in mysql database then FileMaker database should also be updated. Is this thing possible in mysql? If no then in which open source database this thing is supported?
The best way to do that with FileMaker would be to hook the MySQL database up to FileMaker via External SQL Sources (ESS).
You can create layouts in FileMaker that display the actual MySQL data, and the MySQL can be used in FileMaker scripts, calculations, etc. just like any other FileMaker data.
You can choose to simply build layouts that are based on MySQL tables, or you can create scripts in FileMaker to copy data from MySQL based layouts to actual FileMaker based layouts.
I have database with multiple tables in Microsoft SQL Server with schema in tables as "xyz".
i am able to copy this database tables along with data from one sql server to another using export and import wizard of SQL server.
I want to do find a way to-
1. Copy only tables with no data.
2. is it possible to covert current database design to a script and then run the same on another server which will create all these tables with empty data ?
Thanks in advances.
Best Regards
Yes, you could do that with Management Studio. Right click your database and then select Tasks -> Generate Scripts.
There are some settings there you should tweak, like if it should generate scripts for indexes and statistics. They are all in plain sight.
An alternative is SQL Server Data Tools. It's relatively new (ex-Data Dude). It's not as straightforward, but better on a long term, for database versioning and for creating migration scripts.