I'm new to Talend. I want to make a script that transform my data (using an sql query) from a database and insert them to an other one.
Could you help me please with the list of components that I should use ? any tutorial ?
Thank you
Talend has many database specific components. You will find input and output components for all databases. input components are those which enables you to read data from database and bring it to talend and output components are those which allows you to write/insert data to database.
for example if your source and target are both oracle then -
toracleinput will be for reading from oracle db - (you have to mention connection details, sql query and schema for this component).
toracleoutput will be for inserting this data back to oracle database table. Here again you have to mention connection details, target table name, type of operation etc..
finally you have to connect flow of data from input to output component and if you need any intermediate transformations, joins etc you have to user other talend components in between like tMap etc..
Related
I have an SQL Database (SQL Server 2008 r2) that I link to Tableau via a Custom SQL Query (connected to a view in SQL). Instead of adding the new fields in the SQL Database, I am creating calculated fields in Tableau. Thedata source connected to Tableau is a viewI created by joining other views (there is a pivot I join to the main table). I want to now add the parameters from tableau as new fields in SQL and remove them from Tableau since it is bogging the tool down. What do you recommend to be the best approach in this? I have never added fields to a view and curious how this can be achieved. All of the parameters work in tableau only via the custom SQL query (the view created), but would not if I created them from the main data table in SQL.. I hope this makes sense. Thank you so much for the help! Have a great day -p
its always a good practice to create all your required fields calculation in sql table which will improve your performance. and create a extract connection with your table instead of live.
I have two different databases. I have to access data from one database and insert them into another ( with some data processing included, it is not only to copy data ) Also, the schema is really complex and each table has many rows, so copying data into schema in the second database is not an option. I have to do that using MySQL Workbench, so I have to do it using SQL queries. Is there a way to create a connection from one database to another and access its data?
While MySQL Workbench can be used to transfer data between servers (e.g. as part of a migration process) it is not useful when you have to process the data first. Instead you have 2 other options:
Use a dedicated tool you write yourself to do that (as eddwinpaz mentioned).
Use the capabilities of your server. That is, copy the data to the target server, into a temporary table (using dump and restore). Then use queries to modify the data as you need it. Finally copy it to the target table.
i am trying to compare the data of two mysql databases using the redgate data compare tool for mysql. The tool identifies two databases with identical data as having different tables. How can i solve this?
I hope it will be work in redgate tool after creating a new project. and on Object Mapping tab ,
select an Unmapped table or view that you want to map from the source database.
Select the Unmapped table or view that you want to map from the target database.
Click Map.SQL Data Compare moves the tables or views to the upper pane.
I want to migrate the tables/data from one Oracle Schema (SISPEX) using the Copy Tables Wizard feature.
Actually, the oracle JNDI connection in my kettle file is like:
orclLocal/type=javax.sql.DataSource
orclLocal/driver=oracle.jdbc.OracleDriver
orclLocal/url=jdbc:oracle:thin:#localhost:1521/pdborcl.df.cgu
orclLocal/user=system
orclLocal/password=password
But when i create this oracle connection at kettle and click to "explore", it shows the desired tables under the Schema "SISPEX". And the "Tables" option is empty.
How can i get the tables of the SISPEX to appear at the "Tables" list?
I need that to use the Copy Tables Wizard and migrate those tables/data to my MySql Database.
Thanks.
Sadly you can't with the copy tables wizard. It's a known bug:
http://jira.pentaho.com/browse/PDI-4442
Just write a simple ETL instead - Table Input -> table output.
I am in a process of generating reports using SSRS. I have multiple servers with multiple oracle databases on each server. I am wondering if I can create multiple shared data sources, and shared data sets, and create one reports by switching data sets and data sources.
Otherwise I will have to create multiple reports for each data source, which can run into 100's of reports.
Any suggestion help would be highly appreciated..
Thanks
Nirmal
Almost everything in Reporting Services is an expression, including the SQL Statement of the dataset. This means it can be altered on the fly. Assuming the datasource credentials you use can access the databases you want to get to, then you just supply the database as a parameter and you're good to go. Of course, for databases on other servers you will need to use linked servers so the server you connect to can link across to the other server to access the database.
We have a table with a nice user readable name for the database such as "End of Financial Year 2009" which holds the database name for that data. Create a dataset to use this as a parameter - display the nice name as the label and get the server+databasename connection string from the value.
Then your dataset just looks like:
="SELECT * FROM " & Parameters!Database.Value & "TableName"
This assumes the databases have the same structures as far as the report's needs are concerned.
You have to set the fields manually but it gives you flexibility.