I'm new on elastic search, i'm in a project that intent to be a system with a huge amount of data queryable, so the idea is using the elastic search to search from each index.
I try to create a system that support a cluster of elastic search, i know that we can create a cluster of ES nodes.
However me and my co-workers we're worried about data (backups, maintenance) so the idea is that ES nodes using a single instance of amazon RDS (and make amazon deal with scaling the servers) that way we can centralize the data. That is a valid thing to do?
My doubt is how I can setup the local ES server to connect with remote mysql server (RDS or other one) , i try to use https://github.com/jprante/elasticsearch-river-jdbc to make this with no success. That anyone already use ES with amazon RDS that can help?
After investigate a bit more on a plugin documentation i think that i'm understand what i'm missing.I've already configured with successful the river mode (pulling data from mysql server) however i think i'm missing the feed mode (putting data from plugin) that is why i'm not getting any data from mysql server.
Thanks in advance
For everyone that have any problems setup the river-plugin for elastic search, I've contacted the guy who maintain the plugin and he've written a step-by-step setup tutorial on linux here
I hope that is help anyone
Related
I have defined a schema and populated with data into MySql on my laptop. However, due to the large-scale of the datasets, the computing time suffers in the following analysis stage in python. So I decide to try to move all my work to cloud. I'm wondering if there is anyway to let the server in AWS directly connect to the mysql server in my laptop so that I can use the existing datasets without recollect them.
You may be interested in AWS Database Migration Service.
You can use DMS database migration service of aws which will do everything for you.
https://aws.amazon.com/dms/
But you have to take care about foreign key and other data. sometime it is generating the error.
DMS will transfer all of your data from laptop to aws database which will be on RDS or you can choose.
I have installed Openfire XMPP server on my linux machine, and everything is working fine except for one thing - for some reason there is some kind of cache mechanism that I can't figure out.
I perform changes on the admin console but the database doesn't change.
I understand there is some sort of cache involved, but how can I stop it? I have external API's querying the database, and the fact the database is not up to date is really a problem.
I am using MySQL and openfire 3.9.3
Thanks!
We have an existing high traffic PHP web app which uses the MySQL Native driver's load balancing facility to split read & write queries between a master and slave database.
I'm migrating the API part of this app to NodeJS, currently I'm using the MySQL drivers.
My question: is there a way to split read write queries between master and slave databases in NodeJS? I've looked for a NodeJS version of the MySQL Native drivers but have had no luck as yet.
Thanks in advance for any help provided :)
Amazon RDS MySQL vs Amazon RDS SQLServer
I have a data size of about 30-50 GB and its all in SQL Server 2008 present in physical servers. I am thinking of moving my data to cloud and I am considering Amazon web services as a solution.
Now Amazon provides both MySQL and SQLServer and I am trying to figure out which database is the most seamlessly and efficiently supported. SQLServer in AWS is a very new service. My requirements are following :
Scalability (should be provided for both the databases)
Replication
One important thing is that recently there has been a lot of news about Oracle trying to kill MySQL . link --> http://techcrunch.com/2012/08/18/oracle-makes-more-moves-to-kill-open-source-mysql/
What would the implications of this be on Amazon MySQl service. Also besides this I dont think integration of the current db into Amazon should be a problem but how well are both db supported in Amazon. I am looking for a detailed and clear answer. Thanks!
EDIT 1 : I am still looking for a thorough answer. Does anybody have nay idea how well is SQLserver supported in AWS ?
I'm completely new to s3. Started coding on a site today. I'm a mysql guy, but I'm not sure if I can host a mysql database on their server or what my options are. What is my best option for database storage?
Edited to add: I know this question sounds vague, but I literally don't know what my options are. Can I use a mysql database on amazon's servers or am I forced to use Amazon's SimpleDB?
S3 itself is not a typical data storage that you would simply use with RDBMS. It's only accessible via web service and is not a block device. I think that your best bet for hosting database on Amazon would be Relational Database Service which , in effect, is mysql.
You could also run your own mysql server on EC2 using EBS as backing store.
Also, SimpleDB is very nice but it is not a relational database. It's more like persistent hash map. It is not transactional and is eventually consistent. It belongs to category of No SQL solutions and you have to design your system in very specific ways for it.
S3 is a storage provider; you can't run your own code on it. You pay for file storage and can access it from your application, which has to be hosted elsewhere (Amazon EC2 for example).