I am newbie to Apache Drill.
I am querying hive using apache drill. So, i have to enable that plugin in the web console
When i click on hive enable plugin option in the web console, immediately it is throwing exception in the terminal 2:. please help me to solve this issue.
Look at that all the plugins are enabled in the web console except that hive 3:
below is my hive-site.xml file 1:
How do I start Apache Drill correctly?
Please make sure that you performed
schematool -dbType derby -initSchema for Hive metastore 2.1 version (or above) before enabling Drill's Hive storage plugin: https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool
Actually adding datanucleus.schema.autoCreateAll true and hive.metastore.schema.verification: false properties to your plugin could help you, but it is not recomended for production purposes:
https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L974
Note: The default values for them depends on the version of Hive you are using.
If you configure Hive metastore properly, the configs from Apache Drill docs should work for you:
https://drill.apache.org/docs/hive-storage-plugin/#hive-remote-metastore-configuration
Related
Good afternoon everyone.
We are using MYSQL Percona 8 with PAM+SSSD+AD authentication.
Faced with the fact that authentication works well only on the machine where the server is installed, from the terminal console.
When connecting from any other machine, the error is:
ERROR 2059 (HY000): Authentication plugin ‘dialog’ cannot be loaded: /usr/lib/mysql/plugin/dialog.so: cannot open shared object file: No such file or directory
At first I thought the problem was in the native mysql client, so I installed Percona-client , it didn’t help, I tried to add dialog.so manually, which resulted in the error:
ERROR 2059 (HY000): Authentication plugin ‘dialog’ cannot be loaded: Incompatible client plugin interface
In the end, I came to the decision that the connection only starts working if percona-server-server is installed on the client machine.
I think this is an absurd solution or a bug, I don’t know.
Tell me how to transfer only the necessary module and make the client work without installing the entire server?
p.s By the way, even the latest DBeaver also cannot work with this, but in the process of torment, it turned out that if you select not "MySQL" but "MariaDB" when connecting, then it successfully connects via PAM. Perhaps this will help someone.
I probably managed to find a solution to a similar problem here for mariadb and redhat. But I don’t know how to build mysql percona client with these modules.
https://bugzilla.redhat.com/attachment.cgi?id=940720&action=diff
I had a similar issue and changed the plugin from "auth_pam" to "auth_pam_compat" and it resolved the issues with LDAP/PAM Stack authenticated users.
Found in a forum online - https://rimzy.net/category/authenticatin-plugin/
This issue is applicable to all plugins that require loading an external library at the client-side, including the PAM authentication plugin. In this case, you will get the error
ERROR 2059 (HY000): Authentication plugin 'dialog' cannot be loaded: /usr/local/Percona-Server-8.0.25-15-Linux.x86_64.glibc2.17/lib/plugin/dialog.so: cannot open shared object file: No such file or directory
Oracle-compatible auth_pam_compat plugin does not experience this issue, because, instead of
dialog.so
it uses the built-in
mysql_clear_password
plugin.
I'm running jira in openshift using the basic image from atlassian: https://hub.docker.com/r/atlassian/jira-software
So far most things work fine.
I installed a plugin using the web ui which worked as well.
But now I'm running into an issue when a pod is restarted. The pod uses the image and naturally (as specified) my plugin is not installed anymore. I can install the plugin via webservice calls and register it as an osgi module for jira. But I don't want to do this manually. Building a pipeline or jon for this is quite easy (I'm thinking jenkins or ansible tower). But I so far I didn't find a way to trigger this pipeline after the pod is started (or better after jira is started).
Anyone got an idea how to handle this?
Thanks and best regards. Sebastian
Why not create a custom image based on the Atlassian image with everything you need installed?
As far as I know, there isn't a way to trigger a pipeline when a Pod is started; only Webhook, Image Change, and Config Change triggers are available. You'll need to write a Jenkinsfile to script all of the installation and setup you want, but then that can be triggered in one of the three ways mentioned.
I'm thinking an Image Change trigger would work best for you, so when the latest version of Atlassian's image comes out, you can run your pipeline to set everything up on the latest version.
Also, just curious, but do you have some persistent storage attached to the Jira pod? If not, you'll lose everything in Jira if the Pod dies; that means tickets, boards, comments, everything.
Update:
Looking at this page, it looks like most of the stuff you're trying to persist is stored in jira-home, so maybe mounting that as a persistent volume will be a good solution for you.
You're correct that the tickets are stored in the database, but I'm guessing the database connection settings are getting wiped when the Pod is cycled.
The jira-home directory stores your application and database connection settings, as well as a subdirectory for your plugins.
dbconfig.xml
This file (located at the root of your JIRA home directory) defines
all details for JIRA's database connection. This file is typically
created by running the JIRA setup wizard on new installations of JIRA
or by configuring a database connection using the JIRA configuration
tool.
You can also create your own dbconfig.xml file. This is useful if you
need to specify additional parameters for your specific database
configuration, which are not generated by the setup wizard or JIRA
configuration tool. For more information, refer to the 'manual'
connection instructions of the appropriate database configuration
guide in Connecting JIRA to a database.
jira-config.properties
This file (also located at the root of your JIRA home directory)
stores custom values for most of JIRA's advanced configuration
settings. Properties defined in this file override the default values
defined in the jpm.xml file (located in your JIRA application
installation directory). See Advanced JIRA configuration for more
information.
In new JIRA installations, this file may not initially exist and if
so, will need to be created manually. See Making changes to the
jira-config.properties file for more information. This file is
typically present in JIRA installations upgraded from version 4.3 or
earlier, whose advanced configuration options had been customized
(from their default values).
plugins/
This is the directory where plugins built on Atlassian's Plugin
Framework 2 (i.e. 'Plugins 2' plugins) are stored. If you are
installing a new 'Plugins 2' plugin, you will need to deploy it into
this directory under the installed-plugins sub-directory.
'Plugins 1' plugins should be stored in the JIRA application
installation directory.
This directory is created on JIRA startup, if it does not exist
already.
I try to connect with my database and use Navicat with MacOS , but I get an error and not able to connect. I tried many different things but not able to connect yet. any help really appreciates and it's really great to help me.
Error :
Connection Failed
Authentication plugin 'mysql_clear_password' cannot be loaded:
dlopen(/usr/local/mysql/lib/plugin/mysql_clear_password.so, 2): image
not found
I got the same error in my MySQLWorkbench, went through the available ui configs and ticked the
Enable Cleartext Authentication Plugin
Steps need to be taken:
Open Connect to Database window
Choose Advanced option
Tick Enable Cleartext Authentication Plugin option
You could try starting Navicat from the terminal. This assumes the app is 'Navicat Premium Essentials'.
LIBMYSQL_ENABLE_CLEARTEXT_PLUGIN=y /Applications/Navicat\ Premium\ Essentials.app/Contents/MacOS/Navicat\ Premium\ Essentials
This solved the issue for me with Sequel Pro. See: https://github.com/sequelpro/sequelpro/issues/2247#issuecomment-144567527
I have a problem with CKAN 2.0, just installed on a VirtualBox VM Ubuntu 12.04 64Bit.
I followed all steps of the official documentation but when I upload a file CSV into a dataset, the preview don't work because dataviewer use Dataproxy in place of Datastore.
My question is: CKAN 2.x uses only the dataproxy for prevew csv/xls files or I can use the datastore as in the previous versions? Reading here http://docs.ckan.org/en/ckan-2.0/data-viewer.html?highlight=datastore#viewing-structured-data-the-data-explorer is not clear if Datastore is used for all type of file or for all type except CSV/XLS.
Thank you! ;)
If you have the DataStore enabled and the data for that resource (data file) stored in the datastore then the datastore rather than the dataproxy will be used for the preview.
Think of the dataproxy as a fallback that kicks in if the DataStore is not enabled (or you have not stored that data file in the datastore).
I want to have a plugin that can start my local process, is there any existing solution available? The plugin should be able to accept parameters and the start the local .exe file properly. Thanks.
No. Plugins execute in a sandbox that does not allow access to executing programs in the local filesystem.