How do i set the path of libhdfs.so for pyarrow? - pyarrow

I'm trying to use pyarrow and i keep getting the following error.
ImportError: Can not find the shared library: libhdfs3.so
so i read some stackoverflow and it says that i need to set enviorment variable for ARROW_LIBHDFS_DIR.
The path to libhdfs.so is /usr/local/hadoop/native/
it tried to set it in bashrc but it didn't work
the conda installation doesn't seem to work i.e.
conda install libhdfs3
pip install libhdfs3
conda install -c clinicalgraphics libgcrypt11
conda install libprotobuf=2.5
conda update libhdfs3
it will be a great help if i get this.
thanks in advance.

ensure libhdfs.so is in $HADOOP_HOME/lib/native as well as in $ARROW_LIBHDFS_DIR
use this to check if you have the variable set in your bash environment ls $ARROW_LIBHDFS_DIR
if not locate the file using
locate -l 1 libhdfs.so
Assign the directory path you locate to the ARROW_LIBHDFS_DIR variable using
ARROW_LIBHDFS_DIR=<directory location to libhdfs.so>
referenced here in SO - https://stackoverflow.com/a/62749351/6263217

Related

OCI CLI fails to load default profile from config file even if I have proper default profile

When I run any oci cli command I'm getting below error:
ERROR: Profile '<DEFAULT>' not found in config file C:\Users\user1\.oci\config
Below is my config file for OCI CLI:
[DEFAULT]
user=<admin user ocid>
fingerprint=<fingerprint>
key_file=<path/to/private/key>
tenancy=<tenancy ocid>
region=ap-mumbai-1
I had a similar problem to this. If you use Python and have changed some of the libraries it's possible you may have updated some of the needed dependencies. Upgrade/reinstall oci ie.
pip install oci-cli --upgrade
This sorted the problem for me.
I would suggest you take a backup of this config file, delete it and reconfigure CLI automatically by executing "oci setup config"
I guest that you are using pacman to install oci-cli. You should remove it and reinstall with official method.
https://docs.oracle.com/en-us/iaas/Content/API/SDKDocs/cliinstall.htm
bash -c "$(curl -L https://raw.githubusercontent.com/oracle/oci-cli/master/scripts/install/install.sh)"
Please refer this document on Configuring the CLI and tally it with the config file of yours.
And refer the discussion in this forum OCI Config not found issue, this might be useful as well.

polymer : command not found

I am using ubuntu 16.04. I have install polymer-cli npm install -g polymer-cli which is properly installed but when I enter command polymer server
it is throwing error that polymer:command not found.
To check if a package is globally installed you can take a look at the npm root folder.
npm root -g will show you the root folder
ls $(npm root -g) therefore lists all public installed packages.
If you do not find polymer-cli there then your global installation was not successful... if you find it there but you still can not use it you probably want to try to reinstall it.
For me the answer relied in the fact that the bin folder of node wasn't defined in PATH.
The fix for me was to add it to the export PATH= part in my .zshrc-file or, if you don't use ZSH, .bash_profile. To know what to add to this PATH export run npm bin -g. For me the output was /usr/local/Cellar/node/11.14.0_1/bin. After this I opened my .zshrc-file and added the :/usr/local/Cellar/node/11.14.0_1/bin to the PATH definition. Notice the : which distinguishes a new location.
export PATH="$PATH:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/mysql/bin:/usr/local/Cellar/node/11.14.0_1/bin"
Good luck!
If polymer-cli is globally installed successfully, change your path environment variable - add polymer.js' parent directory to it and polymer serve will work. You'll find polymer.js in .npm-global/bin

unable to use javapackager command

I am using ubuntu 16.04, and my java is in /usr/bin/java
and jdk is in /usr/lib/jvm/java-8-openjdk-amd64 . non of these had the javapackager inside.
I am not able to use javapackager command and do not know how to configure it to use in command-line.
Can anyone help me?
Thanks.
It seems javapackager comes with a package called openjfx,
so running apt install openjfx should make the tool available for you, among your other java tools.
$ apt-file search javapackager
openjfx: /usr/lib/jvm/java-8-openjdk-amd64/bin/javapackager
openjfx: /usr/lib/jvm/java-8-openjdk-amd64/man/ja_JP.UTF-8/man1/javapackager.1.gz
openjfx: /usr/lib/jvm/java-8-openjdk-amd64/man/man1/javapackager.1.gz
You should define your java path.
You can set your JAVA_HOME in /etc/profile as Petronilla Escarabajo suggests. But the preferred location for JAVA_HOME or any system variable is /etc/environment.
Open /etc/environment in any text editor like nano or gedit and add the following
JAVA_HOME="/usr/lib/jvm/open-jdk" (java path could be different)
Use source to load the variables, by running this command:
source /etc/environment
Then check the variable, by running this command:
echo $JAVA_HOME

How to installing Pygame for Python 3.5 via pip?

I'm trying to install Pygame for python 3.5 32bit. I have learned that I can open the .whl files provided on the site by using the pip command. The problem is I've tried multiple ways doing this but with constant error.
python -m pip install pygame-1.9.2a0-cp35-none-win32.whl
'python' is not recognized as an internal or external command,
operable program or batch file.
The file I'm trying to install: pygame-1.9.2a0-cp35-none-win32.whl
My python program is located in my programs folder and everything else works fine.
You need to add python.exe to your Windows PATH variable.
The is the system variable that the operating system uses to locate the needed executables from the command line or Terminal windows. [1]
Actually there are many methods to set the PATH variable on windows. One way is to type
set PATH=%PATH%;location path of Python.exe
into the windows command-line interpreter (cmd):
set PATH=%PATH%;C:\Python35-32
Now -- before running the pip command -- you need to make sure that either
your working directory is set to the same folder where your pygame-1. ... in32.whl file is located
or
you supply the full absolute or relative path to the pip command.
Now you should be able to run your python -m pip command after restarting the cmd.exe.
if you get trouble when install pygame error about missing visual studio 10+. I have the answer: the problem is not about have or not have visual studio, because I try many version but it not work. The problem is file: between tar.gz and .whl so, this is the solution:
1) download file:
http://www.lfd.uci.edu/~gohlke/pythonlibs/#pygame go here and download your pygame version, notice about x64 or x86 and python version. my system is x64 and python is 3.4 so I choose: pygame-1.9.2a0-cp34-none-win_amd64.whl
2) put it in some where to install:
I put it in "C:", so open cmd: and type: cd C:\ (this changes the location to C:)
3) install
pip install C:\pygame-1.9.2a0-cp34-none-win_amd64.whl
done !

Getting gnuplot to work in JRuby - "RuntimeError: gnuplot executable not found on path"

I've installed gnuplot using...
jruby -S gem install gnuplot
But I get "RuntimeError: gnuplot executable not found on path" when I try to run it using...
require 'gnuplot'
If I change it so I say...
require 'C:\jruby-1.7.0.preview1\lib\ruby\gems\shared\gems\gnuplot-2.5.0\lib\gnuplot'
I still get the same error. Any advice? When I change the require command to reference the exe it gives a LoadError. So I'm assuming I should set up the path to the exe in some other way. I have installed gnuplot seperately.
Where/how do I setup the path correctly?
Consult the intall logs or use "find" to find out where it's installed.