Why hadoop is running on other port? - hadoop2

I'm learning hadoop and just u=installed hadoop myself
So I had set up 127.0.0.1:54310/ in core-site.xml file while configuration.
But when I open this open 127.0.0.1:54310/. it shows this quote
"It looks like you are making an HTTP request to a Hadoop IPC port. This is not the correct port for the web interface on this daemon."
Here the ports runnings
tcp 0 0 0.0.0.0:50070 0.0.0.0:* LISTEN 1001 120452 22666/java
tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 1001 119197 22787/java
tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 1001 119235 22787/java
tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 1001 120744 22787/java
tcp 0 0 127.0.0.1:54310 0.0.0.0:* LISTEN 1001 117942 22666/java
tcp 0 0 0.0.0.0:50090 0.0.0.0:* LISTEN 1001 125548 22953/java
tcp6 0 0 :::54935 :::* LISTEN 1001 122123 23275/java
tcp6 0 0 :::8088 :::* LISTEN 1001 118396 23130/java
tcp6 0 0 :::8030 :::* LISTEN 1001 126362 23130/java
tcp6 0 0 :::8031 :::* LISTEN 1001 126344 23130/java
tcp6 0 0 :::8032 :::* LISTEN 1001 118392 23130/java
tcp6 0 0 :::8033 :::* LISTEN 1001 125653 23130/java
tcp6 0 0 :::8040 :::* LISTEN 1001 126351 23275/java
tcp6 0 0 :::8042 :::* LISTEN 1001 122149 23275/java
But when I open 127.0.0.1:50070, it shows me hadoop page with Overview, Datanode etc tabs in it.
Could anyone explain what these ports are diff ports, how hadoop is running on 50070 ports, as I had set up on 54310 and why is it so ?

Well, the default dfs.namenode.http-address is 50070. And that's in hdfs-site.xml
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
Apparently you didn't set that property and set something else. Sounds like you set the datanode IPC address, which is 50020.
Unless you know you have a conflict on a port, don't need to change anything

Related

OKD 4.5 single node installation

I'm trying to build an OKD 4.5 single node cluster following Craig Robinson blog post (at https://medium.com/swlh/guide-okd-4-5-single-node-cluster-832693cb752b). I faced with this issue first on bootstrap node, but after deleting and recreating the whole process again, it booted up successfully. But the same issue happened again while preparing control plane master node. After initial coreos download (which proves webserver is working fine), I get this recurring GET error message over and over again:
ignition[xxx]: GET error: Get "https://api-int.lab.okd.local:22623/config/master": EOF
And this is my control plane node config:
ip=10.106.31.233::10.106.31.1:255.255.255.0:::none nameserver=10.106.31.231 coreos.inst.install_dev=/dev/sda coreos.inst.image_url=http://10.106.31.231:8080/okd4/ fcos.raw.xz coreos.inst.ignition_url=http://10.106.31.231:8080/okd4/master.ign
IPs are:
okd-services: 10.106.31.231 ;
bootstrap: 10.106.31.232 ;
control-plane: 10.106.31.233
I can reach the http://10.106.31.231:8080/okd4 address from remote pc and list the contents including master.ign file. Also pinging "api-int.lab.okd.local" is successful too. firewalld open ports on okd-services node are:
[root#okd4-services ~]# ss -ltu
Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port Process
udp UNCONN 0 0 0.0.0.0:hostmon 0.0.0.0:*
udp UNCONN 0 0 10.106.31.231:domain 0.0.0.0:*
udp UNCONN 0 0 127.0.0.1:domain 0.0.0.0:*
udp UNCONN 0 0 127.0.0.53%lo:domain 0.0.0.0:*
udp UNCONN 0 0 [::]:hostmon [::]:*
udp UNCONN 0 0 [::]:domain [::]:*
tcp LISTEN 0 128 0.0.0.0:ssh 0.0.0.0:*
tcp LISTEN 0 4096 127.0.0.1:rndc 0.0.0.0:*
tcp LISTEN 0 4096 0.0.0.0:https 0.0.0.0:*
tcp LISTEN 0 4096 0.0.0.0:22623 0.0.0.0:*
tcp LISTEN 0 4096 0.0.0.0:cslistener 0.0.0.0:*
tcp LISTEN 0 4096 0.0.0.0:sun-sr-https 0.0.0.0:*
tcp LISTEN 0 4096 0.0.0.0:hostmon 0.0.0.0:*
tcp LISTEN 0 4096 0.0.0.0:http 0.0.0.0:*
tcp LISTEN 0 10 10.106.31.231:domain 0.0.0.0:*
tcp LISTEN 0 10 127.0.0.1:domain 0.0.0.0:*
tcp LISTEN 0 4096 127.0.0.53%lo:domain 0.0.0.0:*
tcp LISTEN 0 128 [::]:ssh [::]:*
tcp LISTEN 0 4096 [::1]:rndc [::]:*
tcp LISTEN 0 4096 [::]:hostmon [::]:*
tcp LISTEN 0 511 *:webcache *:*
tcp LISTEN 0 10 [::]:domain [::]:*
the output of the dig test on okd-services node is:
[root#okd4-services ~]# dig -x 10.106.31.231
; <<>> DiG 9.11.25-RedHat-9.11.25-2.fc33 <<>> -x 10.106.31.231
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 60620
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 0, ADDITIONAL: 1
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;231.31.106.10.in-addr.arpa. IN PTR
;; ANSWER SECTION:
231.31.106.10.in-addr.arpa. 604800 IN PTR api-int.lab.okd.local.
231.31.106.10.in-addr.arpa. 604800 IN PTR api.lab.okd.local.
231.31.106.10.in-addr.arpa. 604800 IN PTR okd4-services.okd.local.
;; SERVER: 127.0.0.53#53(127.0.0.53)
I deleted and recreated the control plane to see if it solved the issue, but was not successful. Any idea what this issue means?
I had exact the same issue with this article. The problem was with bootstrap node that cannot finish initialization process. First of all initialize bootstrap node and sure that the process was finished. The simplest way to check what's going on with a node:
Connect to a node with ssh core#<NODE'S-IP> from the machine where you generate ssh-certificate
ssh will provide you useful information:
This is the bootstrap node; it will be destroyed when the master is
fully up.
The primary services are release-image.service followed by
bootkube.service. To watch their status, run e.g.
journalctl -b -f -u release-image.service -u bootkube.service This
is the bootstrap node; it will be destroyed when the master is fully
up.
The primary services are release-image.service followed by
bootkube.service. To watch their status, run e.g.
journalctl -b -f -u release-image.service -u bootkube.service Fedora
CoreOS 32.20200629.3.0 Tracker:
https://github.com/coreos/fedora-coreos-tracker Discuss:
https://discussion.fedoraproject.org/c/server/coreos/
First of all you have to check journalctl -b -f -u release-image.service -u bootkube.service because it's main units. However, there're might be other issues so check failed/not finished systemd's service units with systemctl list-units --type=service and journalctl -f -u <UNIT-NAME> to follow the process
Whole process will spend some time (~20-40 mins in my case) and there're might be some timeouts in journal's logs so just wait the final status of the unit.
Only then you can start initializing of control-plane node
Finally, my issue was in wrong fedora-core-os version because you can use 32 version only. For me it's installed okay with:
fedora-coreos-32.20201104.3.0-metal.x86_64.raw.xz
fedora-coreos-32.20201104.3.0-metal.x86_64.raw.xz.sig
fedora-coreos-32.20201104.3.0-live.x86_64.iso
openshift-client-linux-4.5.0-0.okd-2020-10-15-235428.tar.gz
openshift-install-linux-4.5.0-0.okd-2020-10-15-235428.tar.gz

Ejabberd does not work on MAC with [Failed to open socket at [::]:5222]

I am facing errors at the first cup of Ejabberd.
On my Mac(10.13.6) I installed "ejabberd-18.12.1-osx.app" and I have followed all instruction written in official website. (https://docs.ejabberd.im/admin/installation/#install-on-macos)
After installation was completed I noticed nothing significant and found error logs were generated as below.
2019-01-16 10:02:03.936 [error] <0.316.0>#ejabberd_listener:report_socket_error:417 Failed to open socket at [::]:5222 for ejabberd_c2s: address already in use
2019-01-16 10:02:03.937 [error] <0.315.0> Supervisor ejabberd_listener had child {5222,{0,0,0,0,0,0,0,0},tcp} started with ejabberd_listener:start({5222,{0,0,0,0,0,0,0,0},tcp}, ejabberd_c2s, [{ip,{0,0,0,0,0,0,0,0}},{max_stanza_size,262144},{shaper,c2s_shaper},{access,c2s},{starttls_required,...}]) at undefined exit with reason eaddrinuse in context start_error
2019-01-16 10:02:03.937 [error] <0.274.0> Supervisor ejabberd_sup had child ejabberd_listener started with ejabberd_listener:start_link() at undefined exit with reason {shutdown,{failed_to_start_child,{5222,{0,0,0,0,0,0,0,0},tcp},eaddrinuse}} in context start_error
2019-01-16 10:02:03.942 [critical] <0.81.0>#ejabberd_app:start:66 Failed to start ejabberd application: {error,{shutdown,{failed_to_start_child,ejabberd_listener,{shutdown,{failed_to_start_child,{5222,{0,0,0,0,0,0,0,0},tcp},eaddrinuse}}}}}
I exactly understand what "address already in use" means but netstat does not show any possession on this port. Also I never changed any of the server configuration. I tried to start server manually but same errors repeats.
Does this version of Ejabberd have bugs on Mac installation?
Many thanks in advance.
When ejabberd starts, it uses several ports (some for XMPP, others for additional ejabberd features, others for Erlang). Notice that some ports may be in IPv6:
tcp 0 0 0.0.0.0:42859 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:4560 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:epmd 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:5280 0.0.0.0:* LISTEN
tcp6 0 0 [::]:epmd [::]:* LISTEN
tcp6 0 0 [::]:xmpp-client [::]:* LISTEN
tcp6 0 0 [::]:xmpp-server [::]:* LISTEN
Maybe you have other previous ejabberd installation around there messing? Or other XMPP server?

Unable to open up SonarQube page

I am installing SonarQube on my Ubuntu Server with the help of this link. When i start/restart Sonar from terminal it shows like this:
But when i try to open sonar page ipaddress:9000/sonar the page is not at all opening.
But i followed same link for installation on my ubuntu VM, it worked as expected.
after netstat -ntl got following output
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:32000 0.0.0.0:* LISTEN
tcp6 0 0 :::36870 :::* LISTEN
tcp6 0 0 :::9000 :::* LISTEN
tcp6 0 0 127.0.0.1:9001 :::* LISTEN
tcp6 0 0 :::8080 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 :::35866 :::* LISTEN
This is my sonarQube property file which i used for installation.
Following logs which i got after restarting SonarQube
Launching a JVM...
Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved.
2017.06.06 23:14:50 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /opt/sonar/temp
2017.06.06 23:14:50 INFO app[][o.s.a.p.JavaProcessLauncherImpl] Launch process[es]: /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Xmx1G -Xms256m -Xss256k -Djna.nosys=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -Des.network.host=127.0.0.1 -Djava.io.tmpdir=/opt/sonar/temp -cp ./lib/common/*:./lib/search/* org.sonar.search.SearchServer /opt/sonar/temp/sq-process4114582605652920236properties
2017.06.06 23:15:00 INFO app[][o.s.a.SchedulerImpl] Process[es] is up
2017.06.06 23:15:00 INFO app[][o.s.a.p.JavaProcessLauncherImpl] Launch process[web]: /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Djava.io.tmpdir=/opt/sonar/temp -cp ./lib/common/*:./lib/server/*:/opt/sonar/lib/jdbc/mysql/mysql-connector-java-5.1.42.jar org.sonar.server.app.WebServer /opt/sonar/temp/sq-process3191822142101588969properties
2017.06.06 23:15:04 INFO app[][o.s.a.SchedulerImpl] Process [web] is stopped
2017.06.06 23:15:04 INFO app[][o.s.a.SchedulerImpl] Process [es] is stopped
2017.06.06 23:15:04 INFO app[][o.s.a.SchedulerImpl] SonarQube is stopped
<-- Wrapper Stopped
After installing Ubuntu 16 Desktop edition the problem got solved. I don't the specific reason why it was giving error, but after installing Desktop version, without changing anything it got solved.

How grant access to remote mysql

i have installed mysql on ubuntu server, but i want to connect with mysql workbench remotely.
I just see other answer, but my /etc/mysql/my.cnf is that:
GNU nano 2.5.3 File: /etc/mysql/my.cnf Modified
# --print-defaults to see which it would actually understand and use.
#
# For explanations see
# http://dev.mysql.com/doc/mysql/en/server-system-variables.html
#
# * IMPORTANT: Additional settings that can override those from this file!
# The files must end with '.cnf', otherwise they'll be ignored.
#
!includedir /etc/mysql/conf.d/
!includedir /etc/mysql/mysql.conf.d/
I just Grant privileges to 'root'#'%'
This is netstat:
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 16431/mysqld
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 1471/sshd
tcp6 0 0 :::80 :::* LISTEN 15874/apache2
tcp6 0 0 :::22 :::* LISTEN 1471/sshd
What can i do? Any ideas of bad configuration?

configuring my Kurento Media Server over Public IP

I try to setup a Kurento Media Server in my Ubuntu 14.04 64x, have configure my system with Turn server from here and after that I install my KMS from This doc When i try to find my Listening ports using
sudo netstat -atnp | grep LISTEN commandnd i found the following tcp 0 0 127.0.0.1:5941 0.0.0.0:* LISTEN 1773/teamviewerd
tcp 0 0 192.168.122.1:53 0.0.0.0:* LISTEN 1634/dnsmasq
tcp 0 0 127.0.1.1:53 0.0.0.0:* LISTEN 1297/dnsmasq
tcp 0 0 192.168.0.2:3478 0.0.0.0:* LISTEN 6140/turnserver
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 1117/sshd
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 5642/cupsd
tcp 0 0 0.0.0.0:5432 0.0.0.0:* LISTEN 1256/postgres
tcp 0 0 0.0.0.0:445 0.0.0.0:* LISTEN 791/smbd
tcp 0 0 127.0.0.1:5766 0.0.0.0:* LISTEN 6140/turnserver
tcp 0 0 0.0.0.0:139 0.0.0.0:* LISTEN 791/smbd
tcp6 0 0 :::22 :::* LISTEN 1117/sshd
tcp6 0 0 ::1:631 :::* LISTEN 5642/cupsd
tcp6 0 0 :::8888 :::* LISTEN 1683/kurento-media-
tcp6 0 0 :::5432 :::* LISTEN 1256/postgres
tcp6 0 0 :::445 :::* LISTEN 791/smbd
tcp6 0 0 :::139 :::* LISTEN 791/smbd
But I am not able to find my public ip on it.
Please guide me how to configure the media server for my public ip. I am Using a Wifi Router for my internet connection.
Since you're behind a router, your computer has no direct way of knowing your public IP. To find your public IP, load up a browser and ask Google what your IP is. If your OS has is a CLI only server, use this one-liner I yanked from https://askubuntu.com/questions/95910/command-for-determining-my-public-ip.
curl ipecho.net/plain ; echo