I have a problem in setting up novadocker, to set up a Docker compute node with Openstack.
Openstack version is Horizon.
I have followed this tutorial https://wiki.openstack.org/wiki/Docker#Installing_Docker_for_OpenStack, but when I change the node-compute.conf file accordingly with what is written in the tutorial, I get this error in the log file when I try to start nova-compute service:
ImportError: No module named novadocker.virt.docker
Do you know what this is due to and what can I do to fix it?
Thank you so much for the help!
Marco
PS in /usr/local/lib/python2.7/dist-packages/ there is a file called nova-docker.egg-link which contains the real location of novadocker driver... It seems it is ignored when nova is looking for it.
UPDATE
I forgot to run python setup.py install. Now I've done it but thre is another error I can't solve:
2014-09-29 14:59:47.233 22982 ERROR nova.virt.driver [-] Unable to load the virtualization driver
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver Traceback (most recent call last):
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver File "/usr/lib/python2.7/dist-packages/nova/virt/driver.py", line 1299, in load_compute_driver
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver virtapi)
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver File "/usr/lib/python2.7/dist-packages/nova/openstack/common/importutils.py", line 52, in import_object_ns
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver return import_class(import_str)(*args, **kwargs)
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver File "/usr/lib/python2.7/dist-packages/nova/openstack/common/importutils.py", line 28, in import_class
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver __import__(mod_str)
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver File "/usr/local/lib/python2.7/dist-packages/novadocker/virt/docker/__init__.py", line 20, in <module>
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver from novadocker.virt.docker import driver
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver File "/usr/local/lib/python2.7/dist-packages/novadocker/virt/docker/driver.py", line 31, in <module>
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver from nova.i18n import _
2014-09-29 14:59:47.233 22982 TRACE nova.virt.driver ImportError: No module named i18n
I don't know what this module is and how to fix this problem...
Can anybody help me?
UPDATE 2
I managed to solve this issue by going backward the last commits, actually this commit https://github.com/stackforge/nova-docker/commit/9ce916c486a64bfac38fb665fbe7619cef4e1f92. But now surprisingly I get this problem:
2014-09-29 17:31:21.667 4979 ERROR nova.virt.driver [-] Unable to load the virtualization driver
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver Traceback (most recent call last):
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver File "/usr/lib/python2.7/dist-packages/nova/virt/driver.py", line 1299, in load_compute_driver
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver virtapi)
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver File "/usr/lib/python2.7/dist-packages/nova/openstack/common/importutils.py", line 52, in import_object_ns
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver return import_class(import_str)(*args, **kwargs)
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver File "/usr/lib/python2.7/dist-packages/nova/openstack/common/importutils.py", line 28, in import_class
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver __import__(mod_str)
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver File "/usr/local/lib/python2.7/dist-packages/novadocker/virt/docker/__init__.py", line 20, in <module>
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver from novadocker.virt.docker import driver
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver File "/usr/local/lib/python2.7/dist-packages/novadocker/virt/docker/driver.py", line 41, in <module>
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver from novadocker.virt.docker import client as docker_client
2014-09-29 17:31:21.667 4979 TRACE nova.virt.driver ImportError: cannot import name client
I actually don't know what to do! Please, help me.
I have found what the problem was. This worked to me:
https://ask.openstack.org/en/question/49874/nova-docker-issue-import-error-no-module-named-i18n/
Juno doesn't require limitation like mentioned above :-
$ git checkout -b pre-i18n 9045ca43b645e72751099491bf5f4f9e4bddbb91
View "Running Nova-Docker on OpenStack RDO Juno (CentOS 7 && Fedora 21)"
1. http://www.linux.com/community/blogs/133-general-linux/799569-running-nova-docker-on-openstack-rdo-juno-centos-7
2.http://www.linux.com/community/blogs/133-general-linux/802013-set-up-nova-docker-on-openstack-rdo-juno-on-top-of-fedora-21/
Related
Traceback (most recent call last):
File "C:\Users\josej\AppData\Local\Programs\Python\Python310\lib\site-packages\mysql\connector\abstracts.py", line 553, in config
DEFAULT_CONFIGURATION[key]
KeyError: 'datebase'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\josej\proyectos\holamundo\curso\db.py", line 3, in
midb = mysql.connector.connect ( host="localhost", user="josejan21", password="123JOSE123jan#gmail", datebase="prueba")
File "C:\Users\josej\AppData\Local\Programs\Python\Python310\lib\site-packages\mysql\connector_init_.py", line 272, in connect
return CMySQLConnection(*args, **kwargs)
File "C:\Users\josej\AppData\Local\Programs\Python\Python310\lib\site-packages\mysql\connector\connection_cext.py", line 94, in init
self.connect(**kwargs)
File "C:\Users\josej\AppData\Local\Programs\Python\Python310\lib\site-packages\mysql\connector\abstracts.py", line 1049, in connect
self.config(**kwargs)
File "C:\Users\josej\AppData\Local\Programs\Python\Python310\lib\site-packages\mysql\connector\abstracts.py", line 555, in config
raise AttributeError("Unsupported argument '{0}'".format(key))
AttributeError: Unsupported argument 'datebase'
There's a typo in your code, in the mysql connect method you are passing in "datebase" instead of "database" as an argument.
I am having problems using a MySQL database as a metadata database in a TensorFlow Extended pipeline.
I used the penguin template to set up a very simple pipeline and also set up a MySQL database locally.
The only thing I changed in the code was using
tfx.orchestration.metadata.mysql_metadata_connection_config as the metadata_connection_config input to the pipeline instead of tfx.orchestration.metadata.sqlite_metadata_connection_config
from tfx import v1 as tfx
# [...] Add a simple CsvExampleGen
tfx.dsl.Pipeline(
pipeline_name=pipeline_name,
pipeline_root=pipeline_root,
components=components,
metadata_connection_config=tfx.orchestration.metadata
.mysql_metadata_connection_config(
host="localhost",
port=3306,
database="ml_metadata",
username="root",
password="password"),
beam_pipeline_args=beam_pipeline_args,
)
Running this code results in the following error message:
[2021-11-17 12:02:16,948] {taskinstance.py:1270} INFO - Marking task as FAILED. dag_id=penguin_pipeline, task_id=CsvExampleGen, execution_date=20211117T110208, start_date=20211117T110212, end_date=20211117T110216
[2021-11-17 12:02:16,966] {standard_task_runner.py:88} ERROR - Failed to execute job 101 for task CsvExampleGen
Traceback (most recent call last):
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/task/task_runner/standard_task_runner.py", line 85, in _start_by_fork
args.func(args, dag=self.dag)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/cli/cli_parser.py", line 48, in command
return func(*args, **kwargs)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/utils/cli.py", line 92, in wrapper
return f(*args, **kwargs)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/cli/commands/task_command.py", line 292, in task_run
_run_task_by_selected_method(args, dag, ti)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/cli/commands/task_command.py", line 107, in _run_task_by_selected_method
_run_raw_task(args, ti)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/cli/commands/task_command.py", line 180, in _run_raw_task
ti._run_raw_task(
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/utils/session.py", line 70, in wrapper
return func(*args, session=session, **kwargs)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1332, in _run_raw_task
self._execute_task_with_callbacks(context)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1458, in _execute_task_with_callbacks
result = self._execute_task(context, self.task)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1514, in _execute_task
result = execute_callable(context=context)
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/operators/python.py", line 151, in execute
return_value = self.execute_callable()
File "/home/user/anaconda3/lib/python3.8/site-packages/airflow/operators/python.py", line 162, in execute_callable
return self.python_callable(*self.op_args, **self.op_kwargs)
File "/home/user/anaconda3/lib/python3.8/site-packages/tfx/orchestration/airflow/airflow_component.py", line 76, in _airflow_component_launcher
launcher.launch()
File "/home/user/anaconda3/lib/python3.8/site-packages/tfx/orchestration/launcher/base_component_launcher.py", line 191, in launch
execution_decision = self._run_driver(self._input_dict, self._output_dict,
File "/home/user/anaconda3/lib/python3.8/site-packages/tfx/orchestration/launcher/base_component_launcher.py", line 152, in _run_driver
with self._metadata_connection as m:
File "/home/user/anaconda3/lib/python3.8/site-packages/tfx/orchestration/metadata.py", line 152, in __enter__
raise RuntimeError(
RuntimeError: Failed to establish connection to Metadata storage with error: mysql_real_connect failed: errno: , error:
In this log I was using AirFlow, but the same exception message is shown if I run a LocalDagRunner:
Exception has occurred: RuntimeError
Failed to establish connection to Metadata storage with error: mysql_real_connect failed: errno: , error:
I have tried changing the host to "127.0.0.1", but this didn't change anything. Anyone had a similar issue or maybe see an apparent error in my approach?
The MySQL server is version 8.0 and I am using TensorFlow Extended version 1.4.0
Hi I'm new to the PYTHON and MYSQL. I'm trying to update the data base using the python where I'm taking user input and trying to update into the database.
Can any buddy help me in this error.
Traceback (most recent call last):
File "C:\Users\YGIN\Anaconda3\envs\MyTest\lib\site-packages\mysql\connector\network.py", line 148, in send_plain
self.sock.sendall(packet)
File "C:\Users\YGIN\Anaconda3\envs\MyTest\lib\ssl.py", line 1037, in sendall
return super().sendall(data, flags)
OSError: [WinError 10038] An operation was attempted on something that is not a socket
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:/Users/YGIN/PycharmProjects/MyTest/BankApplication.py", line 181, in <module>
c1.customer_closing_account()
File "C:/Users/YGIN/PycharmProjects/MyTest/BankApplication.py", line 146, in customer_closing_account
dbq.delete_cust_account(self.account_no)
File "C:\Users\YGIN\PycharmProjects\MyTest\DB_queryies.py", line 71, in delete_cust_account
my_cursor.execute(mysqlinsertquery, recordstodel)
File "C:\Users\YGIN\Anaconda3\envs\MyTest\lib\site-packages\mysql\connector\cursor.py", line 569, in execute
self._handle_result(self._connection.cmd_query(stmt))
File "C:\Users\YGIN\Anaconda3\envs\MyTest\lib\site-packages\mysql\connector\connection.py", line 590, in cmd_query
result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query))
File "C:\Users\YGIN\Anaconda3\envs\MyTest\lib\site-packages\mysql\connector\connection.py", line 344, in _send_cmd
packet_number, compressed_packet_number)
File "C:\Users\YGIN\Anaconda3\envs\MyTest\lib\site-packages\mysql\connector\network.py", line 151, in send_plain
errno=2055, values=(self.get_address(), _strioerror(err)))
mysql.connector.errors.OperationalError: 2055: Lost connection to MySQL server at 'localhost:3306', system error: 10038 An operation was attempted on something that is not a socket
C:\Users\abhi1702\Desktop\selenium\venv\Scripts\python.exe
C:/Users/abhi1702/Desktop/selenium/app.py
Traceback (most recent call last):
File "C:\Users\abhi1702\Desktop\selenium\venv\lib\site-packages\selenium\webdriver\common\service.py", line 72, in start
self.process = subprocess.Popen(cmd, env=self.env,
File "C:\Users\abhi1702\AppData\Local\Programs\Python\Python38-32\lib\subprocess.py", line 854, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "C:\Users\abhi1702\AppData\Local\Programs\Python\Python38-32\lib\subprocess.py", line 1307, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] The system cannot find the file specified
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:/Users/abhi1702/Desktop/selenium/app.py", line 5, in <module>
chrome= webdriver.Chrome(executable_path='Users\abhi1702\Desktop\chromedriver\chromedriver.exe')
File "C:\Users\abhi1702\Desktop\selenium\venv\lib\site-packages\selenium\webdriver\chrome\webdriver.py", line 73, in __init__
self.service.start()
File "C:\Users\abhi1702\Desktop\selenium\venv\lib\site-packages\selenium\webdriver\common\service.py", line 81, in start
raise WebDriverException(
selenium.common.exceptions.WebDriverException: Message: 'chromedriver.exe' executable needs to be in PATH. Please see https://sites.google.com/a/chromium.org/chromedriver/home
Answer is in probably your post:
Message: 'chromedriver.exe' executable needs to be in PATH
So please try adding chromedriver.exe to your system variable PATH.
For Windows, open System Properties - Environment Variables - and modify System variable "PATH": click Edit, add new entry with path to chromedriver.exe, for example: C:\drivers\chromedriver.exe
I run into such problems when I running my Django project(a week ago, the project work properly, today find this problem):
My Django version is 1.10.2 with python version 3.5.2, MySQL version is 5.5 on ubuntu 14.0.
/Users/deja/Virtualenv/python3.5/bin/python3.5 /Applications/PyCharm.app/Contents/helpers/pydev/pydevd.py --multiproc --qt-support --client 127.0.0.1 --port 60850 --file /Users/mozat/project/crawler_management_system/manage.py runserver 0.0.0.0:6380
pydev debugger: process 81527 is connecting
Connected to pydev debugger (build 145.1504)
pydev debugger: process 81528 is connecting
Performing system checks...
System check identified no issues (0 silenced).
You have 13 unapplied migration(s). Your project may not work properly until you apply the migrations for app(s): admin, auth, contenttypes, sessions.
Run 'python manage.py migrate' to apply them.
January 03, 2017 - 07:55:47
Django version 1.10.2, using settings 'crawler_management_system.settings'
Starting development server at http://0.0.0.0:6380/
Quit the server with CONTROL-C.
Internal Server Error: /
Traceback (most recent call last):
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/network.py", line 226, in recv_plain
chunk = self.sock.recv(4 - packet_len)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/mozat/project/crawler_management_system/crawler_management_system/mysql_utility.py", line 32, in open_db
raise err
File "/Users/mozat/project/crawler_management_system/crawler_management_system/mysql_utility.py", line 28, in open_db
yield cursor
File "/Users/mozat/project/crawler_management_system/crawler_management_system/views.py", line 40, in select_batch_records
cursor.execute(sql.format(table=self.table,times=times))
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/cursor.py", line 515, in execute
self._handle_result(self._connection.cmd_query(stmt))
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 488, in cmd_query
result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query))
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 267, in _send_cmd
return self._socket.recv()
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/network.py", line 255, in recv_plain
errno=2055, values=(self.get_address(), _strioerror(err)))
mysql.connector.errors.OperationalError: 2055: Lost connection to MySQL server at '127.0.0.1:10189', system error: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 710, in reset_session
self.cmd_reset_connection()
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 1046, in cmd_reset_connection
raise errors.NotSupportedError("MySQL version 5.7.2 and "
mysql.connector.errors.NotSupportedError: MySQL version 5.7.2 and earlier does not support COM_RESET_CONNECTION.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/protocol.py", line 267, in parse_eof
unpacked = struct_unpack('<xxxBBHH', packet)
struct.error: unpack requires a bytes object of length 9
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/django/core/handlers/exception.py", line 39, in inner
response = get_response(request)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/django/core/handlers/base.py", line 249, in _legacy_get_response
response = self._get_response(request)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/django/core/handlers/base.py", line 187, in _get_response
response = self.process_exception_by_middleware(e, request)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/django/core/handlers/base.py", line 185, in _get_response
response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/Users/mozat/project/crawler_management_system/crawler_management_system/views.py", line 99, in mainpage
result = batch_record_repo.select_batch_records(times)
File "/Users/mozat/project/crawler_management_system/crawler_management_system/views.py", line 41, in select_batch_records
return cursor.fetchall()
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/contextlib.py", line 77, in __exit__
self.gen.throw(type, value, traceback)
File "/Users/mozat/project/crawler_management_system/crawler_management_system/mysql_utility.py", line 40, in open_db
connection.close()
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/pooling.py", line 117, in close
cnx.reset_session()
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 713, in reset_session
self._database, self._charset_id)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 661, in cmd_change_user
self._post_connection()
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/abstracts.py", line 695, in _post_connection
self.set_charset_collation(self._charset_id)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/abstracts.py", line 654, in set_charset_collation
charset_name, collation_name))
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 869, in _execute_query
self.cmd_query(query)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 488, in cmd_query
result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query))
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 393, in _handle_result
return self._handle_eof(packet)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/connection.py", line 344, in _handle_eof
eof = self._protocol.parse_eof(packet)
File "/Users/deja/Virtualenv/python3.5/lib/python3.5/site-packages/mysql/connector/protocol.py", line 269, in parse_eof
raise errors.InterfaceError(err_msg)
mysql.connector.errors.InterfaceError: Failed parsing EOF packet.
[03/Jan/2017 07:56:40] "GET / HTTP/1.1" 500 172448
anyone happen to see same problem?Could you please give me some suggestion.
all ,nothing wrong with mysql, and Django. It's for I use a complex SQL to access mysql:
SELECT *
FROM
(SELECT *,
#batch_rank := IF(#current_batch = spider , #batch_rank + 1, 1) AS batch_rank,
#current_batch := spider
FROM deja_crawler.crawl_batch_record
where spider in (select distinct spider from deja_crawler.crawl_batch_record where spider like '%_new' or spider like '%_update')
ORDER BY spider, create_time DESC)
ranked
WHERE batch_rank <= 3
the tables used to have not too much data, so it works, later, the table became huge, and the access time cost is almost 30s, but the connection time out is set as 20s, so it will raise time out error.