[2023-10-04 20:01:49,550: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-04 20:02:19,971: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-04 20:02:50,250: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-04 20:03:20,502: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-04 20:03:50,767: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-04 20:04:21,060: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py:686: RuntimeWarning: Exception raised outside body: OperationalError('(sqlite3.OperationalError) attempt to write a readonly database'): Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1965, in _exec_single_context self.dialect.do_execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: attempt to write a readonly database The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 494, in trace_task I, R, state, retval = on_error(task_request, exc) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 399, in on_error R = I.handle_error_state( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 178, in handle_error_state return { File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 230, in handle_failure task.backend.mark_as_failure( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 167, in mark_as_failure self.store_result(task_id, exc, state, File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 19, in store_result session.commit() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 1923, in commit trans.commit(_to_root=True) File "", line 2, in commit File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go ret_value = fn(self, *arg, **kw) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 1239, in commit self._prepare_impl() File "", line 2, in _prepare_impl File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go ret_value = fn(self, *arg, **kw) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 1214, in _prepare_impl self.session.flush() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 4179, in flush self._flush(objects) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 4315, in _flush transaction.rollback(_capture_exception=True) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__ raise exc_value.with_traceback(exc_tb) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 4275, in _flush flush_context.execute() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute rec.execute(self) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute util.preloaded.orm_persistence.save_obj( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/persistence.py", line 93, in save_obj _emit_insert_statements( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/persistence.py", line 1226, in _emit_insert_statements result = connection.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1844, in _execute_context return self._exec_single_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1984, in _exec_single_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1965, in _exec_single_context self.dialect.do_execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 921, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) attempt to write a readonly database [SQL: INSERT INTO task (task_id, result, state, api_account_id) VALUES (?, ?, ?, ?)] [parameters: ('b4374669-53e2-42ec-aceb-b8683b9a26cb', 'Maximum retries occured', 'FAILURE', 1)] (Background on this error at: https://sqlalche.me/e/20/e3q8) warn(RuntimeWarning( [2023-10-05 01:08:49,791: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:09:20,070: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:09:50,339: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:10:20,701: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:10:50,991: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'd2db-220-158-159-51.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:11:21,278: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[b4d34adb-fa84-4491-95c8-de5a4ad27299] raised unexpected: RuntimeError('Maximum retries occured') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured [2023-10-05 01:13:36,044: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:13:36,388: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-05 01:13:36,433: INFO/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[6d422ed6-96b7-4029-a8ea-42cc626b3b95] succeeded in 0.42608970031142235s: 200 [2023-10-24 14:19:33,143: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:20:03,989: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:20:34,707: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:21:05,340: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:21:36,028: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:22:06,863: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py:686: RuntimeWarning: Exception raised outside body: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.'): Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 494, in trace_task I, R, state, retval = on_error(task_request, exc) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 399, in on_error R = I.handle_error_state( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 178, in handle_error_state return { File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 230, in handle_failure task.backend.mark_as_failure( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 167, in mark_as_failure self.store_result(task_id, exc, state, File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) warn(RuntimeWarning( [2023-10-24 14:22:07,033: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[91bf2568-c172-46f4-ab56-f6fbeaf5bf2b] raised unexpected: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 494, in trace_task I, R, state, retval = on_error(task_request, exc) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 399, in on_error R = I.handle_error_state( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 178, in handle_error_state return { File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 230, in handle_failure task.backend.mark_as_failure( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 167, in mark_as_failure self.store_result(task_id, exc, state, File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) [2023-10-24 14:25:09,204: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:25:39,664: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:26:10,130: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:26:40,691: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:27:11,210: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:27:41,839: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[320cbb9f-58b7-4dcd-92ae-72944a8d6ea1] raised unexpected: RuntimeError('Maximum retries occured') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured [2023-10-24 14:27:41,959: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:28:12,606: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:28:43,210: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:29:13,850: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:29:44,405: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:30:14,956: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[06040a3e-a562-41dc-b2f1-f961c3ab4641] raised unexpected: RuntimeError('Maximum retries occured') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured [2023-10-24 14:30:15,021: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:30:45,666: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:31:16,305: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:31:46,970: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:32:17,631: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '15c2-220-158-159-149.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-10-24 14:32:48,147: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[8936daba-423c-4663-bf04-70393843e340] raised unexpected: RuntimeError('Maximum retries occured') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured [2023-12-25 15:20:33,610: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '4f92-2409-40f4-100b-4cde-5901-2ecb-7b73-6f4d.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-12-25 15:21:03,834: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '4f92-2409-40f4-100b-4cde-5901-2ecb-7b73-6f4d.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-12-25 15:21:33,986: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '4f92-2409-40f4-100b-4cde-5901-2ecb-7b73-6f4d.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-12-25 15:22:04,119: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '4f92-2409-40f4-100b-4cde-5901-2ecb-7b73-6f4d.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-12-25 15:22:34,237: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host '4f92-2409-40f4-100b-4cde-5901-2ecb-7b73-6f4d.ngrok-free.app'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2023-12-25 15:23:05,273: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[e11d9014-63b4-466c-bcc2-90fedcffbda3] raised unexpected: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 494, in trace_task I, R, state, retval = on_error(task_request, exc) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 399, in on_error R = I.handle_error_state( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 178, in handle_error_state return { File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 230, in handle_failure task.backend.mark_as_failure( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 167, in mark_as_failure self.store_result(task_id, exc, state, File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) [2024-06-12 21:19:10,529: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 21:19:42,929: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 21:20:14,879: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 21:20:46,467: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 21:20:47,905: INFO/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[770e28e5-0d06-404a-82de-f2bc7d1c3580] succeeded in 97.88488457351923s: 200 [2024-06-12 21:22:56,341: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 21:23:48,350: INFO/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[37bac59e-5c76-4014-9c29-0a235c82b20d] succeeded in 52.461295476183295s: 200 [2024-06-12 21:24:58,548: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 21:24:59,362: INFO/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[2c78e221-2606-412a-92ba-9f14384967c4] succeeded in 1.261266615241766s: 200 [2024-06-12 23:42:31,832: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[3bb4108e-b087-4b1b-934f-fbc99cf596a3] raised unexpected: RuntimeError('Maximum retries occured') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook raise RuntimeError('Maximum retries occured') RuntimeError: Maximum retries occured [2024-06-12 23:52:25,461: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 23:53:22,102: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-12 23:53:32,567: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py:686: RuntimeWarning: Exception raised outside body: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.'): Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 544, in trace_task task.backend.mark_as_done( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 157, in mark_as_done self.store_result(task_id, result, state, request=request) File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) warn(RuntimeWarning( [2024-06-12 23:53:32,795: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[c2c638fa-5682-45c4-a6e3-2c15a3c3db0b] raised unexpected: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 544, in trace_task task.backend.mark_as_done( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 157, in mark_as_done self.store_result(task_id, result, state, request=request) File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) [2024-06-23 02:45:01,079: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:45:33,470: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:46:05,551: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:46:37,555: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:47:09,535: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:47:41,554: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py:686: RuntimeWarning: Exception raised outside body: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.'): Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook except: RuntimeError: Maximum retries occured During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 494, in trace_task I, R, state, retval = on_error(task_request, exc) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 399, in on_error R = I.handle_error_state( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 178, in handle_error_state return { File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 230, in handle_failure task.backend.mark_as_failure( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 167, in mark_as_failure self.store_result(task_id, exc, state, File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) warn(RuntimeWarning( [2024-06-23 02:47:41,812: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[e2ec3a29-5759-4c04-8c08-2fd75f3186fb] raised unexpected: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 477, in trace_task R = retval = fun(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 760, in __protected_call__ return self.run(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/app.py", line 51, in trigger_webhook except: RuntimeError: Maximum retries occured During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 494, in trace_task I, R, state, retval = on_error(task_request, exc) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 399, in on_error R = I.handle_error_state( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 178, in handle_error_state return { File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 230, in handle_failure task.backend.mark_as_failure( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 167, in mark_as_failure self.store_result(task_id, exc, state, File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) [2024-06-23 02:53:57,465: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:54:30,222: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:55:02,472: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:55:34,575: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:56:06,546: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-23 02:56:07,669: INFO/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[bf90ac89-80c5-47bd-aab3-1d0dd41d50cd] succeeded in 130.6559865642339s: 200 [2024-06-24 13:03:57,762: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-06-24 13:04:03,559: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[bac1cd8b-8b2f-41b9-a84b-cf76d264febe] raised unexpected: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 544, in trace_task task.backend.mark_as_done( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 157, in mark_as_done self.store_result(task_id, result, state, request=request) File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) [2024-09-18 15:07:45,721: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/urllib3/connectionpool.py:1095: InsecureRequestWarning: Unverified HTTPS request is being made to host 'proxy.infomin.solutions'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( [2024-09-18 15:07:47,685: WARNING/ForkPoolWorker-1] /home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py:686: RuntimeWarning: Exception raised outside body: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.'): Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 544, in trace_task task.backend.mark_as_done( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 157, in mark_as_done self.store_result(task_id, result, state, request=request) File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8) warn(RuntimeWarning( [2024-09-18 15:07:47,855: ERROR/ForkPoolWorker-1] Task scheduler_infomin_solutions.app.trigger_webhook[8c7001e8-bdeb-464d-bb03-4902d5777df5] raised unexpected: OperationalError('(mysql.connector.errors.OperationalError) MySQL Connection not available.') Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") mysql.connector.errors.OperationalError: MySQL Connection not available. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/app/trace.py", line 544, in trace_task task.backend.mark_as_done( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/celery/backends/base.py", line 157, in mark_as_done self.store_result(task_id, result, state, request=request) File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 22, in store_result raise e File "/home/infominsolutions/scheduler_infomin_solutions/backend.py", line 16, in store_result api_account = session.query(connection.ApiAccount).filter_by(api_key=api_key).first() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2743, in first return self.limit(1)._iter().first() # type: ignore File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 2842, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2262, in execute return self._execute_internal( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/session.py", line 2144, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1412, in execute return meth( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection return connection._execute_clauseelement( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1635, in _execute_clauseelement ret = self._execute_context( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1816, in _execute_context self._handle_dbapi_exception( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2339, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1810, in _execute_context context = constructor( File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1398, in _init_compiled self.cursor = self.create_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1722, in create_cursor return self.create_default_cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 1728, in create_default_cursor return self._dbapi_connection.cursor() File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/sqlalchemy/pool/base.py", line 1489, in cursor return self.dbapi_connection.cursor(*args, **kwargs) File "/home/infominsolutions/scheduler_infomin_solutions/venv/lib/python3.8/site-packages/mysql/connector/connection_cext.py", line 700, in cursor raise OperationalError("MySQL Connection not available.") sqlalchemy.exc.OperationalError: (mysql.connector.errors.OperationalError) MySQL Connection not available. [SQL: SELECT api_account.id AS api_account_id, api_account.api_key AS api_account_api_key FROM api_account WHERE api_account.api_key = %(api_key_1)s LIMIT %(param_1)s] [parameters: [{}]] (Background on this error at: https://sqlalche.me/e/20/e3q8)