In watcher/metrics_engine/cluster_history/api.py, we can find the BaseClusterHistory abstract base class. To follow the same naming convention observed throughout the rest of the project, I renamed watcher/metrics_engine/cluster_history/api.py to watcher/metrics_engine/cluster_history/base.py Change-Id: If18f8db7f0982e47c1998a469c54952670c262f5 Closes-Bug: #1548398
120 lines
4.9 KiB
Python
120 lines
4.9 KiB
Python
# -*- encoding: utf-8 -*-
|
|
# Copyright (c) 2015 b<>com
|
|
#
|
|
# Authors: Jean-Emile DARTOIS <jean-emile.dartois@b-com.com>
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License");
|
|
# you may not use this file except in compliance with the License.
|
|
# You may obtain a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
|
# implied.
|
|
# See the License for the specific language governing permissions and
|
|
# limitations under the License.
|
|
#
|
|
|
|
"""
|
|
A :ref:`Cluster Data Model <cluster_data_model_definition>` is a logical
|
|
representation of the current state and topology of the
|
|
:ref:`Cluster <cluster_definition>`
|
|
:ref:`Managed resources <managed_resource_definition>`.
|
|
|
|
It is represented as a set of
|
|
:ref:`Managed resources <managed_resource_definition>`
|
|
(which may be a simple tree or a flat list of key-value pairs)
|
|
which enables Watcher :ref:`Strategies <strategy_definition>` to know the
|
|
current relationships between the different
|
|
:ref:`resources <managed_resource_definition>`) of the
|
|
:ref:`Cluster <cluster_definition>` during an :ref:`Audit <audit_definition>`
|
|
and enables the :ref:`Strategy <strategy_definition>` to request information
|
|
such as:
|
|
|
|
- What compute nodes are in a given
|
|
:ref:`Availability Zone <availability_zone_definition>`
|
|
or a given :ref:`Host Aggregate <host_aggregates_definition>` ?
|
|
- What :ref:`Instances <instance_definition>` are hosted on a given compute
|
|
node ?
|
|
- What is the current load of a compute node ?
|
|
- What is the current free memory of a compute node ?
|
|
- What is the network link between two compute nodes ?
|
|
- What is the available bandwidth on a given network link ?
|
|
- What is the current space available on a given virtual disk of a given
|
|
:ref:`Instance <instance_definition>` ?
|
|
- What is the current state of a given :ref:`Instance <instance_definition>`?
|
|
- ...
|
|
|
|
In a word, this data model enables the :ref:`Strategy <strategy_definition>`
|
|
to know:
|
|
|
|
- the current topology of the :ref:`Cluster <cluster_definition>`
|
|
- the current capacity for each
|
|
:ref:`Managed resource <managed_resource_definition>`
|
|
- the current amount of used/free space for each
|
|
:ref:`Managed resource <managed_resource_definition>`
|
|
- the current state of each
|
|
:ref:`Managed resources <managed_resource_definition>`
|
|
|
|
In the Watcher project, we aim at providing a generic and very basic
|
|
:ref:`Cluster Data Model <cluster_data_model_definition>` for each
|
|
:ref:`Goal <goal_definition>`, usable in the associated
|
|
:ref:`Strategies <strategy_definition>` through some helper classes in order
|
|
to:
|
|
|
|
- simplify the development of a new
|
|
:ref:`Strategy <strategy_definition>` for a given
|
|
:ref:`Goal <goal_definition>` when there already are some existing
|
|
:ref:`Strategies <strategy_definition>` associated to the same
|
|
:ref:`Goal <goal_definition>`
|
|
- avoid duplicating the same code in several
|
|
:ref:`Strategies <strategy_definition>` associated to the same
|
|
:ref:`Goal <goal_definition>`
|
|
- have a better consistency between the different
|
|
:ref:`Strategies <strategy_definition>` for a given
|
|
:ref:`Goal <goal_definition>`
|
|
- avoid any strong coupling with any external
|
|
:ref:`Cluster Data Model <cluster_data_model_definition>`
|
|
(the proposed data model acts as a pivot data model)
|
|
|
|
There may be various
|
|
:ref:`generic and basic Cluster Data Models <cluster_data_model_definition>`
|
|
proposed in Watcher helpers, each of them being adapted to achieving a given
|
|
:ref:`Goal <goal_definition>`:
|
|
|
|
- For example, for a
|
|
:ref:`Goal <goal_definition>` which aims at optimizing the network
|
|
:ref:`resources <managed_resource_definition>` the
|
|
:ref:`Strategy <strategy_definition>` may need to know which
|
|
:ref:`resources <managed_resource_definition>` are communicating together.
|
|
- Whereas for a :ref:`Goal <goal_definition>` which aims at optimizing thermal
|
|
and power conditions, the :ref:`Strategy <strategy_definition>` may need to
|
|
know the location of each compute node in the racks and the location of each
|
|
rack in the room.
|
|
|
|
Note however that a developer can use his/her own
|
|
:ref:`Cluster Data Model <cluster_data_model_definition>` if the proposed data
|
|
model does not fit his/her needs as long as the
|
|
:ref:`Strategy <strategy_definition>` is able to produce a
|
|
:ref:`Solution <solution_definition>` for the requested
|
|
:ref:`Goal <goal_definition>`.
|
|
For example, a developer could rely on the Nova Data Model to optimize some
|
|
compute resources.
|
|
|
|
The :ref:`Cluster Data Model <cluster_data_model_definition>` may be persisted
|
|
in any appropriate storage system (SQL database, NoSQL database, JSON file,
|
|
XML File, In Memory Database, ...).
|
|
"""
|
|
|
|
import abc
|
|
import six
|
|
|
|
|
|
@six.add_metaclass(abc.ABCMeta)
|
|
class BaseClusterModelCollector(object):
|
|
@abc.abstractmethod
|
|
def get_latest_cluster_data_model(self):
|
|
raise NotImplementedError()
|