key: cord-0044819-o0q4eypt
authors: Harmati, István Á.; Kóczy, László T.
title: Improvements on the Convergence and Stability of Fuzzy Grey Cognitive Maps
date: 2020-05-16
journal: Information Processing and Management of Uncertainty in Knowledge-Based Systems
DOI: 10.1007/978-3-030-50153-2_38
sha: 73a6931a0fe7b78eb09270483c9d1ea5cff2e7bb
doc_id: 44819
cord_uid: o0q4eypt

Fuzzy grey cognitive maps (FGCMs) are extensions of fuzzy cognitive maps (FCMs), where the causal connections between the concepts are represented by so-called grey numbers. Just like in classical FCMs, the inference is determined by an iteration process, which may converge to an equilibrium point, but limit cycles or chaotic behaviour may also show up. In this paper, based on network measures like in-degree, out-degree and connectivity, we provide new sufficient conditions for the existence and uniqueness of fixed points for FGCMs. Moreover, a tighter convergence condition is presented using the spectral radius of the modified weight matrix.

Fuzzy cognitive maps are neural network-based decision support tools, where the neurons represent specific factors or characteristics of the modelled system [11] . Graphically, a fuzzy cognitive map is a weighted, directed graph. The constant weights assigned to the edges from the interval [−1, 1] express the strength and direction of causal connections. The current states of the neurons (which are called concepts in FCM literature) are also characterized by numbers in the [0, 1] interval (in some applications the interval [−1, 1] is also applicable [12] ). These are the activation values of the concepts [6] . Formally, the system can be described by the set of concepts (C 1 , C 2 , . . . , C n ); the current activation values of the concepts (A 1 , A 2 , . . . , A n ); the weight matrix W which assigns weight w ij to each edge connecting the nodes C i and C j ), expressing how strongly influenced is concept C i by concept C j . The sign of w ij indicates whether the relationship between C j and C i is direct or inverse. So matrix W represents the weighted causal connections between the concepts. A transformation function f : R → [0, 1] calculates the activation value of concepts at every time step of the iteration and the activation values in the allowed range (sometimes a function f : R → [−1, 1] is applied).

The iteration rule which calculates the values of the concept at every step may or may not include self-feedback. In general form it can be written as

where A i (k) is the value of concept C i at discrete time k, w ij is the weight of the connection from concept C j to concept C i and 0 ≤ d i ≤ 1 expresses the possible self-feedback. If d i = 0, then there is no self-feedback. If we include the d i s into the diagonal of weight matrix W , the iteration equation can be rewritten in more compact style:

where w i = [w i1 , . . . , w in ] is the ith row of W and A(k) = [A 1 (k), . . . , A n (k)] T is the concept vector after k iterations. We apply dot product between them, so w i A (k) is a real number. Moreover, if we couple the coordinates of the concept vector together and denote by G the mapping R n → R n that generates the concept vector A(k + 1) from A(k), then we have that:

. . .

The iteration rule repeated until either the FCM converges to an equilibrium state (fixed point) or the maximal number of iterations is reached. Mathematically, the FCM may converge to a fixed point, may arrive to a limit cycle or shows chaotic pattern [2, 5] . The weights of the connections are usually determined by human experts or by learning methods. In both of the cases there are some uncertainties about the exact values of the weights. This was the main motivation of Fuzzy Grey Cognitive Maps, where the weights and concept values are modelled by the socalled grey numbers [8] [9] [10] 13] .

A grey number (denoted by ⊗g) is a number whose accurate value is unknown, but we know the range within the value is included. A grey number with both a lower limit (g) and an upper limit (g) is called an interval grey number [4] , so ⊗g ∈ [g, g] . In applications, a grey number is usually an interval. The basic arithmetic operations on grey numbers are the following [4] :

Beside the above defined operations, we have to provide a consistent definition for the generalization of any f : R → R function to grey numbers. The function of a grey number ⊗g ∈ [g, g] is the grey number

For a continuous and monotone increasing function f we have

Consequently, f (⊗g) = f (g) and f (⊗g) = f (g) and f (⊗g) ∈ [f (g), f(g)].

The dynamics of an FGCM is similar to the original FCM's. It begins with an initial grey vector A(0), which represents initial uncertainty. The elements of this vector are grey numbers, i.e. A i (0) ∈ [A i (0), A i (0)] for every i. The activation values are computed by the iterative process, resulting grey numbers as concept values:

An FGCM with continuous threshold produces one of the following behaviours:

1. Fixed point: the FGCM converges to a grey fixed-point attractor. This fixed point is vector, whose coordinates are grey numbers (intervals). The convergence (stabilization) means that the endpoints of these intervals are stabilized after a certain number of iterations. 2. Limit cycle: the state values keep oscillating between several states. These states (elements of the limit cycle) are concept vectors with interval coordinates. 3. Chaotic behaviour: the FGCM produces different grey vector states for each iteration, without any pattern.

Usually, the behaviour of fuzzy cognitive maps is examined by trial-error methods. The main contribution of this paper is to present analytical conditions for the existence and uniqueness of attracting fixed points of FGCMs. It also ensures the global exponential stability of the system. Previously, Boutalis et al. [14] proved a condition for the convergence of a class of FCMs. Their result has been generalized in [2] . Knight et al. [15] studied the problem of fixed points of FCMs using only the topology, without the weights.

In this paper, we give several conditions for convergence and stability of fuzzy grey cognitive maps. In Sect. 2 different type of behaviours of FCMs and FGCMs are demonstrated by illustrative examples. In Sect. 3 we briefly summarize the mathematical background, in Sect. 4 some theorems are proved regarding to existence and uniqueness of fixed points of FGCMs. We illustrate the results with an example in Sect. 5, and shortly summarize them in Sect. 6.

Consider the following toy example to demonstrate the behaviour of FCMs and FGCMs ( Fig. 1 ). Although this network is extremely simple, it is able to produce qualitatively different behaviours for different choice of weights. Let us apply the hyperbolic tangent function with parameter λ (tanh(λx)) as threshold function (for some properties of hyperbolic tangent FCMs see [3] ). Different settings of weights and parameter λ yield completely different behaviour, although the topology remains the same.

For a certain set of parameters we may have a non-trivial fixed point (the trivial fixed point is the zero vector, since it is always a fixed point of hyperbolic tangent FCMs, but not always attractor [3] ) (Fig. 2 ). Other setting yields oscillation, namely a quasiperiodic behaviour (Fig. 3) .

Convergence of FGCMs means that the upper and lower endpoints of the intervals containing the activations values are stabilized. It can be observed in Fig. 4 , while with different weights and parameter λ we can observe oscillating pattern (Fig. 5) . 

The results presented in the next section are based on the contraction property of the mapping that generates the iteration. Here we recall the definition of contraction mapping [7] :

The notion of contraction is related to the distance metric d applied. It may happen that a function is a contraction w.r.t. one distance metric, but not a contraction w.r.t. another distance metric. The iterative process of an FCM may end at an equilibrium point, which is a so-called fixed point.

The following theorem provides sufficient condition for the existence and uniqueness of a fixed point [7] . Moreover, if mapping that generates the iteration is a contraction, it ensures the stability of the iteration.

Theorem 1 (Banach's fixed point theorem) . If G : X → X is a contraction mapping on a nonempty complete metric space (X, d) , then G has only one fixed point x * . Moreover, x * can be found as follows: start with an arbitrary x 0 ∈ X and define the sequence x n+1 = G(x n ), then lim n→∞ x n = x * . Definition 2. Let x * be a fixed point of the iteration x n+1 = G(x n ). x * is locally asymptotically stable if there exist a neighborhood U of x * , such that for each starting value x 0 ∈ U we get that

If this neighborhood U is the entire domain of G, then x * is a globally asymptotically stable fixed point.

If G : X → X is a contraction mapping on a nonempty complete metric space (X, d), then its unique fixed point x * is globally asymptotically stable.

In Sect. 4, the following property of the sigmoid function will be applied:

The derivative of the sigmoid function f : R → R, f (x) = 1/(1 + e −λx ), (λ > 0) is bounded by λ/4. Moreover, for every x, y ∈ R the following inequality holds

In [1] the following statements have been introduced about the convergence of fuzzy grey cognitive maps: Theorem 2. Let ⊗W be the extended (including possible feedback) weight matrix of a fuzzy grey cognitive map (FGCM), where the weights ⊗w ij are nonnegative or nonpositive grey numbers and let λ > 0 be the parameter of the sigmoid function f (x) = 1/(1 + e −λx ) applied for the iteration. Let W * be a matrix defined by the absolute values of the weights, i.e. w * ij = max |w ij |, |w ij | . If one of the inequalities

hold, then the FGCM has one and only one grey fixed point, regardless of the initial concept values.

Here * 1 , * ∞ and * F denote the 1-norm, infinity norm and Frobenius norm of the matrix, respectively. Here fixed point ⊗A * is

The grey fixed point is unique in the sense that the endpoints of the intervals containing grey concept values are unique, i.e. the values A * i and A * i are unique for every i.

In this section, we provide several theorems regarding the existence and uniqueness of attracting grey fixed point. The first three theorems are based on the structure of the FGCM, namely they are based in the so-called in-degree, outdegree and connectivity, which are widely used measures to describe the quality of the network. The last one is based on the spectral radius of the modified weight matrix W * and it gives the better condition in the sense that it ensures the convergence for the largest set of parameter λ.

which is the sum of the absolute values of the entries of the jth column of W .

which is the sum of the absolute values of the entries of the ith row of W .

We note that self-feedback means self-loop in the graph. So if self-feedbacks are applied in the concepts, then the weights of the feedback are counted in the in-degree and the out-degree, too. It is the reason that we did not exclude i = j from the summations above.

Connectivity measures the 'density' of the network. If self-feedback is allowed, then the maximum number of connections is n 2 , if not allowed, then the maximum number of connections is n(n − 1). The weighted in-degree, weighted out-degree and weighted connectivity can defined similarly for FGCMs, but instead of absolute values of real numbers (exact weights), we use the absolute values of grey numbers (intervals):

If self-feedback is allowed, then the weighted connectivity is

If self-feedback is not allowed, then the weighted connectivity is

For fuzzy grey cognitive maps, we apply the absolute values of the grey weights (w * ij − s), so the enumerator is the sum

Theorem 3. Let λ be the parameter of the sigmoid threshold function applied for every concept. If the maximal in-degree of the FGCM (including possible feedback) is less than 4/λ, then the FGCM has one and only one fixed point.

Proof. In [1] it has been shown that if W * 1 < 4/λ, then the FGCM has one and only one grey fixed point. Moreover, since

this condition is equivalent to the requirement stated in the theorem. Proof. The proof goes similarly to the previous one, but instead of 1-norm we use the infinity norm. In [1] it has been shown that if W * ∞ < 4/λ, then the FGCM has one and only one grey fixed point. Moreover, since

this condition is equivalent to the requirement stated in the theorem.

The theorems above are mathematically equivalent with the statements of Theorem 2, but they are easier to capture by the users of FCMs. While the users are not necessarily familiar with matrix norms, they can easily handle notions like in-and out-degree, which are graphically straightforward.

Let λ be the parameter of the sigmoid threshold function applied for every concept. If the weighted connectivity (Con w ) of the FGCM small enough, namely 1. if self-feedback is allowed:

if self-feedback is not allowed:

then the FGCM has one and only one fixed point.

Proof. We show that if n i=1 n j=1 w * ij < 4/λ, then mapping G is a contraction, so it has exactly one fixed point. Let us define the distance of grey concept vectors as

We are going to show that with the distance measure above:

By the definition of the distance of two grey-valued vectors, we have

It has been shown in [1] that the following upper estimation can be given for the difference of the ith coordinates (similar inequality holds for the difference of the upper endpoints):

where w * i is the ith row of matrix W * and we apply dot product between w *

Use this inequality for the distance of G(A) and G(A ):

If λ 4 n i=1 n j=1 w * ij < 1, then the mapping is a contraction, so the iteration leads to a unique fixed point, regardless to the initial value. Rearanging this inequality and division both sides by n 2 ( or n(n − 1)) completes the proof.

Although Theorem 5 provides weaker condition, it has an important message expressed by connectivity: poorly connected FGCMs cannot produce complex behaviour (the term 'poorly' depends on λ and n). Proof. Let us define the distance of two grey-valued vectors as the norm of their difference. At this stage we do not specify this norm:

We are going to show that with the distance above and for a suitable matrix norm:

By the definition of the distance of two grey-valued vectors, we have

It has been shown in [1] that the following upper estimation can be given for the difference of the ith coordinates (similar inequality holds for the difference of the upper endpoints):

where w * i is the ith row of matrix W * . Since this inequality holds for every coordinates, we conclude to following inequality for the difference of the lower endpoint vectors:

Using this inequality (and the corresponding inequality for the upper endpoints) we provide upper estimation for the distance of G(A) and G(A ):

In W * , the matrix norm is induced by the vector norm. By the contraction mapping theorem, if the coefficient of d(A, A ) is less than one, then mapping G is a contraction, consequently it has exactly one fixed point. Moreover, if the spectral radius of a matrix is less than one, then there exists a matrix norm, such that norm of the matrix is less then one, i.e. if ρ λ 4 W * < 1, then there exist a matrix norm, such that λ 4 W * < 1. Applying this matrix norm, mapping G is a contraction, which completes the proof.

Since ρ(W * ) ≤ W * for any matrix norm, Theorem 6 gives the best condition expressed by W * . Remark 1. The results in Sect. 4: Theorem 3, Theorem 4, Theorem 5 and Theorem 6 are valid for fuzzy grey cognitive maps with hyperbolic tangent threshold function (tanh(λx)), too, but we have to replace 4/λ by 1/λ, since the derivative of tanh(λx) is bounded by λ (and not λ/4).

Let us consider the following weight matrix with imprecise (grey) entries: 

The corresponding measures:

-Maximal weighted in-degree: 2.3 -Maximal weighted out-degree: 2 -Connectivity • without self-feedback: Con w = 0.2633 • with self-feedback: Con w = 0.2194 -spectral radius: ρ(W * ) = 1.1485

According to Theorem 6, if λ < 3.4827, then this grey FCM has one and only one grey fixed point. It also means that in this case the FGCM produces globally asymptotically stable behaviour, since every initial grey vector leads to the same equilibrium state.

Fuzzy Grey Cognitive Maps are generalizations of classical FCMs, that can model the uncertainties of activation values and weights of causal connections.

In this paper, we provided some conditions for the convergence of FGCMs to a unique fixed point. The unicity of this attracting fixed point also ensures that the FGCM is globally exponentially stable, i.e. it converges to the same fixed point attractor regardless of the initial concept vector. Future work is focused on the effective detection of multiple fixed points scenarios and the prediction of oscillating patterns without simulations. The future goal is to provide exact analytical conditions for both of these behaviours.

On the convergence of sigmoidal fuzzy grey cognitive maps

On the existence and uniqueness of fixed points of fuzzy cognitive maps

Notes on the dynamics of hyperbolic tangent fuzzy cognitive maps

Grey Information

On the convergence of sigmoid fuzzy cognitive maps

Methods and algorithms for fuzzy cognitive map-based decision support

Principles of Mathematical Analysis

Modelling grey uncertainty with fuzzy grey cognitive maps

A fuzzy grey cognitive maps-based decision support system for radiotherapy treatment planning. Knowl.-Based Syst

Uncertainty propagation in fuzzy grey cognitive maps with Hebbian-like learning algorithms

Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive maps

Development of supply chain risk management approaches for construction projects: a grounded theory approach

Adaptive estimation of fuzzy cognitive maps with proven stability and parameter convergence

Linear and sigmoidal fuzzy cognitive maps: an analysis of fixed points

Acknowledgment. The research presented in this paper was carried out as part of the EFOP-3.6.2-16-2017-00016 project in the framework of the New Széchenyi Plan. The completion of this project is funded by the European Union and co-financed by the European Social Fund.This research was supported in part by National Research, Development and Innovation Office (NKFIH) K124055.