Abstract
Taking concepts from supply management, we developed a specification-assessment-compliance approach to obtain a transparent multi-criteria decision-making method. We designed an artificial-neuron-like node that allows the implementation of networks to represent hierarchies of evaluation criteria. A new graphical model based on functions in the unit segment uses the concept of Pythagorean fuzzy set (PFS). The specification PFSs’ entropies modulate the widths of one-sided triangular fuzzy numbers (TFNs) with positive slopes that become the evaluation nodes’ activation functions. All the specifications refer to the same point to facilitate the evaluation and ensure coherence. One-sided TFNs with negative slopes biunivocally represent the assessment PFSs at the input layer of the network. A risk case study on the options for the outsourcing of an information technology development project shows the proposed method’s implementation. We compare the results with those of the application of two other previous methods.
Keywords
Introduction
Nowadays, organizations depend more and more on information technology (IT). Organizations launch IT projects across all departments to adapt to new required services, maintain competitiveness, meet emerging needs, and keep pace with technology in continuous evolution [1, 2]. IT projects are challenging to manage and show a higher failure rate than projects in other areas [3, 4]. The continuous evolution of technology generates cycles in which the rate of failure slowly drops thanks to the learning process, to rocket up again when new technological paradigms arise [5, 6]. Given that proper risk management is essential for projects of any type, this asseveration becomes more drastic in IT projects.
The motivation and the goal of this paper are to overcome the opacity of risk assessment methods. The research objective is to implement a flexible, transparent method that assesses the risk factors, analyzes their interactions, and evaluates the project’s overall risk.
In multi-criteria decision-making (MCDM), a set of evaluation criteria {C1, C2, … , CM } determines how well the options (O1, O2, … , ON) suit the desired solution. The MCDM implementation assigns different weights (W1, W2, … , WM) to the criteria according to their importance and assesses each option concerning each evaluation criterion. The application of an MCDM model [7] permits implementing a risk evaluation method in which the risk factors become the evaluation criteria.
Risk characterization is uncertain by nature.
Fuzzy logic [8] uses fuzzy sets (FS) with membership functions. Many authors use triangular fuzzy numbers (TFN) [9] as membership functions.
FS and intuitionistic fuzzy sets (IFS) [10] help deal with uncertain values.
Pythagorean fuzzy sets (PFS) [11] overcome the limitations of classic IFS [12] and are better representing and handling uncertainties [13–15].
The entropy of a fuzzy set provides information on the amount of knowledge it contains [14–16].
Several authors have proposed fuzzy logic-based methods for project risk evaluation [17–24] (Table 1).
Fuzzy evaluation of project risk
Fuzzy evaluation of project risk
As part of the case study, we compare the results obtained by the new method proposed here with the results obtained by applying a vectorial method [21]. In that method, IFS and TFN did not relate, and the latter was used only in calculating weights. The vectorial method used the classic representation of IFS. It calculated Euclidean distances from the points corresponding to the ideal virtual solution to the points that correspond to the option under evaluation. It is not possible to consider the tolerances with the vectorial method.
The aggregation of the assessments by vector calculations did not permit the analysis of interactions among risk factors and was less intuitive in representing the decision-making problem.
Many intuitionistic evaluation methods measure the distance-based similarity. From the direct measurement of the Hamming distance [25] or the Euclidean distance [26] to more sophisticated approaches to the calculation of distance [21], different authors compare every parameter under evaluation with its respective reference. The similarity/dissimilarity method [27] relates knowledge to the distance to the reference. It improves coherence by fixing the reference at the most intuitionistic point. Some methods use a two-sided symmetric TFN’s width to measure the uncertainty or lack of confidence in an assigned value [28]. Other authors propose the entropy-based measuring of the knowledge contained in the IFSs to calculate the weights of criteria in decision-making problems [29].
There are geometric interpretations of IFS and PFS [30, 31] based on intuitionistic space points.
We can find two approaches to integrating IFS and artificial neurons. The most common approach consists of the combination of IFS and fuzzy inference networks. The fuzzy inference network includes an intuitionistic fuzzy inference layer in which each element represents a fuzzy inference rule [32, 33]. The least common approach adapts the classic artificial neural network to admit IFS or PFS as input, output, or weight [34]. A classic artificial neural network needs a previous training procedure and produces results through an opaque process.
To provide simplicity and transparency, permit partial evaluations, analyze inter-factors influence, and have flexibility, we do not design an inference network but an artificial-neuron-like-based network that implements a hierarchy of evaluation criteria representing the taxonomy of risk factors. This paper integrates the PFS and the TFN to obtain the artificial neuron-like evaluation node. As in the classic artificial neural network, not having an inference layer, it is not possible to use a PFS directly as an input of the activation function that, in our case, expresses the specification tolerance.
Several authors have demonstrated the use of TFN as input of artificial neural networks [35, 36], usually to integrate linguistic variables in their models [37, 38]. So that, since the PFS cannot directly feed the activation function, the main benefit of transforming the PFS into a one-sided TFN is coherently integrating its three values in a single function, permitting a PFS to become the input of an evaluation network. Thus, the PFS/TFN model, in association with the activation function, acts as a new adjustable defuzzification module. Furthermore, evaluators will find it easier to visualize than the representation as a point somewhere in the first quadrant of the unit circumference.
In this way, the new method benefits from both the hierarchical evaluation network capabilities and the PFS advantages to deal with uncertainty, thus implementing an understandable specification-assessment-compliance approach that facilitates the evaluator’s task.
Unlike previous proposals, we obtain an intuitive representation of the decision-making problem through an evaluation network. Furthermore, setting the reference at the maximum membership level is more intuitive and keeping it along the process facilitates the assessment’s coherence.
The method could also apply, with some minor modifications, to other evaluation or decision-making problems. Furthermore, we can explore the use of the PFS/TFN model as part of other specific fuzzy methods that apply to varied fields, from the web service selection for rejuvenation [39] or the fuzzy transportation problem [40] to the shortest path problem [41].
Table 1 compares the proposed method with other fuzzy logic-based proposals for the evaluation of risk in projects.
Artificial neural network
In artificial neurons, each weight W i multiplies an input x i and the sum of all the weighted inputs (plus a usually necessary bias b) stimulates an activation function f (x).
The output y of each artificial neuron is [42]:
Classic artificial neural networks arrange artificial neurons in a fully connected network that needs a training process to adjust its weights and biases.
Given a universe of discourse X, a fuzzy set (FS) A is described by:
In an IFS, π A (x) = 1 - μ A (x) - ν A (x) denotes the level of indeterminacy of x to A.
The Pythagorean fuzzy set (PFS) [11] is a generalization of the concept of IFS with the following restriction [12]:
In a PFS,
The triangular function
The function of a one-sided TFN with a positive slope (l, m, m) is [43]:
The lack of knowledge of a PFS can be related to its entropy [16]. The following equation calculates the entropy of a PFS [15]:
The proposed method connects artificial neuron-like evaluation nodes to build a network representing the risk factors’ taxonomy.
This hierarchy of risk factors becomes the hierarchy of evaluation criteria and sub-criteria of the new MCDM method.
Figure 1 shows a schematic representation of the artificial neuron-like evaluation node model. With minor changes, the proposed method can use either IFS or PFS. We selected PFS because PFS has a lesser restricted range of membership and non-membership values than IFS, facilitating the evaluator’s task.

Evaluation node.
At hierarchy levels other than the input layer, the crisp output values y that result from the previous layer are the inputs in i to the evaluation nodes.
Each input to an evaluation node has an associated weight (W i ) related to the level of influence of the respective risk factor.
We can evaluate individual risk factors along the hierarchy and take the hierarchy output as the overall risk.
The evaluation method includes the following steps:
Weights (W i ) set the importance of every evaluation criterion or sub-criterion. The calculation of weights for the evaluation criteria and sub-criteria is beyond the scope of this work.
The connection of the evaluation nodes implements the evaluation network.
For every evaluation sub-criterion of the input layer, we specify its desired characteristics employing a descriptive text, and we define the tolerance for every sub-criterion and criterion using a specification PFS (μ
s
, ν
s
, π
s
):
The membership value μ s sets the level of confidence in the specification description or the level of requirement of its fulfillment. The non-membership value ν s sets the lack of confidence in the specification description or the level of looseness in its requirement. The value π s sets the level of hesitance or uncertainty concerning the given specification.
We use the entropy-based Equation (8) to calculate the width (0 ⩽ d = 1 - d
s
⩽ 1) of a specification ramp and so setting the activation function threshold, considering that it will not make sense to specify a requirement and be more confident in its inadequacy than in its suitability and that therefore, in practical specification cases, we will have that
Figure 2 shows the threshold values d s for ν s = 0, and μ s > π s .

d s vs π s ; ν s = 0.
Figure 3 shows the threshold values d s for π s = 0 and μ s > ν s .

d s vs ν s ; π s = 0.
Figure 4 shows the specification function S (x): a one-sided TFN with a positive slope and maximum value at x = 1 that becomes a ramp-type activation function in the neuron-like evaluation node (Fig. 1).

Activation function S (x).
For d
s
< 1 :
A greater width d (i.e., a smaller threshold value d s ) means a lesser restrictive specification. A null width d (i.e.,d s = 1) represents the most restrictive condition.
The specification PFS (μ s , ν s , π s ) modulates the width of the activation function S (x). Nevertheless, this TFN is not a representation of the PFS.
For every evaluation sub-criterion of the input layer, the evaluator analyzes the extent to which the option under evaluation On matches the specification descriptive text.
The membership value μa sets the level of match between the specification and the option under evaluation. The non-membership value νa sets the level of incompatibility between the specification and the option under evaluation. The value πa sets the level of hesitancy or uncertainty of the assessment. In this way, the assessment PFS (μa, νa, πa) assesses the compliance with a specification by the option under evaluation.
We consider three extreme cases: When, for a given sub-criterion, the evaluated option On perfectly matches the specification, the assigned PFS is (1, 0, 0); if it does not match at all, the assigned PFS is (0, 1, 0); and if the evaluator is not able to produce any conclusion about the comparison between the option and the specification, the assigned PFS is (0, 0, 1).
Limited by these three extreme values, and considering that
PFS/TFN
As shown in Fig. 5, a one-sided TFN A (x) with a negative slope biunivocally represents the assessment triplet (μa, νa, πa):

Assessment function A (x).
A (x) reaches its maximum value at the membership squared value of the assessment PFS:
The closer μa is to the point of the maximum level of membership (i.e., the closer μa is to x = 1), the better the option meets the specification.
The width of this TFN corresponds to the hesitance or uncertainty squared value

Output v of an activation function S (x) in the input layer.
Figures 7 and 8 show examples of output values v of an activation function in the input layer with a threshold value ds = 0.5.

v vs.

v vs.
Each risk factor value r is given by:
At hierarchy levels other than the input layer, the previous layer’s crisp output values y are the inputs in to the evaluation nodes. Figure 9 shows the output v of the activation function S (in).

Output v of an activation function S(x) in layers other than the input one.
The study’s objective is to show the method application. The company performs development projects for its own sales network in Spain. In some cases, a third party will execute the project, and it is necessary to evaluate the risk of the different options before subcontracting. The study evaluates the risk in seven options for an outsourced IT development project related to electronic transactions. After interviewing some employees, an evaluator designed the hierarchy of risk factors, calculated the weights, described the evaluation reference, set the specifications tolerances, and assessed each option’s risk factors.
Evaluation process
Technical Infrastructure Implementation of standards Personnel education and experience Management: Financial health Project management resources Collaborative: Previous collaborations Country

Case study. Evaluation hierarchy.
We calculated the normalized weights (Table 2). For this purpose, we used FAHP, but the process for weights calculation is not within the scope of this paper, and any suitable method is valid.
Normalized weights
Technical: Infrastructure: Availability of all the necessary equipment for the development and test of the required applications. Implementation of standards: Skilled use of accepted engineering and quality standards. Personnel education and experience: Sound experience in the development of similar applications. Management: Financial health: Favorable position concerning its assets and liabilities. Business continuity out of the question. Project management resources: Use of project management methodologies. History of schedule and budget compliance. Collaborative: Previous collaborations: Existence of previous completely satisfactory experiences. Country: Absolute legal certainty. Same time zone and common language.
We specified the tolerance for every sub-criterion and criterion. Table 3 shows the values of the specification PFS (μs, νs, πs) for S ij and S i required for the evaluation sub-criteria (C ij ) and criteria (C i ) and the resulting threshold values ds.
Specifications tolerances
Squared values of the assessment
Output V and partial results v for option O1
Table 6 shows the outputs Vnof the hierarchy (the higher, the better), the results for the overall risk Rn = 1 - Vn(the higher, the worse), and the normalized scores Sn = Vn/Max (V) obtained for every option On.
Outputs Vn, overall risk Rna nd normalized score Sn
The results were coherent: criteria and sub-criteria with higher weights presented a more remarkable influence on the assessment, and options assessed as closer to the specification produced outputs Vn with higher values.
Let us suppose that the risk factor C31 influences risk factor C13. We add a new level in the hierarchy and perform a backward connection (Fig. 11). For simplicity, both inputs to S13 are equally weighted (w131 = w132 = 0.5), and we set the two new activation functions for a specification PFS

Analysis of risk dependencies.
Table 7 shows the output Vn, the risk Rn and the normalized score Sn for every option On considering the influence of C31 on C13. Some values show slight differences from those in Table 6.
Influence of C31 on C13
We applied two other methods to the case study: the vectorial method [21] and the Mean-Variance model. Table 8 shows the results. The best option was always O2, but the ranking in the proposed method varies from those in the other two methods.
Results obtained with three different methods
Results obtained with three different methods
If we disable the tolerances, setting all the specification PFSs to

Options ranking.
IT projects are particularly prone to failure, making risk evaluation essential for their success. Evaluation methods are usually opaque, presenting difficulties in explaining the results and not analyzing the possible interrelationships among risk factors.
This study’s main result is developing a transparent and flexible MCDM method that integrates purposely designed fuzzy decision nodes to implement evaluation networks, facilitating the analysis of risk factors and their interaction.
With specification functions configured by PFSs and assessment functions that biunivocally represent PFSs, both in the unit segment, a new graphical model implements the proposed specification-assessment-compliance approach.
The transformation of PFS into TFN allows the PFS as input to the evaluation network, which otherwise had only been possible by adding an inference layer that would have reduced the simplicity and flexibility of the method. Furthermore, the consistent output of the activation functions at the input layer of the evaluation network reinforces the demonstration of the coherence of the PFS/TFN model. It also shows its capability to act in association with the activation function as a new adjustable defuzzification module.
The case study results demonstrate the influence of tolerances on evaluating the options, the new method’s coherence, its easy implementation, and transparency. In addition, the results obtained in the analysis of risk dependencies demonstrate the model’s versatility that permits the hierarchy’s reconfiguration, allowing even backward connections.
However, the lack of a procedure to implement group assessment and the lack of a method to establish the relationship between the risk factors and their Pythagorean assessment can produce biases. Further research should tackle these limitations.
The work described in this article opens the following prospects for future work: Maintaining the specification-oriented approach, we propose the search for other specification and assessment functions and the research on the suitability of the different possibilities, their possible link with each specific evaluation problem, and the suitability of using the intuitionistic procedures to configure the new functions. We should also define a procedure and a nomenclature to analyze more complex cross-relationships between risk factors. We could investigate the substitution of the evaluation hierarchy by a classic full-connected artificial neural network to implement a different approach requiring a previous training process. Such a training process might lead to conclusions about the interaction among evaluation criteria. We can also investigate the possibilities of using the proposed specification-oriented node as an artificial neuron for its integration in artificial neural networks. We should also test the method to verify its suitability for the application to other managerial decision-making problems. Furthermore, we should explore using the PFS/TFN model as part of other specific fuzzy methods. Finally, we can also use the one-sided TFN for the biunivocal representation of classic IFSs using intuitionistic values instead of its squared values.
