Research Article | Volume 4 Issue 1 (Jan-June, 2023) | Pages 1 - 11
Presenting a New Model for Evaluation of R & D Units with the WBM/DEMATEL Approach
 ,
1
Assistant Professor, Department of Industrial Management, Kooshyar non-profit higher education institute, Rasht, Iran
2
Associate Professor, Department of Industrial Management, Rasht Branch, Islamic Azad University, Rasht, Iran
Under a Creative Commons license
Open Access
Received
Feb. 15, 2023
Revised
Feb. 20, 2023
Accepted
March 2, 2023
Published
May 1, 2023
Abstract

Purpose- The purpose of this paper is presenting a New Model for Prioritizing Effective Indicators in Evaluation of R & D Units of Manufacturing Companies. Design/methodology/approach- In this research a new   general pattern is proposed to evaluate research and development units by using combinational method of WBM and  DEMATEL. Findings- As a result of prioritization of evaluation criteria for R&D units (in Guilan province companies) with the aid of proposed pattern, financial criteria because of their most branches will be at the first priority. Research limitations/implications- Considering the importance of research and development units, we suggest that another section with the title of” diagnosis” with the aid of any fault detection method like  FTA3,FMEA4, MORT5, HAZOP6 and etc. be added to the pattern of this research. Practical implication-The case study is Guilan province companies. And the goal of analyze is that with the utilization of a step-by-step proposed pattern prioritization of affective indexes on evaluation of mentioned units in considered companies. Originality/value- According to the fact that every evaluation method has its advantages and disadvantages. So the combination of models in order to improve evaluation process can help decision makers to investigate performance of organizations in more details

Keywords
INTRODUCTION

Management and research & development (R&D) are identified as the pillars of the creation, improvement and technology exploitation which are among the necessities of social and economic development in any country, and in developing countries, seeking industrial and economic self-reliance, policy making and planning of research and development strategies as well as  application of the effective management system for  these activities are regarded as priority to national, industrial and productive activities. The expansion and enhancement of R&D activities, especially industrial research, require the identification of factors influencing the R &D process and design of policies and the effective mechanisms of such activities. In the current competitive conditions of the industrial world, R & D activities are identified as one of the most efficient tasks undertaken by business managers, and the costs allocated to these activities are increasing day by day in the industrialized countries of the world. [1] Research and develop is a word that is paid attention from the beginning of first century. Before the Second World War actions related to research and develop was mostly concentrated in army Industries of United States and Europe and Japan. And that period research and development Institutes were small. Management of these Institutes we’re not as complex as today and encountering research and develop units with other Factors was simple. At the end of Second World War United States went ahead regarding other parts of the world at various technology Fields. Simultaneous to the period when Europe and Japan tried to rebuild destructions of war, while America improved very fast based on investing on the results of research and development actions made during war. Nowadays, research and development, which in fact transforms knowledge and ideas into new and improved products, processes, services or gaining competitive advantage, has become a major industrial activity throughout the industrialized world  [2]

 

Another country and after the ending of imposed war and it start of the rebuilding era and compensating failures of the production most of the managers of industrial units which were supported by government, requested R&D groups to rebuild and improve their sources. In recent years ministry of industry trade and mines have follow policies for established research and development units inside factories. In most of the organizations the important point is that there is no rational performance evaluation method available. In fact to solve the problems in industry range it is sometimes needed to build a small section in laboratory or one parts of the factory which can act with open mind in different fields inside the factory and do research and develop, and the result other researchers will be beneficial for all the company [3]

 

On the other hand Performance appraisal (PA) has been considered as one of the best methods to obtain decision making information in organizations. In order to obtain the desirability and quality of its activities, each organization needs an evaluation system, especially in complex and dynamic environments. On the other hand, the lack of a monitoring and evaluation system in an organization denotes that there is no relationship between the external and external environment of an organization with   ultimate consequences of aging or even death in the organization.

 

 The different definitions of PA in general and organizational performance evaluation are presented. According to [4] PA is a methodological review process that helps organizations to achieve their predetermined goals. In fact, PA improves a culture of accountability and integrity of organization’s objectives. PA is regarded as a tool for maintaining organizational control, i.e. the process of ensuring the implementation of strategies that lead to achieve quantitative and qualitative goals. [5] In general, a performance appraisal system of the measurement process and the comparison of the amount and how to achieve a desired situation with certain criteria and attitudes in a given domain and area with certain criteria within a given period of time with the aim of monitoring and reviewing for continuous Improvement [6]

 

Also Criteria are an effective tool in the management system, and allowed to achieve the predetermined goals in the programs. Focus attention on performance criteria can help identify and gain a better understanding of shortcomings and inadequacies of the organization. Criteria usually come from attitudes and situations, and can be used as signs that identify the route. Criteria represent the existing realities of the organization's activities or services, and they provide an efficient tool to evaluate programs and activities in the management system So that they can be used to achieve the predetermined goals in the programs. Generally, the measurable criteria can be defined as one of the essential requirements in any of types of planning. Being up to date, the reliability and meaningfulness of these criteria can play an important role in determining strategies and implementing policies and procedures.

 

With all the interpretations, it seems that after several years it is required to have some investigations be made regarding the quality of such units. Such investigations can control policies which are decided and implemented for several years. So in general and in this research we have tried to propose a pattern to detect and priorities crucial and effective criterion of R&D teams in production factories based on the scope of work of research and develop teams which is defined by Ministry of trade industry and mine. 

2. LITERATURE REVIEW

Nowadays activities of R&D section is the main Motivator and the main reason for industrial and economic development in all firms. There are various mechanisms and methods to develop technology buy a help of research and develop like local research and develop, common research and develop, research and develop contract, outsourcing research and develop [7]

 

In industry aspects R&D is not limited to design and develop of new products. Experts in research and develop are not only engineers but sometimes the statistics and marketing and human source experts that analyses existing conditions to find gap between the supposed conditions and existing conditions to find suggestions to improve the existing conditions.

 

Manuchehr [8] made a research on performance evaluation of research and development units regarding establishment goals in industry field. Results revealed that in the field of design and manufacturing of new products research and development teams contribution is the biggest part and in most cases have an effective role. Regarding the increase of utilization of internal sources for production it is shown that in 47% of cases R& D units have not any contribution but they have contributed in 24% of other cases this means that other factors are effective on encouraging the use of internal sources for Production.

 

Regarding the reducing the waste of production line it is short. In 18% of cases research and develop units do not contribute but in 55% of cases they have contributed effectively. It can be concluded that efforts of R&D units and requests that they have made have decreased waste of production line.

 

Regarding the reducing of environmental problems of production units it is shown that in 43% of the cases research and development units do not have any contribution but in 38% of cases that have effective roles. This means despite the fact that environmental problems have been decreased by the establishment of research and development teams but other factors are effective in decrease of these problems.

 

another research analyzed effects of research and development unit on efficiency of productive Industries. She discussed the effects of research and development unit on automobile industry case study. For this research two methods are used one is statistical descriptive and communicational method and other is the statistical tests of Spearman- kruskal-wallis-freedom. The most important assumption: there’s a meaningful connection between the existence of research and develop units and the efficiency of industry. The subsidiary assumption is that: presence of effective experts in research and develop units have meaningful connection with the efficiency of industry. Results show that there is a meaningful connection between acceptability of proposed designs of research and development and Efficiency of industry and also there is a meaningful connection between the control of Resource and Development Team on other units and Efficiency of industry.

 

[9] In a research entitled Identification and Prioritization of R&D department managers who used the experts from the university and industry and through Friedman questionnaire and test, prioritized the suitability of the managers of this unit. The results of this study indicate that 3 competencies are: 1. Cardimy, communication and knowledge sharing; 2. Organizing and directing research teams; 3. Motivation and empowerment of specialists are of higher priority than other recognized competencies.

 

In other researchers in India.they evaluated the performance of national organizations of R&D by the help of integrated method of DEA-AHP. The aim of this research was to evaluate and compare performance of R&D national organization of India based on the relative efficiency regarding some quality criteria of output. Method used in this study is Data Envelopment Analysis DEA and analytical hierarchy process AHP. Results showed that relative efficiency of national R&D organization not also depend on the number of outputs but also depends on the quality of them. And provides more realistic and extensive results for decision makers to distinguish organizations of R&D in a comparative evaluation and also detect useless organizations.

 

[10] in their research used AHP/DEA methods to measure the efficiency of actions of Resource and develop management. For a better performance evaluation of actions of research and development of management in research based universities, used a combination of AHP and DEA to evaluate efficiency of management of R&D units. This includes the measuring previous and existing power of research and develop in universities by AHP and evaluating relative efficiency of R&D power growth related to the evaluated efficiency of other universities by DEA. Which is considered as the measured management base of other universities. Using this method for evaluating efficiency of R&D management in 29 universities of China show that universities which improved their management regardless of power of R&D (strong or weak), have reached higher efficiency.

 

[11] in a paper entitled “Designing a Model to Examine Capabilities of Research and Development Section”, reviews research background of (R& D) and reverse engineering, simulation software modeling to achieve the most effective parameters and their relationships and offer strategies for optimal per unit R& D and access to technologies of modern. Also, this study contains R & D department of a chemical factory (Tage) as selected population which is one of the important industrial factories in Iran. Reverse engineering technique and causal simulation software are used. Some of the important key factors is considered in R& D unit of this factory include: number of accomplished projects in R& D unit, system inputs including (primary materials & new need), expert & skillful human resources, versed management of R& D unit, Planning and project control of R& D unit. Finally, by analyzing these factors and designing the desired model, the capabilities and of the R&D unit in Tage chemical factory were identified and its efficiency were compared with other factories and concluded that the efficiency increased when the number of accomplished projects in R& D unit of this factory was increased, due to the versed management of R& D unit.

3. RESEARCH METHOD

This research is practical. In this work a pattern to evaluate performance of R&D units of production companies according to the scope of work defined by the ministry of industry is proposed. According to the fact that in this work and in case study, analysis and description of connections between factors by the aid of data equation and answer to questions is performed, so this work is a descriptive research. To collect data expert people are used. According to detailed observation of studied parameters of society and information collection and assigning meanings for them this work is considered a survey research [12]

 

Cases study in this work includes production companies of Guilin province which have R&D license. Results can be generalized for all of the production companies which have research and develop license.

 

Data are collected by both survey and library method. In library method by referencing to books, Tethys, internal and foreign papers and web searches literature of research work is collected. And in survey method data are collected by question papers.

 

In this work 2 question papers are provided. First question paper includes a table to define excellence amount of best index relative to other indexes and to define worst index relative to other indexes which would be a number between 1 and 9.to extract index weights and sub-index weights, this question paper was filled by the WMB method and by supervision of managers and experts of R&D unit, whom are experienced over 20 years and minimum academic license of bachelor of science in their corresponding field. In second question-paper due to large number of indexes which were extracted from internal and foregoing papers, researches and also from the interview with experts of R&D a five answered questioner  was established to define the most effective index on managers and expert of R&D.(no, low, average, high and extra high importance).

 

It is clear that the validity and reliability measurement of questioner is one of the important stages of project, so that lack of validity and reliability of questioner or any other measurement tool can have negative effects on general results of the research. To evaluate reliability of the research Alphay Chron Bakh method is used. Value of this criteria for both questioner is 7.58% which is more than 0.7 in conclusion question paper have acceptable reliability. To be sure about the validity, 3 question papers of first and second are distributed among experts to advice on questions, used terms and understandability. In results some words were simplified and some professional definitions were added. To make sure regarding content validity following steps are took:

  1. Detail study and identification of indexes to evaluate R&D units in production companies.

  2. Interview with experts familiar to meaning of R&D.

In this research, MATLAB software is used to solve the selected DEMATEL method.

4. Introducing the general step to step pattern.

So that various tasks are considered for R&D units it is very crucial to distinguish the most important task for productive companies, so at first we study the latest regulation addressed by ministry of trade, industry and mine which most important tasks are declared. As follows:

  1. Absorb, adapt, modify, innovate and development of technology.

  2. Waste management and pollutant reduction.

  3. Efficiency increase by measurement and improving factors.

  4. Optimization of existing processes by emphasis on automation level improvement.

  5. Quality based products increase.

  6. Design of new products regarding their practical advantages.

  7. Power consumption optimization.

  8. Increase the contribution of internal material and sources.

  9. Net price and raw material reduction.

  10. Processing minerals till the end product (ministry of trade, mine and industry website).

By various analyses and several studies in internal and foreign papers and by interview with experts and successful managers 7 indexes are adapted out from mentioned 10 criteria to be a constant base to simply evaluate by production companies. For better, more rational and understandable result sub-indexes are defined for any index. All index with corresponding sub-index is presented in table 1.

 

Table1. index with corresponding sub-index to evaluate performance of R&D unit

Process/technology/new product

Number of New job positions 

Provided by R&D. 

 Number of new products provided by R&D.

Number of innovations applied to traditional products.

     

Accessibility level to facilities:

Laboratory facilities.

Knowledge implementation.

 Access to information technology like internet. 

 

 

 Optimization value:

       Energy consumption.

      Pollutant and waste decrease.

       Reducing production expenses.

Human source quality:

Academic degree.

Passed training courses per year.

Work experience

Research performance:

Published papers and books per year.

Patent registration.

Taking part in internal and foregoing conference and seminar.

Financial aspects. 

R&D unit budget.

Salary level of workers.

Research budget increase comparing to last year.

 

Client oriented:

Lost clients

New clients

Utilization present of guarantee of all of the delivered products

 

According to the defined indexes in table 1, proposed pattern to evaluate research and development units using combined method of WBM and DEMATEL is described in three phases as the following:

 

First phase: prioritization of indexes and sub-indexes.

The goal of this phase is to prioritize indexes regarding the below tools and sources:

  • Interview with managers.

  • First questioner. 

  • WBM method.

 

BWM in multi-criteria decision-making methods, a number of options are evaluated according to a number of criteria to select the best option. According to Best-Worst Method (BWM) developed by [13] the best and the worst criteria are identified first by the decision-maker.  Pairwise comparisons are then conducted between each of these two criteria (best and worst) and the other criteria, and then a maximin problem is formulated to determine weight of various criteria. In this method, a formula is also used to calculate the compatibility rate for assessing the validity of the comparisons. One of the salient features of BWM compared to other MCDM methods are: (i) it requires less comparison data; (ii) it leads to more consistent comparisons, which means that it produces more reliable results.

 

Best-worst method (BWM) suppose we have n criteria and we want to execute a pairwise comparison these criteria using a 1/9 to 9 scale1. The resulting matrix would be

           

A=

Where aij shows the relative preference of criterion i to criterion j. aij ¼ 1 shows that i and j are of the same importance. aij 41 shows that i is more important than j with aij ¼ 9 showing the extreme importance of i to j. The importance of j to i is shown by aji. In order for matrix A to be reciprocal, it is required that aij ¼ 1=aji and aii ¼ 1, for all i and j. Considering the reciprocal property of matrix A, in order to obtain a completed matrix A, it is necessary to have n (n1)/2 pairwise comparisons. The pairwise comparison matrix A is considered to be perfectly consistent if: 



 

Here we try to make a better understanding of the so-called pairwise comparison, which, in fact, makes the foundation of our proposed method (BWM).
When executing a pairwise comparison aij, the decision-maker expresses both the direction and the strength of the preference i over j. In most situations, the decision-maker has no problem in expressing the direction. However, expressing the strength of the preference is a difficult task that is almost the main source of inconsistency. To understand this important issue better, we use a visual illustration (Figs. 1 and 2).

Comparing tree A with the other trees in Fig. 1, it may be easy to determine that A is shorter than B and taller than the other trees (direction). However, assigning a number to express the level of relative tallness (strength) is more difficult. In fact, when one wants to assign a number to show one’s judgment with regard to comparing A and B, one also keeps in mind the relationships between these two and some others. For example, suppose one

Fig1. A comparison example: the preference of A over E

Fig2. A comparison example: the preference of B over E

Wants to assign a number to indicate the preference of tree A over tree E (solid line AE in Fig. 1). Obviously, it is easy to see that A is taller than E. Therefore, one is going to assign a number greater than 1 to show the preference of A over E. One certainly does not assign the maximum number 9, because it is clear that C is much shorter than E (in fact, one is comparing A and C as well as E and C —dashed lines AC and EC in Fig. 1). In addition, it is clear that B is taller than A (dashed line BA in Fig. 1), which means 4 or 5 are likely numbers. One assigns such a number when one has, for instance, an 8 in mind to compare B and C (dashed line BC in Fig. 1). As may be clear, when considering the preference of A over E, the decision-maker also considers the best and the worst alternatives with respect to the criterion in question. In our example, the best (tallest tree) is B and the worst (shortest tree) is C. It is important to note that, in this example, the other tree (D) plays no role. If we add more trees, taller than C and shorter than B, they would also play no role in this comparison. When comparing A and D, the same problem arises as with A and E. However, when one member of a pair is the best or the worst alternative, the task seems to be much easier, for instance when comparing tree B with tree E. Following the same line of reasoning, however, in this case one only needs to make three comparisons (Fig. 2), compared to six in the previous example (Fig. 1). The task is also relatively easy when comparing B (the tallest tree) or C (the shortest tree) and one of the other trees.

 

Generally WBM method is based on the following steps [15]:

  1. Defining a set of indexes.

  2. Defining the best and the worst index among them (using from tool 3).

  3. Defining the amount of excellence for the best index relative to the other indexes by a value between 1 and 9(using till tool 2).

  4. Defining the amount of excellence for the worst index relative to the other indexes by a value between 1 and 9(using till tool 2).

  5. Calculating optimized weights utilizing programming model of following equation: 


 

 

 

 

 

 


 

 

By solving this linear programming problem, optimized weights and optimum value of which is * will be resulted. Using the value of * consistency rato of dual comparisons can be calculated by the help of equation 2 and table 2.

 


 

                                                                                                                                              Consistency Ratio =

 

 

 

Table 2. incompatibility ratio index

9

8

7

6

5

4

3

2

1

aBW

5.23

4.47

3.73

3.00

2.30

1.63

1.00

0.44

0.00

Consistency Index(max )

 


 

Phase 2: analyze on mutual effectiveness of sub-indexes and prioritization of them based on that.

The goal in this phase is to study the intensity of the effect of sub-indexes on each other which is in fact the amount of affecting and being effected among sub-indexes is being defined and sorted from the least to highest. First interview with managers and first questioner is performed and the required data for DEMATEL method is collected and solved by MATLAB via mentioned technique.

Tool:

  1. Second questioner.

  2. Interview with R&D managers.

  3. DEMATEL method.

  4. MATLAB software.

The DEMATEL method had been used successfully in many decision making problems. Also, many researchers used this method in combination with another multi criteria decision analysis (MCDM) method. For example, 

DEMATEL Method Decision Making Trial and Evaluation Laboratory (DEMATEL) is a comprehensive method for constructing and analyzing a structural model of the causal relationships between the complex and numerous factors (Lin & Lin, 2008). This method was first used at Battelle Memorial Institute in Geneva between 1972 and 1976 in order to study and solve the complicated and intertwined problem group [14]DEMATEL has been developed to solve complex problems. This method can enhance understanding of the specific problematic group of interacted factors, and criteria and provide a feasible solution by building a hierarchical relevant network system. This technique is widely used in solving complex problems [15-23]

DEMATEL method is performed following these steps [24]

Step1. Establishing decision matrix (M) which is the relativity of indexes with each other.

Step2. Normalization of decision matrix by equation 3.


 

 

                                                                                                                                                                     

 

Which in this equation k is calculated by eq 4. First sum of columns and rows are calculated. Inverse of the biggest value of column and row defines k:

 

    

 

Steep3. Calculation of total relation matrix by eq 5:

 

                                                                                                                   

 

Step4. Defining the amount of effecting and being affected.


 

Sum of elements of each row (D) for each factor describes the amount of effecting strength of factor on other factors. Also the sum of the elements of each column (R) for each factor defines the amount of being affected by other factors of the system. So the horizontal vector of (R+D) is the amount of effecting and affected-by of considered factor. This means that if the value of R+D is high for a factor, that factor interacts more with other factors. Vertical vector of D-R is defining the effecting strength of a factor. Generally if D-R is positive or negative, the factor nature is effect and cause respectively. At last a Cartesian coordinate page is drawn in which x-axis is values of D+R and y-axis is D-R and position of each factor is defined by (D+R, D-R).

 

Third phase: other prioritization of main indexes regarding the output of phase 2 in comparison with phase 1 and analyze and final decision.

 

In this phase, by the help of following tools and sources and according to the output of second phase, another prioritizing is performed for main indexes and with comparison to phase 1 results ,final results of analysis on values is concluded. This is made in a manner that effecting grade of every sub-index (output of phase 2) is written in front of every index in form of separated sets (7sets). Then the mean value of grades of each set is calculated and recorded. Now mean values are sorted from bottom to top (lower mean, higher priority) and corresponding index of every set is written in front of it. And the result is another prioritization of the indexes.

 

At final analysis of the mentioned phase, the resulted priorities are compared with the results of phase one. And a mean of grades of priority in each result for each index is calculated which will be the final ascending prioritization.

Tool:

DEMATEL model

 

5. Analysis of a study case for proposed pattern

In this research a study case is analyzed to test validity and implementation accuracy on proposed pattern and to find the important fields for future researches. The case study is related to some companies with R&D license in Guilan province of Iran which are as follows:

  • Fuman shimi.

  • Pegah Guilan.

  • Pars shahab.

  • Pars zar Asa.

  • Azhiran.

  • Ehagohstar.

  • Doxaniyat.

  • Payaklauch.

  • Arpanoush(istak).

  • Dawruu poush.

  • Dagug shimi.

  • Faraavari va sakht.

  • NIKA.

Implementation of phase 1:

According to the description of this phase and with the aid of tools and introduced sources and with WBM method, weights are calculated for indexes and sub-indexes. Which are shown in tables 2 and 3.financial index with the highest weight is the best index and sub-index of “R&D budget” is the highest and best sub-index (table 3, 4).


 

 

Table 3. Prioritization of main index for performance evaluation of R&D units of Guilan province

Main index

Wi

Priority

Financial aspects

0.447

1

Process/technology/new product

0.418

2

Human source quality

0.385

3

Client oriented

0.361

4

Accessibility level to facilities

0.168

5

Optimization value

0.113

6

Research performance

0.108

7

 

Table 4. Prioritizing the Influential Indicators on Performance Evaluation of R & D Departments of Guilan Province Production Units

wi

Sun-index

priority

0.565

R&D unit budget

1

0.564

Reducing production expenses

2

0.512

Academic degree

3

0.481

New clients

4

0.413

Access to information technology like internet

5

0.402

Patent registration

6

0.391

Taking part in internal and foreign conference and seminar

7

0.372

Number of New job positions     provided by R&D

8

0.355

Laboratory facilities

9

0.352

Lost client

10

0.318

Number of innovations applied to traditional products

11

0.31

Number of new products provided by R&D

12

0.265

Pollutant and waste decrease

13

0.253

Passed training courses per year

14

0.25

Salary level of R&D workers 

15

0.235

Work experience of R&D workers

16

0.232

Knowledge implementation facilities

17

0.207

Published papers and books per year

18

0.185

Research budget increase comparing to last year

19

0.171

Energy consumption

20

0.168

Utilization present of guarantee of all of the delivered products

21

Implementation of second phase:


 

 

According to the description of this face and tools and Resources and with the help of DEMATEL method, effecting strength(R) and affected by value (J) and values of R +J and R-J are calculated. As it is shown in table 5, budget of R&D unit sub-index has a positive value for (R-J) which means it can affect. And has gained the highest value of (R+J), which means it is the most effective index. Also index named facilities for implementation of knowledge and laboratory facilities (after budget index) have intense effect on other indexes from the point of view of experts. From the aspect of being affected by other indexes sub-index of academic degrees by gaining the highest value for (R-J) is the index more affected by other indexes? Indexes from the aspect of being affected by or affecting other indexes are sorted in table 5 and 6.

 


 

 

Table 5. Output values of DEMATEL model

number

Sub-index

R

J

R+J

R-J

1

Laboratory facilities

1.114089

0.58099

1.695079

0.533099

2

Knowledge implementation

1.206481

0.68039

1.886871

0.526091

3

Access to information technology like internet

0.590532

0.5514

1.141932

0.039132

4

Academic degree

0.949785

0.28429

1.234075

0.665495

5

Training courses per year

0.527778

0.60691

1.134688

-0.079132

6

Years of experience

0.18526

0.25467

0.43993

-0.06941

7

R&D unit budget

1.538867

1.10407

2.642937

0.434797

8

Salary level of R&D workers

0.174304

0.97349

1.147794

-0.799186

9

Research budget increase comparing to last year

0.732081

0.78169

1.513771

-0.049609

10

Number of New job positions     provided by R&D

0.477479

1.06719

1.544669

-0.589711

11

Number of new products provided by R&D

0.66632

0.98718

1.6535

-0.32086

12

Innovation used in traditional products

0.391577

0.86947

1.261047

-0.477893

13

Energy consumption

0.151315

0.6249

0.776215

-0.473585

14

decrease in pollutants and waste

0.090111

0.66363

0.753741

-0.573519

15

Reducing production expenses

0.665464

0.45452

1.119984

0.210944

16

Published papers and books per year

0.557108

0.71792

1.275028

-0.160812

17

Taking part in internal and foreign conference and seminar

0.105822

0.57961

0.685432

-0.473788

18

Pattern registration

0.782819

0.61483

1.397649

0.167989

19

Lost clients

0.786659

0.33496

1.121619

0.451699

20

New client absorption

1.040778

0.53626

1.577038

0.504518

21

Utilization present of guarantee of all of the delivered products

0.73974

0.20599

0.94573

0.53375

 

 

 

Table 6. prioritization of sub-indexes regarding effectiveness

Sub-index

priority

R&D unit budget

1

Knowledge implementation

2

Laboratory facilities

3

Number of new products provided by R&D

4

New client absorption

5

Number of New job positions provided by R&D

6

Research budget increase comparing to last year

7

Pattern registration

8

Published papers and books per year

9

Innovation used in traditional products

10

Academic degree

11

Salary level of R&D workers

12

Access to information technology like internet

13

Training courses per year

14

Lost clients

15

Reducing production expenses

16

Utilization present of guarantee of all of the delivered products

17

Energy consumption

18

decrease in pollutants and waste

19

Taking part in internal and foreign conference and seminar

20

Years of experience

21

 

Table 7. prioritization of sub-indexes regarding being affected by

Sub-index

priority

Academic degree

1

Utilization present of guarantee of all of the delivered products

2

Laboratory facilities

3

Knowledge implementation

4

New client absorption

5

Lost clients

6

R&D unit budget

7

decrease in pollutants and waste

8

Pattern registration

9

Access to information technology like internet

10

Training courses per year

11

Years of experience

12

Research budget increase comparing to last year

13

Published papers and books per year

14

Number of new products provided by R&D

15

Energy consumption

16

Taking part in internal and foreign conference and seminar

17

Innovation used in traditional products

18

decrease in pollutants and waste

19

Number of New job positions provided by R&D

20

Salary level of R&D workers

21

 

 

Implementation of third phase:

According to the description of this phase and with the use of tools and Resources that are introduced grade for every index of phase1 is written in front of it and then mean value is calculated table eight.

 

Table 8. Grade mean table

Process/technology/new product

Number of New job positions provided by R&D.  grade=6

Number of new products provided by R&D. grade=4 Number of innovations applied to traditional products. grade=10

 

Average grade=20.3

Accessibility level to facilities:

Laboratory facilities. grade=3

Knowledge implementation. grade=2

Access to information technology like internet. grade=13

 

Average grade=18.3

 Optimization value:

 Energy consumption. grade=18   

 Pollutant and waste decrease. grade=19

  Reducing production expenses. grade=16

Average grade=53.3

Human source quality:

Academic degree. grade=11

Passed training courses per year. grade=14

Work experience grade=21

Average grade= 46.3

Research performance:

Published papers and books per year. grade=9

Patent registration. grade=20

Taking part in internal and foreign conference and seminar. grade=8

Average grade-37.3

Financial aspects. 

R&D unit budget. grade=1

Salary level of workers. grade=12

Research budget increase comparing to last year. grade=7

 

 

 

Average grade=20.3

Client oriented:

Lost clients grade=15

New clients grade=5

Utilization present of guarantee of all of the delivered products grade=17

Average grade=37.3

 


 

Final analyst in phase 3

Prioritization regarding effectiveness of sap indexes by DEMATEL method.

  1. Financial aspects. 

  2. Process/technology/new product.

  3. Human source quality.

  4. Client oriented.

  5. Accessibility level to facilities.

  6. Optimization value.

  7. Research performance.

 

Grading regarding prioritization of main index WBM method.

  1. Accessibility level to facilities.

  2. Financial aspects. Process/technology/new product.

  3. Client oriented. Research performance.

  4. Human source quality.

  5. Optimization value.

 

Final grading accounting today combination of two phase (combining two methods of DEMATEL, WBM).

2, 1. Financial aspects.  Av=1.5.

2, 2. Process/technology/new product. Av=2.

4, 3. Human source quality. Av=3.5.

3, 4. Client oriented. Av=3.5.

1, 5. Accessibility level to facilities. Av=3.

5, 6. Optimization value. Av=5.5

3, 7. Research performance. Av=5.

 

Finally according to the calculated mean values in combinational effort final prioritization of main indexes in an ascending order is as follows:

  1. Financial aspects

  2. Process/technology/new product.

  3. Accessibility level to facilities.

  4. Human source quality. / Client oriented.

  5. Research performance.
  6. Optimization value.

Grading of sub- indexes in previous phases were done by the DEMATEL method.

6. CONCLUSION

Mainly the first step to evaluate performance of organizations is to select an evaluation model and criteria relative to dimensions of problem so that decision makers want to evaluate their units based and that goals. According to the fact that every evaluation method has its advantages and disadvantages. So the combination of models in order to improve evaluation process can help decision makers to investigate performance of organizations in more details. So in this research we tried to present a step-by-step new and general pattern to make it simpler to detect and priorities effective indexes in evaluating R&D units of production companies which have R&D license. WBM and DEMATEL combinational method is used for proposed pattern. The goal of Design of this pattern is to categories performance evaluation indexes of organizations regarding importance level and analyses of effectiveness of indexes and sub-indexes on each other in order to improve integrated programming and decision making in R&D units of productive companies. Finally a practical study case to implement pattern is introduced and analyzed. This is study case is performed in Guilan province in order to evaluate performance of research and develop units in sort of productive companies. And the goal of analyze is that with the utilization of a step-by-step proposed pattern prioritization of affective indexes on evaluation of mentioned units in considered companies is performed and results show that financial aspects are the most important and most effective index and budget of R&D units are the most important sub-index. Considering the importance of research and development units and their effect on performance and success of organizations in mind, we suggest that another section with the title of” diagnosis” with the aid of any fault detection method like FTA, FMEA, MORT, ETBA HAZOP, SHA be added to the pattern of this research in order to consider risk taking problem of indexes while screening existing indexes of units performance evaluation.

Conflict of Interest:

The authors declare that they have no conflict of interest

Funding:

No funding sources

Ethical approval:

The study was approved by the Islamic Azad University, Rasht, Iran.

REFERENCES
  1. Akhbari,mohsen and others,article of process of developmevt of new products,tadbir journal number 184,2008 (in persian)           

  2. Microsoft Corporation, (2014), White Paper Innovation Process Management.

  3. Shariati, R. and Afkhami, M. (2016), "Identification and Prioritization of Performance Indicators for R & D Centers Based on Balanced Scorecard", Scientific and Proceeding Journal of Oil and Gas Exploration and Production, No. 137.

  4. Zhang, J., & Tan, W. 2012.Research on the Performance Evaluation of Logistics Enterprise Based on the Analytic Hierarchy Process. Energy Procedia, 14, 1618.

  5. Amaratunga, Baldry&Sarshar, 2000, Proscessimprovement through performance measurement: the

  6. Kaplan, Robert and Norton, David, Strategy -Oriented Organization, Translation by Parviz Bakhtiari(2009), Eighth Edition, Industrial Management Organization press.

  7. Penan, H. (1996), "R & D strategy in a techno-economic network Alzheimer's disease therapeutic strategies, journal of Research Policy, Vol. 25, No. 3: 337-358.

  8. Sadafi, M. and dagh Bandan, A. (2001)," Evaluation of the performance of research and development units (R & D) within the framework of their objectives in the industrial sector", master's thesis, Islamic Azad University of Rasht.

  9. Mahdiloo Torkamani, P. and Safdari Ranjbar, M. and Moshabaki Esfahani, A. and 
    SHojaie, A. (2017),"  Identifying and Prioritizing Managers’ Competencies In
    Technology R& D Centers", Roshd-e-Fanavari , Volume 13 , Number 49; Page(s) 54 To 62.

  10. Liou, J. J. H., Yen, L., & Tzeng, G. H. (2008). Building an effective safety management system for airlines. Journal of Air Transport

  11. Khadem Gerili, Neda. Radfar, Reza. Designing a Model to Examine Capabilities of Research and Development Section, Quarterly Journal of Parks and Growth Centers, Seventh Year, No. 27, Summer 2011.

  12. Khaki, Gh. (2008), Research Methodology with Dissertation Approach, Reflection Publication, Tehran.

  13. Rezaei, j. (2015). Best-Worst multi-criteria decision-making method: some properties and a linear model. Omega, 1-5. 

  14. Tzeng, G., & Huang, J. (2011). Multiple attribute decision making: meth and applications. Boca Raton, FL: CRC Press. Wu, W. W. (2008). Choosing knowledge management strategies by use combined ANP and DEMATEL approach. Expert Systems Applications, 35(3), 828-835.

  15. Lin, C. L., & Tzeng, G. H. (2009). A value-created system of science (technology) park by using DEMATEL. Expert Systems with Applications, 36, 9683-9697.

  16. Hori, S., & Shimizu, Y. (1999). Designing methods of human interface for supervisory control systems. Control Engineering Practice, 7(11), 1413-1419

  17. Huang, C. Y., Shyu, J. Z., & Tzeng, G. H. (2007). Reconfiguring the innovation policy portfolios for Taiwan’s SIP Mall industry. Tec novation, 27(12), 744-765

  18. Lin, C. J., & Wu, W. W. (2008). A causal analytical method for group decision making under fuzzy environment. Expert Systems with Applications 34(1), 205-213

  19. Seyed Hosseini, S. M., Safaei, N., & Asgharpour, M. J. (2006). Reprioritization of failures in a system failure mode and effects analysis by decision making trial and evaluation laboratory technique. Reliability Engineering and System Safety, 91(8), 872-881.

  20. Tsai, W. H. & Chou, W. C. (2009). Selecting management systems sustainable development in SMEs: A novel hybrid model based DEMATEL, ANP, and ZOGP. Expert Systems with Applicati 36(2), 1444-1458.

  21. Tzeng, G. H., Chiang, C. H., & Li, C. W. (2007). Evaluating inter effects in e-learning programs: A novel hybrid MCDM model b on factor analysis and DEMATEL. Expert Systems with Applicati 32(4), 1028-1044.

  22. Wu, W. W., & Lee, Y. T. (2007). Developing global managers’ competent using the fuzzy DEMATEL method. Expert Systems with Applicat 32(2), 499-507

  23. Habibi, A. and Izadiyar, S. and Sarafrazi, A. (2014), Fuzzy Multi-criteria Decision Making, Katibgil Publishing, Rasht.

  24. Fadaei, M. and Alvani, M. (1999), "Investigating the Effects of the Research and Development Unit on the Efficiency of Manufacturing Industries", master's thesis, Shahid Beheshti University of Tehran.

Recommended Articles
Research Article
OBSERVATIONS ON THE HOMOGENEOUS TERNARY QUADRATIC DIOPHANTINE EQUATION x2 + 4xy + 9y2 = 21z2
Download PDF
Research Article
Computer Driven Library Management and Service Rendering System: Mobile Library Landscape
...
Published: 10/06/2020
Download PDF
Research Article
Influence of Optimum Percentage of Waste Ceramic Powder as a Fine Aggregate Replacement on Hardened Properties of Concrete
...
Published: 11/06/2020
Download PDF
Research Article
The Possibility of Treating Corrosion in Iron Valves of Flow Regulators, Pumping Station Components, and Suspended Solids Filtration Networks in Rivers and Streams in Al-Qadisiyah Governorate
...
Published: 02/03/2026
Download PDF
Chat on WhatsApp
Flowbite Logo
PO Box 101, Nakuru
Kenya.
Email: office@iarconsortium.org

Editorial Office:
J.L Bhavan, Near Radison Blu Hotel,
Jalukbari, Guwahati-India
Useful Links
Order Hard Copy
Privacy policy
Terms and Conditions
Refund Policy
Shipping Policy
Others
About Us
Team Members
Contact Us
Online Payments
Join as Editor
Join as Reviewer
Subscribe to our Newsletter
+91 60029-93949
Follow us
MOST SEARCHED KEYWORDS
Copyright © iARCON International LLP . All Rights Reserved.