Abstract
The idea of measuring efficiencies of service delivery of veterinary dispensaries (VDs) and ranking them is an unexplored territory. However, since governments spend considerable amounts of money on promoting service delivery of VDs to enable animal production and productivity, and thereby promote rural livelihoods, efficiency measurement and ranking of VDs based on efficiency are necessary in a futuristic ‘transparency in governance’ environment apart from guiding in better performance. Given the non-quantifiable nature of the production function of veterinary service delivery, a non-parametric method like data envelopment analysis (DEA) can be an answer. Hence, this study measures the efficiencies of 101 VDs belonging to 2 ecosystems in Odisha, India, using DEA and ranks them using principal component analysis (PCA) along with average efficiency based on multiple data models. Analysis of various variables in models revealed that the presence or absence of variables—institutions; vaccination; a weighted variable combining castration, insurance and training (CIT); large animals’ population; and breedable animals’ population—lead to differences in average efficiencies. PCA of efficiency scores reveals that vaccination, CIT and large animal population are significant in factor loadings on first principal component (PC). The study finds high correlation between ranking based on average efficiency and ranking based on PCA, suggesting that the two methods are comparable. Both the efficiency measures and ranking reveal that VDs of the coastal ecosystem performed better than those of the western ecosystem.
Background and Introduction
Animal husbandry is the most important non-agriculture activity in rural areas and contributes a major chunk of the rural GDP of most developing countries. It is next to agriculture in terms of contribution to GDP and employment in rural India. It is more equitable in nature compared to agriculture as more farm animals are owned by landless, marginal and small farmers in India. Livestock production is an important part of rural livelihood system in Odisha, India, and is a mixed-crop–livestock system. The majority of the animals are local cattle, which are known for their low productivity. Animal husbandry is backward in Odisha and has been a neglected sector in the state historically (GoO 2010).
The Fisheries & Animal Resources Development (FARD) Department of the Government of Odisha, which formulates and implements plan, policies and programmes for animal husbandry and fisheries sectors in the state, visualised a lot of scope for promoting animal husbandry as a viable livelihood option for the rural people. Therefore, a 10-year perspective plan for the sector was developed named ‘Perspective Plan Animal Resources Development Sector 2010–20’. The plan has the vision:
to excel as a holistic support system by providing, securing and facilitating effective and efficient services to become self sufficient/surplus in milk, egg and meat by enhancing Livestock productivity along with helping the poor to secure sustainable livelihood through livestock development and management while working in close coordination and partnership with allied institutions. (GoO 2010, 2)
Achievement of self-sufficiency in milk, egg and meat production and offering employment opportunities for the rural poor through ‘efficient’ and effective service delivery are the missions of the plan (GoO 2016, 1). The service delivery of the livestock sector to the farmers is provided through a network of various veterinary institutions spread across the state. Veterinary dispensaries (VDs) are such veterinary institutions which are the main service providers to the animal husbandry sector in both India and Odisha. The state of Odisha has 540 VDs functioning for service delivery (GoO 2010, 4).
Services Delivery at the Grassroots by Veterinary Department
Figure 1 gives the organogram of the Animal Resources Development (ARD) Department of the Government of Odisha, depicting the organisation structure, at both state and district levels. The grassroots-level service delivery is offered at the block—which is a sub-district level administrative and developmental unit in most states of India—and sub-block levels. Each block has one or more VDs including a block-level veterinary dispensary (BVD), which is headed by the block veterinary officer (BVO), who is also the administrative head of any other dispensary in the block. Other dispensaries in the block are run by a veterinary assistant surgeon (VAS) or an additional veterinary assistant surgeon (AVAS). VDs in turn have many livestock aid centres (LACs) under their jurisdiction. The LACs usually located at the panchayat level are headed by a livestock inspector (LI). The state of Odisha has 2,939 LACs functioning for service delivery (GoO 2010, 4). These three veterinary institutions directly deliver various services of the department—treatment, surgery, gynaecological and obstetrical services, disease diagnosis service, breeding services like providing artificial inseminations (AI), disease preventive measures like vaccinations—apart from other services such as de-worming, castration and insurance facilitating services like ear tagging for identification, issuing health certificate and post-mortem if insured animals die. The institutions also offer various extension services like training on animal husbandry management, feeding and fodder development. Gomitras are personnel who are trained in providing AI services at the doorstep of farmers and are usually placed in LACs. BVDs also have a mobile veterinary unit (MVU) with a veterinary doctor and an attendant and are provided with a vehicle (a car or a van) to travel to various villages. The MVUs, which are equipped with various equipment for providing AI and treatment, travel to various villages based on a planned schedule to offer such services at the grassroots.
Veterinary service delivery is offered through various inputs of staff and materials such as veterinary doctors, LIs, VDs, LACs, medicines and vaccines and produces several outputs such as treatment, vaccination, AI of animals and farmers’ trainings. Many of the inputs and outputs cannot be measured in monetary terms or in any other common form, thus making it difficult to measure efficiency using any direct ratio or a weighted average. Data envelopment analysis (DEA) is the technique which was developed for measuring efficiencies of such programmes of governments and not-for-profit organisations and can be used here. The technique does not require any common denominator like money and can use whatever units in which particular inputs or outputs are measured as long as all measures of a particular variable are expressed in the same unit for all decision-making units (Charnes, Cooper and Rhodes 1978; Ramanathan 2003).
This article is organised as follows. A brief review of literature on DEA and ranking is given in the next part followed by research design including the techniques used, rationale, objectives and locations for this study, data, models and methods, a brief data description, findings of DEA efficiencies and ranking of VDs, summary of findings, discussion of results, concluding remarks and limitations of the study, followed by references.

Organogram of ARD Department.
Literature Review
M. J. Farell (1957) proposed the concept of economic efficiency being the product of technical efficiency and allocative efficiency. The concept of measuring efficiency using an operation research technique called DEA was first proposed by Charnes, Cooper and Rhodes (1978), a method with ‘possible uses in evaluating public programs’ which have a collection of decision-making units (DMUs) with common inputs and outputs (with positive values for each DMU). They developed the technique for measuring total efficiency combining both technical efficiency and scale efficiency, referred to as CCR Model which assumes constant returns to scale (CRS). Banker, Charnes and Cooper (1984) developed the technique for measuring technical efficiency separately without combing scale efficiency called as BCC model which allows for variable returns to scale (VRS). Ali and Seiford (1990) established the conditions under which DEA models are translation invariant, which affords a solution to the problems of scaling and zero values on DEA.
One of the earlier literatures on application procedures for DEA is by Golany and Roll (1989), which discussed various aspects of the application including DMUs and factors among others. Boussofiane, Dyson and Thanassoulis (1991) focused on key issues in practice in applying DEA. Another important paper in the category is of Dyson et al. (2001), which considers various aspects of application including minimum number of DMUs to be used to have discrimination in efficiency scores. Podinovsky and Thanassoulis (2007) recommend weighting of individual factors to aggregate them as one of the methods of reducing the number of factors and argue that it is equivalent to using weight restrictions in the multiplier model. A more recent paper is the one by Cook, Tone and Zhu (2014).
The concept of cross-efficiency and cross-efficiency matrix was first introduced by Sexton, Silkman and Hogan (1986). The paper defined cross-efficiency as the efficiency score derived by calculating the score based on optimal input and output weights of other DMUs. Andersen and Peterson (1993) developed a model for ranking efficient DMUs, which later became known as super efficiency model. Doyle and Green (1996) developed the concept of cross-efficiency further and coined the term Maverick DMU and Maverick Index.
Friedman and Sinuany-Stern (1997) developed a method for comparison between individual DMUs and the ranking of all DMUs, both efficient and inefficient, with the use of canonical correlation analysis (CCA). The paper also recommends a non-parametric statistical test to validate the classification by DEA and the ranking by CCA using Mann-Whitney rank sum test. Sinuany-Stern and Friedman (1998) developed a method using discriminant analysis to provide common weights for multiple inputs and outputs that discriminate optimally between efficient and inefficient DMUs. The method, termed as discriminant DEA of ratios (DR/DEA), calculates the ratio of weighted outputs and inputs to be used as a metric for ranking DMUs. Friedman and Sinuany-Stern (1998) developed a combined ranking method for ranking DMUs in the DEA context based on three ranking methods, the CCA, the DR/DEA and the ranking based on cross efficiency method (CE/DEA). Adler, Friedman and Sinuany-Stern (2002), in a review of various ranking methods, divided the methods into six somewhat overlapping areas. The first area is based on the use of cross-efficiency matrix, the second on super efficiency methods, the third on number of DMUs for whom a particular efficient DMU is a peer, the fourth on various multivariate statistical techniques, the fifth area on ranking of inefficient DMUs based on proportional measures of efficiency and the sixth on combining multiple criteria decision methodologies with DEA.
Cinca and Molinero (2004) argue that the selection of DEA model is problematic and that the estimated efficiency of any DMU will depend on the inputs and outputs included in the model and the total number of inputs and outputs. Stressing the importance of selecting a parsimonious specification and to avoid models that assign high efficiency values to DMUs that operate in unusual ways (mavericks), the paper proposed a new method for model selection. The paper suggests the use of PCA for analysing the efficiency scores obtained from various model specifications and for producing DMU rankings. Each model (data model) may be used as a variable, and each efficiency score of individual DMUs may be taken as observations of the variable for running the PCA. The paper advocates the use of factor loading on each model of first principal component (PC) for estimating its importance and factor scores of first PC of DMUs to rank them. Also individual components may be used to describe the nature of efficiency measurement of each model. The paper demonstrates the method by applying PCA on efficiency scores of 18 DMUs from 21 DEA models.
There are several studies done on measurement of efficiency of dairy farms in various countries. Zibaei, Kafi and Bakhshoodeh (2008) study the context by which veterinary services may affect the technical efficiency of 840 Iranian dairy farms. The study uses DEA to estimate the regional frontier and meta frontier-level technical efficiencies. Gaspar et al. (2009) analyse technical efficiencies of livestock farming systems in Extremadura, Spain, using input-oriented both CRS and VRS models. Kelly et al. (2012) use DEA to measure efficiencies of a sample of Irish dairy farms and compare key production characteristics of efficient and inefficient units using ANOVA and identify longer grazing season, higher milk quality standard, higher likelihood of participation in milk recording and greater land quality associated with more efficient dairy farms, apart from using less input per unit of output and higher production per cow and per hectare. Kelly et al. (2013) estimate the technical and scale efficiencies of pasture-based Irish dairy farms using DEA. The study also shows that increased farm size, intensification and dairy specialisation are associated with higher efficiency. Aldeseit (2013) uses DEA to measure technical efficiency of dairy farms in Jordan and finds that the farms are not operating at optimal scale size.
Although there are many studies in the animal husbandry domain, we could find no study measuring efficiency of VDs or of ranking them. The current study differs from the above-mentioned studies in important ways. First, all those studies are on efficiency of for-profit units undertaking some economic activity unlike VDs which are service-oriented government-sponsored units. Values of the outputs of veterinary services are not readily measurable, especially in the absence of a competitive market for the same, making it more difficult to measure efficiencies. Veterinary services are one of the inputs to the animal husbandry activities, and their cost to a dairy unit, for example, is readily measurable as the amount paid for the services and the costs of purchase of materials like medicines and vaccines, if any. Hence, measuring the efficiency of VDs is altogether of a different kind compared to efficiency measurement of any animal husbandry unit.
The term ‘ranking’ in this study refers to arranging the DMUs, VDs in this case, in terms of their performance in a descending order with the best performing VD at the top and worst performing VD at the bottom. DEA results produce efficiency scores for each DMU between 0 and 1. The DMUs which get an efficiency score of 1 are considered efficient and others as inefficient. As the scores of all efficient DMUs are equal to 1, they cannot be ranked using this score alone. Hence, an additional method of ranking is required in this case. Several studies exist in the literature where efficiency measurement using DEA and ranking using a related method are done in the not-for-profit domain. Hollingsworth and Harris (2002) use DEA and super efficiency to measure cost and production efficiency of local government programmes for childhood immunisation in urban and rural parts of Australia. The study ranks the programmes using super efficiency scores. Ramanathan (2005) studied the operations efficiency of 20 hospitals in the Sultanate of Oman using DEA and ranked the efficient hospitals using the super efficiency model. Singh (2016) measured the performance of states under the Mahatma Gandhi National Rural Employment Guarantee Act (MGNREGA) using DEA and ranked the states using cross-efficiency approach. Visbal-Cadavid, Martínez-Gómez and Francisco (2017) assessed the efficiency of public universities in Columbia using DEA. The universities are also ranked in the study using Pareto efficient cross-efficiency model. Mirmozaffari and Alinezhad (2017, 217–22) used cross-efficiency and two-stage DEA for efficiency measurement and ranking of 12 heart hospitals in Iran.
Khan and Gulati (2019) used DEA and double bootstrapping approaches to measure financial, operational and social efficiency measures and ranked micro finance institutions (MFIs) in India using bias corrected efficiency scores obtained from bootstrapping. Puertas and Marti (2019) used cluster analysis and DEA to measure the contribution of universities towards sustainability and developed a ranking scheme which they called ‘GreenMetric’ to rank universities.
Most of these studies are comparable to the current study as they are public programmes where assessment of market values of outputs is difficult and hence measurement of efficiency needs a method like DEA. Ranking of DMUs is done based on one of the available methods. The DEA and PCA method, not used in any of these studies, fulfils two objectives at the same time—selecting most important factors or input and output variables among several available input and output variables and ranking all DMUs, both efficient and inefficient.
Research Design
DEA for Efficiency Measurement
DEA is a methodology for measuring the performance efficiency of organisational units called DMUs. This technique aims to measure how efficiently a DMU uses the resources available to generate a set of outputs. DMUs can include manufacturing units, schools, bank branches, hospitals or even practising individuals like doctors or lawyers. Most of these DMUs are non-profit organisations where the measurement of performance is difficult as a lot of inputs used by such organisations and a lot of outputs produced by them cannot be measured using a common denominator like money. Efficiencies of DMUs estimated using DEA are relative with respect to the best performing DMU. DEA is a non-parametric technique and does not require the assumption of the nature of a distribution (Ramanathan 2003).
Stochastic frontier analysis (SFA) developed by Meeusen and van den Broeck (1977) and Aigner, Lovell and Schmidt (1977) is another frontier technique of measuring efficiency. However, it is a parametric technique and requires specification of the functional form of the production function. Given the limited knowledge about the production function of veterinary service delivery, the technique is not considered in this study.
Rationale for the Study
The 10-year ‘Perspective Plan ARD Sector 2010–20’ has a total outlay of nearly ₹22.516 billion (around $322 million) out of which veterinary service delivery itself has a 39% share of ₹8.696 billion (around $124 million). The plan has delivery of ‘efficient veterinary services at the door step of the farmers’ as one of its missions (GoO 2010), and thus measurement of efficiency of veterinary service delivery is of practical importance. There is also a growing awareness among people about need for accountability and transparency in public programmes and public spending, which makes it important to measure the efficiency of service delivery by veterinary institutions in Odisha.
The method of DEA was proposed with the intention of measuring the efficiencies of programmes in the not-for-profit sector like those of governments and NGOs. However, while the use of DEA has increased manifold in the for-profit sector, its application in the intended sectors like animal husbandry has been negligible. Therefore, this study attempts to demonstrate the use of DEA in this less explored application on a government programme/department providing veterinary services. Also, the department at various levels (like district, sub-division and block levels) attempts to evaluate performances of VDs and ranks them periodically with the help of various outputs (most of which are used in this study also) individually. Hence, using a more comprehensive method like DEA for the purpose should be highly desirable.
Hence, a study is conducted with the following research questions and objectives.
It tries to answer the research questions of ‘Can DEA be used to measure the efficiency of VDs?’ and ‘Can meaningful and useful interpretations be made by this?’ and sets out with the following objectives:
Measuring the relative efficiencies of VDs of the study location using DEA, based on various inputs and outputs identified as relevant and identify peers for inefficient dispensaries.
Measure optimal levels of inputs/outputs for VDs identified as inefficient to make them efficient and identify their current returns to scale (RTS) properties.
Rank all the VDs based on their efficiencies for benchmarking.
The study is conducted in two parts. The first part examines input and output variables for their suitability in applying DEA (and makes suitable modifications wherever required) and uses basic DEA models to measure technical and scale efficiencies, finds input/output projections of inefficient DMUs for achieving efficiency, identifies RTS properties, thereby covering the first two objectives, and ranks DMUs using super efficiency and cross-efficiency. The second part of the study, which is the subject of this article, uses the not-so-commonly used PCA on DEA efficiency scores to rank DMUs based on the method proposed and demonstrated in Cinca and Molinero (2004).
This article tries to look at two aspects in specific to understand the role of different variables in the models in determining the efficiencies of VDs using PCA and rank the VDs based on DEA average efficiency (AE) and PCA.
Locations for the Study
Two ecosystems of the state where animal husbandry and animal production are more advanced, the coastal Odisha and the western Odisha are selected for this study. In particular, six districts from the two ecosystems are selected. The term ‘ecosystem’ is used here with its general meaning to represent two separate regions geographically, climatically and socio-culturally. The two ecosystems are selected as they are more advanced in animal husbandry and animal production compared to other parts of the state. The districts included in the study are Balasore with 21 VDs, Cuttack with 25 VDs (final 23 VDs) and Jagatsinghpur with 12 VDs of the coastal ecosystem and Bargarh (19 VDs), Jharsuguda (9 VDs) and Sambalpur (17 VDs) of the western ecosystem.
Models and Methods
This study uses the input-oriented version of the basic model of CCR (Charnes, Cooper and Rhodes 1978), which produces more discriminating efficiency scores for measuring technical efficiencies of VDs under various combinations of inputs and outputs. The choice of input or output orientation does not make a difference in this study because this study uses the efficiency scores alone which will be the same for individual DMUs under both input- and output-oriented CCR models. To rank the VDs, PCA, a multivariate statistical technique, is used in addition to average of DEA efficiency scores.
DEA in Detail
DEA is a linear programming-based technique to measure the relative efficiency of various units called DMUs. Each unit (DMU) would have used various inputs in different quantities to produce various outputs in different quantities.
Efficiency may be defined as a ratio of output to input and its measurement will be simple if one type of input is used to produce one type of output. Efficiency can then be measured as the ratio between the quantity of output to the quantity of input. Similarly, if all inputs and outputs can be expressed in terms of their monetary values, a similar ratio can be used to measure efficiency. In these cases, the unit which gets a higher value for this ratio can be considered to have higher efficiency and vice-versa. However, if the numbers of inputs or/and outputs are more than one and there are no common denominator like money to measure all inputs and outputs, then a simple ratio is not possible and one may have to devise some weighting scheme to find weighted input and weighted output to find such a ratio. In such a situation, how to assign weights to different inputs and outputs will be debatable. The problem may be compounded when the units of measurement of each of the inputs and outputs are different. If devising a weighting scheme is possible with reasonable accuracy, the ratio of weighted outputs to weighted inputs can be considered as efficiency. DEA uses linear programming to solve such a problem of assigning weights to different inputs and outputs such that the weighted ratio of outputs to inputs is maximised for the unit being studied, at the same time ensuring that no unit including the one being studied will get a ratio value of more than one using the same weights. This ratio will vary between 0 and 1. A unit will be considered as efficient if it gets a ratio of 1 and inefficient otherwise. Such a linear programming problem is run for each of the units to find their respective efficiencies. (Charnes, Cooper and Rhodes 1978; Ramanathan 2003).
CCR Input-oriented Model
The CCR model (Cooper, Seiford and Tone 2007) may be expressed in matrix form—by taking the input values in matrix form as ‘X’, output values in matrix form as ‘Y’ and the input multipliers as a row vector ‘v’ and output multipliers as a row vector ‘u’—as follows:
(LP 1) Max uyo
Subject to
vxo = 1
uY – vX < = 0
v > = 0, u > = 0,
Where yo is the column vector of outputs and xo is the column vector of inputs for DMUo.
The dual of the above primal LP problem, DLP 1, known as ‘envelopment’ form in DEA literature, with a real variable θ and a non-negative vector λ = (λ1, λ2, …, λn)T of variables, can be formulated as follows:
(DLP 1) min θ
Subject to the constraints
θxo - X λ > = 0
Y λ > = yo
λ > = 0.
This DLP 1 tries to guarantee at least an output level as given in yo of DMUo while reducing the input vector xo proportionally to a value as small as possible. Hence, this method is called as the input minimisation or input-oriented model. In applications of DEA, like in this study, the dual form of the LP (DLP 1) is solved as this will reduce the computational effort and to make interpretation more straight forward. This model is used in this study to find efficiencies of VDs under all the data models.
Principal Component Analysis
PCA is a dimension reduction tool that can be used to reduce a large set of variables to a small set that still contains most of the information available in the large set. It is a multivariate procedure that transforms a number of correlated variables into a smaller number of uncorrelated variables called PCs. Factor loadings are simple correlations between the variables and the factors, while factor scores are composite scores estimated for each respondent on the derived factors (Malhotra and Dash 2016).
Decision-making Units
Decision-making happens at various levels of veterinary service delivery among which BVDs and VDs are the most critical levels. Most of the planning and target setting occurs at the block level and most of the responsibility for achieving the target happens at the VD level. As VDs are considered as the focal points for delivery of veterinary services, VDs are the DMUs for this study, as most of the performance monitoring and assessment of the department occurs at this level. There are three types of VDs under the two ecosystems. One type is the block-level VDs which have a VD and a MVU. The second type is the sub-block-level VDs which do not have an MVU. Each of these VDs have a few LACs under itself. The third type of VDs is the district-level veterinary polyclinics which have doctors specialised in medicine, surgery and gynaecology. They also have other infrastructural facilities which are not there in the first two types of VDs. Under the study area, there was only one such unit during the period for which data was collected (2016–17). This particular VD is excluded from the analysis as this is not comparable with other VDs, while the other district-level VDs where polyclinics were not established during the period for which data was collected are retained in this study. Thus, typically, VDs in this study, considered as DMUs, have one VD with or without a MVU and some LACs under their jurisdiction.
Variables and Data Models Used
The variables involved in the delivery of veterinary services included the following:
Input factors such as technical staff; institutional infrastructure; equipment related to treatment, breeding, vaccination, gynaecology and obstetrics; diagnostic services and surgery; and supplies like medicines and semen straws.
Environmental factors like type and number of different animals and the competitive environment for offering veterinary services.
Output factors such as numbers of various services provided like treatments, AI, number of progenies born from AI services, vaccinations, surgeries, castrations, de-worming, animal health camps conducted, training and exposure visits for farmers, and various programme implementation outputs.
In the initial stage, 60 input variables and more than 12 output variables were identified as per the procedure laid down in Golany and Roll (1989), and data were collected on these for 103 VDs of the 6 districts for the year 2016–17 from the respective VDs and the respective SDVO or CDVO offices. From the data collected and based on discussions with the veterinary doctors of the VDs (Bowlin et al. 1985, as cited in Golany and Roll 1989), it was observed that the most important differentiating inputs were the staff and type of institution such as district-level VD, block-level VD or sub-block-level VD. The staff included veterinary doctors, para-veterinary staff called livestock inspectors (LIs), non-salaried trained staff called Gomitras, and support staff. If each of the institutional components or staff components are to be considered as separate input variables, they should have positive values for each DMU. However, many of these variables have zero values for many DMUs. Given the difficulties about zero-valued factors (inputs and outputs) in DEA (Ali and Seiford 1990; Charnes, Cooper and Rhodes 1978), it is decided to have only positive values in the analysis. In addition, to minimise the number of factors to increase discrimination in efficiency scores, a weighting scheme is used (Podinovsky and Thanassoulis 2007) with suitable weights to quantify the staff of a VD based on the salaries and wages of the respective employees with weights of 10:5:4:3 for veterinary doctors, LIs, Gomitras and support staff, respectively. Based on the investment made to set up a veterinary institution, weights were assigned to different types of institutions such as a VD, MVU and LAC using weights of 8:3:1, respectively.
Based on discussions with the veterinary doctors (Bowlin et al. 1985m as cited in Golany and Roll 1989), seven important output variables are identified. Four of them—the number of treatments done, number of AIs done, number of progeny born and number of vaccinations done—are most important, and all of the VDs had some positive values for them. The number of progeny born, which is an outcome rather than an output variable and represents AIs done nine months back and the success rate of AIs done, is considered as an alternative output variable to AI in this study. Although it is an outcome variable, it is used as a proxy to combination of number AIs done and success rate of AIs done, as most veterinary doctors with whom the authors discussed, expressed that progeny is also an important output apart from AI. The values of the other three output variables—castrations, number of man-days of training given to farmers and number of animals insured—had zero in many VDs. Given the difficulties about zero-valued factors (inputs and outputs) in DEA (Ali and Seiford 1990; Charnes, Cooper and Rhodes 1978), it is decided to have only positive values in the analysis. This required a weighting scheme to construct one output variable out of these three variables. A suitable weighting scheme is devised based on a survey of farmer users of these services and a single output variable ‘CIT’ is constructed using weights of 1:1.2:1.3 for castration, insurance and farmers’ training, respectively. Thus, five output variables were identified finally as treatment, AI, progeny born, vaccination and CIT, representing weighted castration, insurance and training. One VD which had zero value for CIT is excluded from the analysis. Thus, finally this study has 101 VDs as DMUs.
Among the environmental variables, the animal population in the jurisdiction of a VD is observed to be the most critical and included indigenous (native) cattle, crossbred or exotic cattle, buffaloes, sheep, goat, pigs, dogs and poultry. These are combined into three broad categories of large animals, small animals and poultry and used as environmental input variables. Another representative population variable of importance is the breedable animal population which is the count of indigenous cattle, crossbred/exotic cattle and buffaloes which have attained puberty and are potential candidates for AI. Thus, four different environmental variables are considered.
After arriving at two input variables, four environmental input variables and five output variables, various data models are devised to find efficiencies of VDs as described in a subsequent section. The minimum requirement of number of DMUs, which is at least twice of m × n (Dyson et al. 2001), where ‘m’ is the number of inputs and ‘n’ is the number of outputs, is abundantly satisfied in this study. With 101 DMUs, the present study has more than 2.5 times the minimum required number for models with the maximum number of factors: (2 + 3 inputs × 4 outputs) × 2 = 40.
Descriptive Statistics of Inputs and Outputs
Table 1 presents the descriptive statistics of inputs including the environmental input variables ecosystem-wise. The average number of weighted staff units per VD for coastal VDs is 57.5, while that for western VDs is 41.8 and the overall average for all 101 VDs put together is 50.5, though both the ecosystem VDs have comparable number of weighted institutional units. The large animal and poultry populations are higher for coastal compared to western VDs, while the small animal population are comparable.
Descriptive Statistics of Inputs of VDs (In Numbers).
The descriptive statistics of outputs produced by the studied VDs is presented in Table 2. The VDs of the coastal ecosystem have performed better than VDs of western on an average in the case of all five outputs. The relative variation in AIs between all VDs and progeny between western VDs are considerably higher compared to those of other outputs. In general, the higher staff and animal population in coastal VDs appear to have enabled them to produce higher outputs compared to western VDs.
Descriptive Statistics of Outputs of VDs (In Numbers).
Correlation between different inputs, among different outputs and between inputs and outputs were found as required for variable selection in DEA (Golany and Roll 1989) and are presented in Table 3. The correlations between all inputs and outputs are positive and significant as required for using the data in DEA. The variables with their respective codes are given as row heading while only the variable codes are given as column headings to keep the table compact.
Pearson’s Correlation Coefficients Between Inputs and Outputs.
Efficiencies of VDs Based on Various Combinations of Inputs and Outputs
In the current study, two input variables, four environmental input variables and five output variables are used. A total of 138 different data models are generated based on all combinations of these inputs, outputs and environmental inputs by following the below mentioned rules:
Staff is used as a single input or in combination with institutions as two inputs, leading to two different models. Institutions alone are not used as single input because staff is the most important critical input, and it will be absurd to exclude staff from any model.
Four outputs are used with one output case, two outputs case, three outputs case or four outputs case. In all such combinations where AI is used as an output, number of progeny born is used in an alternative output.
Based on the presence or absence of environmental variables, three forms of models are devised: (a) models with no environmental variables; (b) models with three environmental variables of large animals, small animals and poultry referred to as AP; and (c) models with three environmental variables of breedable animals, small animals and poultry referred to as BP.
Using the above rules, models are devised as follows—4 single output combinations, 6 two output combinations, 4 three output combinations and 1 four output combination—thus making it a total of 15 models. When a single input of staff is used, we have 15 models, and when we use both staff and institutions, we have another 15 models, thus making it 30 models. For each of these, we have three different forms of environmental variables, making it 30 × 3 = 90 models. Out of these 90, AI is used in 48 models which can be replaced by its alternative progeny to devise another 48 models—for a total of 138 data models.
AE, Ranking Based on AE and Number of Times Efficient
Use of arithmetic mean (average) of efficiency (AE) scores based on weights assigned to optimise each and every DMU is done often to obtain what is called as cross-efficiency or average cross-efficiency in DEA literature for ranking DMUs (Adler, Friedman and Sinuany-Stern 2002; Doyle and Green 1984; Sexton, Silkman and Hogan 1986). The current study uses AE scores obtained from different data models as one of the methods for ranking VDs. 1 Efficiency scores of VDs are found for all of the VDs under each of the 138 models using input-oriented CCR model and the AE for each VD is found out. The descriptive statistics of the AE scores based on these 138 models are presented in Table 4, along with ranking of VDs based on AE and number of times individual VDs are efficient among the 138 models.
Descriptive Statistics of AE, Ranks Based on AE and Number of Times Efficient Out of 138 Models.
The AE is the AE score of individual VDs obtained from each of the 138 data models. Coastal VDs perform better with an AE score of 0.604, while western VDs have a lesser AE of 0.458 for an overall average of 0.539 for all the 101 VDs put together. The rankings of VDs based on AE scores also suggest a better performance by coastal with a lower average rank compared to western. Of the 101 VDs, 48 are efficient in one or more of the models, of which 32 are of coastal group and 16 are of western group. No ranking is attempted here as only 48 VDs can be ranked using number of times efficient. Coastal VDs do better in this with a higher average number of times efficient and also the highest of 102 times efficient among the 138 models going to them.
Analysis of AE Scores of Data Models Used
Further analyses of efficiency scores of VDs based on 138 data models are done. Individual VDs’ efficiencies are taken as variables, and each of the models are taken as observations for this analysis. The AE here are the average score of all 101 VDs for a particular model, unlike the VD-wise analysis presented in the previous section. The descriptive statistics of AE and number of efficient VDs for each of the data models are given in Table 5. Thus, the AE of all VDs based on 138 models is 0.539, and the average number of efficient VDs per model is 11.67.
Descriptive Statistics of AE and Number of Efficient VDs Under Various Models.
The influence of presence or absence of each of the input/output variables is studied using non-parametric Mann-Whitney rank sum test to test whether significant differences existed in AE scores and number of efficient VDs of different models with and without a particular variable. Non-parametric tests are used here, as the DEA efficiency scores are considered as non-parametric and use of a parametric test like 2-independent sample t-test is not allowed. Friedman and Sinuany-Stern (1997) also use a non-parametric statistical test to validate the classification by DEA and the ranking by CCA using Mann-Whitney rank sum test in their study on ranking of DMUs using CCA. Table 6 presents a summary of the test results for different models discussed earlier. The table has listed results for only those variables where there is significant difference (p < 0.05) in efficiency scores between models with them and models without them, due to space constraints. As is evident, the efficiency scores are influenced by the presence or absence of each of these input/output variables. The AE and average number of efficient units are also given in the table. The higher values of these for the models with the respective variables compared to models without them show that the presence of these variables has significantly increased the efficiency scores and number of efficient VDs (p < 0.05).
Summary of Mann-Whitney Rank Sum Test for Test of Difference of Efficiency Scores and Number of Efficient VDs, With or Without Given Variables.
Thus, the presence or absence of outputs, AI or progeny and treatment has not changed the efficiency scores or number of efficient VDs per model significantly (p < 0.05), while the presence of institutions, vaccination, CIT and environmental variables—with the exception of models with AP where only number of times efficient is significant and not AE—has significantly increased the AE scores and number of efficient VDs (p < 0.05).
PCA for Prioritising Variables
Cinca and Molinero (2004) devised a method for the use of PCA of efficiency scores obtained under different data models and used the first PCA component score for ranking DMUs. In this study, each of the 138 models are used as a variable, and efficiency scores are used as individual observations for finding PC. Based on an eigenvalue criterion of >1, nine components are extracted as given in Table 7. The first component explains 61% of variation in efficiency scores, second component about 12% and so on. All the nine components put together explain 97.48% of variation.
PCs with Eigenvalues >1.
Different input/output models may be analysed using the first factor loading (Cinca and Molinero 2004). Table 8 presents the highest and lowest factor loadings for first PC and sum of all nine PCs and the data models that obtained these loadings. Based on the first PC, models with more number of input/output variables along with animal population received higher loading, while those with less number of inputs and outputs and progeny as one of the outputs received lower loadings. However, based on sum of all factor loadings, models with progeny as one of the variables and without animal population obtained the maximum loading, while those with vaccination and CIT and one of the animal populations (BP or AP) received the lowest loading, thus rendering it difficult to make any interpretations based on top and bottom ranks alone. Looking at both the factor loadings, it may be suggested that use of AP does better than use of BP as environmental variables. Vaccination and CIT along with either AI or progeny figure in all top models under first factor loading, while treatment and progeny appear in all top models based on all factor loading, suggesting that all four outputs are important. However, whether to use AI or progeny does not get a conclusive answer. As institutions figure in four of the top five models based on first factor loading and in two of the top five models based on all factor loadings, its use as input appears appropriate. Models are represented in Table 8 conveniently by the first letter of each of the input/output factors present in the model.
Models Ranked Based on Their First Factor Loading and Sum of All 9 Factors Loading.
Test of differences of factor loadings of different models is done using Mann-Whitney rank sum test. To understand the importance of each of the input/output variable, test has been conducted to look at differences in factor loadings of first PC between with and without a particular variable. The test results are presented in Table 9 for only those variables where significant differences (p < 0.05) existed.
Summary of Mann-Whitney Rank Sum Test for Test of Difference of Factor Loadings of First PC of Different Models with or Without Given Variables.
The presence or absence of the four variables—AI, vaccination, CIT and AP—have shown significant differences (p < 0.05) in factor loadings of models for first PC. Comparing these results with Table 6, where tests of differences are found between AE and number of times efficient, institutions and BP become less important and AI becomes important. However, vaccination and CIT are shown as important variables in both the methods whether AE or factor loadings of first PC on models.
PCA for Ranking the VDs
Table 10 presents the descriptive statistics of factor scores of VDs and ranks based on them for first factor and sum of all nine factors. Coastal VDs perform better than western VDs with higher average factor scores and lower average factor ranks.
Descriptive Statistics of Factor Scores of VDs and Ranks Based on Them.
Table 11 presents the VD-wise factor scores and ranks along with AE scores, ranks based on them and number of times particular VDs are found to be efficient. Tirtol VD (V46) of coastal ecosystem gets the first rank based on AE and first factor score, while Kesaibahal (V98) gets first rank based on all factors score. Balasore (V9) in coastal gets the top position in number of times efficient by being efficient in 102 out of the 138 models. Dehurda (V1), Machchagoan (V56) and Kolabira (V79) also figure in the list of top five ranks based on one or the other ranking method.
VD-wise AE, Number of Times Efficient, PCA Factor Scores and Ranks Based on Them.
Comparison of AE and PCA for Ranking VDs
As can be seen from the annexure, the ranking of VDs based on the three methods of AE, first factor score and all factors score using PCA are comparable. To test the level of similarity among these ranking methods, Spearman’s rank correlation coefficients are found as presented in Table 12. All the three ranking methods have very high and significant (p < 0.01) correlations among the ranking of VDs produced by them.
Rank Correlation Between Ranking Based on AE, F1 and F9 (N = 101 for All Pairs).
Summary of Results, Discussions and Concluding Remarks
Summary of Results
The technical efficiencies of service delivery of 101 VDs belonging to two ecosystems of Odisha, India, are found using CCR input-oriented model for 138 different data models. The different data models are designed using two input variables, four environmental variables and five output variables in various combinations. The AE of each VD based on 138 efficiency scores and the number of times individual VDs are efficient out of 138 models are presented and discussed. VDs of the coastal ecosystem overall fared better than VDs of the western ecosystem. Ranking of VDs based on AE is also attempted in this study. Further analysis to understand the role of individual factors reveals that the presence of institutions, vaccination, CIT and combinations of animal population variables—AP or BP—has significantly increased the AE and number of efficient VDs under a particular model. Coastal VDs of Dehurda (V1), Balasore (V9), Tirtol (V46) and western VDs of Kolabira (V79) and Kesaibahal (V98) obtained the top five ranks using AE.
Use of factor loadings of first PC for prioritising different data models has given top five ranking for models with more number of input/output variables along with animal population (AP), while those with less number of inputs and outputs and progeny as one of the outputs received lowest five ranking. However, the use of factor loadings of all nine PCs gives contrasting results in terms of top five and bottom five ranks. Mann-Whitney rank sum test as test of differences in factor loadings of first PC between presence and absence of particular variables in models shows AI, vaccinations and CIT (output variables) and AP (environmental input variables) as significant, implying that their presence has given models higher factor loading compared to models in which they are absent. This fact may be interpreted as use of AP (with large animals, small animals and poultry) instead of BP (with breedable animals, small animals and poultry) to be more appropriate and use of AI as an output instead of progeny as more appropriate.
PCA is used in this study as a second method of ranking VDs. Nine PCs are identified which explained nearly 97.5% of the variation in efficiency scores under 138 models. Ranking of VDs is done using the first PC and using the sum of all nine PCs. Coastal VDs of Dehurda (V1), Balasore (V9) and Tirtol (V46) and western VDs of Kolabira (V79) and Kesaibahal (V98) obtained the top five ranks based on first PC, while Machchgoan (V56) replaced Balasore (V9) for the top five ranks based on the sum of all PCs. Spearman’s rank correlation shows a high correlation between ranking based on AE and ranking based on PCs. The first PC and AE have higher correlation compared to those between AE and all PCs and first PC and all PCs.
Discussions
Governments spend considerable amounts of money in providing different services to the public, many of which are on subsidised basis. Given that tax payers’ money is being used for this, it is imperative that such programmes operate efficiently. However, efficiency measurements of such programmes are hardly done in practice. Veterinary service delivery is one such example. Although veterinary services contribute immensely to the development of the animal husbandry sector, efficiency of service delivery is not measured comprehensively. In the studied areas, for example, VDs are ranked based on their performance in individual output achievements, like number of vaccinations done during a year. Such a process would give multiple ranks to each VD based on multiple outputs. Hence, there is need for a comprehensive method of measuring efficiency and ranking VDs based on it.
Overall, the study demonstrates two important aspects. The first is that though efficiency of veterinary service delivery cannot be expressed in the form of a quantitative production model, it can be measured reasonably well using DEA and ranked using the method used in this article. The second point is that useful interpretations like importance of various factors in determining the efficiency of veterinary service delivery can be identified as demonstrated, and useful measures can be taken to improve efficiency. The study also uses PCA as a method for ranking based on DEA efficiency scores and finds that the results have high correlation with ranking based on AE. Thus, using PCA does not produce significant differences in ranking compared to using AE scores itself, though some additional interpretations are possible using PCA. The studies discussed earlier used super efficiency or cross-efficiency for ranking DMUs alone, while the use of DEA and PCA has the additional advantage of facilitating in the selection of important factors (input and output variables) to be used in DEA apart from ranking.
Concluding Remarks
The most important factors as identified by the model are AP consisting of large animal, small animal and poultry (as environmental input variables), AI, vaccination and CIT (as output variables). In conclusion, it can be stated that any model to measure efficiency of VDs should essentially include these variables. The second point is that use of DEA and PCA offers a comprehensive method for ranking VDs for any decision-making instead of a multiple ranking system using multiple outputs.
Some of the limitations of the study include the following.
DEA efficiency scores do not include an error term to represent random effect and hence are considered as biased by many researchers.
There is a limitation on data details. For example, the number of different types of animals treated in a year is not available; instead, only the total number of treatments done during the year is available. This figure may favour those VDs which cater to a higher sheep, goat and poultry population compared to those with predominantly large animal population as treatments given to small animals and poultry are usually many at a time, while those for large animals are usually one at a time.
The study has used CCR input-oriented model alone for measuring technical efficiencies of VDs. As some of the models use environmental variables also, which are not under the control of management of VDs, non-controllable or non-discretionary variable models are appropriate for models with such variables. However, to maintain uniformity in all models for comparison, only CCR input-oriented model is used in the case of all the 138 data models.
Using the same data, some more data models are possible which has not been done in this study. Such models include models without staff as an input variable (69 models possible), use of individual animal populations of large animals, breedable animals, small animals and poultry in various combinations (several hundred models possible), among others.
Footnotes
Acknowledgments
The author would like to thank the Animal Husbandry and Veterinary Services Department of Odisha for providing the data for this study. Thanks also to Prof. L. K. Vaswani, Prof. R. N. Subudhi and Dr Sailabal Debi for their guidance, comments and suggestions during various stages of this research. The author also acknowledges all the help and cooperation extended by his colleagues in completing this study. The author takes complete responsibility for any errors or omissions in this study.
Declaration of Conflicting Interests
The author declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The author received no financial support for the research, authorship and/or publication of this article.
