Development and validation of a KPI-based method and a user-friendly software tool for resilience-focused measurement of OSH management system performance — KPI-OSH-Tool

The literature on tools for the measurement of OSH MS performance shows that these tools are usually characterized by relatively large numbers of leading indicators (PPIs), from more than 180 to almost 500. Recent studies carried out by CIOP-PIB allowed to define ca. 150 indicators assigned in subsets to individual OSH MS components. With regard to OSH training the following 5 exemplary PPIs were identified:

1. % of workers subject of initial OSH instructing or training;
   
2. % of workers participating in OSH courses;
   
3. % of managers participating in OSH courses,
   
4. % of training hours performed on OSH courses,
   
5. no. of hours for OSH training per person.
   

Practical application of such complex performance measurement systems in enterprises is difficult since it involves large investment of time, the need for training and preparing personnel to perform measurements, a large volume of information to be collected and processed, and an extensive documentation associated with carrying out the measurement process. Furthermore, with a large number of PPIs, many of them may be interdependent, since they may possibly be based on the same data, or be linked in cause and effect relationships. Applying a large number of PPIs may also be a significant factor preventing dissemination of OSH MSs based on performance measurement, especially among SMEs. Therefore, it is highly justified to search for such arrangements for OSH MS performance measurement which comprise a minimum number of higher-level key performance indicators (KPIs); moreover, the number of those KPIs would need to be sufficient for proper evaluation of OSH MS status in a given enterprise or a part thereof. In the case of the proposed project the objective would be to reach the target of ca. 20-30 KPIs.

The model of OSH MS adopted for the project will be elaborated on the basis of combined specifications of OHSAS 18001 and ILO-OSH 2001 Guidelines. The model will also consider the contents of OSH MS to be included in future ISO 45001 standard (currently being developed by the ISO/PC 283).

Where a large number of possible PPIs is available, a decision problem appears which concerns the selection of KPIs from a given set of PPIs. The problem in question implies the need for defining the criteria for evaluation and selection of KPIs, and employing a relevant method in the domain of multi-criteria decision making (MCDM) analysis. For the criteria for evaluation and selection of KPIs, a set being frequently recommended in the literature, is the set of criteria denoted by the acronym of SMART, which stands for: Specific, Measurable, Achievable, Relevant, and Time-bound.

There are numerous MCDM methods that may be applied for the selection of KPIs from a given set of PPIs. Those most frequently applied and described in the literature include inter alia: AHP (Analytic Hierarchy Process), ANP (Analytic Network Process), TOPSIS (Technique for Order Preference by Similarity to Ideal Solution), or ELECTRE (Elimination Et ChoixTradusant La Réalite). An analysis of the literature indicates that one of the most popular and most widely applied in practice is the AHP. This method involves determination of various levels of importance for defined criteria, and subsequently an expert comparison and ranking of decision variants in relation to those criteria. The AHP analyses can be performed easily with the support of many available on-line tools, e.g. the Expert Choice, MakeItRational or TransparentChoice. Given the relatively low level of complexity, the availability of relevant supporting tools, and the possibility for applying it for solving decision problems in numerous economy sectors and areas of science, the AHP method has been widely employed in hundreds of documented cases.

The project will contribute to the genuine improvement of operational performance of OSH MSs in enterprises in various countries and various sectors of economic activity. The main categories of stakeholders include: senior managers, safety managers, workers in enterprises, safety consultants and auditors, authorities dealing with OSH, including labour inspectors, as well as customers. The use of KPIs will allow company’s managers to respond quickly and effectively to early indications of irregularities in the operation of OSH MS. This should result, in a longer perspective, in the decreased number of occupational accident rates and the reduction of other adverse effects on employees’ safety and health. At the same time project results will contribute to the decrease of losses associated with poor working conditions, and thus would positively influence productivity and competitiveness of the enterprises.

Project results will be disseminated and transferred to stakeholders by means of brochures, scientific publication, training courses provided by partners as well as by and papers presented on conferences. The results will also be disseminated by international or sectoral guidelines for OSH MS, which would include the recommended set of KPIs for the measurement of OSH MS performance.

The project will be divided into 5 main workpackages:

WP1: Specification for the KPI-based method and a tool for measuring OSH MS performance;

WP2: Defining initial sets of KPIs for measuring performance of OSH MS components;

WP3: Development of the tool for KPI-based measurement of OSH MS performance;

WP4: Pilot implementation and validation of the tool for OSH MS performance measurement;

WP5: Dissemination and promotion of the project results.