Journal of Ergonomics

Journal of Ergonomics
Open Access

ISSN: 2165-7556

+44 1300 500008

Review Article - (2017) Volume 7, Issue 4

A Framework for Adaptive Stress Testing (FAST) at the Workplace

Paul Jiménez* and Anita Dunkl
Department of Psychology, University of Graz, 8010 Graz, Austria
*Corresponding Author: Paul Jiménez, Department of Psychology, University of Graz, Universitätsplatz 2, 8010 Graz, Austria, Tel: +43/316/380-5128, Fax: +43/316/380-9807 Email:

Abstract

In a comprehensive risk assessment at the workplace, all relevant risks at the workplace–and especially psychosocial risks that might be linked to negative health outcomes–have to be assessed. This detailed assessment of psychosocial risks should be done very detailed and as often as possible, which is often complicated as integrating this assessment into the organization’s structure and processes are difficult. In addition, a constant assessment could be experienced as stressful for the employees. We present a Framework for an Adaptive Stress Testing (FAST) as a strategy for an effective assessment of stress and psychosocial risks as a basis for the further development of prevention strategies. In three phases, psychosocial risks can be assessed economically and efficiently: 1) A short assessment with few items and obtaining a first feedback about the individual results, 2) An extended version of the assessment and obtaining a second feedback about the individual results, and 3) Getting in contact with supporting experts to discuss the individual results. FAST can be integrated in the process of risk assessment to get a quick and economical assessment of psychosocial risks to further develop specific interventions on the individual and organizational level.

Keywords: Adaptive testing; Assessment; Feedback; Stress; Workplace

Introduction

The assessment and management of psychosocial risks at the workplace are increasingly becoming a major focus of today´s prevention strategies, which can be seen in different campaigns of the European Union (e.g. the “2014-2015 Healthy Workplaces Campaign” [1]). It is a common view that psychosocial risks (or “mental stress”) should be assessed in psychosocial risk assessment management (PRIMA) and in Workplace Health Promotion (WHP) in a timely manner and at the same time as differentiated as possible [2]. On the other hand, doing assessments often and detailed could add an additional load to the workers and the organization. In practice, organizations often try to extend the intervals between the assessments of stress to keep the load resulting from too many stress assessments for their employees at a minimum; at the same time knowing that this could enhance the risks of overlooking some critical events.

In PRIMA and WHP programs, the results of the risk assessment are aggregated and then provided to the head of the company and the health experts for developing further interventions [3]. The individual employees on the other hand like to know about their personal status and psychological tests that allow individual feedback are very common and strongly used [4,5]. Instant feedback can support the individuals to monitor their personal status and can motivate users to maintain or change their personal status [6]. In practice, these tests already are used to a great extent. The critical point here is that these tests very often lack psychometric quality, the results are poor, the interpretations and suggestions are questionable, and the scientific background typically cannot be found. A next drawback of these tests is that in case of a critical feedback (i.e., a feedback resulting from a high stress score obtained in the test) the person is often left alone, especially if the test is done on the computer and the feedback is given instantly on the computer as well. Receiving critical results can have a negative effect on individuals [5]; therefore, it is important to present the results in an understandable way but not too detailed or too comprehensive.

A combination of single tests for individuals, done on their own and the proper integration of these test results into the organizational process of WHP or PRIMA could support the individuals and the organization. This would be a successful approach as the individuals could get insight into their stress status and it also could support the organizations in their need of knowing the psychosocial risk status without doing detailed assessments repeatedly and all the time. Ideally, the single tests are short and therefore motivating for the individuals to do them quickly and on demand.

Computerized adaptive testing [7] can be a successful way to shorten assessment instruments but at the same time obtain enough information about psychosocial risks at the workplace. We suggest a Framework for an Adaptive Stress Testing (FAST) as a strategy for an effective assessment of stress and psychosocial risks as a basis for the further development of prevention strategies. Our framework also covers crucial aspects regarding anonymity and the integration of experts in the case of critical negative test results.

Based on the introduction several assumptions can be made for an adaptive testing which can be ideally integrated into the organizational strategy for PRIMA and/or WHP. Stress testing should consider following points.

The test must have psychometrical high quality. A test with psychometrically high quality is a clear requirement; standards regarding tests and test usage are already defined and well introduced [8-11].

An important additional aspect is the addition of dimensions and subscales, which can help in a later phase if detailed feedback for the user is wished.

Next to stress, resources should be integrated in the testing process as WHP focuses on the health-supportive aspects of the work [12]. This supports to broaden the view also for the users of the test.

A primary test level in the form of a first screening should be done in a quick and short way (i.e., with few items).

The feedback for the individual must be understandable but at the same time not to comprehensive, which can be ideally solved in a first phase by using a traffic light way (green, yellow, red) with a short interpretation.

The feedback of the stress test must provide strategies for handling critical results. If a result shows a critical result, e.g. high stress, then a support line should be provided (support hotline, internal experts, etc.).

The test can be performed anonymously and in a safe way by providing possibilities to perform the test outside the organization (e.g., at home) if the person wants to do it.

The results are stored anonymously and doing the testing cannot be inferred to a specific single person.

Ideally, the results can be repeated at a deeper level with an extended version of the test (secondary test).

A support line is offered in case of the need of a person to understand the result of the test, ideally an expert in stress or psychosocial risks (e.g. work psychologists).

The supporting expert has the possibility to use the results of the test at both levels (primary and secondary test).

The results can be integrated into an organizational dashboard where an overview of the current status can be used as a rough indicator for psychosocial risk level.

The organizational dashboard data are presented only if a sufficient number of people have used the test (and did not decline the data usage) and the data come from a sufficient number of groups and workplaces so a inference to single persons cannot be done [13].

Computerized adaptive tests have a long tradition in research about short and efficient ways of assessment [7,14]. An adaptive test is characterized by first starting with one item. Based on the person’s answer to this item, a previously defined item selection algorithm calculates which item or set of items will be presented next. Adaptive testing has been mainly used in performance and intelligence tests, but this process can be transferred to health assessments, as well [15]. In the presented FAST, we suggest including adaptive testing in stress assessment in three phases (Figure 1).

ergonomics-adaptive-stress-testing

Figure 1: Framework for adaptive stress testing.

Testing at a first phase can sensitize a person for stress. In this first phase, a short test version with only a few items and a short feedback for this test can be used. The goal of this first feedback is to raise awareness for the individual’s stress status. In this phase, especially a critical result (“red”) can lead to over interpretation or may cause anxiety [5]. Therefore, repeating the test at a later time should be advised as well as clear possibilities for support should be given. In this first phase, the risk of giving false-positive feedback (i.e., reporting a “red” result when actually a “green” result should be given) should be avoided as the persons should not get misleading hints which could raise their fears about stress consequences, which would be typically burnout [16]. A suggestion is to add an extended version of a stress test in a second phase. In that case, this second phase should provide a longer and more detailed test with psychometrically high quality. This test should have higher sensitivity and specificity and therefore the feedback results are more trustworthy for the users of the test. In the third phase, experts should be included for a more detailed discussion of feedback results and further psychosocial risks.

The Support Line–integrating the Experts

The FAST (including resources) suggests the integration of experts for a profound interpretation of the results in the individual feedback. Including experts to support the interpretation of the test results especially for psychosocial aspects can be found in many health promotion programs [17]. Including experts in this process should be particularly considered in computerized assessments at the workplace to raise the quality of the health assessment [18]. In FAST, we suggest to integrate these experts in the process in a way that they can have access to the results of the primary and secondary test phases. This could be done by providing randomly generated codes which can be stored by the test user. This code is unique for every user and only the user knows his/her code. With this method, the only the user can connect his/her individual code with the test results. The experts can combine code and test result only when the user permits the combination. Other proper technical solutions are possible but should fulfill the requirement that the organization cannot make an inference to a single person.

The integration into the organizational psychosocial risk management

Getting insight into the personal level of stress could help to set the right steps and strategies for risk prevention for the individual. This supports the organization as the prevention of risks is more efficient and sustainable then treating stress symptoms after being exposed to risks [19]. The advantage of FAST is that the results could be integrated in an organizational dashboard that provides an insight of the current status of psychosocial risks in a rough level. It is important to note that this requires clear and transparent rules regarding the amount of data which have to be available to calculate results, the refreshing period of the data, the anonymity rules etc. which have to be cleared with the workers council and other stakeholders. A second advantage of FAST is also to decide whether a second step of assessment at the organization level has to be done if the results in the dashboard (as anonymous status of the current psychosocial risk level) are going to be more critical. Then a proper implementation of FAST could be used to decide about psychosocial risk assessment at the organizational level. This can help to adapt the assessment cycle of psychosocial risk management.

The future, FAST for research and practice

FAST suggests to do stress assessment in an adaptive way; therefore the use of short or very short questionnaires in the first phase of the assessment is ethically justifiable. A short questionnaire can be implemented in smartphone apps of existing e-health tools as well. This can lead to a more frequent usage of this stress test as a test on the smartphone can be done at any time and place. The combination of FAST in e-health tools can further enhance the awareness regarding stress as conducting a test can induce self-reflection about the topics of the items [20] and self-monitoring is a prerequisite for changing health-related behaviour [21].

Implementing FAST could raise the question whether assessing stress more often also enhances the awareness in a negative sense, i.e., whether people are more sensitive and therefore are more vulnerable to having a more negative view on work. As we suggest including the resources aspects in the assessment as well, at first we see that as balanced. Nevertheless, the raise of awareness and the change of the focus of the workers’ view regarding stress and resources would be an interesting research question.

The advantage of FAST for practice has been described as supporting the individual with instant feedback in three phases, which can lead to a reduction of stress, and this in turn supports WHP and PRIMA as stress reduction is one of the goals of these concepts. A clear difference has to be made as the described framework first focuses on the assessment and reporting of the individual stress status, whereas WHP and PRIMA have a clear agenda in reducing the stress factors in the organizational environment [3]. Therefore, FAST always is ranked at the second place behind the assessment of psychosocial risks at the organizational level, as the individual testing cannot replace the organizational assessment. In addition, the typical hierarchy of prevention and control measures [22] has to be considered and changes at the level of work environment have higher efficiency than personal protective measures (including individual stress management). As a whole, we think that FAST supports the idea of giving attention to stress and resources for individual persons and the organization in a positive and holistic way.

Acknowledgement

This publication was printed with the financial support of the University of Graz.

References

  1. https://osha.europa.eu/en/healthy-workplaces-campaigns/healthy-workplaces-manage-stress
  2. Leka S, Jain A, Widerszal-Bazyl M, Żołnierczyk-Zreda D, Zwetsloot G (2011) Developing a standard for psychosocial risk management. PAS 1010. SafSci 49: 1047-1057.
  3. Leka S, Jain A, Cox T, Kortum E (2011) The Development of the European Framework for Psychosocial Risk Management: PRIMA-EF. J Occup Health 53:137-143.
  4. Hasson H, Brown C, Hasson D (2010) Factors associated with high use of a workplace web-based stress management program in a randomized controlled intervention study. Health Educ Res 25: 596-607.
  5. Soler R, LeeksKD, Razi S, Hopkins DP, Griffith M, et al. (2010) A systematic review of selected interventions for worksite health promotion. The assessment of health risks with feedback. Am J Prev Med 38: 237-262.
  6. Billings DW, Cook RF, Hendrickson A, Dove DC (2008) A web-based approach to managing stress and mood disorders in the workforce. J Occup Environ Med 50: 960-968
  7. Weiss DJ (1982) Improving Measurement Quality and Efficiency with Adaptive Testing. ApplPsycholMeas 6: 473-492.
  8. DIN (2000) DIN 33430: Anforderungen an Verfahren und derenEinsatz bei berufsbezogenenEignungsbeurteilungen.
  9. The International Organization for Standardization(ISO) (2004) ISO 10075-3: Ergonomic principles related to mental workload Part 3: Principles and requirements concerning methods for measuring and assessing mental workload. Switzerland, Geneva.
  10. The International Organization for Standardization (ISO) (2011) ISO 10667-1: Assessment service delivery–Procedures and methods to assess people in work and organizational settings–Part 1: Requirements for the client.
  11. The International Organization for Standardization (ISO) (2011) ISO 10667-2: Assessment service delivery–Procedures and methods to assess people in work and organizational settings–Part 2: Requirements for service providers.
  12. Aust B, Ducki A (2004) Comprehensive Health Promotion Interventions at the Workplace: Experiences With Health Circles in Germany. J Occup Health Psychol 9: 258-270.
  13. Borg, I, Mastrangelo, PM (2008) Employee surveys in management: Theories, tools, and practical applications. Hogrefe, Cambridge, MA, USA.
  14. Weiss DJ (2004) Computerized Adaptive Testing for Effective and Efficient Measurement in Counseling and Education. MeasEvalCounsDev 37: 70-84.
  15. Revicki DA, Cella DF (1997) Health Status Assessment for the Twenty-First Century: Item Response Theory, Item Banking and Computer Adaptive Testing. Qual Life Res 6: 595–600.
  16. Jiménez P, Dunkl A, Kallus KW (2016) Recovery-Stress Questionnaire for Work. In KW Kallus, M Kellmann, The Recovery-Stress Questionnaires: User Manual, Pearson Assessment, Frankfurt pp: 158-187.
  17. Lustria M, Cortese J, Noear S, Glueckauf R (2009) Computer-tailored health interventions delivered over the web: Review and analysis of key components. Patient EducCouns 74: 156-173.
  18. Dunkl A, Jiménez P (2017) Using smartphone-based applications (apps) in workplace health promotion: The opinion of German and Austrian leaders. Health Informat J 23: 44-55.
  19. Semmer NK (2006) Job stress interventions and the organization of work. Scand J Work Environ Health 32:515-527.
  20. Nussbeck FW, Eid M, Geiser C, Courvoisier D, Cole DA (2012) Convergent and discriminant validity over time: integration of multitrait-multimethod-models and latent-state-trait theory. In:MoosbruggerH,Kelava A (eds.) Springer-Lehrbuch. Test theory and questionnaire construction. Springer-Verlag, Berlin Heidelberg pp: 361-388.
  21. Bandura A (2005) The Primacy of Self-Regulation in health promotion. ApplPsychol Int Rev 54: 245-254.
Citation: Jiménez P, Dunkl A (2017) A Framework for Adaptive Stress Testing (Fast) at the Workplace. J Ergonomics 7:205.

Copyright: © 2017 Jimenez P, et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Top