The Impact of Perceived Training Effectiveness on Innovative Work Behavior in Work-Based Learning Programs: A longitudinal Quasi-Experimental Study
Keywords:
Innovative Work Behavior, Perceived Training Effectiveness, Work-based learningAbstract
This study aims to investigate the relationship between perceived training effectiveness and innovative work behavior within the context of work-based learning programs. Using a separate-sample pretest-posttest quasi-experimental design, the study compared IWB across three groups: (1) a pre-training/control group; (2) a post-training group – filled the survey immediately after the training completion; and (3) a follow-up group – filled the survey after a period of 3-12 months from their training completion. Data from 461 participants (227 pre-training, 126 post-training, and 108 follow-up) were analyzed using ANOVA and correlational methods. Results revealed a statistically significant increase in IWB from pre-training to follow-up, but not from pre-training to post-training. Additionally, a positive correlation emerged between perceived training effectiveness and IWB at both post-training and follow-up stages. These findings contribute to the understanding of training program effectiveness in enhancing IWB, highlighting the importance of well-designed WBL programs and the potential for delayed behavioral change.
References
Adair, J. E. (2007). The art of creative thinking: How to be innovative and develop great ideas. Kogan Page Publishers.
Alt, D., Boniel-Nissim, M., Naamati-Schneider, L., & Meirovich, A. (2022). Precursors of Openness to Provide Online Counseling: The Role of Future Thinking, Creativity, and Innovative Behavior of Future Online Therapists. Frontiers in Psychology, 13, 848235-848235.
https://doi.org/10.3389/fpsyg.2022.848235
Amarakoon, U., Weerawardena, J., & Verreynne, M.-L. (2018). Learning capabilities, human resource management innovation and competitive advantage. The International Journal of Human Resource Management, 29(10), 1736-1766. https://doi.org/10.1080/09585192.2016.1209228
https://doi.org/10.1080/09585192.2016.1209228
Anderson, A., Bravenboer, D., & Hemsworth, D. (2012). The role of universities in higher apprenticeship development. Higher Education, Skills and Work-Based Learning, 2(3), 240-255.
https://doi.org/10.1108/20423891211271773
Anderson, N., Potočnik, K., & Zhou, J. (2014). Innovation and Creativity in Organizations: A State-of-the-Science Review, Prospective Commentary, and Guiding Framework. Journal of Management, 40(5), 1297-1333. https://doi.org/10.1177/0149206314527128
https://doi.org/10.1177/0149206314527128
Aqli, R. F., Hasan, B., & Sucita, T. (2019). Internship program as a part of technical and vocational education training (TVET). 5th UPI International Conference on Technical and Vocational Education and Training (ICTVET 2018), 471-474. https://www.atlantis-press.com/proceedings/ictvet-18/55913994
https://doi.org/10.2991/ictvet-18.2019.108
Aragon, I. B., & Valle, R. S. (2013). Does training managers pay off? The International Journal of Human Resource Management, 24(8), 1671-1684.
https://doi.org/10.1080/09585192.2012.725064
Arthur Jr, W., Bennett Jr, W., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234.
https://doi.org/10.1037/0021-9010.88.2.234
Baseer, N., Degnan, J., Moffat, M., & Mahboob, U. (2020). Micro-feedback skills workshop impacts perceptions and practices of doctoral faculty. BMC Medical Education, 20(1), Article 1. https://doi.org/10.1186/s12909-019-1921-3
https://doi.org/10.1186/s12909-019-1921-3
Becker, G. S. (1962). Investment in Human Capital: A Theoretical Analysis. Journal of Political Economy, 70(5, Part 2), 9-49. https://doi.org/10.1086/258724
https://doi.org/10.1086/258724
Becker, G. S. (1964). Human capital: A theoretical and empirical analysis, with special reference to education. https://library.econ.upd.edu.ph/ir/handle/123456789/6693
Bloom, R., & Kamm, J. (2014). Human Resources: Assets That Should Be Capitalized. Compensation & Benefits Review, 46(4), 219-222. https://doi.org/10.1177/0886368714555453
https://doi.org/10.1177/0886368714555453
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of Training: A Meta-Analytic Review. Journal of Management, 36(4), 1065-1105. https://doi.org/10.1177/0149206309352880
https://doi.org/10.1177/0149206309352880
Boselie, P., Brewster, C., & Paauwe, J. (2009). In search of balance-managing the dualities of HRM: An overview of the issues. Personnel Review.
https://doi.org/10.1108/00483480910977992
Bos-Nehles, Anna. C., & Veenendaal, A. A. R. (2019). Perceptions of HR practices and innovative work behavior: The moderating effect of an innovative climate. The International Journal of Human Resource Management, 30(18), 2661-2683. https://doi.org/10.1080/09585192.2017.1380680
https://doi.org/10.1080/09585192.2017.1380680
Campbell, D. T., & Stanley, J. C. (2015). Experimental and quasi-experimental designs for research. Ravenio books.
Chang, P.-C., Zhang, M.-J., & Wu, T. (2021). Developmental Human Resource Configuration, Unique Human Capital, and Employee Innovative Work Behavior: A Multilevel Moderated Mediation Model. SAGE Open, 11(2), 21582440211027964. https://doi.org/10.1177/21582440211027964
https://doi.org/10.1177/21582440211027964
Chiaburu, D. S., & Tekleab, A. G. (2005). Individual and contextual influences on multiple dimensions of training effectiveness. Journal of European Industrial Training, 29(8), 604-626. https://doi.org/10.1108/03090590510627085
https://doi.org/10.1108/03090590510627085
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/BF02310555
https://doi.org/10.1007/BF02310555
Dahiya, R., & Raghuvanshi, J. (2022). Validation of innovative work behaviour scale: Indian apparel manufacturing sector. Asia Pacific Management Review, 27(2), 120-136. https://doi.org/10.1016/j.apmrv.2021.06.002
https://doi.org/10.1016/j.apmrv.2021.06.002
De Jong, J., & Den Hartog, D. (2010). Measuring Innovative Work Behaviour. Creativity and Innovation Management, 19(1), 23-36. https://doi.org/10.1111/j.1467-8691.2010.00547.x
https://doi.org/10.1111/j.1467-8691.2010.00547.x
Dostie, B. (2018). The Impact of Training on Innovation. ILR Review, 71(1), 64-87. https://doi.org/10.1177/0019793917701116
https://doi.org/10.1177/0019793917701116
Dunnett, C. W. (1955). A Multiple Comparison Procedure for Comparing Several Treatments with a Control. Journal of the American Statistical Association, 50(272), 1096-1121. https://doi.org/10.1080/01621459.1955.10501294
https://doi.org/10.1080/01621459.1955.10501294
Field, A. (2013). Discovering statistics using IBM SPSS statistics. sage.
Gao, L., Lu, Q., Hou, X., Ou, J., & Wang, M. (2022). Effectiveness of a nursing innovation workshop at enhancing nurses' innovation abilities: A quasi-experimental study. Nursing Open, 9(1), Article 1. https://doi.org/10.1002/nop2.1080
https://doi.org/10.1002/nop2.1080
Grohmann, A., & Kauffeld, S. (2013). Evaluating training programs: Development and correlates of the Questionnaire for Professional Training Evaluation. International Journal of Training and Development, 17(2), 135-155. https://doi.org/10.1111/ijtd.12005
https://doi.org/10.1111/ijtd.12005
Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103(2), 265.
https://doi.org/10.1037/0033-2909.103.2.265
Hair Jr, J., Hair Jr, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2021). A primer on partial least squares structural equation modeling (PLS-SEM). Sage publications.
https://doi.org/10.1007/978-3-030-80519-7
Hidayat, R., & Wulandari, P. (2022). Structural Equation Modelling (SEM) in Research: Narrative Literature Review. Open Access Indonesia Journal of Social Sciences, 5(6), 852-858.
https://doi.org/10.37275/oaijss.v5i6.141
Hinkin, T. R. (1998). A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires. Organizational Research Methods, 1(1), 104-121. https://doi.org/10.1177/109442819800100106
https://doi.org/10.1177/109442819800100106
Hirst, G., Van Knippenberg, D., & Zhou, J. (2009). A Cross-Level Perspective on Employee Creativity: Goal Orientation, Team Learning Behavior, and Individual Creativity. Academy of Management Journal, 52(2), 280-293. https://doi.org/10.5465/amj.2009.37308035
https://doi.org/10.5465/amj.2009.37308035
Holton III, E. F., Bates, R. A., & Ruona, W. E. (2000). Development of a generalized learning transfer system inventory. Human Resource Development Quarterly, 11(4), 333-360.
https://doi.org/10.1002/1532-1096(200024)11:4<333::AID-HRDQ2>3.0.CO;2-P
Hung, T.-K. (2010). An empirical study of the training evaluation decision-making model to measure training outcome. Social Behavior and Personality: An International Journal, 38(1), 87-101.
https://doi.org/10.2224/sbp.2010.38.1.87
Jain, G., Sharma, N., & Shrivastava, A. (2021). Enhancing training effectiveness for organizations through blockchain-enabled training effectiveness measurement (BETEM). Journal of Organizational Change Management, 34(2), 439-461. https://doi.org/10.1108/JOCM-10-2020-0303
https://doi.org/10.1108/JOCM-10-2020-0303
Jalil, M. F., Ullah, W., & Ahmed, Z. (2021). Training Perception and Innovative Behavior of SME Employees: Examining the Mediating Effects of Firm Commitment. SAGE Open, 11(4), 21582440211067250. https://doi.org/10.1177/21582440211067250
https://doi.org/10.1177/21582440211067250
Janssen, O. (2000). Job demands, perceptions of effort-reward fairness and innovative work behaviour. Journal of Occupational and Organizational Psychology, 73(3), 287-302. https://doi.org/10.1348/096317900167038
https://doi.org/10.1348/096317900167038
Jehanzeb, K. (2021). How perception of training impacts organizational citizenship behavior: Power distance as moderator. Personnel Review, 51(3), 922-944. https://doi.org/10.1108/PR-07-2020-0566
https://doi.org/10.1108/PR-07-2020-0566
Jehanzeb, K., & Bashir, N. A. (2013). Training and development program and its benefits to employee and organization: A conceptual study. European Journal of Business and Management, 5(2).
Kalkbrenner, M. T. (2023). Alpha, omega, and H internal consistency reliability estimates: Reviewing these options and when to use them. Counseling Outcome Research and Evaluation, 14(1), 77-88.
https://doi.org/10.1080/21501378.2021.1940118
Kanter, R. M. (1988). Three tiers for innovation research. Communication Research, 15(5), 509-523.
https://doi.org/10.1177/009365088015005001
Kirkpatrick, D. L. (1959). Techniques for evaluation training programs. Journal of the American Society of Training Directors, 13, 21-26.
Kirkpatrick, D. L. (2009). Implementing the Four Levels: A Practical Guide for Effective Evaluation of Training Programs: Easyread Super Large 24pt Edition.
Korpi, T., & Tåhlin, M. (2021). On-the-job training: A skill match approach to the determinants of lifelong learning. Industrial Relations Journal, 52(1), 64-81. https://doi.org/10.1111/irj.12317
https://doi.org/10.1111/irj.12317
Leary, M. P., & Sherlock, L. A. (2020). Service-Learning or internship: A mixed-methods evaluation of experiential learning pedagogies. Education Research International, 2020. https://www.hindawi.com/journals/edri/2020/1683270/
https://doi.org/10.1155/2020/1683270
Longmore, B. (2011). Work-based learning: Bridging knowledge and action in the workplace. Action Learning: Research and Practice, 8(1), 79-82. https://doi.org/10.1080/14767333.2011.549333
https://doi.org/10.1080/14767333.2011.549333
Louw, A., & Katznelson, N. (2019). Transfer and reflection in the Danish dual model: Findings from development projects in the Danish vocational education and training programmes. Nordic Journal of Vocational Education and Training, 9(2), 51-70.
https://doi.org/10.3384/njvet.2242-458X.199251
Lukes, M., & Stephan, U. (2017). Measuring employee innovation: A review of existing scales and the development of the innovative behavior and innovation support inventories across cultures. International Journal of Entrepreneurial Behavior & Research, 23(1), 136-158. https://doi.org/10.1108/IJEBR-11-2015-0262
https://doi.org/10.1108/IJEBR-11-2015-0262
McNamara, J. (2013). The challenge of assessing professional competence in work integrated learning. Assessment & Evaluation in Higher Education, 38(2), 183-197. https://doi.org/10.1080/02602938.2011.618878
https://doi.org/10.1080/02602938.2011.618878
Milne, L., & Caldicott, J. (2016). Exploring differences in industry supervisors' ratings of student performance on WIL placements and the relative importance of skills: Does remuneration matter? Asia-Pacific Journal of Cooperative Education, 17(2), 175-187.
Mohammed Saad, A., & Mat, N. (2013). Evaluation of effectiveness of training and development: The Kirkpatrick model. Asian Journal of Business and Management Sciences, 2(11), Article 11.
Onraet, E., Van Hiel, A., Roets, A., & Cornelis, I. (2011). The closed mind: 'Experience' and 'cognition' aspects of openness to experience and need for closure as psychological bases for right-wing attitudes. European Journal of Personality, 25(3), 184-197. https://doi.org/10.1002/per.775
https://doi.org/10.1002/per.775
Palermo, C., Chung, A., Beck, E. J., Ash, S., Capra, S., Truby, H., & Jolly, B. (2015). Evaluation of assessment in the context of work‐based learning: Qualitative perspectives of new graduates. Nutrition & Dietetics, 72(2), 143-149. https://doi.org/10.1111/1747-0080.12126
https://doi.org/10.1111/1747-0080.12126
Pan, J., Guan, Y., Wu, J., Han, L., Zhu, F., Fu, X., & Yu, J. (2018). The interplay of proactive personality and internship quality in Chinese university graduates' job search success: The role of career adaptability. Journal of Vocational Behavior, 109, 14-26.
https://doi.org/10.1016/j.jvb.2018.09.003
Perdana, P. N., Armeliza, D., Khairunnisa, H., & Nasution, H. (2023). Research Data Processing Through Structural Equation Model-Partial Least Square (SEM-PLS) Method. Jurnal Pemberdayaan Masyarakat Madani (JPMM), 7(1), 44-50.
https://doi.org/10.21009/JPMM.007.1.05
Pineda, P. (2010). Evaluation of training in organisations: A proposal for an integrated model. Journal of European Industrial Training.
https://doi.org/10.1108/03090591011070789
Rosen, S. (1976). A Theory of Life Earnings. Journal of Political Economy, 84(4, Part 2), S45-S67. https://doi.org/10.1086/260532
https://doi.org/10.1086/260532
Sawrikar, V., Plant, A. L., Andrade, B., Woolgar, M., Scott, S., Gardner, E., Dean, C., Tully, L. A., Hawes, D. J., & Dadds, M. R. (2021). Global Workforce Development in Father Engagement Competencies for Family-Based Interventions Using an Online Training Program: A Mixed-Method Feasibility Study. Child Psychiatry & Human Development. https://doi.org/10.1007/s10578-021-01282-8
https://doi.org/10.1007/s10578-021-01282-8
Scott, S. G., & Bruce, R. A. (1994). Determinants of innovative behavior: A path model of individual innovation in the workplace. Academy of Management Journal, 37(3), 580-607. https://doi.org/10.2307/256701
https://doi.org/10.2307/256701
Seagraves, L., Osborne, M., Neal, P., Dockrell, R., Hartshorn, C., & Boyd, A. (1996). Learning in Smaller Companies. Final Report. ERIC. https://eric.ed.gov/?id=ED415350
Shah, S. T. H., Shah, S. M. A., & El-Gohary, H. (2022). Nurturing Innovative Work Behaviour through Workplace Learning among Knowledge Workers of Small and Medium Businesses. Journal of the Knowledge Economy. https://doi.org/10.1007/s13132-022-01019-5
https://doi.org/10.1007/s13132-022-01019-5
Srirahayu, D. P., Ekowati, D., & Sridadi, A. R. (2023). Innovative work behavior in public organizations: A systematic literature review. Heliyon, 9(2). https://doi.org/10.1016/j.heliyon.2023.e13557
https://doi.org/10.1016/j.heliyon.2023.e13557
Stoffers, J. M. M., Van der Heijden, B. I. J. M., & Jacobs, E. A. G. M. (2020). Employability and innovative work behaviour in small and medium-sized enterprises. The International Journal of Human Resource Management, 31(11), 1439-1466. https://doi.org/10.1080/09585192.2017.1407953
https://doi.org/10.1080/09585192.2017.1407953
Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2013). Using multivariate statistics (Vol. 6). pearson Boston, MA.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53.
https://doi.org/10.5116/ijme.4dfb.8dfd
Toner, P. (2011). Workforce Skills and Innovation: An Overview of Major Themes in the Literature. OECD. https://doi.org/10.1787/5kgkdgdkc8tl-en
https://doi.org/10.1787/5kgkdgdkc8tl-en
Topno, H. (2012). Evaluation of training and development: An analysis of various models. Journal of Business and Management, 5(2), 16-22.
https://doi.org/10.9790/487X-0521622
Varghese, M. E., Parker, L. C., Adedokun, O., Shively, M., Burgess, W., Childress, A., & Bessenbacher, A. (2012). Experiential Internships: Understanding the Process of Student Learning in Small Business Internships. Industry and Higher Education, 26(5), 357-367. https://doi.org/10.5367/ihe.2012.0114
https://doi.org/10.5367/ihe.2012.0114
Wang, G. G., & Wilcox, D. (2006). Training Evaluation: Knowing More Than Is Practiced. Advances in Developing Human Resources, 8(4), 528-539. https://doi.org/10.1177/1523422306293007
https://doi.org/10.1177/1523422306293007
WEF, W. E. F. (2016). The future of jobs: Employment, skills and workforce strategy for the fourth industrial revolution. In Global Challenge Insight Report. World Economic Forum Geneva. https://www.voced.edu.au/content/ngv:71706
Wennekers, S., & De Jong, J. (2008). Intrapreneurship; conceptualizing entrepreneurial employee behaviour. Scientific Analysis of Entrepreneurship and SMEs (SCALES).
Whiting, K. (2020). These are the top 10 job skills of tomorrow - and how long it takes to learn them. World Economic Forum. https://www.weforum.org/agenda/2020/10/top-10-work-skills-of-tomorrow-how-long-it-takes-to-learn-them/
Zhong, X., & Liu, Z. (2014). Studies on Creativity Enhancement of Contemporary College Students: 3rd International Conference on Science and Social Research (ICSSR 2014), Tianjin, China. https://doi.org/10.2991/icssr-14.2014.148
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 UNIMAS Publisher
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright Transfer Statement for Journal
1) In signing this statement, the author(s) grant UNIMAS Publisher an exclusive license to publish their original research papers. The author(s) also grant UNIMAS Publisher permission to reproduce, recreate, translate, extract or summarize, and to distribute and display in any forms, formats, and media. The author(s) can reuse their papers in their future printed work without first requiring permission from UNIMAS Publisher, provided that the author(s) acknowledge and reference publication in the Journal.
2) For open access articles, the author(s) agree that their articles published under UNIMAS Publisher are distributed under the terms of the CC-BY-NC-SA (Creative Commons Attribution-Non Commercial-Share Alike 4.0 International License) which permits unrestricted use, distribution, and reproduction in any medium, for non-commercial purposes, provided the original work of the author(s) is properly cited.
3) For subscription articles, the author(s) agree that UNIMAS Publisher holds copyright, or an exclusive license to publish. Readers or users may view, download, print, and copy the content, for academic purposes, subject to the following conditions of use: (a) any reuse of materials is subject to permission from UNIMAS Publisher; (b) archived materials may only be used for academic research; (c) archived materials may not be used for commercial purposes, which include but not limited to monetary compensation by means of sale, resale, license, transfer of copyright, loan, etc.; and (d) archived materials may not be re-published in any part, either in print or online.
4) The author(s) is/are responsible to ensure his or her or their submitted work is original and does not infringe any existing copyright, trademark, patent, statutory right, or propriety right of others. Corresponding author(s) has (have) obtained permission from all co-authors prior to submission to the journal. Upon submission of the manuscript, the author(s) agree that no similar work has been or will be submitted or published elsewhere in any language. If submitted manuscript includes materials from others, the authors have obtained the permission from the copyright owners.
5) In signing this statement, the author(s) declare(s) that the researches in which they have conducted are in compliance with the current laws of the respective country and UNIMAS Journal Publication Ethics Policy. Any experimentation or research involving human or the use of animal samples must obtain approval from Human or Animal Ethics Committee in their respective institutions. The author(s) agree and understand that UNIMAS Publisher is not responsible for any compensational claims or failure caused by the author(s) in fulfilling the above-mentioned requirements. The author(s) must accept the responsibility for releasing their materials upon request by Chief Editor or UNIMAS Publisher.
6) The author(s) should have participated sufficiently in the work and ensured the appropriateness of the content of the article. The author(s) should also agree that he or she has no commercial attachments (e.g. patent or license arrangement, equity interest, consultancies, etc.) that might pose any conflict of interest with the submitted manuscript. The author(s) also agree to make any relevant materials and data available upon request by the editor or UNIMAS Publisher.
