Overview

The evolving workforce structure and technological change demands stronger and more continuous connections between training and productivity / employment. On that account, HRDF is committed to navigate this imminent change by rapidly redefining this competitive landscape and adapting to the volatility of marketplace dynamics. Consequently, this shift requires a transformation of traditional training market into ‘Contestable Training Market’ that supports the on-going learning innovation.

There are three (3) main focus areas to achieve the desired Contestable Training Market:

Performance Based Contracting;
Transparent Criteria for Training Provider Accreditation; and
Information on Training Provider Performance and Quality.

Hence, the Research and Development (R&D) Department of HRDF has embarked on HRDF’s Training Effectiveness Evaluation and developed an Evaluation Framework to enforce and expand the Output and Outcome-based assessment for all HRDF’s schemes and initiatives. This significant shift will create a learning function that focuses predominantly on understanding the business needs and providing access to learning at the point of need.

Evaluation Framework

An Evaluation Framework was developed to ensure continuous improvement of HRDF’s Training Schemes and Initiatives through a structured evaluation mechanism that can help in making learning and development more effective and efficient.

Output and Outcome Assessment

There are two types of post-course evaluation assessment, which trainees will receive upon completion of training course:

1

Output Assessment

It assesses immediate reaction of trainees and able to capture the training experience from trainees’ perspective. Issued to trainees on the final day of the course, it measures course quality, trainees’ learning experience towards the training delivery and resources, and customer service of the training provider through HRDF’s’ standardised Output Assessment.

2

Outcome Assessment

It is an overall result of the training implemented after a specific duration. It assesses the actual understanding and the usage/application after the training. Issued to trainees at least six (6) months after the course ended, it measures whether trainees have successfully achieved the desired objectives of a specific scheme / initiative through identified leading indicators / learning objectives.

Learning Outcomes must meet the SMART approach criteria, which stands for Specific, Measurable, Achievable, Realistic, and Time-bound.

Benefits

The benefits of this initiative are to:

Employees

Provide a convenient and flexible access to choose the right training, which most likely meet their needs; and
Provide clear understanding and better expectation towards the learning outcomes.

Employers

Provide an extensive market with wide range of training with actionable learning insights;
Provide consistent comparison across similar courses to make informed decisions when selecting a course; and
Provide measurable results and reporting on each course.

Training Providers

Allow training providers to benchmark performance;
Identify areas for improvement for individual courses;
Enables to improve training delivery through consistence feedback; and
Access to immediate feedback and recognition from participants.

Government

(Macro Level)

Overall performance benchmark of Training Industry in Malaysia;
Deep analytics capability to assess impact of training investment; and
Enables to increase value and efficiency of industry skill needs through efficient training investment.

Progressive Rollout

The HRDF Training Effectiveness Evaluation will be rolled out progressively to all HRDF Strategic Initiatives and Operational Initiatives by the second quarter of 2020.

*

Phase 1

Phase 1 is a small-scale pilot implementation phase that has been commenced in second quarter of 2019 that focuses on four (4) HRDF Strategic Initiatives Pillars namely Pre-Employment, Employment, Post-Employment and Learning Ecosystem and Landscape.

*

Phase 2

Phase 2 constitutes the expansion phase of the pilot. This is an actual implementation of Output and Outcome Assessment using a manual method, which covers all HRDF Schemes / courses. Moving forward, the assessment will be implemented using a new centralised assessment system/ Learning Market System (LMS) targeted for completion by the end of second quarter of 2020.

Roadshow

During this pilot phase, several stakeholders’ engagement sessions have been scheduled from August until end of 2019. Stakeholders are encouraged to actively participate in those sessions for better understanding and implementation of HRDF Training Effectiveness Evaluation.

Resources

Output Assessment Form

Download

HRDF Training Effectiveness Evaluation