Regulatory Open Forum

 View Only

  • 1.  How do you check training effectiveness?

    This message was posted by a user wishing to remain anonymous
    Posted 18-Apr-2021 15:35
    This message was posted by a user wishing to remain anonymous

    How do you check training effectiveness?


  • 2.  RE: How do you check training effectiveness?

    Posted 19-Apr-2021 08:07
    I have seen clients provide a short quiz at the end of training and with a pass/fail sentiment which if failed asks them to take the training again - whether online or in person. In my experience however, having worked in-house and now supporting clients, I find the method of hypotheticals that uses some form of real life situations that the company has experienced and then having live training so that you can talk it through with them is honestly the best way to "check effectiveness". They can talk through it, see what policies/laws etc were affected and why, and how it is resolved. I think it is one of the best ways to see if the training resonated and it allows them to think it through vs. just being told through a didactic presentation. I also have provided a list of Q&As along with the training so they have it on paper.

    ------------------------------
    Alicia Whittlesey
    Counsel and Director of Compliance Services at Porzio Bromberg & Newman P.C.
    Westborough MA
    United States
    ------------------------------

    Original Message


  • 3.  RE: How do you check training effectiveness?

    This message was posted by a user wishing to remain anonymous
    Posted 19-Apr-2021 08:47
    This message was posted by a user wishing to remain anonymous

    Are you trying to check a box that says, 'yes, I verified training effectiveness'?
    Or are you trying to find out ​if the training was sufficient to guide people to perform as needed?

    I'd begin by considering what could go wrong if the training was not effective.
    If the risks are serious, you'll want to measure the results more carefully.
    Original Message


  • 4.  RE: How do you check training effectiveness?

    Posted 19-Apr-2021 09:32
    I have used quizzes, both at the end of reading a process or learning a task and as a periodic check-in. I've also used the review of audit finding and investigations to determine whether they were linked to inadequate training or lack of training. Whatever you do it needs to be more than a check in the box as previously mentioned.

    ------------------------------
    Keri Froese RAC
    Manager Compliance & Regulatory Affairs
    Healthsign
    Ottawa
    Canada
    ------------------------------

    Original Message


  • 5.  RE: How do you check training effectiveness?

    Posted 19-Apr-2021 09:43
    Good day...

    We have training assessment checklist for each area for which we have a training checklist.  It requires the supervisor to observe that each element on the training checklist is being properly performed.  We break our tasks into time frames...what the person should know after 2 weeks, 1 month, 3 months, etc.  We do the assessment at those points and record job order or work order or whatever else is relevant to the task to back-up the assessment information.

    Best regards,

    ------------------------------
    D Michelle Williams
    VP - Operations
    United States
    ------------------------------

    Original Message


  • 6.  RE: How do you check training effectiveness?

    Posted 19-Apr-2021 16:36
    Great solution options from our peers. 

    Relevant, but a bit off-topic, apologies in advance.

    Technology is changing the game. Take a look here https://www.youtube.com/watch?v=tSMgdrRETKA&t=78s  Technology that maps processes visually, provides training, and real-time competency evaluation. 

    It's a new world and paper-based and hybrid human-centric systems are being transformed with technology and AI. Soon work instructions, process monitoring, inspection, non-conformance management, and auto data collection with ERP & PDLM integration will be the norm.




    ------------------------------
    Michael Chellson
    MSc, RAC
    ------------------------------

    Original Message


  • 7.  RE: How do you check training effectiveness?

    Posted 20-Apr-2021 03:44
    Hi OP,
    there are. multiple ways to check effectiveness, from short quizzes to confirming operators can correctly identify product defects or meet some capability requirements.
    it all depends on the task and the level of risk associated with the task.  The greater the risk, the greater the level of effectiveness check is required.  We as manufacturers need to define this.  
    if you have a QMS that meets iso-13485, per clause 6.2 you would need to have this in place.
    hope this helps
    Seb


    ------------------------------
    Sebastian Clerkin
    Consultant
    Ballincollig
    Ireland
    ------------------------------

    Original Message


Related Content