Regulatory Open Forum

 View Only
  • 1.  Rationale for sample size - Verification and validation ISO 13485 requirement

    Posted 06-Jul-2020 08:56
    Dear all,

    I would like to ask for your opinion about the verification and validation activities carried out by an R&D department, before transfering the design to Production.

    Paragraphs 7.3.6 and 7.3.7 of ISO 13485 require that "The organization shall document verification/validation plans that include methods, acceptance criteria and, as appropriate, statistical techniques with rationale for sample size".

    Do you think that these statistical techniques with rationale for sample size are applicable only in a manufacturing contest - after the design transfer - or also during the development of the device when some V&V activities are performed?
    I am asking this because it is easy to figure out how to handle the final verification of the device, but is not so easy to decide how to handle the V&V activities carried out during the development of the device.

    ------------------------------
    Andrea Duca
    Albano Laziale
    Italy
    ------------------------------


  • 2.  RE: Rationale for sample size - Verification and validation ISO 13485 requirement

    Posted 06-Jul-2020 10:04

    The paragraphs apply to design verification and design validation, which are completed before design transfer.

    There is no requirement to use sampling plans. The requirement is that if use one you need to explain why you picked the sample size.

    Also recognize that there are other activities with similar names. Process validation, for example, is completed as part of design transfer. Product verification, called product release in 7.5.1.f, is applied through out the production process. Software validation is completed before releasing software or a change.

    None of these requiring sampling plans, but, when used, good practice documents the rationale for the sample size and the acceptance criteria.



    ------------------------------
    Dan O'Leary CQA, CQE
    Swanzey NH
    United States
    ------------------------------



  • 3.  RE: Rationale for sample size - Verification and validation ISO 13485 requirement

    Posted 07-Jul-2020 04:15
    Hello Andrea,

    The citations you are making come from the design control portion of the standard so this would apply to verification and validation testing, most would understand during design development, i.e. before design transfer.  However, in the existence of working in companies and being exposed to external audits, this does not always apply and can not follow the strictest sense of the standard.  For example, often times the design validation is happening in the middle of design transfer or even sometimes after design transfer.  In addition, often the manufacturing validation, process validations, product validations, may also occur be occurring around that time as well.  The simple answer is statistical rationale applies to all aspects of the device life time, from design and development through manufacturing.

    There are expectations in the industry, regardless whether citing specifically from a standard or regulation, if you are doing sampling for the medical device, there should be a rationale/justification for the sample size.  If there is verification testing in design where certain specifications are being tested - sampling can be done but needs to be defined and why.  During incoming inspection, sampling is performed - needs to define why number is taken.  If routine or spot sampling is done in manufacturing, there needs to be the reason and why the sample size is appropriate or sufficient.  There are also instances where you can leverage sampling during testing such as in verification you can do a large sample size and validation testing a small sample, or vice versa.  In the lifetime of the device, if sampling is performed there should be rationale or justification for the sample size.

    ------------------------------
    Richard Vincins RAC
    Vice President Global Regulatory Affairs
    ------------------------------



  • 4.  RE: Rationale for sample size - Verification and validation ISO 13485 requirement

    Posted 07-Jul-2020 08:19
    I get your point: we got a finding during an audit since the auditors said that picking just one device when performing a firmware validation activity is to be considered as a "sampling plan" with sample size = 1. Do you agree with this point of view?

    In fact, since we have made this kind of sampling, there was a rationale missing.

    ------------------------------
    Andrea Duca
    Albano Laziale
    Italy
    ------------------------------



  • 5.  RE: Rationale for sample size - Verification and validation ISO 13485 requirement

    Posted 07-Jul-2020 09:04

    I do not agree. I think the auditor missed the point. The requirement is to document, as appropriate, "statistical techniques with rationale for sample size". I don't see that you used a statistical technique, therefore the question of sample size should never have come up.

     

    The auditor could argue that you did use a statistical technique, sampling, and need to provide the rationale for the sample size. However, in my opinion, the auditor doesn't understand the concept of statistical techniques. Unfortunately, ISO 9000:2015 doesn't have a definition.

    My first reaction is that this is an example of bad auditing, and you should object to the nonconformance.

    On the other hand, it may not be worthwhile. If you accept the nonconformance, the implication is that you need to revise the design verification procedure, the design validation procedure, design verification protocols and reports, and design validation protocols and reports.



    ------------------------------
    Dan O'Leary CQA, CQE
    Swanzey NH
    United States
    ------------------------------