Regulatory Open Forum

 View Only
  • 1.  User Needs and Design Control

    Posted 03-Apr-2019 16:25

    ​In other recent discussions in this Forum, members have inquired about the relationship between user needs and design inputs. I offer an introductory icebreaker herein.  Like other Forum members, I'd be very interested in hearing others' related thoughts, experiences, and suggestions.


    The ultimate goal of the design and development process is to realize a medical device design that meets user needs and intended uses. As I note in my prior related Forum commentaries, proper construction of design inputs is an imperative step in this process.  But how do design inputs get properly developed?  Edwin Bills and Rem Siekmann are spot-on in directing this question toward understanding user needs.


    Though maybe not immediately obvious upon first review, FDA in its 1997 design control guidance document provides a nice bridge between user needs and design inputs. It hinges on the notion of product "concept". In a nutshell, many firms will generate something often called a "Customer Requirements Document", "Product Requirements Document", or the like.  Similarly, I've adopted the practice of developing a document I call a "Product Concept Document (PCD)".  An overview is given below.


    The marketing staff oftentimes holds the most organic understanding of customer and user needs. But the need for a new or revised product might arise from other sources such as scientific literature, general research, the manufacturing staff, or experience from prior device variants.  If pondering the feasibility of a particular product idea, then such intelligence should be memorialized and assessed prior to formal initiation of the regulated design & development process.  This should be done via a PCD championed by the "idea-initiator" to capture the targeted conceptual characteristics and basis for design of the product.


    FDA's notion of "concept" as well as other principles for creation of a PCD are provided below:

     

    • Product Concept Documents may not be technically comprehensive and should not be expected to be so.
    • The use of general and qualitative terms in the PCD is both appropriate and practical.
    • The PCD identifies the user needs / customer requirements, which will often be stewarded by the marketing staff based on various methods and sources such as, but not limited to, Voice of the Customer (VOC), personal conversation with customers, focus groups, surveys or questionnaires, literature review, "show and tell" sessions with customers, previous experience/precedents, direct observation of customers in the clinical work environment, lectures, presentations, etc.
    • As Edwin Bills points out, there can be multiple types of "user" or "customer", so be sure the needs of all potential stakeholders (internally and externally) are considered.
    • The user needs / customer requirements should be ranked, at the very least as "Essential" vs. "Nice to Have".
    • The PCD is a preliminary starting point for development, but is not to be confused with design inputs, which are derived later in due course by elaborating, expanding, quantifying, and transforming the PCD into a complete set of design input requirements written in measurable terms to an engineering level of detail.
    • Upon completion of the PCD, formal feasibility assessments may be performed using techniques such as Proof of Concept, rapid prototyping, preliminary hazard analysis, etc., in order to justify the feasibility of the proposed concept.


    If, after completion of the PCD and any feasibility work, it seems that the concept holds enough promise to justify further investment and formal development, then record an approval to initiate design and development. This marks the "official" start of the formal, regulated design & development process. The first several steps thereafter are tasks like delegating the Design & Development Team, preparation of a Design & Development Plan, and initiation of the Design & Development Inputs.

     
    Hope this helps,

    ------------------------------
    Kevin Randall, ASQ CQA, RAC (U.S., Canada, Europe)
    Principal Consultant
    ComplianceAcuity, Inc.
    Golden CO
    United States
    www.complianceacuity.com
    © Copyright 2019 by ComplianceAcuity, Inc. All rights reserved except for some narratives extracted from FDA's 1997 Design Control guidance document.
    ------------------------------


  • 2.  RE: User Needs and Design Control

    Posted 04-Apr-2019 07:30
    Interesting discussion on PCD, PRD, or whatever you want To call it.  I can tell you from working with large, mid-stage and very very small startups that I have only seen these concept phase documents in large and MAYBE mid-stage companies.  Never small start-ups.  It is always a challenge to create these after the fact, but something can be done during remediation as you build the DHF.

    Forcing small companies into shoes (processes)  of large  ones is never a great way to achieve buy-in from senior management, unless that management has previous positive experience working in a larger company with these systems and understands the value. Just getting any documentation in place is a win, then roll with it and refine to achieve what Kevin has mentioned.  You will get true believers by the second or third iteration, when you start design reviews or a submission, or after a first NB audit or FDA inspection.

    ------------------------------
    Ginger Cantor, MBA, RAC
    Founder/Principal Consultant
    Centaur Consulting LLC
    River Falls, Wisconsin 54022 USA
    715-307-1850
    centaurconsultingllc@gmail.com
    ------------------------------



  • 3.  RE: User Needs and Design Control

    Posted 05-Apr-2019 14:04
    I think Ginger is right - it rarely happens at smaller start ups, even though it is a well established design best practice. I think fundamentally this is because many starts ups are started by engineers or physicians with an almost intuitive concept. They may be able to express part of the user needs, but not a well defined set. It may be "far out" enough so that the users don't even know they need it, so they can't help much (though generally it is a good idea to try). So you get some engineers with a concept, tweaking as they go based on feedback. Sometimes it works - in fact it is often where truly revolutionary ideas come from. Many times it doesn't.

    An example I use with newer engineers is that "to design a great car for 2020 - you need robust user inputs (and a whole bunch of understanding of how you make tradeoffs between those inputs). However, it is unlikely that any amount of "user input" would have designed the first car. More than likely it would have designed a better train, or a better carriage. But many "great ideas" don't turn into cars and fail the test of meeting needs.

    The challenge as RA/QA pros in those small organizations is to determine how best to help, usually retrospectively, work out what those user needs those original ideas were really trying to meet, what likely concerns there were, and work from there. It is one thing I wish FDA would better recognize is that all great devices don't come from the same process - though generally I think they have done well using regulatory discretion to manage the differences.

    g-




    ------------------------------
    Ginger Glaser RAC
    Chief Technology Officer
    MN
    ------------------------------



  • 4.  RE: User Needs and Design Control

    Posted 04-Apr-2019 07:49
    Kevin,

    I think you have summarized this very nicely.  The place where I have seen the biggest disconnect between Marketing and Product Concept is the "must" and the "wants".  Marketing clearly puts the "wants" as necessary, but ignore the potential trade-offs.  Then, there is the need in many organizations to get something to the market within a certain time frame, potentially prioritizing some "wants" over others.  Your concept of a Project Concept Document as opposed to moving directly into a Project Specification Document provides what I think is a needed bridge.

    As Quality/Regulatory professionals, this early stage of Customer Requirements and Product Definition (be it called PSD, PRD, PCD or whatever) can be challenging.  I have encountered pushback from Marketing to document certain elements of customer feedback in terms of satisfying the Product Realization requirements of ISO 13485:2016; after all, much of it is hearsay but nevertheless valuable.  I believe this is the least understood phase of Design and Development, and because it involves several disparate groups can be difficult to manage. 

    Regards,
    James

    ------------------------------
    James Bonds J.D.
    Director Regulatory Affairs
    Atlanta GA
    United States
    ------------------------------



  • 5.  RE: User Needs and Design Control

    Posted 04-Apr-2019 08:17
    Great way to start the discussion with a rather complete set of facts around user needs. One example I use in establishing user needs is the marketing request for a "portable" product. This is not quite enough information for the design team. So the design input might identify that it is handheld which results in a usability requirement for size of hand and weight of product then potentially other requirements such as screen size, etc. 

    This process can go on a bit, but this gives a sense, I hope, of how the process evolves. 


    ------------------------------
    Edwin Bills MEd, CQA, RAC, BSc, CQE, ASQ
    Principal Consultant
    Overland Park KS
    United States
    elb@edwinbillsconsultant.com
    ------------------------------



  • 6.  RE: User Needs and Design Control

    Posted 05-Apr-2019 14:19
    I agree with Edwin, but I think that starts nowhere near high enough and is often the cause of many problems and "scope creep." So, to take his example - is "portable" the biggest user need to be met? Or is it really a "device they can use more easily in XYZ location?" or even "a device I can reuse more easily?" - I have seen many situations where the project "portable" is someones assumed solution to the real problem. Then, there is the hierarchy of user needs? Does the user need portable, or is a user need for improved safety, or improved visual resolution most important? Does making it portable add cost? will anyone pay for that? if so up to how much? Can the needed safety/resolution improvement can be made while also making it portable? If not, which is the real "user need?" If so, can it be done in the time/cost available? Is there an interim solution? Does it need to be backward compatible?

    In our space, you could even take it further and have scoping questions around "will making it portable impact reimbursement?" and the like. All of these need to be sorted out before starting the formal documentation of "user requirements" as part of the business decision on designing anything.

    One of my frustrations coming out or RA/QA and eventually running our entire technical organization is how many of the various RA/QA folks I have run into get very dogmatic and theoretical about this - for instance - thinking every complaint must be addressed in the next project because it came from a user - even if they may not be safety issues and don't address anywhere near the users biggest needs. Medical devices have improved for many many years by taking incremental steps to better meet user needs, and the idea that many have that there is one "right" set of user needs and related requirements in my mind has a significant risk of slowing down progress to a great degree.

    g-

    ------------------------------
    Ginger Glaser RAC
    Chief Technology Officer
    MN
    ------------------------------



  • 7.  RE: User Needs and Design Control

    Posted 04-Apr-2019 09:43
    Hi Kevin,

    What you describe is very similar to what my firm does, however one difference is that we approve a "user needs summary" or "user requirements" document that is part of the design controls deliverables, since we ultimately trace to design input requirements from those user needs/requirements. We may have a precursor document similar to your Product Concept Document, and those can be very marketing-focused or preliminary in nature, but we eventually document the user needs/requirements later on in a more formal manner with unique identifiers for easy tracing to inputs, outputs, and verification/validation evidence.

    I think either way works, and in some cases it could be less burdensome to not have that "extra" document as part of the design controls deliverables. However, I am also curious what other approaches people are using to align best practices. As already stated, keep in mind the different types of users of the product when doing this work. It is easy to forget those who might maintain the device in the field, for example.

    Thank you,
    Nathan

    ------------------------------
    Nathan Blazei
    Director, Regulatory Affairs
    Morrisville NC
    United States
    ------------------------------



  • 8.  RE: User Needs and Design Control

    Posted 04-Apr-2019 11:19

    Over the last 24 years I've certainly worked at a number of large companies, but mostly small companies (i.e., 1-25 employees).  During that tenure I've repeatedly seen the small companies document user/customer requirements in some kind of PRD, CRD, PCD, or other type of document. (Oftentimes I've found that such information has to a degree, already been characterized by sales/marketing in the corresponding general business plan). Many of the firms were already doing PRD/CRD/PCD's before my arrival and coaching. So, the frequency of the practice, even in small companies, seems to be more than that of a rare or endangered species.

    Remember that, by definition, this step of the process can be less formal than when the concept information is later translated into actual design inputs.  What I've seen be successful, and thus continue to recommend, is a template that is just 1-2 pages in length.  It should ask, say, 8-10 questions aimed at pinpointing topics like the proposed intended used / indications, the itemized/ranked user needs (often just worded in layperson or informal voice-of-customer terms), the targeted advertising claims, etc.  This approach gives companies wide liberty in the degree of information recorded in the document, thereby making it scalable for small and large companies alike.

    Though some companies or stakeholders may balk at this step, the work is likely already being done in some fashion. If you can persuade them to formalize the step a bit more, then the compliance and business dividends can be huge. I believe approaching the concept / user needs in this fashion will help soften the perception that the step is too burdensome.



    ------------------------------
    Kevin Randall, ASQ CQA, RAC (U.S., Canada, Europe)
    Principal Consultant
    ComplianceAcuity, Inc.
    Golden CO
    United States
    www.complianceacuity.com
    © Copyright 2019 by ComplianceAcuity, Inc. All rights reserved.
    ------------------------------



  • 9.  RE: User Needs and Design Control

    Posted 05-Apr-2019 16:33
    Seems like this topic has been pretty thoroughly discussed, but I will add a bit more.  One is the difference between "users" and "customers."  Sales and marketing tends to think in terms of "customers," meaning who is going to actually buy the product.  Design engineers (good ones) tend to think more in terms of the actual users, which more and more are not the customers.  Users and customers often have very different requirements.  In the long run, it is usually in everyone's best interests to meet the needs of the users.  In the short term, often no one even recognizes the difference, and also may overestimate the "customer's" understanding of the "user's" needs.

    ------------------------------
    Julie Omohundro, ex-RAC (US, GS), still an MBA
    Principal Consultant
    Class Three, LLC
    Mebane, North Carolina, USA
    919-544-3366 (T)
    434-964-1614 (C)
    julie@class3devices.com
    ------------------------------