Printlab Autodesk

7 – Test + Iterate

In this Make:able toolkit, we’ll be guiding you in testing and refining your prototype until you reach a final life-improving solution for your end user. Watch the overview video below before going through the sections to plan and implement your iteration strategy.

 

 

 


* As you test and iterate, bear in mind how long you have left for the challenge and don’t forget to save some time to create and edit your video submission!


Here are a range of methods you might use in the iteration phase. As you’ll see, there are both testing methods and evaluation methods to help you determine what improvements to make. Browse through and select ones that might be suitable for your challenge.

A person getting into their car using an assistive handle.

User Testing

The most effective way to improve your prototype is through end user testing. A good method to try is 'Think Aloud Testing', which involves your end user talking through their thoughts as they test your product. When performing user testing methods, refrain from putting words in your end user's mouth. Let them express their own thoughts and observe every action they take. Check out the user testing reel below for inspiration.

Watch User Testing Reel

Roleplay/Simulation

If you cannot meet with your end user for testing, roleplay and simulation activities are a great alternative. Even if you can meet your end user, you might want to consider doing this to experience first hand how your device works. Try and figure out the best way to simulate your end user's disability - whether this be blindfolding yourself, using an arthritis simulation glove or even taping parts of your body to restrict movement.

An online survey highlighting the question - 'How satisfied are you with the comfort of the product?'

Survey

While user testing and interviews may provide more authentic feedback, surveys offer another valuable option. They are particularly useful when engaging with end users who may feel less comfortable vocalising their thoughts or when seeking input from a larger group. Surveys can be completed either on paper or through online apps, providing flexibility and ease of use.

An example evaluation matrix.

Evaluation Matrix

An evaluation matrix can be used to analyse products and prototypes. It involves defining multiple criteria to evaluate, before mapping out positive and negative aspects of each one. Although a simple concept, it ensures your evaluation is thorough and not confined to a single area of the design. The method can be used in combination with user testing or team testing/simulations. Download the instruction below.

Download Instructions

Example importance difficulty matrix.

Importance Difficulty Matrix

An importance difficulty matrix is a great method to use when deciding what improvements to make. In many cases, time and difficulty plays a huge part in what can be improved. This method helps you to prioritise your iteration idea and prompts you to be realistic about what is achievable.

Download Instructions

Feature Variation Models

Feature variation models involve making and testing multiple prototypes simultaneously. The idea is to make each model the same with the exception of 1 design feature, which is varied across the models. By making, testing and analysing multiple models at the same time, you can save time during the design process and come to a decision on how best to design the feature you’re exploring. This method should be used when you have a particular design in mind but want to experiment with a certain aspect of it. Additionally, the method works best with small-scale objects that don’t take long to manufacture.

Workbook
  • In the ‘Iteration Methods’ area of Section 7, select the checkboxes of the methods you intend to use. There are blank spaces included in case you want to list/use methods that are not highlighted in the toolkit.

Here are a variety of tips and strategies to consider for your iteration phase. As you browse through, make notes of any key points that could help you in testing and iterating.

Kevin Kennedy from PDO in front of an Ultimaker 3D printer.

Iterative Design

Kevin Kennedy from Product Design Online (https://productdesignonline.com/) gives us an overview of iterative design and its purpose.

Watch Video

Embrace Failure

If you go in to the iterative design process thinking you're going to get it right first time, there's a good chance you'll be disappointed. Learn to embrace failure and have a positive mindset, even when you make mistakes (which you will!)

Honest Feedback

Your end user may be inclined to only give you positive feedback because they are appreciative of your efforts and don't want to offend you. In order to get them comfortable with being critical, let them know that you aren't expecting your prototype to be perfect and encourage them to be honest and constructive with their feedback.

Alex from DiveDesign.

Small Changes

Alex from DiveDesign provides us with his top tip for prototyping. Check out the below video where Alex talks us through the benefits of making small changes when iterating.

Watch Video

Workbook
  • In the ‘Iteration Tips’ area of Section 7, write down 3 key tips to remember/consider when testing and iterating.

In this section, we highlight several examples of how other teams have documented the test and iterate stage of their journey. Browse through the gallery and make note of how you could document your own journey. Once you’ve completed this task, test and iterate until you reach a final product you are happy with!

User Testing

We recommend documenting as much footage of your end user as possible, including them testing your prototypes. When doing this, remember to ask for their permission and take measures to ensure they are comfortable throughout the process.

Iteration Models

Don't forget that we want to see your iterations. This team did a great job with this shot where they laid out their iterations on a table and captured a quick camera shot across them. Simple, quick and effective!

Part Testing

Don't be afraid to show iterations that don't look like fully refined solutions. We enjoyed how this team documented a functionality test of just a small part of their overall model.

Evaluation Methods

As with previous stages of the design process, you might want to show evaluation methods you used. In this example, the team shares a a top down view of an evaluation matrix. In their final video, they don't talk through every aspect of the evaluation matrix, but showing the short clip is evidence that the team went through a rigorous iteration process.

Close-Up Shots

Close-up shots of your iterations and final product are a great way to add contrasting elements to your final video.

Final Model Presentation

Showing your final product being used in context is much more powerful than simply photographing your 3D prints. Try and capture the moment your end user is presented with your solution but if this isn't possible, document some footage of your team using the product.

End User Interview

Whilst presenting your end user with their solution, why not ask them to talk about their thoughts and opinions on camera. If they aren't comfortable on camera, make notes of what they say and include this information as a voice over or text overlay in your final video.

Branding

Although not a requirement, branding your product can give your video a creative and professional look. Why not give your product a name and logo like in this example.

Workbook

Before you implement your iteration strategy:

  • In the ‘Documentation Strategy’ area of Section 7, write down how your iteration phase will be documented.

 

After you’ve completed your iteration strategy:

  • In the ‘Iterations’ area of Section 7, upload 2 key images of your first iteration in a landscape format. This might be an image of the process (E.g. user testing), plus an image of the 3D printed iteration.
  • Write a summary of iteration 1 in the space provided.
  • Repeat the above 2 steps for your next iterations. The workbook provides space to upload information about 4 iterations, but don’t worry if you didn’t develop this many. You can, for example, leave the iteration 4 area blank if you didn’t create a fourth iteration.
  • In the ‘Final Product’ area, write down a name for your product. Then upload a series of visuals that best show off your final product. This might be professional photos, renders, or other media techniques. We recommend showing your product in context for best results (i.e. Being used by your end user).
  • Write a summary of your final product in the space provided. Include a brief overview of how the product works and why it was designed in the way it was.
  • List 5 key features of the final product in the space provided.

Here is a selection of optional resources that you may wish to watch/use, depending on your challenge context and time constraints.

Make:able Champion, Cath, holding Pinchee - a 3D printed pinching game aimed at supporting users with arthritis. The title 'Test + Iterate' is overlaid in white bold text.

Rob's Challenge

In this stage of Rob’s Make:able Challenge, he takes you through his testing and iterating phase to reveal the final product for Cath.

Multiple 3D printed iterations of DRAG - an assistive writing device. The title 'A design is never done' overlaid in white text.

A Design is Never Done

In this video, Rob shows you the process he took to refine one of the submissions to the Make:able Challenge. The aim of the video is to highlight the steps and rigour required in the iteration process.

Watch Video


Before moving on to the next toolkit, you should have achieved the below objectives.

  1. I evaluated the functionality, ergonomics, aesthetics and production methods of my prototype.
  2. I used my evaluation data to develop improved iterations of my prototype.

If you are using the workbook, you can tick these off at the bottom of Section 7, and make note of any key learnings or important things to remember.

 

Go to Next Toolkit – Share your Story