Wednesday, February 10, 2016

The traditional web survey is dead

Why we should throw out most of what we know on how to visually design web surveys

In 2000, web surveys looked like postal surveys stuck onto a screen. Survey researchers needed time to get used to the idea that web surveys should perhaps look differently from mail surveys. When I got into survey methodology in 2006, everyone was for example still figuring out whether to use drop down menus (no), how many questions to put on one screen (a few at most), let alone whether to use slider bars (it's not going to reduce breakoffs).
We now know that good web surveys don't look like mail surveys. Proponents of 'gamification' in surveys argue that survey researchers are still underusing the potential of web surveys. Perhaps they are right. So, while web surveys are ubiquitous, and have been around for almost 20 years, we still don't exactly know to to visually design them.

The next challenge is already upon us. How are we going to deal with the fact that so many surveys are now being completed on different devices than computers? Touch screens are getting more popular, and screens for smartphones can be as small as 4 inches. People are nowadays using all kinds of devices to complete surveys. The rules for how a questionnaire should look like on a 21 inch desktop monitor are in my view not the same however as for a 5 inch Iphone.

Just take the following picture as an example. It was taken from the Dutch LISS panel in 2013, before they came up with a new and much better design for mobile surveys. Yes this is still what many people still see when they answer a survey question on a smartphone. Is this the way to do it? Probably not. Why should there be a 'next' (verder) button at the bottom of the page? Can't we redesign the answer scale so that we use more space on the screen?
 

Small touchscreens ask for a different design. Take the picture below. Tiles are used instead of small buttons, so that the entire screen is used. There is no next button; once you press a tile the next questions shows up. To me this looks better, but is it really? Only proper (experimental) research can tell.

I also still see lots of problems with adapting our visual design to smartphones. Where to put the survey question in the example below? On a separate page? What if respondents tick a wrong answer? And, what if some respondents get this question on a PC? Should the questions look the same to minimize measurement differences, or be optimized for each device separately? Web surveys are dead. Mixed-device surveys are here to stay.


I think there are lots of opportunities for exciting research on how to design surveys for the new era of mixed-device surveys. For anyone interested, I recently edited an open-access special issue on mixed-device surveys together with Vera Toepoel, where different authors for example study:

- why using slider bars is a bad idea for (mobile) surveys
- the effects of device switching within longitudinal surveys (study 1 and study 2) on data quality
- different possible visual designs for implementing mixed-device surveys, and their effects on data quality

These studies are just the beginning. Much more is necessary, and it will take trial, error and probably another 15 years before we have figured out how to design surveys for mixed-device surveys properly.

21 comments:

  1. i have door all the feedback and hints posted by using the visitors for this article are entirely suitable-humored,we will watch for your adjoining article accurately by using yourself.thanks! https://advertisingsolutions.co.za/

    ReplyDelete
  2. Many homework on the continual hunt along with offstage on the road to winning. Definitely not attached, simple to-fall as a result of wayside; And not investigation, afterward into a path travel toward the black. Visit website

    ReplyDelete
  3. At Divus Design we have few guidelines and bouderies to our workArticle Hunt, anyway we generally structure our inventive reasoning around these four words - CLEAN - Straightforward - Crisp - Calculated.Webdesign Webshop

    ReplyDelete
  4. Webdesign. Sterke groeiambities en hoge ROI verwachtingen? Webdesign bureau Sempris lanceert uw bedrijf digitaal met professioneel en betaalbaar webdesign..Webdesign

    ReplyDelete
  5. This is my first time visit to your blog and I am very interested in the articles that you serve. Provide enough knowledge for me. Thank you for sharing useful and don't forget, keep sharing useful info: Webdesign

    ReplyDelete
  6. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work... Webdesign

    ReplyDelete
  7. This is a great article thanks for sharing this informative information. I will visit your blog regularly for some latest post. I will visit your blog regularly for Some latest post. Webdesign

    ReplyDelete
  8. I recently found many useful information in your website especially this blog page. Among the lots of comments on your articles. Thanks for sharing. Webdesign

    ReplyDelete
  9. I need to to thank you for this very good read!! I definitely loved every little bit of it. I have you bookmarked to check out new things you post… Webdesign

    ReplyDelete
  10. Hello! I just wish to give an enormous thumbs up for the nice info you've got right here on this post. I will probably be coming back to your weblog for more soon! Webdesign

    ReplyDelete
  11. This is a great article thanks for sharing this informative information. I will visit your blog regularly for some latest post. I will visit your blog regularly for Some latest post. Webdesign

    ReplyDelete
  12. Thanks For sharing this Superb article.I use this Article to show my assignment in college.it is useful For me Great Work. Webdesign

    ReplyDelete
  13. This is a great post. I like this topic.This site has lots of advantage.I found many interesting things from this site. It helps me in many ways.Thanks for posting this again. Webdesign

    ReplyDelete
  14. I recently found many useful information in your website especially this blog page. Among the lots of comments on your articles. Thanks for sharing. Webdesign

    ReplyDelete
  15. Webdesigner waar u een professionele en betaalbare website kan laten maken? De nr. 1 webdesigner in Limburg, Antwerpen en Vlaams-Brabant voor SEO websites. Webdesigner

    ReplyDelete
  16. This is a great post. I like this topic.This site has lots of advantage.I found many interesting things from this site. It helps me in many ways.Thanks for posting this again. Webdesign

    ReplyDelete
  17. I think this is an informative post and it is very useful and knowledgeable. therefore, I would like to thank you for the efforts you have made in writing this article. Webdesign

    ReplyDelete
  18. Took me time to read all the comments, but I really enjoyed the article. It proved to be Very helpful to me and I am sure to all the commenters here! It’s always nice when you can not only be informed, but also entertained! Webdesign

    ReplyDelete
  19. 1 Ways connections, Recips, 3 Ways, Article, Directory (free and a chosen few paid), Forum Sigs, Offsite Blogs, Blog Comments, and Press Releases. Webdesign

    ReplyDelete
  20. Your page may be completely relevant to their search,Web design company gurgaon but if visitors cannot access the content easily across a number of devices, your site may receive a less than positive review and be placed lower in the search results.

    ReplyDelete
  21. I recently came across your blog and have been reading along. I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often. Webdesign bureau

    ReplyDelete