• A bit about myself and the team
• Project Overview
• Introduction to User experience
• Behavioural Design
  • Behavioural Intervention Technologies (BITs)
• UX Evaluation Methods (UXEM)
• Design Factors

A bit about me

About myself:

I'm a fifth year Phd student at York University in the Department of Psychology in the Quantitative Methods area. My research interests are loosely about open science practices, statistical pedagogy, Monte Carlo Simulations, effect size estimates, and integrating technology into classrooms. I've taught introduction to using R and the Tidyverse short courses, as well as workshops on data cleaning and preregistration.

About the team:

• Monique Herbert
• Andreja Stajduhar
• Nahuel Melgarejo
• A certain 6yo who hijacks most of my meetings and loves to "code"

Project Overview

In it's current stage, the main goal of this project was to develop a series of interactive web applications which can teach students some basic data cleaning techniques.

Goals

• Make a resource which students will actually use (not just that I think they will use)

• Incorporate many GAISE (2016) recommendations

  1. Teach statistical thinking.
  2. Focus on conceptual understanding.
  3. Integrate real data with a context and a purpose.
  4. Foster active learning.
  5. Use technology to explore concepts and analyze data.
  6. Use assessments to improve and evaluate student learning.

Guidelines for Assessment and Instruction in Statistics Education, 2016

User Experience (UX)

UX includes a user’s “emotions, beliefs, preferences, perceptions, physical and psychological responses, behaviours and accomplishments before, during, and after use”

ISO 9241-210:2019

Designing learning-focused content, and the organizational structure of that content, needs to consider UX (and by extension accessibility) right from its inception if it aims to effectively accomplish its learning objectives.

Germonprez, Hovorka, & Gal, 2011

Behavioural Design

A common behavioural design model is the Fogg Behavioural Model (2002, 2009) for developing persuasive design technologies

• Motivation, ability, prompt/trigger
• 8-step design process

Lockton, Harrison, and Stanton's (2010) Design with Intent Method (DwI)

• Incorporates behavioural economics
  • Kahneman and Tversky's work on heuristics and biases
• Focus on six lenses of influencing behaviour
  • Architectural, errorproofing, persuasive, visual, cognitive, and security lens

Behavioural design is already in use for online health interventions and can be leveraged to increase the effectiveness of interventions

Schneider, van Osch, & de Vries, 2012

Photo by Karl Solano on Unsplash

Photo by Pankaj Patel on Unsplash

Behavioural Intervention Technology Models (BITs)

BITs refers to

behavioral and psychological interventions that use a broad range of technologies, such as mobile phones, the Web, and sensors, aimed at changing behaviors and cognitions related to health, mental health, and wellness.

Mohr, Schueller, Montaque, Burns, & Rashidi, 2014;

BITs have four components:

Digital Nudges

Goal is to guide users' attention to specific aspects of designs.

• Animation
• Anchoring effects
• Use of color
• Use of Icons

Aims (the why)

• Students to have resources they can consult and come back to.

• Students to gain a deeper understanding of data (where it comes from, how to use it, etc.)

• Software independent

• Avoiding the use of statistical jargon

• Essentially removing barriers students have which we see coming up perennially in the intermediate statistics lab

• Partial success if students actively engage in in the interactive components of the website

User Experience Evaluation Methods

Perhaps the hardest part of this project was how to measure success of our goals

First I had to decide what to measure and then how to measure it.

Saffer, 2010

UXEM Taxonomies

1. Research type
   • Survey and expert evaluation
2. Development phase
   • Design and prototype
3. Type of Data
   • quantitative and qualitative
4. Type of Users
   • "normal" user and subject matter experts
5. Time restriction factors

Rajeshkumar, Omar, Mahmoud, 2013

UXEM

I know roughly who the "normal" uses will be (recruited via the undergrad participant pool)

I also am hoping to recruit the experts (along with my committee members)

Design Features

1. Navigation

Design Features (cont)

2. Graphical representation

Design Features (cont)

3. Organization

Design Features (cont)

4. Content Utility

Design Features (cont)

5. Purpose

• Is there a clearly state purpose
• Does the user know the purpose of each section
• Does the user know what is expected of them at each point of the activities?
• Are the "learning objectives" clear?

Design Features (cont)

6. Simplicity

Design Features (cont)

7. Readability

Technical Specs and Project Sustainability

This entire project was made using RStudio with many fantastic packages:

• {renv}
• {blogdown}
• {DT}
• {plotly}

Skills to pay the bills:

• javascript
• R
• HTML
• CSS
• Hugo/Go
• GitHub
• Netlify
• Google Analytics