Svoboda | Graniru | BBC Russia | Golosameriki | Facebook
SlideShare a Scribd company logo
UI Beyond the Screen
17 Feb 2016
Jason Mesut
Founder, Resonant
Local Leader, IxDA London
@jasonmesut
We’re going to watch some videos this evening
Corning — A day made of glass 2
User Interfaces beyond the screen
How would these future solutions
work as part of your life?
What does your home look like?
Original iPhone
??
2007
—Direct manipulation
—Dynamic display
—Rich graphics

Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Original iPhone
??
2007
—Direct manipulation
—Dynamic display
—Rich graphics

Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knobs
Buttons
Switches
Levers and handles
I believe…
We should be designing products and services
that fit our worlds, and enhance our lives
What are the things you ?
People
Activities
Apps?
Technics 1200 SH-101
OP-1Tenori-On
I love
objects
Q-Bert
Technics
1200
Q-Bert
Technics
1200
Roland
SH-101
Q-Bert
Technics
1200
Milo Mesut
Yamaha
Tenori-On
Teenage Engineering
OP-1
Technics 1200 SH-101
OP-1Tenori-On
I love
objects
Why do I care about the
future of User Interfaces?
5years
Industrial Design
years
Digital User Experience
16
4years
Local leader
Interaction Design
Association
L o n d o n
Subjects over 4 years
Internet of Things
Future of publishing
Urban environment
Smart materials
Mobility / Automotive
Clinical applications
Smart home
Upcoming…
Music interfaces
Consumer healthcare
Working on a new transportation
service for past 2 years
Icons created by Vicons Design from the Noun Project
?
– Helps people unlock London
– Mobile apps and wider digital services
– Spaces, places, people, vehicles, interactions
– Various connected things
– Design trends and strategy
– Interaction design
– Visual inspiration
– Animations
– Video
Also conceiving future
UI for vehicles
2015 2017 2019 2021 2023 2025 2027 20292016 2018 2020 2022 2024 2026 2028 2030
Targeting a long term future
2015 2017 2019 2021 2023 2025 2027 20292016 2018 2020 2022 2024 2026 2028 2030
The earliest release
2015 2017 2019 2021 2023 2025 2027 20292016 2018 2020 2022 2024 2026 2028 2030
The time horizons digital designs for
2015 2017 2019 2021 2023 2025 2027 20292016 2018 2020 2022 2024 2026 2028 2030
How long the solution may exist for
2015 2017 2019 2021 2023 2025 2027 20292016 2018 2020 2022 2024 2026 2028 2030
Different time horizons
2015 2017 2019 2021 2023 2025 2027 20292016 2018 2020 2022 2024 2026 2028 2030
Future fuzziness
Safety vs. sales
– In-car UI
– Considering autonomous driving
– A long term future
UI/UX/SD/DSUser Interface User eXperience Service Design Design Strategy
I could talk about all of the above
User Interface
UI/UX/SD
What is a
User Interface?
UI/UX/SD
User Interface
UI/UX/SD
User Interface
A human that uses a product or service:
customer, employee, citizen, parent, child
UI/UX/SD
User Interface
A human that uses something
A medium for a user to understand
and control a product or service
UI/UX/SD
Classic diagram by Bill Verplank
Assessment
Thought
Comprehension
UI
Inputs
Outputs
System
Processes
Rules
Attention
Perception
Intention
Cognition
Sensing
Processes
Control actions
Assessment
Thought
Comprehension
UI
Inputs
Outputs
System
Processes
Rules
Attention
Perception
Intention
Cognition
Sensing
Processes
Control actions
Reaction
Action
See Hear Touch Smell Taste
Icons from Volodin Anton, hunotika, Deivid Sáenz, Jakob Vogel via the Noun Project
Speed of perception
Amount of information
Interpretation accuracy
Ability to ignore
++
++
+
+
++
+
-
-
+++
+
-
- -
-
+
-
- -
-
+
-
- -
See Hear Touch Smell Taste
See Hear Touch Smell Talk
Handles and buttons
Continuous (analogous) and
Discreet (digital)
Inputs
The best interfaces combine
both handles and buttons
eg, Touchscreen, mouse
Bill Verplank
User Interfaces beyond the screen
Graphical
User Interface
Allows users to
interact with
electronic systems
Visual Language
Motion Graphics
Information Design
Information Architecture
Interaction Design
Visual Language
Motion Graphics
Information Design
Information Architecture
Interaction Design
Visual language
Motion graphics
Information Design
Information Architecture
Interaction Design
Still relevant
But there’s more to
UI than just GUI
Physical
Telephone
Voice
Embedded
Distributed
Text
I want to talk you through
The future present
The future possible
The future likely
What you can do
What’s going on now?
The future present
We’re still getting to
grips with touchscreens
Touchscreens enable flexibility
We are often blind to their
Weaknesses
User Interfaces beyond the screen
We are still addressing the
Input problem of fingers on glass
User Interfaces beyond the screen
???
Steve lied
We do need
hard keys
???
Steve lied
We do need
a pointer
Screens dominating
Screens on
everything
Screens replacing
tactile controls
Screens in
front of babies
http://www.digitaltrends.com/wp-content/uploads/2013/12/fisher-price-ipad-apptivity-seat.jpg
What is going on
Beyond the screen?
Free space gesture
Wii
Leap
Theremin
Tiring
Coarse control
Confusion with natural gestures
Action != intention
Gestural
Nest Protect
User Interfaces beyond the screen
We’re
attracted to
magic like
magpies
Emerging hardware revival
Tech companies
buying hardware
companies + skills
Service
companies
selling hardware
Wearable
excitement
Something other than a
smartphone to design
Even if they make
us look ridiculous
A recipe for connected products?
+ +Physical
Product
Physical/ Digital
Interface
Digital
Services
Connected
product
=
Aesthetic 

Visceral. Visual, sonic, feel.

Interactive
Behavioural. Distribution of inputs and controls.
Experiential
Reflective. Fit with person’s context and ecosystems.
Key levels
of harmony
Components of integrated experience
+ +Physical
Product
Physical/ Digital
Interface
Digital
Services
Connected
product
=
What are the possible futures?
The future possible
Artificial Intelligence
How far can this go?
How far can this go?
Her
How far can this go?
Ex Machina
Natural UI
No such thing
as a natural UI
Ban the word intuitive
No UI
No UI is the best UI
Zero UI
The invisible interface
Most of the time
It’s still UI
Just not GUI
Less visual clutter
Less learning (in theory)
Less conscious interaction
Greater chance of false intention
User Interfaces beyond the screen
KISSKeep it Simple Stupid
An overly simplistic business cliche
YMCAYou Must Consider Alternatives
What I always think in response
Simplicity
Misunderstood and overrated
Displaced complexity
System rules
Mental models
User Interfaces beyond the screen
Complexity
Inevitable and important
Designers role
Tame complexity for
human + business advantage
Where should we focus?
The future likely
The future is already
here — it's just not very
evenly distributed.
William Gibson, 1993
Cliche
slide
Touch and gesture
will evolve
User Interfaces beyond the screen
Screen form factors
will evolve
Round screens
Any shape screens
Curved screens
We will see more
immersive interfaces
for niche applications
VR
You can now fly
Sony projector
Escapism or focus?
Gamers and experts?
Use sound more
Wayfindr
Physical controls will
augment screens
Integrated
automotive
interface
Texas Instruments

Immersive Automobile

Physical controls
designed in concert with
graphical user interface

User Interfaces beyond the screen
User Interfaces beyond the screen
We’ll see more
strokable surfaces
Roli
Seaboard
Roli 

Innovative expressive
piano. Keys you can bend.
User Interfaces beyond the screen
There will be more
distributed interfaces
Mainly knobs
Distributed controls and displays
Distributed controls
Distributed
knobs
Slick knobs
Knobs with
embedded
displays
One thing is for certain, although we
are entering a digital future,
the Knob is here to stay!
http://knobfeel.tumblr.com/
There will be buttons
Loads of buttons
And keyboards will
still be important
And older interfaces
will survive
Mice are precise
How can you better
focus for the future?
Get Physical and Digital
designers together
Connect on shared motivations and values
Calibrate language, practices and timelines
Create together
Make the future real
Beware concept videos
Tell real stories and demonstrate
with working prototypes
The Internet of
Ubiquitous
Computing
Information
Appliance Things is
growing

Prototype out loud
Tinkertronics
SAM Labs
SAM Labs
Shun the shiny
Don’t be a magpie
to the magical
The Future of User Interfaces?
Knobs
Buttons
Switches
Levers and handles
Knobs
Buttons
Switches
Levers and handles
Almost anything can be done physically or
digitally now. Now it’s about choice.
Understanding industrial Design
The Future of User Interfaces?
It’s like today, with
some small differences
— Politer interactions
— Evolved touch, gesture, voice, sound
— New screen form factors
— Physical controls augmenting displays
Thank you jasonmesut@gmail.com
@jasonmesut
slideshare.net/jasonmesut

More Related Content

User Interfaces beyond the screen