Immersive Data (Simple)
IBM Immersive Data
Augmented Reality data analysis tool for mobile
project description
Immersive Data uses the power of 3D to allow data scientists to quickly discover valuable relationships and patterns. The product targets analysts who normally spend tons of time trying to find insights amongst massive amounts of data. This project displays the transition from the Immersive Insights headset experience to the Immersive Data mobile experience (for iOS devices), and how we integrated this product into IBM’s Augmented Data Explorer tool.
my contribution
I worked directly with developers and data analysts to create a mobile app. I designed user journeys, interactive prototypes and animations. I conducted generative user research and user testing sessions to understand user pain points and compiled competitive analysis to understand the current market for 3D data analysis products. I created promotional videos that were shown at several IBM events and conferences around the world and presented a keynote of the product at the XRDC conference in 2018.
““The way we analyze data now doesn’t make sense. With a 3D graph you’ll have more degrees of freedom which will lead you to interesting correlations. This will be more intuitive for people.””
User Research
Product Definition
After some initial research we were able to map out a typical data analysis workflow. Breaking up the process into digestible pieces helped us understand the data science process and progress towards the user’s goals.
Usage Scenarios
Our interviews with data scientists gave us evidence that, while data analysts are still our primary users, business executives and business analysts could also benefit greatly from using Immersive Data as a way to communicate important insights. We added these positions to our map to see where all 3 of these roles overlap in the data science process.
Low Fidelity Sketches
I started by focusing on the most important components that all data analysis tools need to have. These include filtering data points, manipulating axes and organizing data points by category.
Transitioning from a hands-free AR headset to a mobile device means less room on the screen for UI components. I had to be selective with how many elements to show on the screen at once in order to keep the user focused.
Key User Flows
User Onboarding
Log in or try out the app as a new user.
select & open visualization
Choose a visualization from the menu and watch your plot appear before you. Use global menus for project and plot interactions.
core action: explore visualization
Swap variables on any of the 3 axes, color by category, filter points, and inspect data point details further in the collection box.
MANIPULATE VISUALIZATION
Remove the visualization from the scene or save it for later.
Final Designs
axis configuration
The user can select a variable for each of the three axes to visualize different scenarios.
collect points
After a point is selected its corresponding details pop up in the collection box, a place the user can explore information further, on the right.
color by
The user can choose how to categorize the data points by color.
Column selection
Each data point has various types of information associated with it. With the column selector, users can choose exactly which categories they want to see and compare points with one another.
Filter
Filter the visualization and narrow it down to a preferred subset for a closer look.
Plot comparison
Pull in additional visualizations to compare one or more plots side-by-side.
POINT Selection
If a certain data point is of interest, the user can select it to explore its details further in the collection box. The point will remain highlighted until it is unselected.
Remove points
Select one or multiple points to remove from the collection box to reduce clutter.
save visualization
After exploring the data and finding interesting insights, the user can save this visualization just the way it is to revisit later.
pulse + halo
In a sea of data points, it can be hard to make sure you are selecting the right one. With a combination of a pulse scale effect and a halo, the user can easily identify which point they selected.
rotate
A quick action for the user to see the data from multiple perspectives while staying in one place. A billboarding effect has been added to ensure the axis labels always face the user no matter where they are located.
Scale
Users need to be able to see the visualization both from a distance and up close. This allows them to do so quickly and easily.
Outcome
Our product has been showcased at several conferences around the world. We provided iPhones and iPads at booths so attendees could experience it themselves, and members of our team have presented keynotes as well. This generated a lot of interested from multiple large companies including American Express and NASA.
Keynote at XRDC 2018
XRDC is an AR & VR conference showcasing innovation across the board, ranging from gaming to enterprise software. My colleague, Reena Ganga, and I explained how IBM is transforming the world of data analytics using Augmented Reality. We also addressed design challenges we’ve faced throughout the process and how we’ve navigated through the uncharted territory associated with emerging technology.