Research & Design Portfolio
TitleCard.jpg

L-RROI


Lrroi.jpg

Overview

Team: John Sykes, Tyler La, Angela Yung, Yomna Huwas
Client: NASA Jet Propulsion Laboratory
Class: MHCI+D Master’s Capstone
Role: Lead Researcher, Synthesis, Competitive Assessment, Interaction Design, Prototyping
Duration: 6 Months
Methods: Literature Review, Competitive Analysis, Expert Interviews, Directed Storytelling, Iterative diagramming, Brainstorming, Sketching, Storyboards, Rapid Iterative Testing & Evaluation (RITE), Paper Prototyping, Remote Usability Testing

Challenge

To enhance mission efficiency, the The Mars 2020 team at NASA Jet Propulsion Laboratory (NASA JPL) is working to reduce rover daily planning time from 12 to 5 hours. Rover planning at JPL is a complex decision-making process, requiring consensus among various scientific and engineering teams to maximize discovery while maintaining the safety of the rover.

 

How might we enable scientists to make better decisions by augmenting their understanding of Martian weather conditions?

Solution

Over 6 months, my team worked with NASA JPL to research and design L-RROI, a web-based platform that visualizes atmospheric opacity (tau) to help scientists quickly understand its impact on instruments and improve the decision-making process.

Final Concept

Long-term Routing and Rover Instrumentation (L-RROI) is a web-based platform that uses the predictability of tau to help the mission teams shift from short-term to long-term planning, increasing efficiency for the Mars 2020 mission.

Anticipate and Validate

The current process of obtaining and analyzing tau data is lengthy and inefficient. L-RROI processes daily tau data from orbiters and landers and reconstructs it on top of the Martian terrain. At a quick glance, scientists can gain situational awareness of dust behavior and plan ahead for a global dust storm. They can also switch among Mars missions: Mars 2020, Curiosity, and InSight.



Make Informed Decisions

During the planning process, scientists can select the instruments they are interested in using. L-RROI takes the input, integrates tau data, visualizes instrument conditions, and helps scientists identify the best time to conduct an activity. This help scientists quickly eliminate time frames that could potentially affect rover's safety, reducing the back and forth between the science and engineering teams.

Detect Trends

Understanding the history data is critical for the mission teams to evaluate and assess current rover plans. Scientists can use L-RROI to compare and contrast data, identify anomalies, and review data pattern overtime in order to plan, study, and predict future dust behaviors.


Simulate Conditions

Dust increases camera exposure time and returns unclear photos. Knowing what the photos would look like at a certain time in the mission can help scientists anticipate and avoid wasting rover power on taking images that wouldn't be usable. L-RROI helps scientists simulate and compare various opacity conditions from the point of view of the rover. Scientists can drop a pin on the map to view past or predicted images. They can further compare and contrast images with different tau values to get a holistic view of tau effects.


Research and Definition

Methods: Literature Review, Expert Interviews, Directed Storytelling, Iterative Diagramming, Competitive Analysis

Formative Research

Research Objectives

Asset 3-8.png

Literature Review

We started off by conducting literature reviews to understand the impact of atmospheric opacity (tau) on past missions and on Mars 2020. We also looked into other topics such as NASA JPL structure, weather variables, collaboration, and data visualization to develop a holistic understanding of the problem space.

Key Findings

Atmospheric opacity (tau) is a measure of optical depth or how much sunlight can penetrate the atmosphere. Since Mars is covered with dust, the higher the tau value means there’s more dust in the air, and less sunlight can reach the surface.

Atmospheric opacity (tau) is a measure of optical depth or how much sunlight can penetrate the atmosphere. Since Mars is covered with dust, the higher the tau value means there’s more dust in the air, and less sunlight can reach the surface.

  1. Similar to the effect of water on Earth, dust dominates dictates most of Mars’ weather conditions.

  2. Each instrument aboard the rover has a favored tau range in order to operate effectively.

  3. Dust deposition can harm camera lens, affecting rover’s ability to take clear photos.

  4. Dust contamination can harm instruments and increase data uncertainty.

Expert Interviews

We conducted interviews with 18 NASA scientists, engineers, and experts to further explore the role of tau during the rover planning process. The goal was to understand how tau affects the decision-making process and collaboration among mission teams to find proper design opportunities. The three main methods we used were Semi-structured interviews, directed storytelling, and iterative diagraming

Insights

1

Meeting the proposed 5-hour operational timeline is unattainable unless rover teams shift focus to long-term goals.

“In the very beginning, it took about 12 hours to just send one day's worth of uplink to Curiosity. I think it reduced down to an average of like seven to eight. On really great days, [...], they got really close to five.”

2

Weather on Mars is relatively predictable, however, there is no weather forecasting despite its potential applications to long-term planning purposes.

“Scientists [predicted]...that Mars was going to get a really big dust storm and it did. That's why Opportunity no longer works, but they were able to predict it fairly well and that's because there's this pattern pretty frequently that occurs on Mars.”

3

Unavailable atmospheric opacity (tau) measurements in internal tools negatively impact operational efficiency.

“Before [scientists] go off and start harassing the folks that do the image processing to get it into the pipeline of what's wrong and why is this broken? It's a lot nicer to go, ‘oh, okay, I'm dealing with the local dust storm, kick the tau up for a day or two.”

4

Data is more revealing when contextualized with other observations. Existing tools do not have this capability, hindering scientific discovery.

For meteorology, time of day is crucial. So if there were a way to compare and contrast a couple of different days, that would be really helpful. Instead of looking at the left half of this plot and the right half. You'd have to visually try to compare this feature to that feature, and that would be awkward.

Revised Problem Statement

Following our exploratory round of research, we felt we’d found a particularly rich area to focus our efforts on. In order to reflect this, we revised our problem statement to focus on aiding scientists better understand and utilize tau information.

 

How might we help scientists understand and predict the impact of atmospheric opacity (tau) on instrumentation and data?

Focused Research

Competitive Analysis

The intention of the competitive analysis was to assess a variety of tools and services related to collaboration, communication, mapping, and data visualization. As there are few publicly available tools focused on understanding Martian weather we included translational products to better understand how other industries approach solving these issues. We looked to terrestrial weather mapping services, data visualization services, project management software, and even video games.

nasa-competitive-analysis (1).png

Design Requirements

Using the Secondary Research, Expert Interviews, and Competitive analysis we were able to better understand the mission requirements and pain points. This knowledge helped us create 5 design requirements meant for us to reference during the design phase, ensuring we addressed the key needs of the Mars 2020 team.


 
Asset 2-8.png
 

Facilitate Debate

The advancement of scientific knowledge stands to benefit from disagreement as dissent breeds productive debate in order to reconcile conflicts. Our tool needs to facilitate healthy discussion between differing points of view in order to drive scientific advancement.

 
 

Prioritize Customization and Flexibility

Scientific discoveries stem from finding novel ways to analyze and interpret data. To promote further exploration, the tool needs to provide scientists the ability to explore a dataset in various ways without disrupting existing work preferences.

 
 

See Through the Same Lens

Scientists are using their own tools and this could lead to misunderstandings about the meaning of their output. As a result, enabling shared mental models is crucial in order to ground conversations.

 
Asset 6-8.png
 

Show How Things Fit Into the Bigger Picture

Scientists and engineers should understand how their work impacts each other and the overall mission. This can be done through contextualizing data to provide a comprehensive view of the situation.

 
Asset 3-8.png
 
 

Stay Transparent

 

Understanding the history of data is just as important as understanding what it means. To scientists, knowing the provenance of data facilitates trust, exposes caveats, and helps ground the conversations.

 
 

Ideation

Methods: Brainstorming, Sketching, Storyboards

Brainstorming

With the information gathered from research, we were able to approach ideation with a narrowed problem space. We chose to continue on with NASA JPL’s established web-based medium.Additionally, our problem statement was clear and concise:

Help scientists understand and predict the impact of atmospheric opacity (tau) on instrumentation and data?

This meant we could spend more effort individually brainstorming features to include in the tool and deciding which would best fit our established requirements.

 
We used the design requirements to evaluate and narrow down 400 features and concepts.

We used the design requirements to evaluate and narrow down 400 features and concepts.

Storyboards

Of our 400 ideas, we chose 6 concepts to explore more deeply and assess whether they would help solve the pain points. Storyboards helped us apply proper contexts to each idea, learning where the concept may fall short and what kind of interactions were needed to make the experience happen. Many of our storyboards ended up informing our prototype, like the Tau Mapping and Instrument Health concepts. Others concepts were more aspirational, but still informed our later design. For instance, Mars Globe combination of snow globe and crystal ball to help scientists visualize tau levels. While we didn’t build this concept, it did inspire both our Rover View and Forecast features in our final design response. 


Concept Testing

Methods: Paper Prototyping, Rapid Iterative Testing & Evaluation (RITE), Remote Usability Testing

Paper Prototyping

Paper prototyping was used early on to explore interaction concepts. We then quickly moved to digital prototype so that we could test with scientists remotely.

Prior to testing with scientists, we ran several pilot sessions with peers in our cohort to quickly spot obvious usability issues.

nasa-paper-prototype (1).jpg

Rapid Iterative Prototyping (RITE)

As the timing of the project only gave us a few short weeks to test and our the NASA scientists and engineer participants were geographically dispersed and difficult to recruit, we opted to utilize the RITE (Rapid Iterative Testing and Evaluation) method. This method allowed us to test new ideas relatively quickly while making changes as problems became apparent, maximizing our time with the NASA team members. This also meant that we didn’t have well defined low/mid/high fidelity prototypes as they were in constant iteration and fidelity naturally evolved along with the design. The key feature iterations are highlighted below.

Iteration 1: Instrument Panel

The goal of the instrument panel is to allow scientists to quickly identify when is the best time to use an instrument. Green means it’s safe to use and red means it’s harmful.

nasa-instrument-iteration.png

Iteration 2: Rover View Panel

The goal of the rover view panel is to allow scientists to simulate what images would look like given the predicted tau value. Scientists can avoid taking images that would not be usable and save rover battery for other activities.

nasa-rover-view-iteration.png

Iteration 3: Seasonal Tau Panel

The goal of the seasonal tau feature is to give scientists access to historical tau data so they can quickly assess data trends and patterns overtime.

nasa-seasonal-tau-iteration.png

Final Outcome

What I Learned

Incremental progress is critical

We originally set out to create a tool NASA JPL would actually use rather than a speculative design piece. We felt this would be more inline with what the client (NASA) was expecting, easier for our participants to see the value in, and more rewarding from a personal perspective. While we went in expecting to create an entirely new tool, what we actually created was a template for incremental progress that the NASA team could use for further design explorations. There is currently no tool that takes weather into account for rover activities, but thanks to us NASA has a point of reference and base research to begin looking at solutions outside of just atmospheric opacity. This design could be utilized to forecast effects of other weather conditions on instruments like pressure, humidity, or wind.

Narrow your problem space

As a result of clearly defining our problem early on, we were focused and better able to coordinate our efforts. As we continued into the design process, we realized that by finding and defining our space early, we were able to concentrate on solving a specific problem rather than spend more time ideating on a broader range of problem spaces, which would have consumed our already limited time. This also allowed us to explore multiple ways of solving the same problem, which became a boon when we realized that some approaches weren’t feasible. Rather than go back to the drawing board, we were able to substitute solutions we’d already presented and discussed. I’m convinced that being ruthless with our problem definition was one of my teams best decisions.

Know your audience and speak in their language

One thing that our team did effectively stepping into the project was preparing ourselves with technical knowledge and learning the lingo at NASA. This helped us build rapport with scientists quickly during the research phase, leading to more productive conversations. This was even more apparent when we began getting peer feedback from within our cohort; when we spoke with our peers about our project there had to be a time allowance for education on Martian meteorology. If we had asked our NASA participants to do this for us, we would have wasted valuable time and the quality of our interactions would have suffered.

What I'd Change

Avoid remote testing early prototypes

Given the constraints of the project, we had very few NASA team members in the Seattle area to test with in-person. This meant that we had to move toward digital prototypes more quickly than I’d have liked. This limited our ability to test interactions in a low-commitment environment, which meant there was a greater threshold for implementing changes to the digital prototype. In-person testing also facilitates more context to the feedback you’re receiving because you are able to interact with the participant more. If I could, I would test early-stage prototypes earlier and with more people so that we could iterate more quickly on our early prototype and solve those problems faster.