Productside Stories

The Productside Team Assessment with Devin Torres

Featured Guest:

Devin Torres | Instructional Designer at Productside
11/06/2024

Summary

In this episode, Rina Alexin speaks with Devin Torres, Instructional Designer at Productside, about the craft and purpose behind building effective assessments for teams and organizations.

Devin opens up about her journey from behavioral health and institutional research to learning design and product assessment. She explains how her background in data analysis and education shaped her understanding of how assessments can drive change — not just for individuals, but for entire organizations.

Together, Rina and Devin unpack the “art and science” of assessments, discussing how good design involves both quantitative precision and human context. They dive into Productside’s new Team Assessment, a lightweight diagnostic tool that helps leaders identify process and culture gaps across product teams.

Listeners will walk away with a deeper appreciation for data storytelling, unbiased question design, and how to transform raw information into meaningful organizational insights.

Takeaways

  • Effective assessments balance science (data) and art (human understanding).

  • Data tells a story — look for insights at the edges, not just the averages.

  • Assessments should be accessible, intentional, and free of unnecessary bias.

  • The value isn’t in the questions—it’s in how you interpret and act on the results.

  • Lightweight tools can reveal process and culture gaps quickly.

  • Look beyond skill gaps to uncover team dynamics and behavioral patterns.

  • Question design should avoid priming and double-barreled phrasing.

  • Flexibility and curiosity are essential when interpreting data.

  • Confirmation bias can limit insight—approach analysis with an open mind.

  • Every assessment is a product; user testing and iteration improve accuracy.

Chapters

00:00 Introduction and Devin’s Non-Traditional Career Path
03:10 Transitioning into Institutional Research and Learning Design
05:01 Joining Productside and the Art of Assessment
09:06 Understanding Data Storytelling and Outliers
10:21 Lessons from Behavioral Health and Data Interpretation
11:45 Connecting Team Assessments to Organizational Change
14:14 Why Assessments Drive Product Team Diagnostics
16:19 Building the Productside Team Assessment
17:30 Identifying Process and Culture Gaps
19:38 Using Data to Support Leadership Decisions
20:18 Improving Assessments Over Time
22:25 Avoiding Bias and Priming in Question Design
25:52 The Importance of Follow-Up and Continuous Feedback
26:12 Treating Assessments as a Product
28:00 Flexibility and Avoiding Confirmation Bias
29:20 How to Connect with Devin Torres
30:00 Closing Remarks from Rina Alexin

Keywords

product assessments, organizational diagnostics, team performance, data storytelling, Productside, Rina Alexin, Devin Torres, bias reduction, behavioral science, learning design, product leadership, culture assessment, data-driven decision making, skill development, qualitative insights, assessment design, feedback loops, innovation

Introduction and Devin’s Non-Traditional Career Path

Rina Alexin | 00:00–01:14

Hi everyone, and welcome to *Productside Stories*, the podcast where we reveal the real lessons learned from product leaders and thinkers all over the world. I’m **Rina Alexin**, CEO of Productside, and today’s episode is a special one — we’re joined by **Devin Torres**, one of our instructional designers and a superstar when it comes to assessments. Devin, thank you for joining me today.

Devin Torres | 01:14–03:10

Thank you, Rina! I actually have a pretty non-traditional journey into assessment. I started in **behavioral health**, focusing on student behavior and data tracking. Over time, I wanted to move from one-on-one change to something more strategic — taking data and using it to shape programs. That led me into **higher education** as an institutional research analyst. I learned how to track underrepresented student data, follow patterns, and use predictive analytics. Eventually, I moved into assessment design and learning analytics, bridging strategy and technology.

Transitioning into Institutional Research and Learning Design

Devin Torres | 03:10–05:01

After years in education, I completed my master’s in **e-learning and distance education**. The pandemic pushed me to explore remote learning full-time. I freelanced as an instructional designer and then found Productside — then known as 280 Group — where the interview process emphasized *showing* your skills. It wasn’t about credentials; it was about how you think. That really resonated with me.

Joining Productside and the Art of Assessment

Rina Alexin | 05:01–06:49

Assessments are a core part of how we transform product teams. They help us see where organizations are starting and what gaps exist. Devin, given your background, what’s your philosophy on designing assessments?

Devin Torres | 06:49–09:06

I see assessment as both **art and science**. You’re not just asking questions; you’re designing an experience that tells a story. You have to consider not only *what* you want to know but also *how* the data will be interpreted and communicated. Accessibility matters — people need to understand and absorb results intuitively.

Understanding Data Storytelling and Outliers

Devin Torres | 09:06–10:21

Data tells a story. It’s not just numbers on a chart — it’s people. Sometimes the most valuable insights lie in the **outliers**, not the averages. I learned that from behavioral health: what’s happening at the edges often reveals what’s really going on.

Lessons from Behavioral Health and Data Interpretation

Rina Alexin | 10:21–11:45

That’s fascinating. It’s like when a product team has a few outliers who perform differently — that can reveal hidden cultural or process issues. The value is in investigating those patterns, not just reporting them.

Connecting Team Assessments to Organizational Change

Rina Alexin | 11:45–14:14

Assessments are foundational to diagnostics. They give us a structured way to understand not just individual skills but **organizational dynamics** — the “why” behind what’s happening. The Productside Diagnostic blends data with human interviews to find those deeper truths.

Why Assessments Drive Product Team Diagnostics

Rina Alexin & Devin Torres | 14:14–16:19

**Rina:** We’ve been running assessments for years — over 6,000 responses — and what we’re doing now with the team assessment feels like the next evolution. It’s lightweight but insightful. **Devin:** Exactly. It gives teams a snapshot of their culture, processes, and strengths in under ten minutes. Leaders can instantly identify where they excel and where they need to investigate further.

Building the Productside Team Assessment

Devin Torres | 16:19–17:30

The goal was to create something accessible and actionable — a starting point. The assessment highlights **gaps in process and culture** and provides immediate insights leaders can act on. It’s not just a test; it’s a roadmap for growth.

Identifying Process and Culture Gaps

Rina Alexin | 17:30–19:38

Every product leader knows something’s off — they just need a framework to pinpoint it. This assessment gives clarity: where the organization is strong, where it’s struggling, and where to focus improvement efforts.

Using Data to Support Leadership Decisions

Devin Torres | 19:38–20:18

Leaders want actionable proof. Data provides credibility — it’s evidence they can bring to the table when advocating for change or additional resources.

Improving Assessments Over Time

Devin Torres | 20:18–22:00

We’re constantly iterating based on benchmark data and trends. As new technologies like **AI** and visualization tools evolve, our approach to reporting changes too. Assessments should always adapt to the needs of modern teams.

Avoiding Bias and Priming in Question Design

Rina Alexin & Devin Torres | 22:25–25:52

**Rina:** Designing questions is an art form. It’s easy to accidentally prime respondents or create double questions. **Devin:** Right. Always assume some bias exists — then design around it. Phrase questions as **statements** and use clear, single-intent language. Make it simple, not tricky. Clarity leads to better data.

The Importance of Follow-Up and Continuous Feedback

Devin Torres | 25:52–26:12

Follow-up is everything. If people take the time to respond, they want to feel heard. Continuous feedback loops keep assessments relevant and build trust.

Treating Assessments as a Product

Rina Alexin | 26:12–27:45

Assessments are a **product** — they need testing, iteration, and user research. Clarity improves only through conversation and feedback.

Flexibility and Avoiding Confirmation Bias

Devin Torres | 28:00–29:20

Be flexible. Don’t go in expecting a specific outcome. If you only look for what confirms your hypothesis, you’ll miss the insights that could transform your understanding.

How to Connect with Devin Torres

Devin Torres | 29:20–30:00

You can find me on **LinkedIn** — just search for *Devin Torres*. I love connecting over assessment design, learning analytics, and professional development.

Closing Remarks from Rina Alexin

Rina Alexin | 30:00–End

Thank you, Devin, for sharing your insights, and thanks to our listeners for joining another episode of *Productside Stories*. Remember: every great product — and every great team — starts with curiosity, data, and empathy. Visit us at **Productside.com** for more free resources, webinars, and templates to power your product journey.