Dante
Garetto
← All writing

Giving a toddler keys to a Hellcat: a student’s honest take on AI in UX research

Read this piece on Bootcamp

· Published in Bootcamp · 11 min read

I copy-pasted the design brief into ChatGPT’s 5.1 and watched it spit out a 20-page-long project scope in under thirty seconds.

Clean headings, structured paragraphs, professional in its presentation.

It felt far too easy — and as I began reading through it, I realized I had no idea whether it was right. I didn’t know enough to properly evaluate what I was reading, and the AI certainly wasn’t going to tell me what I was missing. That’s the strange paradox at the heart of using generative AI as a UX student: you’re like a toddler trying to drive a Hellcat. The power is real, and so is the danger of not knowing what you don’t know.

UX research is a discipline built on cultivated judgment — the ability to ask the right question, notice the unexpected answer, and know the difference between a pattern and an insight. Generative AI is now doing the scaffolding work of research faster than any junior designer could: drafting problem statements, suggesting methodologies, synthesizing interview notes, generating personas. For a student still building their instincts, that acceleration is deeply disorienting and terrifying. Putting the work aside, is this the speed I am now expected to learn at as well?

But speed is not the point of research. The point is understanding people, and that has always required something AI cannot fake yet: genuine human judgment. As AI reshapes every phase of the UX research process, the discipline’s future won’t be determined by how much we automate, but by how clearly we understand what automation cannot touch.

The Seduction of Speed

In any design project, the early moments without direction feel the hardest; staring at a brief and trying to figure out where to even begin. What is the real problem here? Who else has tried to solve it? What do we actually know versus what are we assuming? It’s a phase that feels slow, messy, and frustrating.

This semester, I skipped past these feelings, dropping my brief into ChatGPT. In minutes, it had generated a structured problem statement, scoped research plan, and competitor analysis. It felt less like research and more like cheating.

That feeling is one worth interrogating. While the output wasn’t necessarily wrong, besides an incorrectly identified competitor and inconsistency here and there, the way AI frames the problem is entirely influenced by the training data baked into its system. I hadn’t discovered or learned that framing; and as a student still developing my own design instincts, I had almost no way to know the difference.

This is the quiet risk of AI-assisted problem framing: it is extraordinarily good at producing outputs that look like insight without requiring the researcher to do the cognitive work that makes insight meaningful. Research methodology creation faces the same trap. When AI suggests a methodology, it’s pulling from a library of conventional approaches that have worked in similar contexts. As a student, I’d probably end up doing the same in order to gain experience with the research process during my education; but as I continue to grow in this field, I need to develop my own senses and establish intentionality derived from the who, what, and why.

This isn’t an argument against using AI in the early stages of research. It’s an argument for using it with intention and caution. Getting a first draft of a problem statement out of your head and onto a page creates something to react to, push against, and refine. But refinement requires taste, and taste is built through experience and exposure that takes time to develop. For a student, that creates a specific kind of vulnerability: AI can frame your problem faster than you can develop the judgment to evaluate the framing. The tool accelerates your work. It does not accelerate your growth.

Interview Intentionality

While the first phase of research is where AI seduces you with speed, the interview phase is where its limits are revealed more honestly. AI is more than capable in drafting interview guides, simulating users, and even analyzing transcripts with structured, logical follow up prompts built within. At face value, the one I used was better formatted than anything I would have written from scratch as a first draft, and that’s where the problem starts.

Despite an interview guide being named as a way to guide an interview, a skilled researcher is expected to abandon it the moment something more interesting walks through the door. The best user interviews are not defined by the questions that are prepared. They are defined by questions nobody planned to ask. The moment a participant says something unexpected, slightly contradictory, or emotionally charged, it is the job of the researcher to drop the script and follow the thread. That instinct cannot be prompted into your guide — it must be developed by the researcher themselves.

The risk for students is subtle but serious. The polished, professional presentation generated by AI carries an implicit pressure to honor it. For students and junior researchers, deviating from it creates a sense of anxiety in a field they lack familiarity in; but they are supposed to deviate, as detours are the data. Clinging too tightly to an AI generated guide isn’t conducting an interview — it’s administering a survey with better eye contact.

There is some conversation about using AI to simulate user interviews. While the efficiency case is obvious, especially for those in resource-constrained teams or environments, synthetic interviews put you at risk for validating what you already think. Turning to representations over real people also diverts away from the core systems that ensure voices of end users are heard, preventing researchers from encountering surprising or unexpected findings that ultimately reshape the project. Simply put by the Nielsen Norman Group:

“UX without real-user research isn’t UX” (Rosala & Moran, 2024).

Working through my own user interviews this semester, I noticed how much I began to lean on AI to prepare, and how little that preparation could account for what actually happened in conversations. Participants misinterpreting questions, going off on tangents, and recounting their thoughts and actions provided the foundation for my personas — something neither the framework of an AI generated guide could provide or conduct in my place.

Synthesis at Scale, at Speed

If there is one phase of the UX research process where generative AI makes an undeniably compelling case for itself, it’s synthesis. Anyone who has sat in front of three hundred sticky notes on a digital whiteboard, trying to cluster themes from multiple interviews, knows the particular exhaustion of that work. AI can do a version of that in minutes: grouping responses, labeling themes, surfacing recurring language, generating a first-pass affinity map that would have taken a human team an entire workshop session. I’ve used it across multiple classes and assignments, and the time saved was significant enough that I almost didn’t stop to ask what I might be trading away.

What I was trading away was the friction that leads to insight.

There is something that happens when you sit inside a messy pile of qualitative data long enough. Patterns that don’t fit anywhere, contradictions that refuse to resolve neatly. Eventually, that discomfort evolves into signals that reveal genuine insights that would otherwise be overlooked. When AI smooths over that friction by clustering everything cleanly and labeling it with confident category headers, it skips the most crucial part of the process. While you get organization, you won’t always get understanding.

As I dropped my transcripts and interview guides into ChatGPT and asked it to generate personas, I also started to see just how much information the LLM was taking from its training data over the information I provided. Needs and experiences that never appeared in my data started seeping into my personas, presenting claims about users that I would never make.

None of this means AI synthesis is without value. For large-scale research with dozens of participants, the ability to quickly surface recurring themes is genuinely powerful and would be irresponsible to ignore. I don’t believe that researchers should avoid AI synthesis. Rather, they should treat AI-generated synthesis as a starting hypothesis rather than a finished conclusion. As always, the only way to be thoroughly confident in an output is to go through the process yourself.

The Human in the Loop

By the time I reached the PRD and early solution exploration phase of my project, I had developed a rhythm with generative AI that felt almost collaborative. Prompt, evaluate, push back, refine. What I didn’t fully appreciate until later was that this back-and-forth was part of the research process. The human in the loop wasn’t a safeguard on top of the work, it was integral to the generation process.

A lot of hype surrounding AI is focused on the ability to set an agent on a task and let them run free, managing files and generating documents as they set off on a great adventure that hopefully won’t wipe your repo. The human element is often regarded as the final check before a change goes live or gets published. But research isn’t just a report, the ‘output’ is about understanding, and understanding is not something you can just audit in the way you proofread a document. If a researcher outsources all the interpretive work to AI and only reviews the generated results, they aren’t in the loop — they’ve waited outside to spot check the packaging.

Genuine human-in-the-loop judgement is a lot messier and demanding in practice than an intermittent review step. It means questioning outputs before you accept them, even when it sounds reasonable. It means noticing when a synthesized persona feels demographically plausible but humanly hollow. It means recognizing that a research methodology can be technically appropriate and contextually wrong at the same time. These are judgment calls that require both a familiarity with research methods and people; that means their contradictions, their unstated needs, the gap between what they say and what they mean.

There’s an ethical dimension to the field of UX research as well, one of advocacy. Advocating for those who will use the product — especially those who are underrepresented in mainstream assumptions — are an essential component of what it means to be a UX researcher.

LLMs have a “bias laundering problem.” They reflect the dominant voices in their training data and systematically underrepresent marginalized perspectives. Wrapped in the language of empathy and “realistic personas” makes it harder to detect and more dangerous (Papangelis, 2025).

A researcher who isn’t actively interrogating these outputs may be actively designing those biases into a product, which is counterproductive to being the human-in-the-loop.

This semester made that tension concrete for me in ways I didn’t anticipate. There were moments where AI generated outputs were coherent, well-structured, and subtly wrong in ways that took me time to recognize and deal with. A problem statement that jumped the gun on what factors created friction. A persona that disregarded real experiences like they were an edge case. A PRD that prioritized technical feasibility over user needs. Catching those things required me to utilize what I was still actively developing: a point of view. Not just about design, but about people. About what matters and why. That is not a skill you can develop by reviewing AI outputs. You develop it by doing the hard work yourself, getting it wrong, figuring out why, and trying again.

Researcher of the Future

TLDR? AI is a tool with no accountability, use it wisely, don’t forget people in the process.

Now, what that conclusion doesn’t capture is the disorientation of learning a discipline at the exact moment when it’s being completely restructured around you. It’s when spending months reaching out to professionals with decades of experience results in the same prepackaged corporate word salad they’ve heard from their executives. It’s when all you hear is ‘good luck out there’ from those with any proximity to AI development. It’s when half your teachers advocate for learning how to utilize AI while the other half protest its existence and tell you to cast it aside.

I don’t think the answer is to resist the tools. The speed, the scale, the ability to get a first draft of almost anything out of your head and onto paper are genuine advantages that will cost you your job in almost any field if you do not learn to adapt. A researcher who refuses to engage with AI because it feels like cheating is going to find themselves outpaced by researchers who figured out how to use it without losing themselves in it.

Meanwhile, losing yourself in it is a real risk, and it’s a risk that hits hardest for people who are still figuring out who they are as researchers. When AI can do the scaffolding work of research faster than you can develop the instincts to evaluate it, there is a temptation to let the scaffolding become the building. What gets skipped in the AI-powered productivity pipeline isn’t a set of tasks, it’s the formation of a researcher. Combining that with the drop in entry-level positions across the job market only exacerbates this issue.

The future of UX research in an AI-augmented world doesn’t belong to prompt engineers. It belongs to the people who have done enough real research — slow and uncomfortable — to know what a good output actually feels like. That depth of experience is what makes the human-in-the-loop judgment meaningful rather than ceremonial.

AI will not replace UX researchers, there is something more nuanced than that. As stated by the Nielsen Norman Group, “UX research is about deeply understanding user problems and strategically solving them to achieve business goals.” This mindset has always distinguished top performers in this field, but now it has become the expectation instead of the exception (Moran et. al., 2026).

That deep understanding still has to be built the hard way. What AI has done is made it a lot easier to avoid building it.

References