Technology

What Generative AI Tools Can (and Can't) Actually Do for Everyday Work

Skip the hype and the panic. Here's what the actual research shows generative AI is good for at work right now, where it falls short, and what using it responsibly actually requires.

Illustration of a speech bubble with a spark icon

Generative AI coverage tends to sort into two camps: it’s about to change everything, or it’s an overhyped bubble that produces confidently wrong answers. The actual research, unglamorously, describes something narrower than either — real, measurable productivity gains in specific kinds of work, concentrated unevenly, alongside a limitation that hasn’t gone away no matter how good the models get.

Where adoption actually stands

By Stanford HAI’s 2026 AI Index, organizational AI adoption has reached 88% — a number that sounds like near-universal deployment until you look at what it’s actually measuring. Adoption and benefit aren’t the same thing, and the report is explicit that productivity gains are concentrated in a smaller leading cohort of organizations rather than spread evenly across every company that’s rolled out a tool. Most workplaces have access to generative AI now. Far fewer have figured out how to get real value from it consistently.

The gap between “has access to” and “has actually integrated” shows up in the same report a different way: only 41% of employees say their organization has integrated AI tools into actual workflows and practices, not just made them available — though that figure has been climbing steadily, up three points in a single quarter. Read together, the picture is less “AI adoption has stalled” and more “the easy part — giving people a login — happened fast, and the harder part — changing how work actually gets done — is happening slower and more unevenly, which is exactly what you’d expect from a genuinely new tool rather than a simple software swap.”

What the field experiments actually show

The most credible evidence on AI’s productivity effect doesn’t come from surveys asking people if they feel more productive — it comes from controlled field experiments measuring actual output. A few of the better-known ones tell a consistent, if uneven, story.

MIT researchers studied nearly 2,000 software developers at Microsoft and Accenture given access to GitHub Copilot, an AI coding assistant, and found they completed meaningfully more pull requests per week — roughly 13% to 22% more at Microsoft, 8% to 9% more at Accenture. In a separate study of customer support agents, access to a generative AI tool raised average productivity by about 14% — but that average hid a sharp split: the gains were concentrated almost entirely among newer, less experienced workers, while the most skilled agents saw almost no measurable benefit at all.

That pattern — AI helping less-experienced workers close the gap with experts more than it helps the experts themselves — shows up again in a study conducted with Boston Consulting Group, published in the peer-reviewed journal Science, where more than 700 consultants using generative AI on an assigned task improved their performance by close to 40% compared with a control group. The common thread across all three studies isn’t “AI makes everyone dramatically more productive.” It’s closer to: AI is particularly good at raising the floor, and its effect on already-expert performance is smaller and more situational.

Why the hallucination problem isn’t going away soon

The most persistent limitation of these tools has nothing to do with how large or expensive the underlying model is. OpenAI’s own research on the subject traces hallucination — plausible-sounding but false output — back to how models are trained and evaluated in the first place: standard methods reward a confident, specific-sounding answer over an honest “I’m not sure,” which means a model that hedges more often can actually score worse on the benchmarks used to build and compare these systems. Newer models, including OpenAI’s GPT-5, hallucinate measurably less often than their predecessors — but “less often” is doing real work in that sentence. The problem is structural to how the technology is built and evaluated, not a bug that the next version quietly fixes.

That has a direct practical consequence for everyday use: anything a generative AI tool produces that involves a specific fact, figure, citation, or claim needs to be checked against a real source before it’s used, the same way you’d check a first draft from a junior colleague rather than assuming it’s correct because it reads confidently.

What people are actually using it for

Real usage data, rather than surveys about intended use, adds useful texture here. Anthropic’s Economic Index, which tracks how people actually use Claude through privacy-preserving analysis of real conversations, distinguishes between two broad usage patterns: “automation,” where someone hands off a task with minimal back-and-forth, and “augmentation,” where the interaction is more collaborative — iterating, getting feedback, refining. Notably, the balance between the two varies by country: higher-income, higher-usage markets lean more toward the collaborative, augmentation style of use, while lower-income, lower-usage markets lean more toward straightforward task handoff. That’s a reminder that “how people use AI at work” isn’t one universal pattern — it’s shaped by familiarity, trust, and what kind of work people are actually doing with it.

The same research also shows work and personal use blurring together more than the “productivity tool” framing suggests. Writing and editing — the “arts, design, sports, entertainment, and media” category in Anthropic’s data — is the second-largest use case at just over 10% of queries, and purely personal use (product comparisons, general questions, day-to-day tasks unrelated to a job) has grown from about 35% to 42% of conversations. People aren’t only reaching for these tools during work hours for work reasons; the boundary between “productivity software” and “the thing you ask instead of searching” has mostly dissolved.

What this looks like in a normal workday

Stripped of the research-paper framing, the practical pattern is fairly ordinary: drafting a first version of an email or document, turning rough notes into something structured, summarizing a long thread or report before a meeting, and getting unstuck on a coding problem or a blank page. Those are exactly the categories where the field experiments above showed measurable gains, and they share a common feature — there’s a human reviewing the output before it goes anywhere that matters, which is precisely the workflow that makes the hallucination risk manageable rather than disqualifying.

What responsible everyday use looks like

Put together, the practical picture for someone using these tools at work is fairly specific. Generative AI is genuinely useful for drafting, summarizing, restructuring, and handling repetitive or templated work — the categories where the field experiments above showed real gains, particularly for less-experienced workers tackling unfamiliar tasks. It’s least reliable, and needs the most human oversight, on anything involving specific facts, numbers, or claims that matter — precisely because hallucination remains a structural feature of how these models work, not an edge case.

That’s a more modest claim than “AI is transforming work” and a more useful one than dismissing it as a fad. Small businesses experimenting with these tools are running into exactly this same pattern at a different scale — real, measurable value in the right use cases, applied carefully rather than wholesale. And it’s part of the same broader shift in how companies are rethinking work itself: new tools, like new locations, work best when the decision about how to use them is specific rather than sweeping.

Latest stories