when metrics don't match reality

Modern Ways of Working: A Story of Digital Customer Experience

January 28, 20257 min read

In my consulting conversations across industries, I often ask a simple but crucial question: "What if you don't change your delivery approach? What's at stake?" Recently, this sparked a fascinating discussion with a digital delivery executive whose story perfectly captures why modern delivery isn't just another methodology choice. Her experience transformed how I think about the relationship between system metrics and customer reality.

Sarah stares at her screen, frustration mounting. She's trying to modify her insurance policy through her provider's customer portal. Somewhere in the maze of systems, her request has vanished into what feels like a digital black hole. No status updates, no clear next steps, just silence. She picks up her phone to call customer service - again.

Meanwhile, CIO James reviews his organisation's digital performance dashboard with growing concern. Despite significant investment in technology and consistently green SLA indicators, something isn't adding up. Customer satisfaction scores are dropping, and social media sentiment is increasingly negative. As an experienced technology leader, he knows system metrics only tell part of the story - and right now, customers are telling a very different one. He's determined to understand why.

The Black Box Problem

This isn't just a story about poor customer experience - it's a story about the fundamental disconnect between how organisations view their digital systems and how customers experience them. Let's meet our key players:

  • Sarah, our customer, experiences the organisation as a black box: requests go in, sometimes things come out, but what happens in between is a mystery

  • James, our CIO, is wrestling with the challenge of connecting technical metrics to real customer outcomes

  • Maria, our delivery manager, leads teams that are caught between complex legacy systems and mounting pressure to "fix everything"

The traditional response? A massive platform replacement project. "We'll fix it all," the vendors promise. "Just give us 18 months and $15 million." It's a tempting proposition - the digital equivalent of a clean slate.

Why Big Bang Fails

Three months into the major platform replacement project:

  • The requirements document is 500 pages long

  • The solution design makes assumptions about customer needs based on internal process maps

  • The team is drowning in integration complexity

  • And Sarah? She's still waiting for updates on her policy change

This is where we need to stop and recognise a crucial truth: The problem isn't just the technology - it's our understanding of it. We're trying to solve a problem we don't fully understand with a solution we can't fully predict.

Modern Delivery: Beyond Just Agile

Here's where modern delivery approaches - from agile methodologies to human-centred design, lean product development, and DevOps practices - aren't just methodology choices. They represent a fundamental requirement for addressing complex customer-facing processes. Let's follow a different path with the same players:

Week 1-2: Start Small, Learn Fast

Maria's team combines agile iterations with design thinking and lean startup principles. They pick one specific customer pain point: policy modification status updates. Instead of rebuilding the entire platform, they:

  • Add simple status tracking to the existing system (agile)

  • Create a basic notification service informed by customer research (HCD)

  • Start collecting detailed data about the customer journey (lean analytics)

Sarah now receives updates about her policy change. Not everything is fixed, but at least she knows what's happening.

Week 3-4: Learn and Iterate

The team discovers something interesting in the data:

  • 60% of policy modifications get stuck at the underwriting review stage

  • Customers who receive status updates are 80% less likely to call customer service

  • The process itself needs rethinking, not just the technology

James sees his strategic vision starting to materialize through new metrics:

  • Reduced call centre volume translating to real cost savings

  • Improved customer satisfaction driving increased retention

  • Clear data about process bottlenecks enabling targeted improvements

  • Direct correlation between technical changes and business outcomes

Week 5-6: Expand and Improve

Instead of trying to boil the ocean, the team:

  • Adds self-service options for simple modifications

  • Creates automated workflows for common scenarios

  • Builds feedback loops into the process itself

The Key Insights

This approach reveals why modern delivery approaches aren't optional for customer-facing digital processes:

  1. Unknown Unknowns Dominate

    • We don't know what we don't know about customer behaviour

    • Each improvement reveals new insights about the real problems

    • Big bang projects lock us into yesterday's understanding

  2. The Process Is the Product

    • Customers experience our processes, not our systems

    • Small, focused improvements can have outsized impact

    • Technology changes must be guided by process understanding

  3. Feedback Loops Are Critical

    • Every change is an opportunity to learn

    • Direct customer feedback beats internal assumptions

    • Quick iterations reduce the cost of being wrong

The Real Power of Modern Delivery

The story above isn't about using agile or any single methodology because it's trendy or efficient. It's about embracing a modern delivery mindset that combines:

  • Agile's iterative learning and delivery

  • Human-centred design's focus on real user needs

  • Lean's emphasis on value and waste reduction

  • Product thinking's focus on outcomes over outputs

  • DevOps' integration of delivery and operations

This integrated approach is necessary to:

  • Learn about real customer needs in real time

  • Reduce the risk of solving the wrong problems

  • Create feedback loops that drive continuous improvement

  • Break down the black box into understandable, improvable pieces

The CIO's New Perspective

James now sees different metrics on his dashboard:

  • Customer journey maps with real-time pain point identification

  • Feedback loops showing the impact of each change

  • Clear correlation between system changes and business outcomes

More importantly, he sees a new way of thinking about digital transformation:

  • Instead of massive platform replacements, targeted improvements

  • Instead of lengthy requirements documents, continuous learning

  • Instead of project completion metrics, customer success metrics

The Customer's New Reality

Sarah still uses the customer portal, but now:

  • She knows exactly where her requests are in the process

  • She can complete simple changes without calling support

  • When she does need help, the service team has full visibility

The Hidden Transformation

This isn't just a story about improving customer experience. It's about transforming how organisations think about digital systems and processes. The real power of agile in this context isn't in its ceremonies or tools - it's in its fundamental recognition that:

  1. Complex customer-facing processes can't be fully understood upfront

  2. Learning must be continuous and built into the process

  3. Small, focused improvements beat large, risky changes

  4. The ability to adapt quickly is more valuable than perfect planning

The Bottom Line

In customer-facing digital systems, modern delivery approaches - whether we call them agile, lean, product-led, or human-centred - aren't methodology choices. They're survival requirements. The complexity of customer interactions, the speed of changing expectations, and the cost of getting big changes wrong make traditional approaches not just inefficient, but dangerous.

The choice isn't between any particular methodology and traditional approaches. It's between:

  • Learning continuously or betting everything on upfront understanding

  • Adapting quickly or committing to long-term assumptions

  • Seeing the impact of changes immediately or waiting months to find out if we were right

In the end, Sarah doesn't care about our methodology. She cares about getting her policy updated. But our ability to meet her needs - and to keep meeting them as they change - depends entirely on our ability to learn, adapt, and improve continuously. That's not just modern delivery - that's necessity.

Final Words

These conversations stay with me because they're about more than just metrics or methodologies. They're about people - the frustrated customers trying to get things done, the delivery teams caught between systems and expectations, the executives wrestling with transformational choices. When I advocate for modern delivery approaches, it's because I've seen how they free people to do their best work. Teams gain the autonomy to solve real problems. Leaders can focus on enabling greatness rather than managing crises. And customers? They finally feel heard and valued.

Reflecting on that executive's story, I'm reminded that transformation isn't just about changing processes - it's about changing how people experience their daily work and interactions. When we break down these digital black boxes, we're not just improving metrics. We're rebuilding trust between organisations and their customers, restoring pride in delivery teams' work, and giving leaders the confidence to champion meaningful change. That's why this matters. That's why it's worth doing right.

Niall McShane is the founder and Managing Director of Source Agility, specialising in optimising IT delivery through practical, proven approaches. He's also the internationally published author of 'Responsive Agile Coaching', bringing over 12 years of delivery transformation experience to complex IT environments.
Drawing from his unique background spanning sports coaching to Buddhist principles, Niall's counter-intuitive approach helps organisations slow down strategically to accelerate sustainably. His focus on combining immediate delivery improvements with lasting internal capability has helped numerous Australian organisations achieve dramatic improvements in delivery speed and predictability.
When not helping teams unlock their delivery potential, Niall can be found on the golf course, where he admits his professional expertise in performance improvement has yet to benefit his stubbornly unchanging handicap!

Niall McShane

Niall McShane is the founder and Managing Director of Source Agility, specialising in optimising IT delivery through practical, proven approaches. He's also the internationally published author of 'Responsive Agile Coaching', bringing over 12 years of delivery transformation experience to complex IT environments. Drawing from his unique background spanning sports coaching to Buddhist principles, Niall's counter-intuitive approach helps organisations slow down strategically to accelerate sustainably. His focus on combining immediate delivery improvements with lasting internal capability has helped numerous Australian organisations achieve dramatic improvements in delivery speed and predictability. When not helping teams unlock their delivery potential, Niall can be found on the golf course, where he admits his professional expertise in performance improvement has yet to benefit his stubbornly unchanging handicap!

Back to Blog

© 2023 Source Agility, Inc. All rights reserved