At first glance, finance and accounting appear to be ideal environments for AI integration. The work is structured, rules-driven and built on numerical data, which AI can automate and process at scale and speed. As such, it’s ideal for much of the repetitive work — such as invoice capture, reconciliations, reporting, and anomaly detection. These tasks still consume so much time and reduce space and capacity for strategic and creative thinking.

But as confidence in AI grows across the sector, and as the technology is integrated into accounting and finance software, is there a risk that organisations once fearful of the technology may go to the other extreme? What might happen if they lean so deeply into AI that finance and accounting professionals become distant and removed from the numbers?

These questions matter because the decisions that sit behind the numbers are rarely driven by pure logic. Financial strategy is shaped by risk appetite, leadership judgement, organisational priorities and sometimes even internal politics.

So many entrepreneurial success stories include a fateful risk, gamble or moment of inspiration that defies established financial wisdom. A founder deciding whether to invest in growth or a charity balancing financial sustainability with its mission does not rely on numbers alone. That means a surprisingly high number of commercial decisions have a human dimension that AI cannot, and arguably should not, replace.

Balancing AI and Human Strengths

So how can organisations maintain the human intuition and instinct that sits behind so many corporate transactions while embracing AI? The answer is to use the technology to remove repetition rather than people from core financial processes. In practical terms, that means using automation to reduce cognitive load so people can focus on interpretation, creativity and decision-making — the human parts of finance and accounting. 

That’s a sensible approach because poorly implemented automation accelerates errors and obscures decision-making processes. It can also cut humans out of the process exactly at the point where instincts and experience are most needed. In that situation, AI-enabled systems simply become faster at making poor decisions. And those poor decisions end up costing time as well as money.

Once that happens, the space, time and resources that finance and accounting leaders are trying to create for more strategic work will rapidly shrink. By contrast, when humans actively guide AI systems, review outputs and set boundaries, automation becomes a powerful extension of human capability rather than a substitute for it.

The Limits of Automation in Decision-Making

In finance and accounting, numbers often create a sense of objectivity and certainty. But financial reporting still involves interpretation, context and judgement. A technically correct output is not always the same thing as the right commercial decision for a business, its employees or its long-term strategy.

As such, it’s important that accounting and finance professionals at every level do not lose a grip on their data when engaging with AI and automation. Aside from losing an understanding of the systems and processes behind the outputs, there’s still an ethical responsibility to deploy AI in a way that preserves human oversight, authority and compliance in financial reporting. That’s because, for the first time, we’re asking technology, in the form of AI, to provide an opinion on our data — not just deliver the logic and the numbers.

For that reason, finance leaders still need visibility into how AI-generated outputs are reached, the ability to challenge them when necessary, and a clear understanding of the underlying data behind the results. That’s important because AI output is ultimately based on prediction, and prediction is not the same as established and quantifiable truth.

Keeping Score 

One possible middle ground is confidence scoring and validation workflows. Rather than unquestioningly trusting every AI-generated output, organisations can introduce processes that flag lower-confidence results for human review before action is taken. That creates a more balanced relationship between automation and oversight, while also giving finance teams clearer visibility into how reliable or complete AI-generated outputs actually are. The goal should be confidence in AI-supported workflows, not unquestioning reliance.

That visibility, however, should not sit solely with grads and junior finance staff. They need to understand the manual calculations and processes sitting behind automated systems so they can properly challenge the results. But the same principle applies at senior levels too. Experience and seniority should not create distance from the underlying logic behind the numbers. If anything, AI makes that visibility even more important.

Otherwise, organisations risk creating the worst of both worlds: juniors who can’t challenge AI outputs because they haven’t learned the manual processes, and complacent seniors who know the manual systems and assume AI is following them. It means organisations can end up with more information at their fingertips than ever before, while simultaneously becoming more detached from the underlying data and logic behind it.

That risk becomes even more significant at senior levels, where financial decisions often carry wider operational, commercial and strategic consequences. The more detached leaders become from the logic behind the outputs, the greater the impact when reliability or credibility issues emerge within the data.

Conclusion

Productivity gains from AI and automation have the potential to create more space for higher-value thinking rather than remove people from the process. The information AI surfaces can ultimately help senior leaders make more creative and strategic decisions by revealing connections, patterns and insights that may previously have remained hidden within the data. 

Leaders have always relied on summaries, dashboards, and reporting layers to help them make decisions. But AI dramatically widens the gap between decision-makers and the operational reality beneath the numbers. The danger is not simply inaccurate data. It’s overconfidence. When systems appear highly intelligent and highly efficient, organisations can gradually stop questioning how conclusions are reached in the first place.

Ultimately, organisations may wish to focus on people-led automation rather than handing complete control to systems. The goal should be confidence in AI-supported workflows, not unswerving reliance on automated outputs — with AI acting as an extension of human capability rather than a replacement for judgement.

The finance teams that benefit most from AI will likely be the ones that strike the right balance between automation and oversight. Hand over the repetition and the manual processing, but don’t lose visibility into the data itself. Because if organisations surrender that understanding completely, all the entrepreneurial instinct, creativity and commercial judgement in the world may no longer be enough to compensate for the decisions being made underneath them.

Learn more at aqilla.com

Have you ever got into an old car with a Gen-Zer? If they were driving, chances are you wouldn’t have got very far. A recent survey has found that 39% of 14–29-year-olds couldn’t identify an ignition key. Proof, if it were needed, that once technology advances, old ideas are quickly forgotten. This isn’t just happening in cars. The internet and social media have produced their own native generations – people who have never known a world without those technologies.

The same pattern is starting to emerge with AI. That means Gen Z and Millennials are about to experience a similar shift. The first wave of true AI natives will soon enter the workforce – a cohort that has never known a world without AI. 

AI- The New Normal

People’s reactions will largely depend on their experience with AI. But one thing is certain: these graduate and entry-level employees won’t need to be convinced of its value. They’ve already seen what it can do, so if it’s missing, disbelief – or frustration – is likely to follow. It’s a bit like broadband. Here in the UK, it’s simply the standard we all expect. We don’t stop to think about how that connectivity reshaped our lives, helped us work from home or allowed us to stream high-definition media.

Many organisations are still in the early or experimental phases of AI adoption. They might be using the technology to automate basic email inbox management and take meeting minutes. Meanwhile, those further ahead of the curve are exploring more advanced tools and assessing where automation can be safely deployed, particularly for reporting and analysis.

But AI natives won’t see these use cases as experimental. In fact, they probably wouldn’t even refer to them as use cases. It’s just normal, like using a search engine rather than visiting a library to carry out research.

Prompting New Behaviour

Perhaps the biggest difference, however, is where organisations may integrate AI into their existing workflows, AI natives are more likely to structure work around it from the outset.

For them, work tends to start within an AI system, defining the objective clearly, setting constraints, and effectively “briefing” it, before iterating quickly and refining outputs as they go. For AI natives, this kind of prompt-based mindset isn’t a specialist skill; it’s simply how they approach tasks.

This is a fundamental shift. For AI natives, the question isn’t “Should we use AI here?” It’s “Why can’t I use it for this piece of work?” When their expectations collide with more cautious, process-led environments, friction is almost inevitable. Not because one approach is right and the other is wrong, but because both sides are starting from completely different assumptions.

Skills Transfer and Mentoring

But how does the need for AI natives to understand and work through basic manual processes coexist with intuitive prompt-based thinking? Should AI use come with experience-based restrictions in the finance sector? For example, do your three years first, and then you can use the tools.

It’s probably not what AI natives want to hear, but there is logic behind the approach. Learning the manual processes behind automation will enable new recruits to apply the necessary checks and balances to system outputs — putting them in a position to verify data rather than passively accept it.

Without taking this step, there’s a real risk that people will lose the ability to question the outputs they’re working with. That, in turn, has implications for how people are taught. Whether in an educational setting or on the job, that training needs to help AI natives understand the logic behind the systems they’ll be working with.

Lurking in the Shadows 

If AI natives encounter friction when trying to use the technology, there’s a risk they’ll seek informal workarounds. Organisations have seen similar patterns before with personal devices or early cloud adoption. With AI, the risks are more focused on data, traceability, and accountability than on system access and security, though these remain important considerations.

Rather than restricting AI use, organisations are already beginning to reshape it by building oversight into how systems are used. That might mean making the AI’s working assumptions more visible and requiring humans to validate outputs. It might also require AI systems to signal their confidence in those outputs and to request manual checks. Over time, this reduces risk and creates an environment where people can work confidently with AI without losing sight of who is responsible.

This approach also challenges a common narrative. Much of the current discussion around AI focuses on job displacement, but the reality is more nuanced. The issue isn’t a simple replacement of human intuition and experience, but how those qualities evolve alongside increasingly capable systems.

Rather than removing the need for people, this managed shift reinforces it. Greater emphasis is placed on human-in-the-loop models, in which individuals with a deep understanding of AI can interrogate, challenge, and interpret system outputs.

A different starting point

So, what happens next? AI tool adoption, for sure. But it goes far deeper than that. Getting ready for AI natives means shifting to a different starting point – and learning to “live in the prompt”.

As AI natives begin entering the workforce and eventually move into leadership roles, the expectation won’t be that AI is introduced; it will be that it is already there. That shift reshapes how people think, learn, and approach tasks from the outset. It will also change how tasks are conceived, carried out and reviewed. The ability to configure, interrogate and challenge systems will become as important as the ability to interpret their outputs.

For organisations, the question is no longer whether to adopt AI, but whether their processes, governance structures and training pathways are ready for a workforce that already assumes it – and will expect to work that way from day one.

Learn more at aqilla.com