Trust in Agentic AI: A Growing Trend
The landscape of artificial intelligence (AI) is rapidly evolving, and an intriguing aspect of this evolution is the growing trust in agentic AI. According to a recent report from OutSystems, 73% of respondents now express either high or moderate trust in autonomous agents. This marks a significant increase of around 10% from the previous year’s survey, signaling a shift in how organizations perceive and engage with autonomous systems.
The Shift in Trust Levels
The rise in trust levels is especially noteworthy given the heightened scrutiny surrounding AI technologies. While 73% are now comfortable allowing agents to operate independently, the trust placed in code or workflows generated by third-party AI tools is slightly more conservative, standing at 67%. This figure reflects a substantial improvement over last year when only 40% of respondents felt comfortable letting generative AI produce code without human oversight.
This increasing trust in AI can be attributed to various factors, including advancements in technology, improved transparency from AI developers, and a greater understanding of the practical applications of AI in the workplace.
Governance Challenges
Despite the surge in trust, a significant number of organizations face challenges in implementing a centralized approach to AI governance. The survey revealed that only 36% of respondents utilize a centralized governance model, while a concerning 64% reported lacking such a framework. Notably, 41% of organizations implement rules on a per-project basis, indicating a fragmented approach to governance.
Building robust human-in-the-loop checkpoints is considered technically challenging. About two-thirds of respondents stated that managing the orchestration of AI agents—essentially inserting manual brakes into fully autonomous systems—is a complex task. This highlights the ongoing tension between leveraging the capabilities of AI and ensuring adequate oversight.
More Read
The Looser Oversight Models
As organizations navigate these challenges, many appear to be adopting looser oversight models. This trend raises questions about whether increased reliance on AI stems from genuine trust in the technology or a business imperative to deploy AI tools regardless of potential risks. If this trend continues, there’s a concern that the pace of agentic AI adoption may outstrip the development of necessary accountability measures.
The survey emphasizes that firms looking to scale AI agents, especially in regulated or mission-critical environments, should integrate orchestration and auditability as core components of their strategies. Compliance checks, alongside clear traces of accountability through log files and defined responsibilities, are essential elements for any meaningful implementation of agentic AI.
The Issue of AI Sprawl
An alarming finding from the report is that 94% of leaders expressed concern about what’s been termed “AI sprawl.” While the term wasn’t explicitly defined in the survey, it suggests a lack of centralized management for overseeing AI deployments across an organization. Of those surveyed, 39% are very or extremely concerned about this issue, yet only 12% currently utilize a centralized platform to manage their AI operations effectively.
The emergence of AI sprawl underscores the importance of cohesive governance strategies and robust management frameworks. As AI technologies proliferate within organizations, the risk of unmonitored deployments grows, presenting potential challenges in compliance and operational integrity.
Final Thoughts on AI and Big Data
With trust in agentic AI on the rise, organizations must tread carefully. Striking the right balance between innovation and oversight is essential. For organizations aiming to exploit the benefits of AI, a comprehensive approach that includes stringent governance measures, technical orchestration, and effective oversight frameworks will be crucial to ensuring the long-term reliability and accountability of these autonomous systems.
For those looking to deepen their understanding of AI and big data, events such as the AI & Big Data Expo provide an excellent platform to gain insights from industry leaders. By engaging in these discussions, organizations can better prepare for the evolving challenges and opportunities presented by AI technologies today.
Inspired by: Source
