Mumbai, India – Reserve Bank of India (RBI) Governor Sanjay Malhotra issued a clear directive to the nation’s banking sector on Tuesday: while embracing artificial intelligence (AI), ultimate accountability for decisions must remain firmly with human oversight, not with algorithms or technology vendors. Speaking at the annual Fibac event in the financial capital, Malhotra underscored the critical need for banks to integrate “meaningful human oversight” into AI systems from their very design.

Malhotra’s address highlighted the RBI’s progressive stance on AI, viewing it as a powerful capability for banks to harness responsibly, rather than merely a risk to be contained. However, he cautioned against the potential for AI to erode human judgment and accountability if not managed correctly. “For a bank’s decision, the ultimate responsibility has to lie with the bank and not with the vendor or with the algorithm. We cannot say that it is the model who decided it. That can never be an acceptable answer, whether to the bank, to the customer, or to the regulator,” Malhotra asserted.

AI as Augmentation, Not Replacement

The Governor emphasized that AI should serve to augment human judgment, not replace it. He articulated a vision where AI tools empower human employees, making them more efficient and effective. Citing an example, Malhotra suggested that a relationship manager, equipped with an AI system capable of identifying appropriate products and flagging relevant risks, could service a greater number of customers with enhanced efficiency. This approach seeks to alleviate broader concerns about AI’s impact on employment intensity across various economic sectors.

“Meaningful human oversight, the ability to explain, to intervene, and where necessary to override, must remain a design principle and not an afterthought,” Malhotra stated, stressing the non-negotiable nature of human control.

Navigating the Risks of AI Adoption

While championing AI’s potential, Malhotra meticulously outlined several critical risks that banks must proactively address as they deepen their reliance on the technology. Cybersecurity emerged as a primary concern, with the Governor referencing a recent incident where AI itself was reportedly used to attack a system. This underscores the sophisticated and evolving nature of digital threats in an AI-driven landscape.

Bias within AI models was another significant point of concern. Malhotra warned that unchecked algorithms could develop preferences for or against specific geographies, occupations, or even communities, leading to discriminatory outcomes. He also raised the specter of “herding,” a phenomenon where a limited number of financial models or technology vendors supplying platforms across the banking system could inadvertently perpetuate a singular bias across the entire industry.

Beyond Compliance: Data Privacy and Vendor Management

The Governor urged banks to adopt a comprehensive approach to data privacy, moving beyond mere legal compliance to embrace it as a fundamental responsibility. Furthermore, he called for robust management of AI-related risks, particularly when collaborating with external partners. Malhotra stressed that AI platforms must offer explainability, elucidating the rationale behind their recommended decisions on various proposals.

RBI’s Call for Transparency and Governance

To ensure systematic oversight, Malhotra announced that the RBI expects banks to maintain a complete inventory of all AI models operating within their systems. This transparency initiative aims to provide the regulator with a clear understanding of the AI landscape in banking.

He further mandated that banks must implement a board-approved AI governance policy. This policy, Malhotra explained, should establish clear accountability for outcomes generated by AI, shifting the focus from mere technology procurement to responsible deployment and impact. “Meaningful human oversight must be retained at every stage where an error by an AI system could cause material harm to a customer or raise concerns about financial stability,” he concluded, reinforcing the RBI’s unwavering commitment to consumer protection and financial stability in the age of artificial intelligence.

The RBI’s stance provides a crucial framework for Indian lenders, encouraging innovation while firmly anchoring it in principles of ethics, accountability, and human-centric decision-making as they navigate the transformative potential of AI.