Artificial intelligence is moving fast, and so is the debate about how safe it needs to be before it reaches the public. Nvidia CEO Jensen Huang comments on AI safety and regulation on the growing discussion around AI safety, saying that companies should take responsibility for testing their systems rather than relying on more government rules.
Speaking at Salesforce’s Dreamforce conference, Huang said AI safety is mainly an engineering problem. His view is that companies building AI systems should test them properly, identify problems early, and avoid releasing a product if they are not confident that it is safe.
His comments come at a time when governments, technology companies, and researchers are still trying to work out how much oversight AI needs and where regulation should come into the picture.
Jensen Huang comments on AI Safety
For Huang, AI safety starts with the people building the technology.
He believes developers should have environments where they can test AI systems before releasing them to users. If testing reveals a serious problem, the product should be fixed before it goes any further.
His message is fairly simple: companies should not release an AI product if they are unsure about its safety.
That approach puts much of the responsibility on the technology companies themselves. Instead of waiting for regulators to set rules for every possible situation, Huang believes engineers can identify and deal with many safety issues during the development process.
It is also consistent with how other technology products are developed. Software is tested, bugs are fixed, security issues are investigated, and products can be updated when something goes wrong. Huang sees AI safety as part of that same engineering process, although AI systems can introduce their own set of challenges.
Why Jensen Huang Is Skeptical About More AI Regulation
Huang has also questioned whether additional AI regulation is the right answer to every potential risk.
His argument is that companies already have strong reasons to make reliable products. If an AI system causes problems, the company behind it could face financial losses, legal issues, reputational damage, and customers moving to alternatives.
From this perspective, businesses already have an incentive to make their products work properly and avoid preventable risks.
Huang has also argued that policymakers should focus on real-world problems rather than trying to create rules around every theoretical danger associated with AI.
This does not mean that he believes there should be no rules at all. His comments point more toward targeted regulation that addresses specific risks while allowing companies to continue developing the technology.
That distinction matters because AI is now used in very different ways. An AI tool helping someone write an email does not necessarily create the same risks as an AI system used in healthcare, financial decisions, cybersecurity, or critical infrastructure.
What Responsibility Do AI Companies Have?
Huang’s comments place a lot of attention on AI companies and the choices they make before putting products on the market.
Companies developing AI systems have to think about more than performance. They also need to consider how a system could behave in unusual situations, how users might misuse it, and what happens when the system makes a mistake.
Some basic areas companies can focus on include:
- Testing models before releasing them publicly
- Checking how systems respond to unexpected situations
- Looking for security vulnerabilities
- Adding safeguards to higher-risk applications
- Monitoring products after launch
- Fixing serious problems when they are discovered
- Being clear about what an AI system can and cannot do
These steps can help reduce risks without necessarily stopping development.
However, one question remains: can every company be trusted to set its own safety standards? Smaller companies may not have the same resources as large technology firms, while companies may also have different ideas about what level of risk is acceptable.
That is where the wider discussion about AI governance comes in.
Jensen Huang Comments on AI Governance and the Regulation Debate
AI governance covers the rules, standards, processes, and oversight used to guide the development and use of artificial intelligence.
The current debate is not simply about whether AI should have rules. A bigger question is what those rules should cover.
For example, policymakers may need different approaches for consumer chatbots, autonomous systems, medical AI, financial applications, and AI used by governments.
Some technology leaders and researchers believe stronger oversight is necessary, particularly as AI systems become more capable. Others argue that overly broad rules could make it harder for companies to develop new products and compete.
Huang falls closer to the second view. He has argued that AI development and safety do not have to be treated as opposing goals. Companies can continue building new systems while putting more effort into testing and safety during development.
There are also different views within the technology industry itself. Anthropic CEO Dario Amodei, for example, has called for stronger safeguards and coordination around advanced AI. Huang’s comments take a different approach, with greater emphasis on engineering and company responsibility.
The disagreement shows that there is still no single approach to AI governance that everyone in the industry supports.
What Could Happen Next?
The discussion around AI safety is likely to continue as more businesses begin using AI in everyday operations.
For companies developing AI products, testing and monitoring will remain important. For governments, the challenge is deciding where regulation can address genuine risks without creating rules that become outdated as the technology changes.
There is also a practical issue. AI development is happening quickly, while government policies often take much longer to create and update. A regulation designed for today’s technology may not fully address how AI systems work a few years from now.
This makes the relationship between technology companies and regulators particularly important. Stanford HAI’s 2026 AI Index reports that documented AI incidents increased from 233 in 2024 to 362 in 2025. Companies may need to share more information about risks, while policymakers may need to understand how these systems are actually being developed and used.
Conclusion
Jensen Huang’s comments have added another perspective to the discussion around AI safety and regulation. His view is that companies should take responsibility for testing their AI systems and should not release products when they are not confident about their safety.
The debate, however, goes beyond one CEO’s position. AI companies, researchers, governments, and users all have a role in deciding how the technology should be developed and used.
As AI becomes part of more products and services, AI governance and AI regulation will remain important topics. The key question will be how to deal with genuine risks while still giving companies enough room to develop useful AI technology.
Pingback: Huawei AI Chip Is Challenging Nvidia in China's AI Market - Trendrixa