Key members of the House Science Committee are raising red flags over a planned research partnership on artificial intelligence between the National Institute of Standards and Technology (NIST) and the RAND Corporation. This influential think tank, tied to tech billionaires and the controversial “effective altruism” movement, has come under scrutiny for its approach to AI safety research.
The Letter of Concern
In a letter dated December 14, lawmakers from both parties, including House Science Chair Frank Lucas and ranking member Zoe Lofgren, chastised NIST for a lack of transparency and a failure to announce a competitive process for planned research grants related to the new U.S. AI Safety Institute. The letter warns of the quality of AI safety research from outside groups, accusing them of routinely hiding behind secrecy and failing to provide evidence for their claims.
The Role of NIST and RAND
NIST, a key player in President Joe Biden’s AI plans, is tasked with establishing the AI Safety Institute and has released a framework to manage AI risks. However, the agency is notoriously resource-strapped and likely requires outside help to fulfill its growing AI mandate. RAND, known for its extensive research and policy analysis, has recently received significant funding from Open Philanthropy, a major supporter of effective altruism causes.
Controversies and Concerns
The partnership has raised eyebrows due to RAND’s ties to the effective altruism movement and its focus on existential AI risks, which many researchers argue are unsupported by evidence and could distract from current AI harms. The House letter emphasizes that “scientific merit and transparency must remain a paramount consideration,” reflecting a growing concern over how AI governance is shaped and the ideological influences behind it.
NIST’s Response and Future Steps
In response to the congressional letter, a NIST spokesperson stated that the agency is exploring options for a competitive process to support cooperative research opportunities related to the AI Safety Institute. However, no determinations have been made, and NIST maintains that it will execute its responsibilities in an open and transparent manner.
Implications for AI Safety Research
This controversy highlights the complex interplay between government agencies, private think tanks, and the broader AI research community. As AI continues to advance, ensuring that safety research is transparent, competitive, and scientifically rigorous is crucial. The involvement of Congress suggests a growing awareness of the importance of measurement and evidence in regulating AI, as well as the potential ideological biases that can influence policy and research.
As the situation unfolds, the AI community, policymakers, and the public will be watching closely to see how NIST addresses these concerns and whether the partnership with RAND will proceed as planned. The outcome could have significant implications for the future of AI safety research and governance.
Your First 10 AI Skills
10 practical AI skills, copy-paste prompts and a 7-day plan to start using AI with confidence.
Download the guide →