Wonder & Worry

Guidelines by field

AI guidelines for software and AI developers what the field's own bodies ask

The people who build AI have the oldest codes and the newest laws. Professional codes ask engineers to avoid harm; company safety frameworks and two US state laws focus on rare, catastrophic risks. Most of these frameworks are written by the companies themselves.

Last reviewed 27 October 2026. Every claim links to its source.

At a glance

  1. Avoid harm, be honest and fair

    Respect creators' work, privacy and confidentiality.

  2. Build ethics in from the start

    Turn stakeholders' values into system requirements.

  3. Set thresholds in advance

    Define what safeguards a model needs before it crosses a dangerous capability level.

  4. Be willing to pause

    Delay deployment, or even development, if safeguards are not ready.

  5. Publish, report, protect whistleblowers

    California requires serious incidents to be reported within 15 days.

Who has spoken

Amplify existing pathways to severe harm.

OpenAI's definition of "High" capability

Binding and voluntary

Binding

California's SB 53 and New York's RAISE Act for the largest developers, and the EU AI Act's duties for general-purpose models since August 2025.

Voluntary

Company frameworks (self-written and self-enforced, though California now requires the largest developers to publish and follow one), the ACM Code, IEEE standards and the EU Code of Practice.

What changed in 2025 and 2026

Where people still disagree

Developer frameworks focus on rare, severe risks such as biological weapons, cyberattacks and loss of control, while almost every other field focuses on everyday errors, privacy and fairness. Both are real, and they call for different safeguards.

Questions to ask yourself

  • Have I written down, before I build, what my system must never do and how I would know if it did?
  • Who outside my team gets to check my risk assessment?
  • If something goes badly wrong after release, who do I tell, and how fast?

How this lines up with my everyday guidelines

My everyday guidelines beside this field's nearest rules
My everyday guidelinesThe field's nearest rule

4. Use for good Never use AI to deceive, manipulate or harm others.

Contribute to human well-being and avoid harm (ACM Code).

6. Stay curious and critical Question outputs. AI can be confident and wrong.

Evaluate systems thoroughly before and after release (ACM; METR).

Not part of my everyday guidelines, which are for users rather than builders.

Set capability thresholds in advance and be ready to pause (company frameworks; METR).

Source 271

Association for Computing Machinery. ACM Code of Ethics and Professional Conduct. 22 Jun 2018. acm.org/code-of-ethics

See all sources

Source 272

IEEE Standards Association. IEEE 7000-2021, Model Process for Addressing Ethical Concerns during System Design. 15 Sep 2021. standards.ieee.org/news/ieee-7000

See all sources

Source 273

METR. Common Elements of Frontier AI Safety Policies (Dec 2025 version). metr.org/common-elements

See all sources

Source 274

Anthropic. Responsible Scaling Policy v3.0. 24 Feb 2026. anthropic.com/news/responsible-scaling-policy-v3 ; OpenAI. Updating our Preparedness Framework. 15 Apr 2025. openai.com/index/updating-our-preparedness-framework/ ; SiliconANGLE. Google DeepMind expands Frontier Safety Framework. 22 Sep 2025. siliconangle.com/2025/09/22/google-deepmind-expands-frontier-ai-safety-framework-counter-manipulation-shutdown-risks/

See all sources

Source 275

Future of Privacy Forum. California's SB 53, the first frontier AI law, explained. fpf.org/blog/californias-sb-53-the-first-frontier-ai-law-explained/ ; IAPP. The new frontier: lessons from California's SB 53 and New York's RAISE Act. iapp.org/news/a/the-new-frontier-lessons-from-california-s-sb-53-and-new-york-s-raise-act

See all sources

Source 137

Office of Governor Gavin Newsom. Governor Newsom signs SB 53. 29 Sep 2025. gov.ca.gov/2025/09/29/governor-newsom-signs-sb-53-advancing-californias-world-leading-artificial-intelligence-industry/

See all sources

Source 256

European Commission. The General-Purpose AI Code of Practice. 10 Jul 2025. digital-strategy.ec.europa.eu/en/policies/gpai-code-practice

See all sources

Source 255

ActuIA (summary). AI Act obligations in force, and delays under Omnibus 2026/1744. actuia.com/en/news/ai-act-obligations-in-force-and-delays-under-omnibus-2026-1744/ ; Future of Life Institute, AI Act Explorer: Digital Omnibus (check EUR-Lex for the official text). artificialintelligenceact.eu/ai-act-explorer/digital-omnibus/ ; Gibson Dunn. EU AI Act omnibus agreement: postponed high-risk deadlines. gibsondunn.com/eu-ai-act-omnibus-agreement-postponed-high-risk-deadlines-and-other-key-changes/

See all sources