Lowering the Bar: How Large Language Models Can be Used as a Copilot by Hardware Hackers

Large language models (LLMs) can write code in "hardware languages" defining circuits. To learn if LLMs can be asked to add vulnerabilities to hardware, we ran a global competition. We found that teams could introduce even severe vulnerabilities, implying insufficient LLM guardrails.