Researchers Find Architectural Backdoors in AI Models Are Harder to Exploit in the Real World

Unlike traditional AI backdoors, which manipulate a model's learned parameters, architectural backdoors hide malicious instructions directly in the code that defines how the model operates. However, everyday image-processing operations, such as cropping, adjusting contrast, or adding noise, can change a trigger pattern and prevent an attack from working, according to Georgia Tech researchers, including OMSCS instructor Brendan Saltaformaggio.