notes
Short thoughts, interesting finds, and notes on technology, society, and whatever is currently on my mind.
Zarte, verblasste Blütenblätter
Stylistic camouflage
Die Kunst ist eine Tochter der Freiheit. – Friedrich Schiller. One of the studies, »Adversarial Poetry as a Universal Single-Turn Jailbreak Mechanism in Large Language Models« by Bisconti et al., shows that this freedom becomes a problem for many AI models. As soon as queries are made in poetic form, even modern systems respond with significantly less restraint. The researchers found that verse-like “adversarial poetry” prompts significantly weaken the security technology of various models and are effective solely through stylistic camouflage. ...
Not Primarily Due to Technical Superiority
In his article »Revealing the Hidden Economics of Open Models in the AI Era« Frank Nagle summarizes the study »The Latent Role of Open Models in the AI Economy«, which he co-authored with Daniel Yue from Georgia Tech. He shows how clearly open AI models are underestimated in the current market. The basis is an unusually extensive dataset on usage, pricing, and performance of various models. ...
