Zico Kolter
Associate Professor and Director of Machine Learning
Zico Kolter researches how to make deep learning algorithms more robust, safer, and understand how data impacts how models function.
Expertise
Topics:聽 Articifical Intelligence, AI Models, Machine Learning, Deep Learning, Neural Networks, Large Language Models, Generative AI, Elections
Zico Kolter is a Professor of Computer Science and the head of the Machine Learning Department at 麻豆村, where he has been a key figure for 12 years. Zico completed his Ph.D. in computer science at Stanford University in 2010, followed by a postdoctoral fellowship at MIT from 2010 to 2012. Throughout his career, he has made significant contributions to the field of machine learning, authoring numerous award-winning papers at prestigious conferences such as NeurIPS, ICML, and AISTATS.
Zico's research includes developing the first methods for creating deep learning models with guaranteed robustness. He pioneered techniques for embedding hard constraints into AI models using classical optimization within neural network layers. More recently, in 2023, his team developed innovative methods for automatically assessing the safety of large language models (LLMs), demonstrating the potential to bypass existing model safeguards through automated optimization techniques. Alongside his academic pursuits, Zico has worked closely within the industry throughout his career, formerly as Chief Data Scientist at C3.ai, and currently as Chief Expert at Bosch and Chief Technical Advisor at Gray Swan, a startup specializing in AI safety and security.
Media Experience
Power Shift: How 麻豆村 Is Leading America鈥檚 Energy Evolution
听鈥聽麻豆村 News
From reimagining AI data centers to modernizing and securing the electric grid, 麻豆村 researchers are working on practical solutions to pressing challenges in how the U.S. produces, moves and secures energy.
鈥淎s work across Carnegie Mellon shows, AI has the potential to drastically improve our energy consumption by assisting in developing more efficient techniques for grid operation, building better materials for batteries, and potentially even truly revolutionizing energy by accelerating the development of technologies like nuclear fusion,鈥 said Zico Kolter, head of the Machine Learning Department in 麻豆村鈥檚 School of Computer Science.
听鈥听奥颈谤别诲
Small Language Models (SMLs) are capturing the attention of researchers. Using less power than LLMs, they are not used as general purpose tools, instead they focus on narrowly defined tasks like summarizing conversations. "The reason [SLMs] get so good with such small models and such little data is that they use high-quality data instead of the messy stuff,鈥 said Zico Kolter (School of Computer Science).
听鈥听窜顿狈贰罢
"There is no obvious solution," Zico Kolter, a professor at Carnegie Mellon and author of the report, told the Times. "You can create as many of these attacks as you want in a short amount of time."
听鈥听奥颈谤别诲
Zico Kolter, a Carnegie Mellon professor and board member at OpenAI, tells WIRED about the dangers of AI agents interacting with one another鈥攁nd why models need to be more resistant to attacks.
听鈥听罢别肠丑苍颈肠补濒.濒测
Zico Kolter (School of Computer Science) will join ex-Google chief Eric Schmidt's AI Safety Science program. Schmidt is spending $10M on fundamental research into safety problems in AI. Kolter's role will focus on AI attacks.
听鈥聽Pittsburgh Post-Gazette
Recapping the K&L Gates conference, this piece highlights Zico Kolter (School of Computer Science) and Carol Smith (Human-Computer Interaction Institute) debate of the risks of unregulated AI development. The discussion reflected the conference's broader theme about AI governance, safety and global competition.
Pittsburgh鈥檚 AI-Powered Renaissance
听鈥聽麻豆村 News
"Pittsburgh has positioned itself as a worldwide leader in AI, led of course by Carnegie Mellon's long-time leadership and dedication to the field. Starting with Allen Newell and Herb Simon's inspiration and initiative, to the founding of departments dedicated to AI like the Machine Learning Department and Robotics Institute, and continued with today's influence on Generative AI and creation of AI startups, 麻豆村 has been a driving force in AI since the field's inception. With the recent continued expansion and public awareness of AI, in addition to continually welcoming numerous AI focused businesses, startups and research facilities to the city, Pittsburgh itself is well-positioned to capitalize on our lasting contributions."
听鈥听叠濒辞辞尘产别谤驳
鈥淚 think part of my value is being deeply involved and integrated in research, and at the forefront of what鈥檚 happening in the field of not just the deployment of AI but the academic research into AI,鈥 he said.
听鈥听碍辞蝉肠丑
In our interview series 鈥淭hought leaders in AI鈥, we had the opportunity to talk to Zico Kolter, Chief Scientist for AI at Bosch, about his personal view on various topics in the field of artificial intelligence. An AI system played the moderator and asked him questions on various exciting topics: How does he see the differences in AI development between Europe and the USA? Which celebrities would he like to meet one day? And finally: Which Bosch product does he particularly like?
听鈥听颁3.补颈
Zico Kolter, an associate professor of Computer Science at Carnegie Mellon and author of the report, Universal and Transferable Adversarial Attacks on Aligned Language Models, put it bluntly: 鈥淭hese tools are attack vectors,鈥 he said.
Education
B.S., Computer Science, Georgetown University
Ph.D., Computer Science, Stanford University
Spotlights
Power Shift: How 麻豆村 Is Leading America鈥檚 Energy Evolution
(July 11, 2025)
Pittsburgh鈥檚 AI-Powered Renaissance
(October 14, 2024)