This position paper argues that AI agents used in scientific discovery should be studied as human-agent systems, not just evaluated on their standalone capabilities. The authors review current \"AI Scientist\" systems and find most only let humans set goals and check final outputs, missing the back-and-forth collaboration real science teams rely on.</p>\n<p>They point to concrete risks of this gap: hallucinated citations showing up in accepted NeurIPS and ACL papers, a documented drop in topic diversity when AI assists research, and signs of de-skilling among junior scientists who lean too heavily on AI tools. Two case studies (writing up a theorem with Gemini 3 Pro, and modeling thermonuclear burn with GPT-5) show how humans and agents can genuinely complement each other when experts stay actively involved.</p>\n<p>The paper ends with a simple framework for measuring collaboration benefit versus coordination cost, and calls for more research into human-AI synergy specifically for scientific discovery.</p>\n","updatedAt":"2026-08-18T03:12:22.744Z","author":{"_id":"66739484a660dfbb2643eb3d","avatarUrl":"/avatars/c9a6c6a1e295e448dacfccb1a2860e8a.svg","fullname":"Leo Y","name":"LeoYML","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":5,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9127150177955627},"editors":["LeoYML"],"editorAvatarUrls":["/avatars/c9a6c6a1e295e448dacfccb1a2860e8a.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2608.14667","authors":[{"_id":"6a83cd95675db694db8cd529","name":"Patrick Emami","hidden":false},{"_id":"6a83cd95675db694db8cd52a","name":"Sameera Horawalavithana","hidden":false},{"_id":"6a83cd95675db694db8cd52b","name":"Truc Nguyen","hidden":false},{"_id":"6a83cd95675db694db8cd52c","name":"Gihan Panapitiya","hidden":false},{"_id":"6a83cd95675db694db8cd52d","name":"Bruno Jacob","hidden":false},{"_id":"6a83cd95675db694db8cd52e","name":"Siddhisanket Raskar","hidden":false},{"_id":"6a83cd95675db694db8cd52f","name":"Saumya Sinha","hidden":false},{"_id":"6a83cd95675db694db8cd530","name":"Jared D. Willard","hidden":false},{"_id":"6a83cd95675db694db8cd531","name":"Andrew Glaws","hidden":false},{"_id":"6a83cd95675db694db8cd532","name":"Nithin Somasekharan","hidden":false},{"_id":"6a83cd95675db694db8cd533","name":"Ling Yue","hidden":false},{"_id":"6a83cd95675db694db8cd534","name":"Brian Lu","hidden":false},{"_id":"6a83cd95675db694db8cd535","name":"Shaowu Pan","hidden":false},{"_id":"6a83cd95675db694db8cd536","name":"Jason Eisner","hidden":false}],"publishedAt":"2026-08-02T00:00:00.000Z","submittedOnDailyAt":"2026-08-18T00:00:00.000Z","title":"Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems","submittedOnDailyBy":{"_id":"66739484a660dfbb2643eb3d","avatarUrl":"/avatars/c9a6c6a1e295e448dacfccb1a2860e8a.svg","isPro":false,"fullname":"Leo Y","user":"LeoYML","type":"user","name":"LeoYML"},"summary":"Large language model-based agents are increasingly deployed as collaborators in scientific discovery yet most current work focuses on the autonomous capabilities of \"AI Scientists\". We argue that this overlooks the social aspects of scientific teamwork, and that studying AI Scientists as human-agent systems (HAS)--where the unit of analysis is the human-agent pair--is both underexplored and undervalued. We establish these points through literature and empirical analysis, and highlight recent incidences and studies which show that deploying agents in science without accounting for human-agent dynamics introduces near-term risks, including reduced diversity of scientific inquiry. Through analysis of real-world case studies, we show that scientists and agents can augment each other's capabilities. We call for new research that adopts the HAS lens to develop mathematical frameworks for understanding and fostering human-AI synergy in scientific discovery.","upvotes":1,"discussionId":"6a83cd96675db694db8cd537","ai_summary":"Scientific collaboration with AI agents requires studying human-agent pairs to avoid risks like reduced inquiry diversity and to foster synergistic discovery.","ai_keywords":["large language model-based agents","AI Scientists","human-agent systems","human-agent dynamics","human-AI synergy"],"ai_summary_model":"thinkingmachines/Inkling-Small","organization":{"_id":"643ed46f947f8be48fca943a","name":"NatLabRockies","fullname":"National Laboratory of the Rockies","avatar":"https://www.gravatar.com/avatar/79f17685566d1ffcec51a75fc9b49d7a?d=retro&size=100"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"63ac5701c21e60a3e9b58aa7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63ac5701c21e60a3e9b58aa7/g6EX7diOpuA94R2ab-rZC.png","isPro":true,"fullname":"Dipankar Sarkar","user":"dipankarsarkar","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"organization":{"_id":"643ed46f947f8be48fca943a","name":"NatLabRockies","fullname":"National Laboratory of the Rockies","avatar":"https://www.gravatar.com/avatar/79f17685566d1ffcec51a75fc9b49d7a?d=retro&size=100"},"query":{}}">
Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems
Published on Aug 2
· Submitted by Leo Y on Aug 18 Abstract
Scientific collaboration with AI agents requires studying human-agent pairs to avoid risks like reduced inquiry diversity and to foster synergistic discovery.
Large language model-based agents are increasingly deployed as collaborators in scientific discovery yet most current work focuses on the autonomous capabilities of "AI Scientists". We argue that this overlooks the social aspects of scientific teamwork, and that studying AI Scientists as human-agent systems (HAS)--where the unit of analysis is the human-agent pair--is both underexplored and undervalued. We establish these points through literature and empirical analysis, and highlight recent incidences and studies which show that deploying agents in science without accounting for human-agent dynamics introduces near-term risks, including reduced diversity of scientific inquiry. Through analysis of real-world case studies, we show that scientists and agents can augment each other's capabilities. We call for new research that adopts the HAS lens to develop mathematical frameworks for understanding and fostering human-AI synergy in scientific discovery.
Community
This position paper argues that AI agents used in scientific discovery should be studied as human-agent systems, not just evaluated on their standalone capabilities. The authors review current "AI Scientist" systems and find most only let humans set goals and check final outputs, missing the back-and-forth collaboration real science teams rely on.
They point to concrete risks of this gap: hallucinated citations showing up in accepted NeurIPS and ACL papers, a documented drop in topic diversity when AI assists research, and signs of de-skilling among junior scientists who lean too heavily on AI tools. Two case studies (writing up a theorem with Gemini 3 Pro, and modeling thermonuclear burn with GPT-5) show how humans and agents can genuinely complement each other when experts stay actively involved.
The paper ends with a simple framework for measuring collaboration benefit versus coordination cost, and calls for more research into human-AI synergy specifically for scientific discovery.
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
Cite arxiv.org/abs/2608.14667 in a model README.md to link it from this page.
Cite arxiv.org/abs/2608.14667 in a dataset README.md to link it from this page.
Cite arxiv.org/abs/2608.14667 in a Space README.md to link it from this page.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.