News / #funding Tag Funding 500 articles archived under #funding · RSS Sign in to follow arXiv — NLP / Computation & Language research 6d ago ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation arXiv:2610.09163v1 Announce Type: new Abstract: Task-oriented conversational agents remain fragile under real world conversation scenarios as they rarely follow a predictable script, especially when users exhibit non-cooperative behavior. Existing function-calling benchmarks… 12 arXiv — NLP / Computation & Language research 6d ago A Comparative Study of Evaluation Metrics for Long-Document Financial Narrative Summarization with Transformers arXiv:2610.09529v1 Announce Type: new Abstract: There are more than 2,000 listed companies on the UK's London Stock Exchange, divided into 11 sectors who are required to communicate their financial results at least twice in a single financial year. UK annual reports are very… 25 arXiv — NLP / Computation & Language research 6d ago RELATE: An Evaluation Framework for measuring Relational Orientation of Large Language Models arXiv:2610.09569v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for emotional support, raising concern that sustained use may draw users away from their real-world relationships. Yet existing evaluations primarily focus on the safety, empathy,… 33 arXiv — NLP / Computation & Language research 6d ago InsClaimBench: Benchmarking Insurance Claim Adjudication Across the Decision Chain arXiv:2610.09671v1 Announce Type: new Abstract: Recent advances in reasoning-oriented large language models (LLMs) have motivated increasing evaluation of their ability to perform professional decision tasks. Insurance claim adjudication is one such task, requiring models to… 14 arXiv — NLP / Computation & Language research 6d ago Judging in Latent Space: Efficient Generative Reward Modeling via Semantics-Preserving Compression arXiv:2610.09788v1 Announce Type: new Abstract: Reward modeling often requires jointly representing and reasoning over multiple evaluation criteria, yet verbalizing this process token by token can incur substantial inference cost. Recent work on latent reasoning suggests that… 24 arXiv — NLP / Computation & Language research 6d ago LLM Persuasion Is in the Eye of the Evaluation arXiv:2610.10232v1 Announce Type: new Abstract: Large language models (LLMs) have already been shown to match or exceed human experts in persuasion. While their persuasive capabilities hold promise for beneficial uses such as education and health communication, they can also be… 9 arXiv — NLP / Computation & Language research 6d ago PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs arXiv:2610.10455v1 Announce Type: new Abstract: Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post-hallucination reasoning (PHR) mainly characterize changes in final outcomes… 19 arXiv — NLP / Computation & Language research 6d ago Route-Verify-Vote: Procedure-Conditioned Self-Consistency for Mixed-Domain Reasoning arXiv:2610.08814v1 Announce Type: cross Abstract: Compositional generalization remains challenging when language models must combine familiar reasoning operations in unfamiliar ways. The Scenario-Based Commonsense Reasoning Evaluation (SCoRE) 2026 tests this ability on three… 9 arXiv — NLP / Computation & Language research 6d ago Is Word Error Rate Enough? Rethinking Privacy Evaluation in Speech with Entity-Aware Metrics arXiv:2610.08831v1 Announce Type: cross Abstract: As the use of smart devices continues to increase, their potential to capture sensitive speech content raises growing privacy concerns. It is therefore critical to develop techniques that prevent information leakage while… 31 arXiv — NLP / Computation & Language research 6d ago Coding-Agent Benchmarks Should Match Their Users' Task Flows arXiv:2610.09633v1 Announce Type: cross Abstract: The evaluation of coding agents generally strives to be as realistic as possible. In our study, we collect 4,782 agent sessions of real software engineers in JetBrains IDEs, which we call Production Sessions. Since our subject is… 6 TechCrunch — AI news-outlet 7d ago Nous Research confirms it hit $1.5B valuation, launches AI agents for business users The developer of Hermes agent raised a $90 million Series B. 37 TechCrunch — AI news-outlet 7d ago Healthleap raises $38M for its AI that flags hospital patients who may need a closer look The financing includes an $8M seed round co-led by Sequoia Capital and First Round Capital, and a $30 million Series A led by Hummingbird Ventures. 16 arXiv — Machine Learning research 7d ago Learning to Remember: Distilling Memory Retention for Compact Recurrent Neural Networks arXiv:2610.06942v1 Announce Type: new Abstract: Deep learning models, particularly recurrent neural networks and their variants, such as long short-term memory, have significantly advanced time series analysis. These models capture complex, sequential patterns in time series,… 7 arXiv — Machine Learning research 7d ago An Information-Theoretic Evaluation Framework for Benchmark and Model Diagnosis in Knowledge Tracing arXiv:2610.06988v1 Announce Type: new Abstract: Knowledge tracing (KT) models are predominantly evaluated using aggregate metrics such as area under the curve (AUC) and accuracy. However, these global scores obscure where the remaining errors originate and fail to indicate… 17 arXiv — Machine Learning research 7d ago Data, Numbers, and Geometry: Three Tutorials on Numerical Methods, Machine Learning, and Evaluation arXiv:2610.07220v1 Announce Type: new Abstract: We present three practical tutorials on numerical computation and machine learning for mathematical research, developed for the DANGER: Data, Numbers, and Geometry workshop held at the Banff International Research Station in April… 29 arXiv — Machine Learning research 7d ago Conditional Flow Matching for Transport Between Markov Processes arXiv:2610.07229v1 Announce Type: new Abstract: Motivated by sequence-to-sequence transport in the context time-series domain adaptation, we study the problem of transportation between trajectories of Markov processes. Given a limited number of trajectories from source… 35 arXiv — Machine Learning research 7d ago ATLAS-AL: Adaptive Trust-Region for Latent Adversarial Searches via Active Learning arXiv:2610.07323v1 Announce Type: new Abstract: Security evaluation of learning-based systems requires more than just testing the system against a fixed collection of attacks. It requires adaptive mechanisms that can efficiently discover \textit{sets} of inputs that induce model… 10 arXiv — Machine Learning research 7d ago Scale-Invariant Training for Time Series Foundation Models arXiv:2610.07324v1 Announce Type: new Abstract: Time series foundation models (TSFMs) are trained on large collections of time series datasets that span various morphologies and domains. This setting exposes models to series whose scales -- typical magnitudes of their values --… 29 arXiv — Machine Learning research 7d ago Dynamic Budget Allocation for LLM Evaluation under Hard Resource Constraints arXiv:2610.07362v1 Announce Type: new Abstract: We evaluate large language models (LLMs) in multi-turn interactions through their time-to-event: the number of interaction steps required to produce an event of interest, such as a successful jailbreak or agentic task completion.… 9 arXiv — Machine Learning research 7d ago Evaluation of Active Feature Acquisition Policies with Tabular Foundation Models arXiv:2610.07406v1 Announce Type: new Abstract: Active feature acquisition learns policies that sequentially acquire features to maximize information about a target variable. We study how to learn and evaluate such policies from finite offline data using prior-data fitted… 16 arXiv — Machine Learning research 7d ago Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series arXiv:2610.07499v1 Announce Type: new Abstract: Multimodal wearable systems must remain reliable when sensor streams become noisy or unavailable. Existing multimodal test-time adaptation (TTA) methods often assess reliability online, but cross-modal agreement can be misleading… 19 arXiv — Machine Learning research 7d ago Harmful SFT Leaves a Continuous Trace in LLM Checkpoint Updates arXiv:2610.07518v1 Announce Type: new Abstract: Safety auditing of post-trained large language models typically relies on model behavior, requiring model execution and depending on the coverage of available evaluations. This work asks a different question: Do the target… 32 arXiv — NLP / Computation & Language research 7d ago HouseholdBench: Evaluating Large Language Models as Predictors of Household Economic Behavior arXiv:2610.07563v1 Announce Type: new Abstract: Large language models (LLMs) have the potential to meet a key goal in economics: a quantitative model of household decision making, across a variety of settings. Yet existing evaluations cover few surveys and outcomes, and do not… 29 arXiv — NLP / Computation & Language research 7d ago Does Steering Break Your Model? A Multi-Dimensional Evaluation Suite for LLM Steering Methods arXiv:2610.07722v1 Announce Type: new Abstract: Activation steering provides a lightweight and flexible way to control large language model (LLM) behavior. However, effective steering requires more than inducing the intended behavior: it should also limit unintended changes and… 29 arXiv — NLP / Computation & Language research 7d ago Rethinking Faithfulness in LLMs: A Pairwise Context-Sensitive Perspective arXiv:2610.07894v1 Announce Type: new Abstract: Large language models (LLMs) are expected to answer questions faithfully based on the provided context, abstaining when the context information is insufficient to answer the questions. Existing faithfulness evaluations typically… 23 arXiv — NLP / Computation & Language research 7d ago The Labeling Problem in Hallucination Detection Benchmarks: An Empirical Evaluation arXiv:2610.08026v1 Announce Type: new Abstract: In recent years, several methods for detecting when large language models (LLMs) hallucinate have been developed. These methods are often benchmarked with open-domain question answering (QA) datasets containing questions and… 29 arXiv — NLP / Computation & Language research 7d ago Making COMET Comparable Across Scripts: Diagnosis and Correction of Tokeniser-Induced Script Bias in Indic MT Evaluation arXiv:2610.08159v1 Announce Type: new Abstract: COMET reports translation quality as a single number, and that number is routinely compared across target languages written in different scripts. Such a comparison assumes Script Invariance: the score should not depend on the… 28 arXiv — NLP / Computation & Language research 7d ago Memory Depth and Reconstructed Context Width: A Controlled Evaluation of Hierarchical Retrieval arXiv:2610.08300v1 Announce Type: new Abstract: Long-term conversational memory is becoming an integral component of modern LLM systems. Proposed architectures group records by topics and events, construct hierarchies and graphs, and connect facts through causal and temporal… 25 arXiv — NLP / Computation & Language research 7d ago Language Unalignability: Why Some Concepts Resist Cross-Cultural Benchmark Evaluation arXiv:2610.08303v1 Announce Type: new Abstract: Current evaluation of multilingual Large Language Models (LLMs) rests on an implicit Translation-Isomorphism Assumption (TIA): that semantic structures across languages are congruent and mutually mappable without loss of… 13 arXiv — NLP / Computation & Language research 7d ago Holdout Best-of-N: Unbiased Evaluation and Its Cost arXiv:2610.08719v1 Announce Type: new Abstract: Reusing the scores that select a Best-of-$N$ winner can overstate its expected reward. We study evaluation from a fixed matrix of $K$ independent scores per candidate for a policy that selects using $J$ fresh scores. A single… 21 arXiv — NLP / Computation & Language research 7d ago The Missing Minimal Pair: Stereotype Evaluation in LLMs arXiv:2610.08747v1 Announce Type: new Abstract: A common approach to measuring bias in Large Language Models is to compare the log-likelihoods of two contrastive stereotype sentences. We argue that such single-pair comparisons are often unreliable: simply rewriting the same… 35 TechCrunch — AI news-outlet 8d ago AI computing startup Lambda to raise $4B ahead of planned IPO Nvidia-backed Lambda is raising up to $4 billion at a $14.5 billion pre-money valuation ahead of a planned 2027 IPO, led by Coatue and Blackstone. 33 GitHub Blog — AI & ML official-blog 9d ago ReviewBench: An open benchmark for AI code review We’re launching ReviewBench, a benchmark for code review agents built on representative GitHub pull requests, multi-source ground truth, calibrated evaluation, and production-aligned metrics. The post ReviewBench: An open benchmark for AI code review appeared first on The GitHub… 22 Hacker News — AI on Front Page community 9d ago Europe's new robotics unicorn: Germany's RobCo hits $1B valuation Article URL: https://techfundingnews.com/europes-new-robotics-unicorn-germanys-robco-hits-1b-valuation/ Comments URL: https://news.ycombinator.com/item?id=49963366 Points: 224 # Comments: 202 14 arXiv — Machine Learning research 9d ago Validated Data Onboarding for AI Demand Forecasting on U.S. Building Meter Data: Design, Controlled Evaluation, and a Corrected Negative Result arXiv:2610.02397v1 Announce Type: new Abstract: Electric utilities and grid operators increasingly rely on machine-learning models to forecast next-day demand, and those models learn from meter data that is routinely defective: readings go missing, sensors freeze, buildings read… 18 arXiv — Machine Learning research 9d ago OpenGameEval: Benchmarking Agentic Programming and Exploration in a Stateful Game Engine arXiv:2610.02563v1 Announce Type: new Abstract: We present OpenGameEval, a benchmark and evaluation framework for agentic game development inside Roblox Studio. It runs language models as agents in reproducible, stateful game-engine sessions and scores each run with executable… 8 arXiv — Machine Learning research 9d ago A Two-Stage Cascade for Near-Real-Time Forest Anomaly Detection from Sentinel-1 SAR Time Series arXiv:2610.02763v1 Announce Type: new Abstract: Tropical forest monitoring is essential for global climate stability and biodiversity preservation. To address the urgent need for rapid, reliable detection of forest loss which is essential for timely intervention against illegal… 23 arXiv — NLP / Computation & Language research 9d ago Finding the Move Is Not Winning the Game: XiangqiBench for Closed-Loop Evaluation of LLM Agents arXiv:2610.02425v1 Announce Type: new Abstract: Static evaluations credit a language model for naming the right move, but an agent must carry a plan through to a verified outcome while an opponent responds. We introduce XiangqiBench, an executable benchmark that measures this… 34 arXiv — NLP / Computation & Language research 9d ago Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks arXiv:2610.02549v1 Announce Type: new Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain sensitivity, and unstable model behavior. Existing evaluations focus on in-domain… 29 arXiv — NLP / Computation & Language research 9d ago Automatic Evaluation of Mental Health Stigma in Online Communication arXiv:2610.02775v1 Announce Type: new Abstract: Mental health stigma has profoundly harmful impacts but its complexity makes it difficult to evaluate. Stigma may involve explicit derogation, but also subtler forms of blame, fear, paternalistic pity, social distancing, structural… 24 arXiv — NLP / Computation & Language research 9d ago Evaluating LLM-as-a-Judge Beyond Score Alignment: A Psychometric Analysis of Residual Judging Difficulty arXiv:2610.02877v1 Announce Type: new Abstract: Large language models (LLMs) are widely used as automatic judges, with validity typically assessed via alignment with human scores. However, aggregate agreement fails to reveal whether humans and LLMs find the same evaluation cases… 11 arXiv — NLP / Computation & Language research 9d ago Fast Models, Slow Evidence: A Paired and Self-Audited Evaluation of System-1 Decision Models for LLM Agent Harnesses arXiv:2610.02267v1 Announce Type: cross Abstract: Agent harnesses make many small, typed decisions per task: which model to call, which tool to use, whether retrieved text is relevant, whether an input carries an injection. System-1 decision models answer such questions in a… 7 arXiv — Machine Learning research 11d ago SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions arXiv:2610.00523v1 Announce Type: new Abstract: Conformal prediction guarantees marginal coverage, but a single calibration threshold can still spread that coverage unevenly, over-covering easy regions and under-covering hard ones. SimplexUQ is, to our knowledge, the first… 23 arXiv — Machine Learning research 12d ago Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents arXiv:2609.38536v1 Announce Type: new Abstract: Diffusion-based large language models (dLLMs) promise to break the sequential latency bottleneck of autoregressive agents through parallel decoding, but recent evaluations show this efficiency does not transfer to embodied agentic… 35 arXiv — Machine Learning research 12d ago LEARN-TS: LLM-Enhanced Alignment and Reconstruction with Normality Guidance for Multivariate Time-Series Anomaly Detection arXiv:2609.38789v1 Announce Type: new Abstract: Reconstruction errors in multivariate time-series anomaly detection may not reliably distinguish abnormal behavior from benign deviations. Language-derived semantics offer complementary context, but existing multimodal approaches… 27 arXiv — Machine Learning research 12d ago Visualizing Distribution Coverage in Generative Diffusion Models arXiv:2609.38853v1 Announce Type: new Abstract: Diffusion distillation is widely adopted to accelerate sampling, and the resulting few-step models are broadly believed to match or even surpass their multi-step teachers in generation. However, standard evaluations such as… 24 The Information — AI news-outlet 13d ago OpenAI Fires Three Safety Researchers OpenAI said it fired three safety employees for mishandling corporate information, which a person familiar with the matter said included sensitive information with an outside organization that does AI evaluations. “We have parted ways with three individuals for violating our… 37 The Information — AI news-outlet 13d ago Data Center Infra Provider Accelevation Sinks In Post-IPO Trading Data center infrastructure provider Accelevation’s shares were trading down roughly 5% on Thursday morning, as the stock continued to sink following its initial public offering earlier this week. The company on Sept. 29 raised $540 million, moving ahead with the offering even as… 7 arXiv — NLP / Computation & Language research 13d ago Framing the Narrative: Ideological Mimicry in Large Language Models arXiv:2609.38256v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to answer questions about politically contentious issues, yet evaluations typically treat a model's stance as a relatively stable property. Real users, however, communicate… 12 arXiv — NLP / Computation & Language research 13d ago Evaluating Language Model Safety Across Long Adversarial Conversations arXiv:2609.38357v1 Announce Type: new Abstract: Conversational safety evaluations often test language models with a single harmful prompt, even though real-world systems interact with users through long, adaptive conversations. This study examines whether models continue to… 30 Page 2 of 10 · 500 articles ← Newer Older →
