







Human languages encode similar average information rates (~39 bits/s) despite their remarkable differences.
Different languages, similar encoding efficiency: Comparable information rates across the human communicative niche
Human languages encode similar average information rates (~39 bits/s) despite their remarkable differences. , Language is universal, but it has few indisputably universal characteristics, with cross-linguistic variation being the norm. For example, languages differ greatly in the number of syllables they allow, resulting in large variation in the Shannon information per syllable. Nevertheless, all natural languages allow their speakers to efficiently encode and transmit information. We show here, using quantitative methods on a large cross-linguistic corpus of 17 languages, that the coupling between language-level (information per syllable) and speaker-level (speech rate) properties results in languages encoding similar information rates (~39 bits/s) despite wide differences in each property individually: Languages are more similar in information rates than in Shannon information or speech rate. These findings highlight the intimate feedback loops between languages’ structural properties and their speakers’ neurocognition and biology under communicative pressures. Thus, language is the product of a multiscale communicative niche construction process at the intersection of biology, environment, and culture.

The Unbearable Slowness of Being: Why do we live at 10 bits/s?
Researchers at Caltech quantify human behavioral information throughput at approximately 10 bits/s across various tasks, highlighting a vast discrepancy with the brain's sensory input capacity,...

The evolution of syntactic communication
Animal communication is typically non-syntactic, which means that signals refer to whole situations1,2,3,4,5,6,7. Human language is syntactic, and signals consist of discrete components that have their own meaning8. Syntax is a prerequisite for taking advantage of combinatorics, that is, “making infinite use of finite means”9,10,11. The vast expressive power of human language would be impossible without syntax, and the transition from non-syntactic to syntactic communication was an essential step in the evolution of human language12,13,14,15,16. We aim to understand the evolutionary dynamics of this transition and to analyse how natural selection can guide it. Here we present a model for the population dynamics of language evolution, define the basic reproductive ratio of words and calculate the maximum size of a lexicon. Syntax allows larger repertoires and the possibility to formulate messages that have not been learned beforehand. Nevertheless, according to our model natural selection can only favour the emergence of syntax if the number of required signals exceeds a threshold value. This result might explain why only humans evolved syntactic communication and hence complex language.

Lossy communication constrains iterated learning
Humans' distinctive role in the world can largely be attributed to our capacity for iterated learning, a process by which knowledge is expanded and refined over generations. A range of theories seek to explain why humans are so adept at iterated learning, many positing substantial evolutionary discontinuities in communication or cognition. Is it necessary to posit large differences in abilities between humans and other species, or could small differences in communication ability produce large differences in what a species can learn over generations? We investigate this question through a formal model based on information theory. We manipulate how much information individual learners can send each other and observe the effect on iterated learning performance. Incremental changes to the channel rate can lead to dramatic, non-linear changes to the eventual performance of the population. We complement this model with a theoretical result that describes how individual lossy communications constrain the global performance of iterated learning. Our results demonstrate that incremental, quantitative changes to communication abilities could be sufficient to explain large differences in what can be learned over many generations.

Underdog Woof
Our text-to-speech models: one voice in 31.7 MB, or two voices in 40.6 MB with fewer word errors than Fish Audio Drama 3 at over 1,000 times smaller. They read phone numbers, dates, prices and codes the way people say them.

How Large Language Models Actually Work
Making robots more helpful with language
Even the simplest human tasks are unbelievably complex. The way we perceive and interact with the world requires a lifetime of accumulated experience and context. For ex…
Empirical evidence of Large Language Model's influence on human spoken communication
From the printing press to social media, innovations in communication technology have repeatedly reshaped how ideas spread through human culture. Chatbots powered by generative artificial intelligence constitute a new medium, encoding cultural patterns in their neural representations and disseminating them in conversations with hundreds of millions of people. Whether these patterns transmit into human language, and ultimately shape human culture, is a fundamental question. While fully quantifying the causal impact of a chatbot like ChatGPT on human culture is challenging, lexical shifts in human spoken communication may offer an early indicator. Here we show that words preferentially generated by ChatGPT, such as delve, showcase, boast, intricacies and meticulous, increased abruptly in spontaneous human speech. A synthetic-control analysis of 737,083 hours of conversation from 824,634 podcast episodes, screened for unscripted speech, causally links this shift to ChatGPT's release. The measurable influence on spontaneous speech suggests that humans internalize the lexical choices of large language models (LLMs). A preregistered experiment (N = 496) confirms they do, as a brief chatbot interaction led participants to adopt its words as their own, persisting past a distractor task and confirmed in forced lexical choice, indicating entrenchment in the active vocabulary. Together these results show that machines trained on human data now feed their own traits back into human language, integrating LLMs into the ongoing processes of cultural evolution.. This coupling raises concerns about linguistic homogenization and the capacity of a few major AI providers for latent cultural influence at scale.


AI learns language from skewed sources. That could change how we humans speak – and think | Bruce Schneier
Large language models aren’t trained on real-life conversations. As we encounter their language, it could affect our own


Remote work requires communicating more, less frequently | Ben Balter
Async communication is like gzip compression for humans—more upfront processing, but greater throughput with fewer packets.

LLMs and people both learn to form conventions -- just not with each other
Humans align to one another in conversation -- adopting shared conventions that ease communication. We test whether LLMs form the same kinds of conventions in a multimodal communication game. Both humans and LLMs display evidence of convention-formation (increasing the accuracy and consistency of their turns while decreasing their length) when communicating in same-type dyads (humans with humans, AI with AI). However, heterogenous human-AI pairs fail -- suggesting differences in communicative tendencies. In Experiment 2, we ask whether LLMs can be induced to behave more like human conversants, by prompting them to produce superficially humanlike behavior. While the length of their messages matches that of human pairs, accuracy and lexical overlap in human-LLM pairs continues to lag behind that of both human-human and AI-AI pairs. These results suggest that conversational alignment requires more than just the ability to mimic previous interactions, but also shared interpretative biases toward the meanings that are conveyed.

#precision #scaling #generalization #impact | Jean-Rémi King
Well, we did not expect that: in 10 days: 1.6K ⭐ on Github, 70K downloads on HuggingFace 🤗, >6M views on socials. 🧠 TRIBE v2, our new foundation model of the human brain responses to sight, sound, and language, has led to a surge of community demos, dozens of PRs and issues, and a level of engagement that rivals major flagships model at Meta (e.g. Llama4: 3.6M views, and DINOv3: 900K): https://lnkd.in/eQgqyDvf As this raised several questions, let me emphasize some elements of clarification: 1. #Precision: This model exclusively uses fMRI recordings. While powerful, these data are slow-paced proxy measurements of brain activity, and aggregate responses ~100k-3M neurons per data point. This means we are very far from a neuronal-level modeling of the brain. 2. #Scaling: We leveraged ~1,000 hours of naturalistic fMRI data. This is very substantial for a functional imaging study with naturalistic data; but still this is "small data" compared to medical or biology foundation models in general (e.g. structural MRI models are typically tens of thousands of individual brains). 3. #Generalization: The model shows surprising out-of-domain generalization, but it is **not** a replacement for new data collection. The model will almost surely fail in areas it hasn't seen: task-specific behaviors, memory protocols, touch sensation etc. And these are the "known unknowns" - I expect we'll discover many more unknown unknowns along the way. 4. #Impact: The goal of this model, and of our team in general, is fundamental research in neuroscience. While I am optimistic about how such foundation models will help clinical diagnosis, prognosis, and patient care, the physics of MRI is such that there is no clear path for making this kind of technology directly usable to consumer/wearable products. We're in for the science, hence the open sourcing: 📄 Paper: https://lnkd.in/e7cbunJp 💻 Code: https://lnkd.in/ebwBVuJp ▶️ Demo: https://lnkd.in/eEUVxP4S 🤗 Model: https://lnkd.in/e2T8nPJP
Language and AI: Guy Emerson on using AI with language data | Cambridge Language Sciences
It's a funny time to be working on language and AI. A year ago, this might have seemed like a niche interest, but these days ‘large language model’ is practically a household term. I recently had the chance to speak about language and AI at an event run by the Centre for Science and Policy, and I thought I would write a summary, because it seems a lot of people are interested in learning about how AI can be used with language data.
What Makes Language Human?
Words are combined into phrases and sentences in a dazzling array of patterns, collectively referred to as syntax. The complexity of syntax has long confounded researchers. Consider, for example, t…
