Moondream

Training a vision model, or how I learned to stop worrying and love dataset curation

Note: this is not some beginners guide, or how-to. Its an experiment in high dimensional space manifold gymnastics. Quick links to the model and dataset if you don’t care for the narrative version: This is the Badger Model 55 Water Meter: This thing sucks to read. Get down on your knees, enjoy the cement floor of a dark basement room, pull out a flash light and just try to guess if water is leaking from somewhere. The water company knows what they bill you, but your costs jump around li...

oxidecomputer/helios

Helios: Or, a Vision in a Dream. A Fragment.

moonlit.exposed

fragments and whatnots

moonshotai (Moonshot AI)

Org profile for Moonshot AI on Hugging Face, the AI community building the future.

Vision AI Leaderboard - Best Image & Multimodal Models

Compare and explore Vision models ranked by overall performance.

A foundation model of vision, audition, and language for in-silico neuroscience | Research - AI at Meta

Cognitive neuroscience is fragmented into specialized models, each tailored to specific experimental paradigms, hence preventing a unified model of...

Working notes on the role of vision papers in basic science

Many of the papers I most admire are vision papers1. Rather than abstractly define what a vision paper is, here's a list of a few examples of such papers, to convey the gist:

YOLOv8-Based XR Smart Glasses Mobility Assistive System for Aiding Outdoor Walking of Visually Impaired Individuals in South Korea

This study proposes an eXtended Reality (XR) glasses-based walking assistance system to support independent and safe outdoor walking for visually impaired people. The system leverages the YOLOv8n deep learning model to recognize walkable areas, public transport facilities, and obstacles in real time and provide appropriate guidance to the user. The core components of the system are Xreal Light Smart Glasses and an Android-based smartphone, which are operated through a mobile application developed using the Unity game engine. The system divides the user’s field of vision into nine zones, assesses the level of danger in each zone, and guides the user along a safe walking path. The YOLOv8n model was trained to recognize sidewalks, pedestrian crossings, bus stops, subway exits, and various obstacles on a smartphone connected to XR glasses and demonstrated an average processing time of 583 ms and an average memory usage of 80 MB, making it suitable for real-time use. The experiments were conducted on a 3.3 km route around Bokjeong Station in South Korea and confirmed that the system works effectively in a variety of walking environments, but recognized the need to improve performance in low-light environments and further testing with visually impaired people. By proposing an innovative walking assistance system that combines XR technology and artificial intelligence, this study is expected to contribute to improving the independent mobility of visually impaired people. Future research will further validate the effectiveness of the system by integrating it with real-time public transport information and conducting extensive experiments with users with varying degrees of visual impairment.

Sky Museum

A full 3D gallery where you can explore Bluesky feeds and art shares like the works of art they truly are.

How Does A Blind Model See The Earth? — LessWrong

Sometimes I'm saddened remembering that we've viewed the Earth from space. We can see it all with certainty: there's no northwest passage to search f…

Tolaria

A second brain for the AI era. Free forever, local-first, Markdown-based, Git-ready, and AI-friendly.

Ollama's new engine for multimodal models· Ollama Blog

Ollama now supports new multimodal models with its new engine.

TESSERA: Precomputed FAIR Global Pixel Embeddings for Earth...

Petabytes of satellite Earth Observation (EO) data are freely available and can address critical global challenges. However, EO data quality is poor due to clouds and variable lighting conditions....