Neura News

AI News

News reporting focused on AI and machine learning, covering the companies behind these technologies, their real-world applications, and the ethical concerns they raise. This includes areas like generative AI (large language models, text-to-image and video), speech tech, and predictive analytics.

Latest News

7 articles
AI Models

Petals Lets Users Run Large AI Models at Home Like BitTorrent

Petals is a decentralized platform that allows users to run large language models such as Llama 3.1, Mixtral, Falcon, and BLOOM on consumer-grade hardware by sharing computational resources in a peer-to-peer network. Users load only a portion of a model and join a network of others serving the remaining parts, enabling inference speeds of up to 6 tokens per second for Llama 2 70B and 4 tokens per second for Falcon 180B. The platform supports fine-tuning, custom sampling methods, and access to hidden states, combining the convenience of an API with the flexibility of PyTorch and Hugging Face Transformers.

Jul 232 minNeura News
Research

Study Tests Whether Transformers Need All Three QKV Projections

A new paper systematically evaluates three variants of projection sharing in transformer attention: shared key-value, shared query-key, and a single projection. The authors found that sharing key and value projections performs on par with standard QKV attention while reducing KV cache by 50% with only 3.1% perplexity degradation. Combining this with grouped-query or multi-query attention can cut cache by up to 96.9%, enabling practical on-device inference.

Jun 53 minNeura News
AI Models

Bonsai Image 4B Brings Image Generation to Local Devices

PrismML has released Bonsai Image 4B, a family of compact image-generation models that run on local devices like laptops and phones. The models use binary and ternary weight representations to shrink the diffusion transformer to under 1 GB, enabling on-device inference on iPhone 17 Pro Max and other Apple Silicon hardware. Two variants offer different trade-offs between footprint and quality, retaining up to 95% of the accuracy of the full-precision FLUX.2 Klein 4B base model.

May 314 minNeura News
Automation

Jerry Tworek Launches Core Automation AI Lab

Former OpenAI researcher Jerry Tworek has started Core Automation, a new AI lab aimed at creating the most automated AI lab in the world by first automating its own research processes. The lab focuses on new learning algorithms that surpass pre-training and reinforcement learning methods, along with architectures that scale more effectively than transformers. Tworek, who left OpenAI after seven years in January 2026, joins other ex-OpenAI leaders in forming independent labs seeking fresh approaches to AI progress.

Apr 223 minNeura News