Neura News

AI News

News reporting focused on AI and machine learning, covering the companies behind these technologies, their real-world applications, and the ethical concerns they raise. This includes areas like generative AI (large language models, text-to-image and video), speech tech, and predictive analytics.

Latest News

20 articles
Developer

LangChain and NVIDIA Launch NemoClaw Deep Agents Blueprint

LangChain and NVIDIA have released the NemoClaw for LangChain Deep Agents blueprint, designed to help enterprises build open, governed agent systems. The blueprint combines LangChain Deep Agents Code, NVIDIA Nemotron 3 Ultra, and NVIDIA OpenShell runtime, enabling teams to tune agents for their workloads, run them securely, and optimize for quality, cost, and speed. In evaluations, Nemotron 3 Ultra with a tuned LangChain Deep Agents harness achieved an aggregate score of 0.86 at a cost of $4.48, roughly 10 times lower inference cost than the next closest performing model.

Jul 257 minNeura News
AI Models

Petals Lets Users Run Large AI Models at Home Like BitTorrent

Petals is a decentralized platform that allows users to run large language models such as Llama 3.1, Mixtral, Falcon, and BLOOM on consumer-grade hardware by sharing computational resources in a peer-to-peer network. Users load only a portion of a model and join a network of others serving the remaining parts, enabling inference speeds of up to 6 tokens per second for Llama 2 70B and 4 tokens per second for Falcon 180B. The platform supports fine-tuning, custom sampling methods, and access to hidden states, combining the convenience of an API with the flexibility of PyTorch and Hugging Face Transformers.

Jul 232 minNeura News
Industry

Data center electricity use could quadruple by 2035

A new report from BloombergNEF predicts that U.S. data centers will consume four times more electricity by 2035, accounting for one-fifth of the nation's total power generation. The surge is driven by AI compute demand, with nearly half of new capacity going to training and inference. The forecast is 83% higher than BloombergNEF's previous estimate, reflecting rapid data center development and strained electrical grids.

Jul 213 minNeura News
AI Tools

Disaggregated Prefill and Decode for LLM Inference on SageMaker HyperPod

AWS has introduced a method to separate the prefill and decode phases of large language model inference on SageMaker HyperPod. By running each phase on dedicated GPU pools connected via Elastic Fabric Adapter with RDMA, the approach eliminates interference that occurs when the phases share a single GPU. This results in more consistent per-token latency and independent scaling for long-context, high-concurrency workloads.

Jul 106 minNeura News
Funding

SambaNova raises $1B at $11B valuation five months after last round

SambaNova Systems has raised $1 billion at an $11 billion valuation in the first close of its Series F round, led by General Atlantic. The round comes roughly five months after the company's $350 million Series E and launch of its SN50 chip. CEO Rodrigo Liang said additional investors are expected in a second close soon. The company also announced that JPMorganChase has selected SambaNova as an inference infrastructure partner, deepening its ties with Intel through a co-development partnership.

Jul 84 minNeura News
AI Models

NVIDIA Confidential Computing Powers Apple Private Cloud Compute Expansion

NVIDIA announced that its GPUs with Confidential Computing are now used for confidential inference in Apple's Private Cloud Compute (PCC) as Apple expands PCC beyond its own data centers to Google Cloud. The integration, unveiled at Apple's WWDC 2026, uses NVIDIA Blackwell GPUs to support server-side inference for Apple Foundation Models, built by Apple and Google using technologies behind the Gemini family of models. The hardware-based security layer ensures that no one, including system builders, can access user data during processing.

Jun 93 minNeura News
Research

Study Tests Whether Transformers Need All Three QKV Projections

A new paper systematically evaluates three variants of projection sharing in transformer attention: shared key-value, shared query-key, and a single projection. The authors found that sharing key and value projections performs on par with standard QKV attention while reducing KV cache by 50% with only 3.1% perplexity degradation. Combining this with grouped-query or multi-query attention can cut cache by up to 96.9%, enabling practical on-device inference.

Jun 53 minNeura News
AI Models

Bonsai Image 4B Brings Image Generation to Local Devices

PrismML has released Bonsai Image 4B, a family of compact image-generation models that run on local devices like laptops and phones. The models use binary and ternary weight representations to shrink the diffusion transformer to under 1 GB, enabling on-device inference on iPhone 17 Pro Max and other Apple Silicon hardware. Two variants offer different trade-offs between footprint and quality, retaining up to 95% of the accuracy of the full-precision FLUX.2 Klein 4B base model.

May 314 minNeura News
AI Tools

AWS details observability strategy for SageMaker AI LLM inference

AWS published a technical guide on comprehensive observability for large language models deployed on Amazon SageMaker AI. The approach separates monitoring into infrastructure quantity and LLM quality dimensions, using CloudWatch and Amazon Managed Grafana to visualize GPU utilization, cost, and response quality signals. The solution includes alert thresholds for metrics such as safety scores and composite quality scores, evaluated by an LLM-as-judge setup.

May 304 minNeura News