Tech Times on MSN

Google open-sources ML drift: YouTube Shorts engine now available as TFLite GPU delegate ends

ML Drift open source release puts Google's battle-tested on-device GPU inference engine -- already running YouTube Shorts at 40% lower frame latency, Google Photos 2 seconds faster, and Snapchat at 30 ...
Tech Times on MSN

DeepSeek open-sources its inference engine, withholds cost-saving components

DeepSeek open-sources DeepInfer, its production AI inference framework for V4.1-Flash, under Apache 2.0 - but withholds ...
Crypto Briefing

DeepSeek open-sources DeepInfer, the inference engine behind its production models

DeepSeek open-sourced DeepInfer, its Apache-2.0 inference framework for V4.1-Flash, with support for NVIDIA SM100 and Huawei ...
MarkTechPost

DeepSeek Open-Sources DeepInfer, the Inference Framework Behind DeepSeek-V4.1-Flash

DeepSeek open-sourced DeepInfer, its production inference framework for DeepSeek-V4.1-Flash, reporting over 25,000 decode ...
Yahoo Finance

DigitalOcean Launches Inference Engine with New Capabilities for Production AI, Including Inference Router for Efficient Scaling of Agentic Workloads

The above button links to Coinbase. Yahoo Finance is not a broker-dealer or investment adviser and does not offer securities or cryptocurrencies for sale or facilitate trading. Coinbase pays us for ...
New Atlas

Next-level AI engine comes top in LLM speed showdown

Responses to AI chat prompts not snappy enough? California-based generative AI company Groq has a super quick solution in its LPU Inference Engine, which has recently outperformed all contenders in ...
The Next Web

DeepSeek open-sources DeepInfer, the engine that runs its AI models

DeepSeek open-sources DeepInfer, its production inference engine. It runs on Nvidia and Huawei chips and supports V4.1-Flash for now.
MarkTechPost

Liquid AI Launches RIPL, a Real-Time Inference Engine for Sub-50 ms LFMs

Liquid AI just announced Liquid RIPL, short for Real-time Inference Pipeline. RIPL is a low-latency engine that serves Liquid ...
VentureBeat

OpenInfer raises $8M for AI inference at the edge

OpenInfer has raised $8 million in funding to redefine AI inference for edge applications. It's the brain child of Behnam Bastani and Reza Nourai, who spent nearly a decade of building and scaling AI ...
Yahoo Finance

GMI Cloud Announces Cost-Effective High Performance AI Inference Engine at Scale

SAN JOSE, Calif., March 26, 2025 /PRNewswire/ -- GMI Cloud, a leading AI-native GPU cloud provider, today announced its Inference Engine which ensures businesses can unlock the full potential of their ...
VentureBeat

Simplismart supercharges AI performance with personalized, software-optimized inference engine

Enterprises are all in on AI. They want their models to run in production environments smoothly and with as high performance as possible to obtain a high return on investment. However, even with all ...
Nasdaq

DigitalOcean Launches Inference Engine with New Capabilities for Production AI, Including Inference Router for Efficient Scaling of Agentic Workloads

Built alongside early design partners, the Inference Engine gives AI developers unified control over performance, cost, and scale — with customers reporting up to 67% lower inference costs. Inference ...