Tech Bytes: OpenAI and Broadcom unveil Jalapeño inference chip to power next wave of LLMs

The chip has been designed specifically for large language model inference — the stage where trained AI models generate ...

XMax Announces Up to Approximately US$25 million in AI API-Related Service Contracts and Expansion into GPU-as-a-Service

XMax Inc. (Nasdaq: XMAX) ("XMax" or the "Company") today announced a significant commercial milestone in its artificial ...

XMAX secures up to $25M in AI API contracts and enters GPU-as-a-service market

XMax (XMAX) announced a major commercial milestone in its artificial intelligence rollout, securing multiple enterprise AI model API service agreements with a combined potential value of up to $25 ...
InfoQ

JLama: The First Pure Java Model Inference Engine Implemented With Vector API and Project Panama

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Spencer Judge discusses the architectural ...
Nasdaq

Elasticsearch Open Inference API Extends Support for Hugging Face Models with Semantic Text

Applications using Hugging Face embeddings on Elasticsearch now benefit from native chunking “Developers are at the heart of our business, and extending more of our GenAI and search primitives to ...
Tech Times

OpenAI’s First Custom AI Chip Targets 50% Cheaper Inference: Jalapeño Unveiled

OpenAI’s first custom AI chip Jalapeño was unveiled today in partnership with Broadcom, claiming roughly 50% lower inference ...
SiliconANGLE

OpenRouter nabs $40M in funding for its AI inference API

OpenRouter Inc., a startup working to ease the development of artificial intelligence applications, today announced that it has secured $40 million in funding. The company raised the capital over two ...
Business Wire

Elasticsearch Open Inference API Now Supports Anthropic’s Claude

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, today announced the Elasticsearch Open Inference API now integrates with Anthropic, providing developers with seamless ...

Upbound Launches Modelplane: The Open Source Control Plane for AI Inference

AI inference is undergoing the same transformation that cloud infrastructure experienced a decade ago. Open-weight models have expanded who runs AI — neoclouds, regulated enterprises, and AI-native ...
SDxCentral

Elasticsearch Open Inference API Now Supports Mistral AI Embeddings

Mistral AI embeddings on Elasticsearch benefit from native chunking via a single API call SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, today announced the Elasticsearch ...

The Most Expensive Part Of AI Might Not Be The Model

This matters because AI usage is growing fast. Goldman Sachs estimated that global AI infrastructure spending could reach ...
Business Wire

Elasticsearch Open Inference API now Supports Jina AI Embeddings and Rerank Model

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, announced the Elasticsearch Open Inference API now supports Jina AI’s latest embedding models and reranking products.