DeepSeek’s conditional memory fixes silent LLM waste: GPU cycles lost to static lookups

Through systematic experiments DeepSeek found the optimal balance between computation and memory with 75% of sparse model ...
InfoQ

Cactus v1: Cross-Platform LLM Inference on Mobile with Zero Latency and Full Privacy

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
InfoQ

Microsoft Research Develops Novel Approaches to Enforce Privacy in AI Models

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
eLife

Separating selection from mutation in antibody language models

This important study introduces a new biology-informed strategy for deep learning models aiming to predict mutational effects in antibody sequences. It provides solid evidence that separating ...