From the archive
Databricks releases DBRX model weights and hosted access
DBRX arrives as base and instruction-tuned models, with a 32K context window and tools for enterprise adaptation.
Databricks released DBRX, a general-purpose language model available as base and instruction-tuned weights. The company also opened hosted access for Databricks customers and tools for adapting the model to their own data.
Download or use the platform
The weights were published on Hugging Face under the DBRX license. The release has a 32,000-token context window, making it suitable for supplying documents or retrieved material alongside a question. The hosted route places model serving alongside the data and development tools already offered by Databricks.
A mixture of experts
DBRX has 132 billion total parameters, with 36 billion active for an individual input. Its mixture-of-experts design selects part of the model for each computation rather than using every parameter at once.
That approach aims to balance model capacity with the cost of serving requests. The Databricks profile covers the wider platform, managed model access, and deployment choices.