We present BLOOM+1, a method for adding language support to the BLOOM multilingual language model for zero-shot prompting. We demonstrate how to extend the capabilities of large multilingual models to new languages without full retraining.