bloom-1b7

About

What bloom-1b7 is

Version 1.0 / 26.May.2022 Model Card for Bloom-1b7 Table of Contents 1. Model Details 2. Uses 3. Bias, Risks, and Limitations 4. Recommendations 5. Training Data 6. Evaluation 7. Environmental Impact 8. Technical Specifications 9. Citation 10. Glossary and Calculations 11. More Information 12. Model Card Authors 13. Model Card Contact Model Details Model Description This section provides information for anyone who wants to know about the model. - Developed by: BigScience (website) All collaborators are either volunteers or have an agreement with their employer. (Further breakdown of participants forthcoming.) - Model Type: Transformer-based Language Model - Version: 1.0.0 - Languages: Multiple; see training data - License: RAIL License v1.0 (link) - Release Date Estimate: Monday, 11.July.2022 - Funded by: The French government. Hugging Face (website). Organizations of contributors. (Further breakdown of organizations forthcoming.) Uses This section addresses questions around how the model is intended to be used, discusses the foreseeable users of the model (including those affected by the model), and describes uses that are considered out of scope or misuse of the model. It provides information for anyone considering using the model or who is affected by the model. Intended Use This model is being created in order to enable public research on large language models (LLMs). LLMs are intended to be used for language generation or as a pretrained base model that can be further fine-tuned for specific tasks. Use cases below are not exhaustive. Direct Use - Text generation - Exploring characteristics of language generated by a language model - Examples: Cloze tests, counterfactuals, generations with reframings Downstream Use - Tasks that leverage language models include: Information Extraction, Question Answering, Summarization Misuse and Out-of-scope Use This section addresses what users ought not do with the model. See the BLOOM License, Attachment A, for detailed usage restrictions. The below list is non-exhaustive, but lists some easily foreseeable problematic use cases. Out-of-scope Uses Using the model in high-stakes settings is out of scope for this model. The

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys bloom-1b7 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (bloom-1b7 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"bloom-1b7","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Papers

Licence

Commercial licence needed

Sources

Weights & code

Explore

More language models