Model reference · open weights

gpt2-custom

gpt2-custom is an open-weight language model from EleutherAI, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

Licence fee required LLMs EleutherAI 1 variants 281 downloads/mo
Request a licence + hosting quote All served models Not on the shared API today — deployed on request.

About

What gpt2-custom is

Model Card for Model ID Model Details Model Description This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. - Developed by: [More Information Needed] - Funded by [optional]: [More Information Needed] - Shared by [optional]: [More Information Needed] - Model type: [More Information Needed] - Language(s) (NLP): [More Information Needed] - License: [More Information Needed] - Finetuned from model [optional]: [More Information Needed] Model Sources [optional] - Repository: [More Information Needed] - Paper [optional]: [More Information Needed] - Demo [optional]: [More Information Needed] Uses Direct Use [More Information Needed] Downstream Use [optional] [More Information Needed] Out-of-Scope Use [More Information Needed] Bias, Risks, and Limitations [More Information Needed] Recommendations Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. How to Get Started with the Model Use the code below to get started with the model. [More Information Needed] Training Details Training Data [More Information Needed] Training Procedure Preprocessing [optional] [More Information Needed] Training Hyperparameters - Training regime: [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -- Speeds, Sizes, Times [optional] [More Information Needed] Evaluation Testing Data, Factors & Metrics Testing Data [More Information Needed] Factors [More Information Needed] Metrics [More Information Needed] Results [More Information Needed] Summary Model Examination [optional] [More Information Needed] Environmental Impact Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019). - Hardware Type: [More Information Needed] - Hours used: [More Information Needed] - Cloud Provider: [More Information Needed] - Compute Region: [More Information Needed] - Carbon Emitted: [More Information Needed] Technical Specifications [optional] Model Architecture and Objective

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

MakerEleutherAI
TypeLanguage models
Parameters (lead)124M
Context1k tokens
Variants1
Runs withtransformers
Released2026-08-21
Popularity281 downloads / month
LicenceCommercial licence needed

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
gpt2-custom124MBF16~0.3 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys gpt2-custom for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (gpt2-custom below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"gpt2-custom","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

transformers safetensors gpt2_custom text-generation custom_code

Papers

Licence

Commercial licence needed

The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗

Sources

Weights & code

Want gpt2-custom on EU-owned hardware?

Request a licence + hosting quote See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms