Model reference · open weights
pix2text-mfr is an open-weight language model from breezedeus, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Model Card: Pix2Text-MFR Mathematical Formula Recognition (MFR) model from Pix2Text (P2T). Model Details / 模型细节 This MFR model utilizes the TrOCR architecture developed by Microsoft, starting with its initial values and retrained using a dataset of mathematical formula images. The resulting MFR model can be used to convert images of mathematical formulas into LaTeX text representation. More detailed can be found: Pix2Text V1.0 New Release: The Best Open-Source Formula Recognition Model | Breezedeus.com. 此 MFR 模型使用了微软的 TrOCR 架构，以其为初始值并利用数学公式图片数据集进行了重新训练。 获得的 MFR 模型可用于把数学公式图片转换为 LaTeX 文本表示。更多细节请见：Pix2Text V1.0 新版发布：最好的开源公式识别模型 | Breezedeus.com。 Usage and Limitations / 使用和限制 - Purpose: This model is a mathematical formula recognition model, capable of converting input images of mathematical formulas into LaTeX text representation. - Limitation: Since the model is trained on images of mathematical formulas, it may not work when recognizing other types of images. - 用途：此模型为数学公式识别模型，它可以把输入的数学公式图片转换为 LaTeX 文本表示。 - 限制：由于模型是在数学公式图片数据上训练的，它在识别其他类型的图片时可能无法工作。 Documents / 文档 - Pix2Text V1.0 New Release: The Best Open-Source Formula Recognition Model | Breezedeus.com ; - Pix2Text (P2T) Github: breezedeus/pix2text ; - Pix2Text Online Free Service: p2t.breezedeus.com ; - Pix2Text Online Docs: Docs ; - Pix2Text More: breezedeus.com/pix2text ; - Pix2Text Discard: https://discord.gg/GgD87WM8Tf Examples / 示例 Printed Math Formula Images / 印刷体公式图片 Handwritten Math Formula Images / 印刷体公式图片 Model Use / 模型使用 Method 1: Using the model Directly This method doesn't need to install pix2text, but can only recognize pure formula images. 这种方法无需安装 pix2text，但只能识别纯公式图片。 Method 2: Using Pix2Text This method requires the installation of pix2text, utilizing the Mathematical Formula Detection model (MFD) within Pix2Text. It is capable of recognizing not only pure formula images but also mixed images containing text. 这种方法需要安装 pix2text，借助 Pix2Text 中的数学公式检测模型（MFD），它不仅可以识别纯公式图片，还可以识别包含文本的混合图片。 Method 3: Notebook Just try Pix2Text with this notebook: https://github.com/breezedeus/Pix2Text/blob/main/pix2textv11.ipynb. Performance / 性能 The original images for the test data are derived from real data uploade
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | breezedeus |
|---|---|
| Type | Language models |
| Variants | 1 |
| Runs with | transformers |
| Released | 2024-02-11 |
| Popularity | 358k downloads / month |
| Likes | 58 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| pix2text-mfr | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys pix2text-mfr for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (pix2text-mfr below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"pix2text-mfr","messages":[{"role":"user","content":"Hello"}]}'
Details
Tags
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗