Text Generation
Transformers
PyTorch
English
qheart
feature-extraction
medical
ecg
question-answering
multimodal
custom_code
Instructions to use Manhph2211/Q-HEART with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Manhph2211/Q-HEART with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Manhph2211/Q-HEART", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Manhph2211/Q-HEART", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Manhph2211/Q-HEART with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Manhph2211/Q-HEART" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Manhph2211/Q-HEART", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Manhph2211/Q-HEART
- SGLang
How to use Manhph2211/Q-HEART with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Manhph2211/Q-HEART" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Manhph2211/Q-HEART", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Manhph2211/Q-HEART" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Manhph2211/Q-HEART", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Manhph2211/Q-HEART with Docker Model Runner:
docker model run hf.co/Manhph2211/Q-HEART
|
Download README.md from Manhph2211/Q-HEART: direct link, hf CLI and curl.
- Browser
- Download file 3 kB
-
https://huggingface.co/Manhph2211/Q-HEART/resolve/main/README.md
- Command line
-
hf download hf://Manhph2211/Q-HEART/README.md
-
curl -L -o README.md https://huggingface.co/Manhph2211/Q-HEART/resolve/main/README.md
3 kB
| license: apache-2.0 | |
| language: | |
| - en | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| tags: | |
| - medical | |
| - ecg | |
| - question-answering | |
| - multimodal | |
| - pytorch | |
| metrics: | |
| - exact_match | |
| - bertscore | |
| - bleu | |
| - rouge | |
| base_model: | |
| - meta-llama/Llama-3.2-1B-Instruct | |
| <div align="center" style="font-size: 1.5em;"> | |
| <strong>Q-HEART: ECG Question Answering via Knowledge-Informed Multimodal LLMs (ECAI 2025)</strong> | |
| </div> | |
| <div align="center"> | |
| <a href="https://github.com/manhph2211/Q-HEART/"><img src="https://img.shields.io/badge/Website-QHEART WebPage-blue?style=for-the-badge"></a> | |
| <a href="https://arxiv.org/pdf/2505.06296"><img src="https://img.shields.io/badge/arxiv-Paper-red?style=for-the-badge"></a> | |
| <a href="https://huggingface.co/Manhph2211/Q-HEART"><img src="https://img.shields.io/badge/Checkpoint-%F0%9F%A4%97%20Hugging%20Face-White?style=for-the-badge"></a> | |
| </div> | |
| <div align="center"> | |
| <a href="https://github.com/manhph2211/" target="_blank">Hung Manh Pham</a>   | |
| <a href="" target="_blank">Jialu Tang</a>   | |
| <a href="https://aqibsaeed.github.io/" target="_blank">Aaqib Saeed</a>   | |
| <a href="https://www.dongma.info/" target="_blank">Dong Ma</a>   | |
| </div> | |
| <br> | |
| ## Usage | |
| After we have access to [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) model and install suitable transformers package version, we can run: | |
| ```python | |
| # transformers==4.43.3 accelerate==1.0.1 peft==0.13.2 | |
| from transformers import AutoModel | |
| model = AutoModel.from_pretrained("Manhph2211/Q-HEART", trust_remote_code=True, dtype="auto") | |
| ``` | |
| Or | |
| ```bash | |
| git clone https://github.com/manhph2211/Q-HEART.git && cd Q-HEART | |
| conda create -n qheart python=3.9 | |
| conda activate qheart | |
| pip install torch --index-url https://download.pytorch.org/whl/cu118 | |
| pip install -r requirements.txt | |
| ``` | |
| Download the checkpoint from [here](https://huggingface.co/Manhph2211/Q-HEART) and place it at `ckpts/pytorch_model.bin`, then run evaluation: | |
| ```bash | |
| python main.py --model_type meta-llama/Llama-3.2-1B-Instruct --mapping_type Transformer | |
| ``` | |
| ## Citation | |
| ```bibtex | |
| @article{pham2025q, | |
| title={Q-Heart: ECG Question Answering via Knowledge-Informed Multimodal LLMs}, | |
| author={Pham, Hung Manh and Tang, Jialu and Saeed, Aaqib and Ma, Dong}, | |
| journal={arXiv preprint arXiv:2505.06296}, | |
| year={2025} | |
| } | |
| @inproceedings{pham2025qheart, | |
| title = {Q-HEART: ECG Question Answering via Knowledge-Informed Multimodal LLMs}, | |
| author = {Pham, Hung Manh and Tang, Jialu and Saeed, Aaqib and Ma, Dong}, | |
| booktitle = {Proceedings of the European Conference on Artificial Intelligence (ECAI)}, | |
| series = {Frontiers in Artificial Intelligence and Applications}, | |
| volume = {413}, | |
| pages = {4545--4552}, | |
| year = {2025}, | |
| publisher = {IOS Press}, | |
| doi = {10.3233/FAIA251356} | |
| } | |
| ``` | |
| <div align="center"> | |
| Please refer to our <a href="https://github.com/manhph2211/Q-HEART">GitHub repo</a> for more details! | |
| </div> |