Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utilize a specific model version from HuggingFace during LoRA fine-tuning #1199

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

sindhu-satish
Copy link

Some models on HuggingFace do not have safetensor files. There are unmerged PRs on HuggingFace with these files. This commit enables users to further customize and specify the commit hash of a particular model.

@sindhu-satish sindhu-satish changed the title Utilze a specific model version from HuggingFace during LoRA fine-tuning Utilize a specific model version from HuggingFace during LoRA fine-tuning Jan 10, 2025
@awni
Copy link
Member

awni commented Jan 10, 2025

The lora in mlx-examples/lora is really meant more as a simple example rather than something we are going to keep adding features to.

If you want to update this or send a new PR for the LoRA in mlx-lm that would make more sense.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants