Use case
#1
by
Bushido12
- opened
Hi!
How can end user use this for translating text?
You can try it out in https://huggingface.co/spaces/martinsu/tildeopen-30b-mu-instruct-space.
Correct way would be fine tune it on translation work with usage of special language tokens and appropriate training set, use masking, so that it doesnt waste compute to predict input text. And then use it with custom template while doing inference. However wrong SFT can damage model, SFT is easy for ones who actually do this on regular basis. Thats most effective way how to use LLMs for translation-only applications.
But its possible to use it simple way - just to select Your language from prompt and just ask it to translate given text as in chat mode.