ja-ko-vn-12b V2 (GGUF)

Main icon

This model translates text from Japanese visual novels or various games into Korean.

์ด ๋ชจ๋ธ์€ ์ผ๋ณธ์–ด๋กœ ๋œ ๋น„์ฃผ์–ผ ๋…ธ๋ฒจ ํ˜น์€ ๋‹ค์–‘ํ•œ ๊ฒŒ์ž„์˜ ํ…์ŠคํŠธ๋ฅผ ํ•œ๊ตญ์–ด๋กœ ๋ฒˆ์—ญํ•ฉ๋‹ˆ๋‹ค.

Updates

  • 2025/12/13 - Quant upload
  • 2025/12/13 - ์–‘์žํ™” ์—…๋กœ๋“œ

Model Details

Model Description

Google์˜ Gemma 3 12B ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•˜์—ฌ ๋น„์ฃผ์–ผ ๋…ธ๋ฒจ ๋“ฑ ๊ฒŒ์ž„๋ฅ˜์— ์ ํ•ฉํ•œ ๋ฒˆ์—ญ์„ ํ•˜๋„๋ก ๋‹ค์Œ ์ ˆ์ฐจ๋ฅผ ๊ฑฐ์ณค์Šต๋‹ˆ๋‹ค:

  1. ์ผ๋ณธ์–ด, ํ•œ๊ตญ์–ด์— ๋Œ€ํ•œ ๋ฌธํ•™ ๊ณ„์—ด ๋„๋ฉ”์ธ ์–ธ์–ด ํ•™์Šต (CPT)
  2. ๋น„์ฃผ์–ผ ๋…ธ๋ฒจ์˜ ์›๋ฌธ๊ณผ ๋ฒˆ์—ญ๋ฌธ ํ•™์Šต (SFT)
  3. ํŠน์ • ์ƒํ™ฉ ๋ฐ ๋‹จ์–ด์— ๋Œ€ํ•œ ๋„๋ฉ”์ธ ํ•™์Šต (DPO)

์ฃผ๋กœ "์ง์—ญ"์„ ์„ ํ˜ธํ•˜์‹œ๋Š” ๋ถ„๊ป˜ ์ ํ•ฉํ•ฉ๋‹ˆ๋‹ค.

  • Developed by: hell0ks
  • Model type: Translation
  • Language(s) (NLP): Japanese(Input), Korean(Output)
  • License: Gemma
  • Finetuned from model : google/gemma-3-12b-pt
  • Max context length : 4096 (๊นŒ์ง€๋งŒ ํ…Œ์ŠคํŠธ ๋จ)

V1๊ณผ์˜ ์ฐจ์ด์ 

  • Base model์ด Tri-7B์—์„œ Gemma-3-12B๋กœ ๋ณ€๊ฒฝ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
  • CPT, DPO ํ•™์Šต์„ ํ†ตํ•ด ์ข€ ๋” ์ž์—ฐ์Šค๋Ÿฌ์šด ์–ดํœ˜๋ฅผ ์‚ฌ์šฉํ•˜๋„๋ก ์œ ๋„ํ–ˆ์Šต๋‹ˆ๋‹ค.
  • ๊ณ ์œ  ๋ช…์‚ฌ ๊ณ ์ • ๊ธฐ๋Šฅ์ด ๋ถˆ์™„์ „ํ•œ ์ƒํƒœ๋กœ ๋ฆด๋ฆฌ์ฆˆ ๋œ ๊ฒƒ์„ ์ˆ˜์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.

Model Sources

Uses

  • Temperature: 0.1, Top_k = 0.95, repetition_penalty 1.05 ~ 1.1๋ฅผ ์ถ”์ฒœ๋“œ๋ฆฝ๋‹ˆ๋‹ค.
  • ๊ณ ์œ  ๋ช…์‚ฌ, ์ด๋ฆ„ ๋“ฑ์€ System prompt๋กœ ํžŒํŠธ๋ฅผ ์ฃผ์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์˜ˆ: ๅฒก้ƒจๅ€ซๅคช้ƒŽ=์˜ค์นด๋ฒ  ๋ฆฐํƒ€๋กœ,้˜ฟไธ‡้Ÿณ้ˆด็พฝ=์•„๋งˆ๋„ค ์Šค์ฆˆํ•˜
  • ํ”„๋กฌํ”„ํŠธ๋Š” ์ผ๋ณธ์–ด ์›๋ฌธ๋งŒ ์ž…๋ ฅํ•˜์„ธ์š”. ์ œ์–ด ์ฝ”๋“œ๋‚˜ ํŠน์ˆ˜๋ฌธ์ž๋„ ์ตœ๋Œ€ํ•œ ๊ทธ๋Œ€๋กœ ์œ ์ง€ํ•˜๋„๋ก ํ•™์Šต๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
  • Chat ๋ชจ๋“œ๋กœ ์‚ฌ์šฉํ•˜์ง€ ๋งˆ์‹œ๊ณ , Completions ๋ชจ๋“œ๋กœ ์‚ฌ์šฉํ•˜์„ธ์š”. ์‹ฑ๊ธ€ ํ„ด์œผ๋กœ๋งŒ ํ•™์Šต๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
  • llama.cpp์—์„œ ์‚ฌ์šฉํ•˜์‹ค ๋•Œ ๊ผญ --jinja ํ”Œ๋ž˜๊ทธ๋ฅผ ์‚ฌ์šฉํ•˜์„ธ์š”.

Out-of-Scope Use

  • ๋ฒˆ์—ญ์˜ ์ •ํ™•์„ฑ์ด ํฌ๊ฒŒ ์ค‘์š”ํ•˜์ง€ ์•Š์€ ์ž‘์—…์—๋งŒ ์‚ฌ์šฉํ•˜์„ธ์š”.

Bias, Risks, and Limitations

  • ์ผ๋ณธ์–ด์—์„œ ํ•œ๊ตญ์–ด ๋ฒˆ์—ญ๋งŒ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค. ๋ฐ˜๋Œ€๋‚˜ ๋‹ค๋ฅธ ์–ธ์–ด๋Š” ์ง€์›ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
  • Safety RL์ด ๋˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ์œ ์ €๊ฐ€ ์ž…๋ ฅํ•œ ๋Œ€์‚ฌ์— ๋Œ€ํ•ด ๊ทธ๋Œ€๋กœ ๋ฒˆ์—ญํ•ฉ๋‹ˆ๋‹ค.

Recommendations

  • ์‚ฌ์šฉ์ž(์ง์ ‘ ๋ฐ ํ•˜์œ„ ์‚ฌ์šฉ์ž ๋ชจ๋‘)๋Š” ๋ชจ๋ธ์˜ ์œ„ํ—˜์„ฑ, ํŽธํ–ฅ์„ฑ ๋ฐ ํ•œ๊ณ„์ ์„ ์ธ์ง€ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
  • ๊ธด ํ…์ŠคํŠธ๋ฅผ ๋ฒˆ์—ญํ•ด์•ผ ํ•˜๋Š” ๊ฒฝ์šฐ ๋ฌธ๋‹จ ํ˜น์€ ๋ฌธ์žฅ ๋‹จ์œ„๋กœ ์ด์šฉํ•˜์‹œ๋Š” ๊ฒƒ์„ ์ถ”์ฒœ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

Technical Specifications

Hardware

Nvidia DGX Spark, 2 Nodes

Software

Axolotl

Acknowledgement

ํ•™์Šต ํ•˜๋“œ์›จ์–ด๋ฅผ ๋Œ€๊ฐ€ ์—†์ด ์ง€์›ํ•ด์ฃผ์‹  ์ต๋ช…์˜ ๋ถ„๊ป˜ ๊ฐ์‚ฌ ์ธ์‚ฌ ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

Downloads last month
187
GGUF
Model size
12B params
Architecture
gemma3
Hardware compatibility
Log In to add your hardware

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for hell0ks/ja-ko-vn-12b-v2-gguf

Quantized
(1)
this model

Collection including hell0ks/ja-ko-vn-12b-v2-gguf