kth8/gemma-3-270m-it-SuperGPQA-Classifier

A fine-tune of unsloth/gemma-3-270m-it on the m-a-p/SuperGPQA dataset.

Usage example

System prompt

You are a classifier. Categorize the following problem into discipline, field, and subfield in JSON format.

User prompt

Cotton and linen both readily catch fire. A batch of towels is composed of both cotton and linen, and is known to have caught fire. If it is known that the towels were ignited by a lit cigarette, which of the following arguments utilizes the most appropriate form of reasoning?

Assistant response

{"discipline": "Philosophy", "field": "Philosophy", "subfield": "Logic"}

Possible output options

Discipline

['Literature and Arts', 'Sociology', 'Science', 'Agronomy', 'Engineering', 'Medicine', 'History', 'Education', 'Law', 'Economics', 'Military Science', 'Management', 'Philosophy']

Field

['Agricultural Engineering', 'Optical Engineering', 'Electrical Engineering', 'Public Health and Preventive Medicine', 'Architecture', 'Management Science and Engineering', 'Pharmacy', 'Geography', 'Nuclear Science and Technology', 'Political Science', 'Weapon Science and Technology', 'Computer Science and Technology', 'Transportation Engineering', 'Aquaculture', 'Mechanical Engineering', 'Food Science and Engineering', 'Metallurgical Engineering', 'Sociology', 'Animal Husbandry', 'Chemical Engineering and Technology', 'Control Science and Engineering', 'Mechanics', 'Business Administration', 'Education', 'Psychology', 'Stomatology', 'Law', 'Language and Literature', 'Forestry', 'Applied Economics', 'Physics', 'Astronomy', 'Geophysics', 'Basic Medicine', 'Philosophy', 'Power Engineering and Engineering Thermophysics', 'Hydraulic Engineering', 'Oceanography', 'Traditional Chinese Medicine', 'Systems Science', 'Naval Architecture and Ocean Engineering', 'Art Studies', 'Environmental Science and Engineering', 'Materials Science and Engineering', 'Mining Engineering', 'Biology', 'Chemistry', 'Mathematics', 'Surveying and Mapping Science and Technology', 'Electronic Science and Technology', 'Library, Information and Archival Management', 'Geological Resources and Geological Engineering', 'Clinical Medicine', 'Physical Oceanography', 'Public Administration', 'Information and Communication Engineering', 'Physical Education', 'Forestry Engineering', 'Theoretical Economics', 'Atmospheric Science', 'Petroleum and Natural Gas Engineering', 'Instrument Science and Technology', 'Geology', 'History', 'Musicology', 'Aeronautical and Astronautical Science and Technology', 'Civil Engineering', 'Textile Science and Engineering', 'Crop Science', 'Veterinary Medicine', 'Military Science', 'Journalism and Communication']

Subfield

['Social Medicine and Health Management', 'Group Theory', 'Non-ferrous Metallurgy', 'Clinical Stomatology', 'Dynamic Meteorology', 'Architectural History', 'Biochemistry and Molecular Biology', 'Literary History', 'Land Resource Management and Administrative Management', 'Combinatorial Mathematics', 'Otorhinolaryngology', 'Microbiology and Biochemical Pharmacy', 'Radiochemistry', 'Maternal, Child and Adolescent Health', 'Human Anatomy and Histology-Embryology', 'Mineralogy, Petrology, and Economic Geology', 'Environmental Engineering', 'Animal Rearing and Breeding', 'Electromagnetic Field and Microwave Technology', 'Preschool Education', 'Information Management and Communication', 'Solid State Physics', 'Film Studies', 'Marine Engineering', 'Logic', 'Stellar and Interstellar Evolution', 'Immunology', 'Traffic Information Engineering and Control', 'Psychology', 'Communication and Broadcasting', 'Criminal Law', 'Optoelectronic Technology', 'Analytical Chemistry', 'Cryptography', 'Environmental and Resource Protection', 'Electrical Theory and New Technologies', 'Obstetrics and Gynecology', 'Functions of Complex Variables', 'Drama and Opera Studies', 'Traditional Chinese Health Preservation', 'Fundamental Mathematics', 'Discrete Mathematics', 'Oncology', 'Data Structures', 'Structural Geology', 'Broadcasting and Television Art', 'Traditional Chinese Pharmacy', 'Library and Archival Science', 'Tourism Management and Technological Economics Management', 'Ethics', 'Historical Geography', 'Instrumentation and Performance', 'Microbiology', 'Theoretical Mechanics', 'Hydrogeology', 'Urban Infrastructure Engineering', 'Paleontology and Stratigraphy', 'Iron and Steel Metallurgy', 'Zoology', 'Thermodynamics', 'Business and Accounting Management', 'Internal Combustion Engineering', 'Communication Principles', 'Underwater Acoustics', 'Musical Forms and Analysis', 'Crop Science', 'Communication and Information Systems', 'Refrigeration and Cryogenic Engineering', 'International Trade', 'Animal Nutrition and Feed Science', 'Oil and Gas Field Development and Storage & Transportation Engineering', 'Geometry and Topology', 'Textile Materials Science', 'Manufacturing Automation', 'Physical Geography', 'Religious Studies', 'Advanced Programming Languages', 'Special Education', 'Fluid Flow and Heat Transfer in Chemical Engineering', 'Archaeology and Museology', 'Ordinary Differential Equations', 'Relativity', 'Control Theory and Control Engineering', 'Poromechanics and Reservoir Physics', 'Mechatronic Engineering', 'Management Science and Engineering', 'Cell Biology', 'Pharmaceutical Analysis', 'Constitutional and Administrative Law', 'Psychiatry and Mental Health', 'Design Arts', 'Music History, Education, and Technology', 'Aquaculture', 'Radiation Medicine', 'Genetics', 'Philology and Bibliography', 'Neurology', 'Mathematical Analysis', 'Microelectronics and Solid-State Electronics', 'Demography and Anthropology', 'Electrodynamics', 'Water conservancy and Hydropower Engineering', 'Guidance, Navigation and Control', 'Computer Software and Theory', 'History and Theory of Journalism and Media Management', 'Economic History', 'Atomic and Molecular Physics', 'Radiation Protection and Nuclear Technology Applications', 'Emergency Medicine', 'Databases', 'Wood Science and Technology', 'Principles of Seismic Exploration', 'Geotechnical Engineering', 'Theoretical Fluid Mechanics', 'Atmospheric Physics and Atmospheric Environment', 'Pathogen Biology', 'Computational Mathematics', 'Optical Fiber Communication', 'Marine Chemistry', 'Digital Surveying and Remote Sensing Applications', 'Contract Law', 'Military Management', 'Stochastic Processes', 'Procedural Law', 'Applied Optics', 'Health Toxicology and Environmental Health', 'Modern and Contemporary Chinese Literature', 'Fuzzy Mathematics', 'Physical Chemistry', 'Traditional Chinese Medicine Theory', 'Human Geography', 'Geological Resources and Geological Engineering', 'Food Processing and Storage Engineering', 'Graph Theory', 'Urban Planning and Design', 'Semiconductor Physics', 'Pattern Recognition', 'Functions of Real Variables', 'Forensic Medicine', 'Subatomic and Atomic Physics', 'Legal Theory and Legal History', 'Thermal Energy Engineering', 'Solid Mechanics', 'Fluid Machinery and Engineering', 'Theoretical Optics', 'Aeronautical and Astronautical Science and Technology', 'Pediatrics', 'Veterinary Medicine', 'Hydraulics and Hydrology', 'Dermatology and Venereology', 'Transportation Planning and Management', 'Astronomical Observation and Technology', 'Quantum Mechanics', 'French Language and Literature', 'Landscape Plants and Ornamental Horticulture', 'Ophthalmology', 'Geodesy and Surveying Engineering', 'Operating Systems', 'Ship Mechanics and Design Principles', 'Circuits and Systems', 'Surgery', 'Environmental Science', 'Finance', 'Mineral Processing Engineering', 'Political Science', 'Industrial Economics', 'Antenna and Radio Communication', 'Rigid Body Mechanics', 'Nuclear Energy and Reactor Technology', 'Power Machinery and Engineering', 'Power Electronics and Electrical Drives', 'Nursing and Rehabilitation Medicine', 'Mining and Safety Engineering', 'Physical Education and Training', 'Russian Language and Literature', 'Social and Folklore Studies', 'Biophysics', 'Agricultural Environment and Soil-Water Engineering', 'High Voltage and Insulation Technology', 'Food Biochemistry', 'Polymer Physics', 'Computer Architecture', 'Number Theory', 'Architectural Design and Theory', 'Military Command and Information Systems', 'Particle and Nuclear Physics', 'Military Logistics and Equipment', 'Formal Languages', 'Cosmology', 'Principles of Computer Organization', 'International Law', 'Internal Medicine', 'Fine Arts', 'Systems Science', 'Meteorology', 'Classical Chinese Literature', 'Western Economics', 'Materials Processing Engineering', 'Information Management Science', 'Operations Research and Cybernetics', 'Sports Science and Medicine', 'Structural Engineering', 'Astrophysics', 'Solar System Science', 'Theory of Curriculum and Instruction', 'Pathology and Pathophysiology', 'Quantitative Economics', 'Labor Economics', 'Sports Humanities and Sociology', 'Polymer Chemistry and Physics', 'Mass Transport and Separation Process in Chemical Engineering', 'Bridge and Tunnel Engineering', 'Electrochemistry', 'Journalism and News Practice', 'Law and Social Governance', 'Military Thought and History', 'Botany', 'Weapon Systems Science and Engineering', 'Pharmaceutics', 'Military Chemistry and Pyrotechnics', 'Solid Earth Geophysics', 'Epidemiology and Health Statistics', 'Literary Theory', 'Fluid Physics', 'World History', 'Pharmacology', 'Computer Networks', 'Chemical Transport Engineering', 'Signal and Information Processing', 'Numerical Analysis', 'Organic Chemistry', 'Cartography and Geographic Information Engineering', 'Medicinal Chemistry', 'Probability and Statistics', 'Fundamentals of Dynamics and Control', 'Engineering Fluid Mechanics', 'Inorganic Chemistry', 'Forest Engineering', 'Physiology', 'National and Defense Economics', 'Clinical Laboratory Diagnostics', 'Philosophy of Science and Technology', 'Basic Stomatology', 'Ecology', 'Physical Chemistry of Metallurgical Process', 'Composition', 'Harmony', 'Laser Technology', 'Geriatric Medicine', 'Engineering Thermophysics', 'Public Finance', 'Agricultural Mechanization Engineering', 'Nutrition and Food Hygiene', 'Forest Cultivation and Genetic Breeding', 'Philosophical Aesthetics', 'Marine Biology', 'Vehicle Operation Engineering', 'Road and Railway Engineering', 'Linguistics and Applied Linguistics', 'Statistical Mechanics', 'Materials Physics and Chemistry', 'Educational Technology and Principles', 'Power Systems and Automation', 'Physical Oceanography', 'Elements of Chemical Reaction Engineering', 'Advanced Algebra', 'Military Law', 'Pitch and Scales', 'Instrument Science and Technology', 'Imaging and Nuclear Medicine', 'Thermodynamics and Statistical Physics', 'Anesthesiology', 'Education Economics, Management and Social Security', 'Principles of Metallurgy', 'Economic Statistics', 'Heat Transfer', 'Geochemistry', 'Textile Chemistry and Dyeing Engineering', 'Political Economy', 'Space physics', 'Dance Studies', 'Acoustics', 'Polynomials and Series Expansions', 'Special Number Theory', 'Civil and Commercial Law']

Model Details

• Base Model: unsloth/gemma-3-270m-it
• Parameter Count: 268098176
• Precision: torch.bfloat16

Training Settings

Hardware

• GPU: NVIDIA A100-SXM4-40GB

PEFT

• Rank: 32
• LoRA alpha: 64
• Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj

SFT

• Epoch: 2
• Batch size: 16
• Accumulation steps: 1
• Warmup ratio: 0.1
• Learning rate: 0.0002
• Optimizer: adamw_torch_fused
• Learning rate scheduler: cosine

Training stats

• Global step: 3152
• Training runtime (seconds): 1453.1352
• Average training loss: 0.11079519892083055
• Final validation loss: 0.07042485475540161

Framework versions

• Unsloth: 2026.3.8
• TRL: 0.22.2
• Transformers: 4.56.2
• Pytorch: 2.10.0+cu128
• Datasets: 4.3.0
• Tokenizers: 0.22.2

License

This model is released under the Gemma license. See the Gemma Terms of Use for details.