merge_output
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Linear merge method.
Models Merged
The following models were included in the merge:
- TheBloke/Wizard-Vicuna-7B-Uncensored-HF
- ausboss/llama7b-wizardlm-unfiltered
- QuixiAI/WizardLM-7B-Uncensored
Configuration
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: ausboss/llama7b-wizardlm-unfiltered
layer_range:
- 0
- 32
parameters:
weight: 0.3333333333333333
- model: QuixiAI/WizardLM-7B-Uncensored
layer_range:
- 0
- 32
parameters:
weight: 0.3333333333333333
- model: TheBloke/Wizard-Vicuna-7B-Uncensored-HF
layer_range:
- 0
- 32
parameters:
weight: 0.3333333333333333
dtype: bfloat16
merge_method: linear
parameters:
normalize: true
- Downloads last month
- 7