poltextlab/illframes-climate-v4

xlm_roberta_base_10_5e-05_512_english

Model Description

This is an xlm-roberta-base model finetuned on English training data labelled with the Illframes Climate Codebook categories:

• 710: Threatening economic growth
• 720: Threatening national sovereignty
• 721: Climate conspiracy
• 722: Scientific scepticism and denial
• 723: Climate movement bashing
• 724: Other polluters as the real problem
• 730: Threatening energy security
• 740: Threatening way of life
• 799: None of them

---

How to Use the Model

from transformers import AutoTokenizer, pipeline

tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-base")
pipe = pipeline(
    model="poltextlab/illframes-climate_v3",
    task="text-classification",
    tokenizer=tokenizer,
    use_fast=False,
    token="<your_hf_read_only_token>"
)

text = "The European Green Deal is exactly why people, our citizens, pay increasingly expensive energy and food today..."
pipe(text)

Gated Access

This model requires gated access. You must pass the token parameter when loading the model. In earlier versions of the Transformers package, you may need to use the use_auth_token parameter instead.

Model Performance

The model was evaluated on a test set of 374 English examples.

Accuracy: 0.47

Precision: 0.50

Recall: 0.47

Weighted Average F1-score: 0.48

Classification report

Class	Precision	Recall	F1-Score	Support
710	0.41	0.46	0.43	48
720	0.41	0.55	0.47	33
721	0.31	0.38	0.34	48
722	0.40	0.53	0.46	30
723	0.45	0.52	0.49	48
724	0.81	0.63	0.70	40
730	0.65	0.54	0.59	48
740	0.64	0.45	0.53	31
799	0.43	0.27	0.33	48