End of training

README.md

@@ -0,0 +1,86 @@
+---
+license: apache-2.0
+base_model: Salesforce/codet5-base
+tags:
+- generated_from_trainer
+model-index:
+- name: codet5Base-Doc-step-1
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# codet5Base-Doc-step-1
+
+This model is a fine-tuned version of [Salesforce/codet5-base](https://huggingface.co/Salesforce/codet5-base) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0759
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 1
+- eval_batch_size: 1
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 30
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| No log        | 1.0   | 230  | 1.5475          |
+| No log        | 2.0   | 460  | 1.2669          |
+| 2.0737        | 3.0   | 690  | 1.1299          |
+| 2.0737        | 4.0   | 920  | 1.0710          |
+| 1.0726        | 5.0   | 1150 | 1.0345          |
+| 1.0726        | 6.0   | 1380 | 1.0217          |
+| 0.7523        | 7.0   | 1610 | 1.0132          |
+| 0.7523        | 8.0   | 1840 | 1.0215          |
+| 0.544         | 9.0   | 2070 | 0.9870          |
+| 0.544         | 10.0  | 2300 | 0.9926          |
+| 0.4227        | 11.0  | 2530 | 1.0094          |
+| 0.4227        | 12.0  | 2760 | 1.0106          |
+| 0.4227        | 13.0  | 2990 | 1.0087          |
+| 0.3384        | 14.0  | 3220 | 1.0196          |
+| 0.3384        | 15.0  | 3450 | 1.0264          |
+| 0.2754        | 16.0  | 3680 | 1.0283          |
+| 0.2754        | 17.0  | 3910 | 1.0341          |
+| 0.2371        | 18.0  | 4140 | 1.0493          |
+| 0.2371        | 19.0  | 4370 | 1.0506          |
+| 0.207         | 20.0  | 4600 | 1.0526          |
+| 0.207         | 21.0  | 4830 | 1.0518          |
+| 0.1761        | 22.0  | 5060 | 1.0600          |
+| 0.1761        | 23.0  | 5290 | 1.0644          |
+| 0.1735        | 24.0  | 5520 | 1.0668          |
+| 0.1735        | 25.0  | 5750 | 1.0635          |
+| 0.1735        | 26.0  | 5980 | 1.0726          |
+| 0.1487        | 27.0  | 6210 | 1.0711          |
+| 0.1487        | 28.0  | 6440 | 1.0760          |
+| 0.1451        | 29.0  | 6670 | 1.0757          |
+| 0.1451        | 30.0  | 6900 | 1.0759          |
+
+
+### Framework versions
+
+- Transformers 4.35.2
+- Pytorch 2.1.0+cu121
+- Datasets 2.16.1
+- Tokenizers 0.15.1

generation_config.json

@@ -0,0 +1,8 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "decoder_start_token_id": 0,
+  "eos_token_id": 2,
+  "pad_token_id": 0,
+  "transformers_version": "4.35.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c86a332227ce677654cc6723a03846f0805d87a9efcb0b8c6b0bfae2dd016ca1
+oid sha256:59af70105a0f0609b11a3fd8a526fb676f8e0a1a16f3987ac5b8e542444e69a2
 size 891558696

runs/Jan30_12-51-14_b24b8101f395/events.out.tfevents.1706619086.b24b8101f395.82606.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e920d36c21043bdeb0d713a5072622f306cc6de6d84c57e9393f5be17e129a08
-size 15014
+oid sha256:6c3c76b0369226ff02cfa0fdb0bd65744540029dcd88970062afc3ed62c86699
+size 15910