nekomeowww commited on
Commit
57a79b4
·
unverified ·
0 Parent(s):

feat: trained

Browse files
.gitattributes ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.lz4 filter=lfs diff=lfs merge=lfs -text
12
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
13
+ *.model filter=lfs diff=lfs merge=lfs -text
14
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
15
+ *.npy filter=lfs diff=lfs merge=lfs -text
16
+ *.npz filter=lfs diff=lfs merge=lfs -text
17
+ *.onnx filter=lfs diff=lfs merge=lfs -text
18
+ *.ot filter=lfs diff=lfs merge=lfs -text
19
+ *.parquet filter=lfs diff=lfs merge=lfs -text
20
+ *.pb filter=lfs diff=lfs merge=lfs -text
21
+ *.pickle filter=lfs diff=lfs merge=lfs -text
22
+ *.pkl filter=lfs diff=lfs merge=lfs -text
23
+ *.pt filter=lfs diff=lfs merge=lfs -text
24
+ *.pth filter=lfs diff=lfs merge=lfs -text
25
+ *.rar filter=lfs diff=lfs merge=lfs -text
26
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
27
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ # Audio files - uncompressed
37
+ *.pcm filter=lfs diff=lfs merge=lfs -text
38
+ *.sam filter=lfs diff=lfs merge=lfs -text
39
+ *.raw filter=lfs diff=lfs merge=lfs -text
40
+ # Audio files - compressed
41
+ *.aac filter=lfs diff=lfs merge=lfs -text
42
+ *.flac filter=lfs diff=lfs merge=lfs -text
43
+ *.mp3 filter=lfs diff=lfs merge=lfs -text
44
+ *.ogg filter=lfs diff=lfs merge=lfs -text
45
+ *.wav filter=lfs diff=lfs merge=lfs -text
46
+ # Image files - uncompressed
47
+ *.bmp filter=lfs diff=lfs merge=lfs -text
48
+ *.gif filter=lfs diff=lfs merge=lfs -text
49
+ *.png filter=lfs diff=lfs merge=lfs -text
50
+ *.tiff filter=lfs diff=lfs merge=lfs -text
51
+ # Image files - compressed
52
+ *.jpg filter=lfs diff=lfs merge=lfs -text
53
+ *.jpeg filter=lfs diff=lfs merge=lfs -text
54
+ *.webp filter=lfs diff=lfs merge=lfs -text
.gitignore ADDED
@@ -0,0 +1,185 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ .Trash/
2
+ .trash/
3
+ .DS_Store
4
+ **/.obsidian/
5
+ .postgres
6
+
7
+ # Node.js
8
+ .idea
9
+ .nuxt
10
+ .temp
11
+ .vite-inspect
12
+ components.d.ts
13
+ **/typed-router.d.ts
14
+ node_modules
15
+ .eslintcache
16
+ **/tsconfig.tsbuildinfo
17
+ **/vue-global-types.d.ts
18
+
19
+ dist
20
+ out/
21
+
22
+ *.local
23
+ *.log
24
+ **/.cache/**
25
+ **/temp/
26
+ .cache
27
+ # python - ultralytics
28
+ **/labels.cache
29
+
30
+ .coverage
31
+ .coverage.*
32
+ coverage/
33
+ cover/
34
+ htmlcov/
35
+
36
+ *.pcm
37
+ *.wav
38
+ *.ogg
39
+ *.mp3
40
+
41
+ # Make it easy for devenv users to override their local environment.
42
+ # See: https://github.com/moeru-ai/airi/pull/110#discussion_r2024378953
43
+ .direnv
44
+ .pre-commit-config.yaml
45
+ .envrc
46
+ .devenv*
47
+ devenv.*
48
+
49
+ # pixi environments
50
+ .pixi
51
+ *.egg-info
52
+
53
+ # Byte-compiled / optimized / DLL files
54
+ __pycache__/
55
+ *.py[cod]
56
+ *$py.class
57
+
58
+ # C extensions
59
+ *.so
60
+
61
+ # Distribution / packaging
62
+ .Python
63
+ build/
64
+ develop-eggs/
65
+ dist/
66
+ downloads/
67
+ eggs/
68
+ .eggs/
69
+ lib/
70
+ lib64/
71
+ parts/
72
+ sdist/
73
+ var/
74
+ wheels/
75
+ share/python-wheels/
76
+ *.egg-info/
77
+ .installed.cfg
78
+ *.egg
79
+ MANIFEST
80
+
81
+ # PyInstaller
82
+ # Usually these files are written by a python script from a template
83
+ # before PyInstaller builds the exe, so as to inject date/other infos into it.
84
+ *.manifest
85
+ *.spec
86
+
87
+ # Installer logs
88
+ pip-log.txt
89
+ pip-delete-this-directory.txt
90
+
91
+ # Unit test / coverage reports
92
+ .tox/
93
+ .nox/
94
+ nosetests.xml
95
+ coverage.xml
96
+ *.cover
97
+ *.py,cover
98
+ .pytest_cache/
99
+ .hypothesis/
100
+
101
+ # Translations
102
+ *.mo
103
+ *.pot
104
+
105
+ # Django stuff:
106
+ *.log
107
+ local_settings.py
108
+ db.sqlite3
109
+ db.sqlite3-journal
110
+
111
+ # Flask stuff:
112
+ instance/
113
+ .webassets-cache
114
+
115
+ # Scrapy stuff:
116
+ .scrapy
117
+
118
+ # Sphinx documentation
119
+ docs/_build/
120
+
121
+ # PyBuilder
122
+ .pybuilder/
123
+ target/
124
+
125
+ # Jupyter Notebook
126
+ .ipynb_checkpoints
127
+
128
+ # IPython
129
+ profile_default/
130
+ ipython_config.py
131
+
132
+ # PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
133
+ __pypackages__/
134
+
135
+ # Celery stuff
136
+ celerybeat-schedule
137
+ celerybeat.pid
138
+
139
+ # SageMath parsed files
140
+ *.sage.py
141
+
142
+ # Environments
143
+ .venv
144
+ env/
145
+ venv/
146
+ ENV/
147
+ env.bak/
148
+ venv.bak/
149
+
150
+ # Spyder project settings
151
+ .spyderproject
152
+ .spyproject
153
+
154
+ # Rope project settings
155
+ .ropeproject
156
+
157
+ # mkdocs documentation
158
+ /site
159
+
160
+ # mypy
161
+ .mypy_cache/
162
+ .dmypy.json
163
+ dmypy.json
164
+
165
+ # Pyre type checker
166
+ .pyre/
167
+
168
+ # pytype static type analyzer
169
+ .pytype/
170
+
171
+ # Cython debug symbols
172
+ cython_debug/
173
+
174
+ # PyCharm
175
+ # JetBrains specific template is maintained in a separate JetBrains.gitignore that can
176
+ # be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
177
+ # and can be added to the global gitignore or merged into this file. For a more nuclear
178
+ # option (not recommended) you can uncomment the following to ignore the entire idea folder.
179
+ #.idea/
180
+
181
+ # Ruff stuff:
182
+ .ruff_cache/
183
+
184
+ # PyPI configuration file
185
+ .pypirc
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ # Full model card template at https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md
3
+ language:
4
+ - en
5
+ - multilingual
6
+
7
+ license: mit
8
+
9
+ tags:
10
+ - YOLO
11
+ - ONNX
12
+ - onnxruntime
13
+
14
+ datasets:
15
+ - proj-airi/games-balatro-2024-ui-detection
16
+
17
+ base_model: Ultralytics/YOLO11
18
+ ---
19
+
20
+ <p align="center">
21
+ <img src="./docs/cover.png">
22
+ </p>
23
+
24
+ ## Balatro (2024, game) YOLO UI detection
25
+
26
+ > This project is part of (and also associate to) the [Project AIRI](https://github.com/moeru-ai/airi), we aim to build a LLM-driven VTuber like [Neuro-sama](https://www.youtube.com/@Neurosama) (subscribe if you didn't!) if you are interested in, please do give it a try on [live demo](https://airi.moeru.ai).
27
+ >
28
+ > Who are we?
29
+ >
30
+ > We are a group of currently non-funded talented people made up with computer scientists, experts in multi-modal fields, designers, product managers, and popular open source contributors who loves the goal of where we are heading now.
31
+
32
+ | Basic | Multiple card types | Description | Crowded cards |
33
+ | ------------------------- | ------------------------- | ------------------------- | ------------------------- |
34
+ | ![](./docs/example-1.jpg) | ![](./docs/example-2.jpg) | ![](./docs/example-3.jpg) | ![](./docs/example-4.jpg) |
35
+
36
+ ## Training
37
+
38
+ We trained this model on our own datasets labelled with n<1k images using Label Studio with YOLOv11n as the base model, it's
39
+ available on HuggingFace as well: [proj-airi/games-balatro-2024-ui-detection](https://huggingface.co/datasets/proj-airi/games-balatro-2024-ui-detection).
40
+
41
+ The training was performed on a single NVIDIA 4080Super GPU with 16GB VRAM, the loss optimized well and converged within set 2000 epochs.
42
+
43
+ ![](./docs/training-metrics-1.png)
44
+
45
+ ![](./docs/training-metrics-2.jpg)
46
+
47
+ ## Citation
48
+
49
+ If you find our works useful for your research, please consider citing:
50
+
51
+ ```bibtex
52
+ @misc{proj_airi_game_ai_models_balatro_2024_yolo_ui_detection_2025,
53
+ title = {Balatro (2024, game) YOLO UI detection},
54
+ author = {Project AIRI Team, Neko Ayaka, Makito, Rainbow Bird},
55
+ howpublished = {\url{https://huggingface.co/proj-airi/games-balatro-2024-yolo-ui-detection}},
56
+ year = {2025}
57
+ }
58
+ ```
59
+
60
+ ## License
61
+
62
+ This model is licensed under the MIT.
docs/cover.png ADDED

Git LFS Details

  • SHA256: ef25ce89efce941b7a44a14cccbf6918b1c3076eec5edb76fbc165353724ec23
  • Pointer size: 132 Bytes
  • Size of remote file: 1.59 MB
docs/example-1.jpg ADDED

Git LFS Details

  • SHA256: 71409cf7b63d30feb50b079ba072e328c0abf791f9cb5093d74c8902cf1ad95e
  • Pointer size: 131 Bytes
  • Size of remote file: 213 kB
docs/training-metrics-1.png ADDED

Git LFS Details

  • SHA256: 43080a88bc93e00f39152bc99b39b4e58f354bb858930f2d26786d3d991eac9e
  • Pointer size: 131 Bytes
  • Size of remote file: 272 kB
docs/training-metrics-2.jpg ADDED

Git LFS Details

  • SHA256: 0f385646ed1acd48f253e84cc4d98646a282c2f06a09b322dd1f5e7f4b5e2163
  • Pointer size: 131 Bytes
  • Size of remote file: 442 kB
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ed34cf2a3a37aef22d36e14a277fa6c84e14380376f2701579c1bb6c014e342
3
+ size 5613850
onnx/model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b952fac1e640beacacc4c71f55c568788fabe9d6667f02fc5d2f89409acab9f
3
+ size 10630294