Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,224 @@
|
|
| 1 |
-
---
|
| 2 |
-
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
---
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
base_model: Qwen/Qwen-VL
|
| 5 |
+
tags:
|
| 6 |
+
- lora
|
| 7 |
+
- qwen-image
|
| 8 |
+
- anime
|
| 9 |
+
- background
|
| 10 |
+
- visual-novel
|
| 11 |
+
language:
|
| 12 |
+
- en
|
| 13 |
+
pipeline_tag: text-to-image
|
| 14 |
+
library_name: peft
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Anime Visual Novel Backgrounds LoRA
|
| 18 |
+
|
| 19 |
+
LoRA fine-tuned on Qwen-Image for generating consistent anime-style backgrounds for visual novels.
|
| 20 |
+
|
| 21 |
+
## Model Details
|
| 22 |
+
|
| 23 |
+
- **Base Model**: Qwen-Image-Edit
|
| 24 |
+
- **LoRA Rank**: 16
|
| 25 |
+
- **Training Steps**: 1000
|
| 26 |
+
- **Dataset Size**: 80 anime backgrounds
|
| 27 |
+
- **Specialization**: Visual novel backgrounds with time/weather control
|
| 28 |
+
|
| 29 |
+
## Trigger Word
|
| 30 |
+
|
| 31 |
+
**Required**: `anim3bg`
|
| 32 |
+
|
| 33 |
+
## Usage
|
| 34 |
+
|
| 35 |
+
### Basic Prompt Structure
|
| 36 |
+
```
|
| 37 |
+
anim3bg, anime style background, [location], [time], [weather], [lighting details], [specific elements], no characters, high quality
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
### Example Prompts
|
| 41 |
+
|
| 42 |
+
**School Hallway - Sunset:**
|
| 43 |
+
```
|
| 44 |
+
anim3bg, anime style background, japanese school hallway interior, sunset golden hour, warm orange and yellow lighting streaming through large windows, dramatic light reflections on polished wooden floor, shoe lockers lining left wall, sliding glass doors and windows on right side, empty peaceful corridor, nostalgic atmosphere, no characters, high quality
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
**City Street - Night Rain:**
|
| 48 |
+
```
|
| 49 |
+
anim3bg, anime style background, urban japanese street at night, heavy rain falling, wet asphalt reflecting colorful neon signs, glowing vending machines and shop lights, street lamps creating bokeh effect in rain, puddles with vibrant reflections, moody atmospheric lighting, no characters, high quality
|
| 50 |
+
```
|
| 51 |
+
|
| 52 |
+
**School Courtyard - Morning:**
|
| 53 |
+
```
|
| 54 |
+
anim3bg, anime style background, school courtyard with cherry blossom trees, early morning sunrise, soft pink and orange sky, gentle sunlight filtering through pink petals, wooden benches along brick pathways, fountain in center with water sparkling, peaceful spring atmosphere, no characters, high quality
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
**Beach - Sunset:**
|
| 58 |
+
```
|
| 59 |
+
anim3bg, anime style background, sandy beach shoreline, sunset golden hour, vibrant orange and pink sky with dramatic clouds, gentle waves washing onto shore, wooden pier extending into ocean, warm romantic atmosphere, no characters, high quality
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
**Library Interior - Afternoon:**
|
| 63 |
+
```
|
| 64 |
+
anim3bg, anime style background, quiet library interior, afternoon sunlight streaming through tall windows, dust particles visible in light beams, rows of wooden bookshelves filled with books, reading tables with desk lamps, peaceful studious atmosphere, no characters, high quality
|
| 65 |
+
```
|
| 66 |
+
|
| 67 |
+
## Time of Day Keywords
|
| 68 |
+
|
| 69 |
+
- `sunrise` / `early morning` - Soft pink/orange tones, gentle lighting
|
| 70 |
+
- `morning` - Bright morning light, fresh atmosphere
|
| 71 |
+
- `day` / `midday` - Bright daylight, strong shadows
|
| 72 |
+
- `afternoon` - Warm afternoon light, golden tones
|
| 73 |
+
- `sunset` / `golden hour` - Golden orange lighting, warm glow
|
| 74 |
+
- `evening` / `dusk` - Post-sunset, blue hour tones
|
| 75 |
+
- `night` - Dark with artificial lighting, street lamps
|
| 76 |
+
- `late night` - Very dark, minimal lighting, quiet atmosphere
|
| 77 |
+
|
| 78 |
+
## Weather Keywords
|
| 79 |
+
|
| 80 |
+
- `clear sky` / `clear` - No weather effects, good visibility
|
| 81 |
+
- `cloudy` / `overcast` - Gray sky, diffused lighting
|
| 82 |
+
- `partly cloudy` - Mixed conditions, scattered clouds
|
| 83 |
+
- `rainy` / `light rain` - Rain effects, wet surfaces with reflections
|
| 84 |
+
- `heavy rain` / `stormy` - Intense rain, dramatic atmosphere
|
| 85 |
+
- `foggy` / `misty` - Reduced visibility, mysterious atmosphere
|
| 86 |
+
- `snowy` / `snow falling` - Snow effects, white coverage
|
| 87 |
+
- `windy` - Movement suggestion, leaves blowing
|
| 88 |
+
|
| 89 |
+
## Lighting Keywords
|
| 90 |
+
|
| 91 |
+
Use these for better control:
|
| 92 |
+
- `warm lighting` - Orange/yellow tones
|
| 93 |
+
- `soft lighting` - Gentle, diffused light
|
| 94 |
+
- `dramatic lighting` - Strong contrast, shadows
|
| 95 |
+
- `golden hour lighting` - Sunset/sunrise warm glow
|
| 96 |
+
- `streaming light` / `light beams` - Rays of light visible
|
| 97 |
+
- `reflections` - Light bouncing off surfaces
|
| 98 |
+
- `glowing` - Artificial lights illuminated
|
| 99 |
+
- `atmospheric lighting` - Mood-setting light
|
| 100 |
+
|
| 101 |
+
## Recommended Settings
|
| 102 |
+
|
| 103 |
+
**For Best Results:**
|
| 104 |
+
- Always include trigger word `anim3bg` at the start
|
| 105 |
+
- Use natural language descriptions (not tags)
|
| 106 |
+
- Be specific about location and architectural details
|
| 107 |
+
- Include time of day with lighting description
|
| 108 |
+
- Add weather conditions
|
| 109 |
+
- Describe atmosphere/mood
|
| 110 |
+
- End with "no characters, high quality"
|
| 111 |
+
|
| 112 |
+
## Prompt Writing Tips
|
| 113 |
+
|
| 114 |
+
### ✅ DO:
|
| 115 |
+
- Use descriptive adjectives: "dramatic light reflections", "warm golden lighting"
|
| 116 |
+
- Include spatial details: "left wall", "right side", "in center"
|
| 117 |
+
- Describe materials: "polished wooden floor", "brick pathways"
|
| 118 |
+
- Add atmosphere: "nostalgic", "peaceful", "moody"
|
| 119 |
+
- Be specific about colors: "orange and yellow lighting", "pink and orange sky"
|
| 120 |
+
|
| 121 |
+
### ❌ DON'T:
|
| 122 |
+
- Use structured tags: `location:school, time:sunset`
|
| 123 |
+
- Use abbreviations: `bg`, `loc`
|
| 124 |
+
- Be too generic: just "school" instead of "japanese school hallway interior"
|
| 125 |
+
- Skip the trigger word `anim3bg`
|
| 126 |
+
- Include character-related terms
|
| 127 |
+
|
| 128 |
+
### Example of Good vs Bad Prompts:
|
| 129 |
+
|
| 130 |
+
**❌ Bad (Too Generic):**
|
| 131 |
+
```
|
| 132 |
+
anim3bg, school, sunset
|
| 133 |
+
```
|
| 134 |
+
|
| 135 |
+
**✅ Good (Detailed & Natural):**
|
| 136 |
+
```
|
| 137 |
+
anim3bg, anime style background, school courtyard with cherry trees, sunset golden hour, warm orange lighting, peaceful atmosphere, no characters, high quality
|
| 138 |
+
```
|
| 139 |
+
|
| 140 |
+
## Training Details
|
| 141 |
+
|
| 142 |
+
- **Training Data**: Custom curated dataset of anime backgrounds
|
| 143 |
+
- **Locations Covered**:
|
| 144 |
+
- School environments (classrooms, hallways, courtyards, rooftops)
|
| 145 |
+
- Urban settings (streets, stations, shopping districts)
|
| 146 |
+
- Nature scenes (beaches, parks, forests, riversides)
|
| 147 |
+
- Indoor locations (cafes, libraries, homes)
|
| 148 |
+
- **Variations**: Multiple times of day and weather conditions per location
|
| 149 |
+
- **Optimizer**: AdamW
|
| 150 |
+
- **Learning Rate**: 1e-4
|
| 151 |
+
- **Scheduler**: Cosine with warmup
|
| 152 |
+
- **Caption Style**: Natural language descriptions
|
| 153 |
+
|
| 154 |
+
## Limitations
|
| 155 |
+
|
| 156 |
+
- Best results with locations similar to training data
|
| 157 |
+
- May require multiple generations for perfect consistency
|
| 158 |
+
- Not designed for character generation
|
| 159 |
+
- Works best with detailed, natural language prompts
|
| 160 |
+
|
| 161 |
+
## Advanced Usage
|
| 162 |
+
|
| 163 |
+
### Consistency Across Scenes
|
| 164 |
+
|
| 165 |
+
To maintain consistency for the same location:
|
| 166 |
+
1. Use similar location descriptions
|
| 167 |
+
2. Keep architectural details consistent
|
| 168 |
+
3. Only change time/weather/lighting keywords
|
| 169 |
+
4. Consider using the same seed
|
| 170 |
+
|
| 171 |
+
**Example - Same Location, Different Times:**
|
| 172 |
+
```
|
| 173 |
+
Base: "japanese school hallway interior, shoe lockers on left, windows on right"
|
| 174 |
+
|
| 175 |
+
Morning: anim3bg, anime style background, [base], morning bright sunlight, ...
|
| 176 |
+
Sunset: anim3bg, anime style background, [base], sunset golden hour, ...
|
| 177 |
+
Night: anim3bg, anime style background, [base], night artificial lighting, ...
|
| 178 |
+
```
|
| 179 |
+
|
| 180 |
+
### Atmospheric Variations
|
| 181 |
+
|
| 182 |
+
Add mood descriptors for different feels:
|
| 183 |
+
- `nostalgic atmosphere` - Warm, memory-like
|
| 184 |
+
- `peaceful atmosphere` - Calm, serene
|
| 185 |
+
- `moody atmosphere` - Dark, dramatic
|
| 186 |
+
- `cheerful atmosphere` - Bright, happy
|
| 187 |
+
- `melancholic atmosphere` - Sad, bittersweet
|
| 188 |
+
|
| 189 |
+
### Seasonal Variations
|
| 190 |
+
|
| 191 |
+
Include seasonal keywords:
|
| 192 |
+
- `spring season, cherry blossoms`
|
| 193 |
+
- `summer season, bright green foliage`
|
| 194 |
+
- `autumn season, red and orange leaves`
|
| 195 |
+
- `winter season, snow coverage`
|
| 196 |
+
|
| 197 |
+
## Version History
|
| 198 |
+
|
| 199 |
+
- **v1.0** (2025-01-XX): Initial release
|
| 200 |
+
- 80 training images
|
| 201 |
+
- LoRA Rank 16
|
| 202 |
+
- 1000 training steps
|
| 203 |
+
- Focused on school and urban environments
|
| 204 |
+
|
| 205 |
+
## License
|
| 206 |
+
|
| 207 |
+
Apache 2.0
|
| 208 |
+
|
| 209 |
+
## Acknowledgments
|
| 210 |
+
|
| 211 |
+
Trained using Qwen-Image-Edit base model. Special thanks to the Qwen team for the excellent base model.
|
| 212 |
+
|
| 213 |
+
## Tips for Integration in Visual Novels
|
| 214 |
+
|
| 215 |
+
1. **Generate variations**: Create 2-3 versions of each scene
|
| 216 |
+
2. **Maintain logs**: Keep track of prompts and seeds used
|
| 217 |
+
3. **Post-processing**: Minor touch-ups in Photoshop/Krita if needed
|
| 218 |
+
4. **Consistent naming**: Use organized file naming (e.g., `ch01_scene03_school_morning.png`)
|
| 219 |
+
5. **Test in context**: View backgrounds with character sprites before finalizing
|
| 220 |
+
6. **Backup everything**: Save prompts, seeds, and original generations
|
| 221 |
+
|
| 222 |
+
**Enjoy creating beautiful anime backgrounds for your visual novel!** 🎨✨
|
| 223 |
+
|
| 224 |
+
---
|