VR Forklift Simulation Data for RLHF - Skills Model and Indicators
Forklift-Simulator teaches people to operate forklifts in warehouses and industrial spaces using bespoke hardware. Our OSHA compliant training curriculum is based on real-world assessments and is used by more than 300+ companies across the globe.
Operators train with a compact hardware setup using real OEM forklift controls combined with a VR headset, navigating Unity based warehouse environments and exercises modeled on real-world scenarios. This process generates a rich multimodal dataset of human task execution: spatial, behavioral, and sequential.
In collaboration with academic partners, FL-Simulators developed a validated skills model with performance indicators, enabling deep training insights. The article on this research can be found here.
Revised Competency Model
Parallel Coordinate Plot of Cluster Averages (Expert vs other groups)
Box Plot of Cluster Averages
The dataset we are releasing is a snippet of the larger dataset that was used to draw insights for the above mentioned article. It represents a structured sample of this unique, real-world human learning environment designed to support research in simulation, reinforcement learning, RLHF, and embodied AI development.
It includes data from loading (engaging a load) sections of five performances along with their videos.
The dataset contains:
| timestamp | block_id | instance_id | p_bool_id | rule | rule_exp | value |
|---|---|---|---|---|---|---|
| 2023-06-19 11:11:35 | L-G2-A | 1 | 1 | 1 | safe height before driving | 0 |
| 2023-06-19 11:11:35 | L-G2-A | 1 | 1 | 2 | safe stacking | 1 |
| 2023-06-19 11:11:35 | L-G2-A | 1 | 1 | 3 | load against backrest | 1 |
| 2023-06-19 11:11:35 | L-G2-A | 1 | 1 | 4 | parking brake on | 1 |
| 2023-06-19 11:11:35 | L-G2-A | 1 | 1 | 5 | checked shhoulder before exiting (the block) | 0 |
| 2023-06-19 11:11:35 | L-G2-A | 1 | 1 | 6 | wheels straight before driving | 1 |
| ... | ... | ... | ... | ... | ... | ... |
Based on the reception of this dataset, a simulated environment in Unity that will allow users to benchmark their models on similar forklift tasks will be released.
More info: [email protected]