Upload modeling_patram.py

#5

Added torch_dtype detail.

I am actually trying to train the model using UnSloth.
Was getting error due to this missing of the following value

torch_dtype: Optional[Union[str, torch.dtype]] = "auto" wont this be a better addition as we are using the default of the gpu
hrithiksagar-tih changed pull request status to closed

Sign up or log in to comment