My roommate is creeping me out

I live in a one room dorm on my campus and my roommate and I haven’t really talked at all. He mostly keeps to himself and I’ve already lived with him for a semester and a half. 2 weeks ago when I came back from the showers, I pit my shower shoes on my shoe shelf and my basket on the ground for a second and when I turned around (mind you wearing nothing but a towel) my roommate was like half a foot away from me. It made me jump which made him jump and he grabbed my wrist in a panic. Last night when I was sleeping, I shot awake at 11:30 and I found him in the same bed as me. I was super uncomfortable and gently tried waking him up without startling him. I told him he was in the wrong bed and he went back on his own. I’m definitely not dorming with this guy next semester and I’m not sure what to do during the meantime.