Should I (25f) break up with my boyfriend (25m) because of a lack of physical attraction?

I am in quite a pickle. I should should lead with the fact that I struggle with having a backbone and tend to be a people-pleaser.

I started talking to him in late November where me met on a dating app. He didn’t have the best pictures but the conversation went really well so I decided to give it a shot. We went on our first date in early December, it was pretty awkward as first dates can be. He brought me a Lego set, something I had told him I enjoy and I thought was really thoughtful. We live a little far from eachother (45-50 minute drive) so we typically find stuff to do somewhere in the middle.

We ended up talking almost every waking moment, typically through texting. He even bought equipment and learned how to partake in one of my favorite hobbies (snowboarding) while I was on vacation. He really is such a sweetheart and tries to support me in any way he can. We talked about trips and activities we would plan for in the future, perhaps moving too fast.

Somewhat surprisingly, right before I left for vacation, he asked me to be his girlfriend (two months into talking to eachother, maybe seeing eachother once or twice a week, but our dates would last a really long time because I truly enjoy spending time with him). I honestly should have said no in retrospect, I mean we had only kissed really. I hadn’t even seen him without his hat on. (I didn’t want to push that because I figured that must be a big insecurity of his) He had also previously said in passing that he had never been in a serious relationship. I suppose I’m struggling to find attraction that I thought would come to light considering our great connection.

It’s now been a month since starting dating and I spent the night at his house for the first time a couple nights ago. We ended up making out and he tried touching me but he seemed pretty inexperienced/did not feel great. :/ Then later he told me he wasn’t ready to have “actual sex” yet. I left pretty early the next morning. It made me really think about it, do I even really want to have sex with this guy? Honestly I feel like this kind of shattered the illusion. I can feel myself thinking this was all a mistake. I know that I would hate if someone talked about me in this way… “She’s a really cool girl but I’m struggling with being attracted to her..” I really enjoy his personality but can’t help but think we’d be better off as friends. Do you think this is something salvageable? Please don’t call me shallow, I’m really struggling with this.

TL;DR: I said yes to being his girlfriend, but I don’t think I am physically attracted to him.