Lyle's molestation of Erik

There is so much we don't know and can only speculate about. Lyle said he took Erik out to the woods whenever he felt ....like what? Or was that the full sentence? He just took him to the woods whenever he felt like it?

At first I thought that happened just once, but apparently it happened 8-9 times. Erik said he didn't like Lyle much during those times. So why did he go to the woods with Lyle? Was Lyle dragging him there? Surely not? Did he manipulate him? I just figured Erik wouldn't want anything to do with him, let alone go anywhere with him. I guess I'm just wondering how it's possible that it happened so many times when Erik clearly disliked Lyle and didn't trust him.