Is babysitting really worth it when the parents see you as nothing but and employee?

I started babysitting a friend of a friends kids about February 2009. When I started out they really never listen to me and at times things where pretty bad but after a while they both got used to me. I am talking about a 4 year old boy and a girl soon to be 6. I have learning problems which really affects my memory and attention so at times I make a lot of mistakes. So at times id get them something to eat from the fridge and would then get them something else which is wasting. This wasn't all the time but sometimes id **** up and do this. There mother also complained how I tried to be there friend more then I disciplined them which wasn't true. I was very strict with them but was also very nice to them. When I was babysitting I seen there kids more then them so they both began to love me which in a way made them jealous because they act as if they love me more and there mom and dad are mean as hell to them so that's another reason. Not to mention there dad acts as if he doesn't like them. I missed a few times and didn't call her and let her know. Now things have gone down hill. As me and my parents where in the process of moving I decided that I couldn't do it anymore because of my inability to get to there house from where I am moving. The last day I was there she basically yelled at me for putting the kids yogurt in the fridge and giving them something else which you say as wasting and I also left there pop tarts on there little tables in the living room. She basically yelled me head off so instead of coming back later that day I called me dad and he came and got me from about 12 miles away. I didn't go back so shes mad at me and wants her kids no where near me. Shes even looking for a new babysitter which I don;t really mind because I decided I needed to get a job more them just making 20 dollars a week. Even though I cant get there I feel sad because Ive grown to love her kids and they love me but right now I cant see them for the entire summer but if she decides she never wants me near her kids that I was just a employee then ill be crushed. Is it right for them to act like this? am I in the wrong?