Did he word for word say that he thinks you are ugly or unattractive, or did he say that he doesn't find you attractive? Because the first one indicates that he thinks you are ugly, while the second makes it more likely that he is on the asexual spectrum. If he IS ace, then it could be that the sex the two of you did have early on was during a period he did experience sexual attraction, a period he had a sex drive even if he didn't have sexual attraction, it could have been something he did because he loved you and you wanted sex, or because he was worried that you would break up with him just for not wanting sex without looking at other options.