Let me refer you directly to Virtuopus Pedophiles for the most fundamental questions. My previous website Fate and Challenge answers the two most important ones here (in German):
Brief summary: Pedophilia is one particular sexual preference among many. Most people have some corner of their sexual desires that does not conform to “the norm”; they may feel aroused by feet, pain or special clothing. The best known of these preferences is homosexuality, which is now widely recognized by society as just one of many varieties. Sexual preferences have nothing to do with impulse control or a sense of wrongdoing but are solely a matter of sexual feelings and perception. This means that feeling a certain attraction does not mean that you give in to it without restraint. Desires and feelings are unique to each individual, but there is always a certain degree of self-control between thought and action.
In the case of people with paedophilia, this means that their sexual feelings for children don't need to bleed through to their actions. They live in the realm of thoughts and feelings while only actions can harm others. As long as it remains fantasies and feelings and there is no abusive behavior, pedophilia can be considered just as harmless as other sexualities are, as long as a person stays clear of inappropriate behavior.
Sexual acts or advances towards children, on the other hand, are fundamentally offensive in nature. That is why everyone has a responsibility to refrain from such acts. They are never the direct result of pedophilic feelings, but a person chooses to commit them — or they choose not to. That is why it is inexcusable when people behave in abusive ways, because dealing with sexual feelings and behavior lies within the responsibility of each individual! No sexual orientation exempts its owner from responsibility for their actions.
Many people find it disgusting to even think about anyone finding children sexually attractive. And they associate fear of abuse very closely with this topic. But now imagine your neighbors finding something disgusting and concerning about your feelings: would that justify them defaming you? Or if it was your entire community: would you accept stigmatization, discrimination, ostracism and hatred while you have done nothing wrong?
Please, break away from this conflation! It will also be good for yourself not to lump desire together with action, because that also causes a lot of problems in other areas.