The alpha at the moment is a closed alpha and so therefore for now the launcher is required but in the future it won't be required.

Is there an early access feature on the Epic Store?

Yep.