I got it working now, I also found this thread : Active Directory IConfigureNamedOptions - can't inject IUserService userService keeps hanging - #6 by darrenhunterEmerald
I was using UserService and UserGroupService in my constructor, so added the service via ServiceProvider, and now mine is running.