xUnit v3, WebApplicationFactory and Umbraco, how to make this work?

I am currently using xUnit 2 in combination with WebApplicationFactory for integration testing. This works well and I am able to run tests on an Umbraco site in-memory.

When I upgrade to xUnit v3 however, the same tests throw errors. I’m able to compile and run, but I get a runtime error when starting the website:

System.IO.FileNotFoundException : Could not load file or assembly 'Mono.Cecil, [...] The system cannot find the file specified.

Stack Trace: 
----- Inner Stack Trace -----
RuntimeAssembly.InternalLoad(AssemblyName assemblyName, StackCrawlMark& stackMark, AssemblyLoadContext assemblyLoadContext, RuntimeAssembly requestingAssembly, Boolean throwOnFileNotFound)
Assembly.Load(AssemblyName assemblyRef)
ReferenceResolver.ResolveAssemblies()
FindAssembliesWithReferencesTo.Find()
DefaultUmbracoAssemblyProvider.get_Assemblies()
TypeFinder.GetAllAssemblies()
TypeFinder.GetFilteredAssemblies(IEnumerable`1 excludeFromResults, String[] exclusionFilter)
TypeFinder.get_AssembliesToScan()
TypeLoader.get_AssembliesToScan()
...

I found this similar looking issue on GitHub:

But the resolution here was to update Umbraco’s assembly whitelist, which hardly seems like a durable solution.

Has anyone been able to make this work and is willing to share?