Part of the problem is that we force physicians to waste too much time on administrative work. Some of this could be delegated to cheaper employees or not done at all, thus effectively increasing supply. Administrative overhead is also one of the factors driving physicians to quit and pivot to other careers or retire early, which further constrains supply.
This part is controversial but we'll also have to shift a lot of primary care to Physician Assistants and Nurse Practitioners. Care quality might be lower in some cases but for routine conditions it's probably better to see a PA/NP today instead of waiting weeks for a physician.