Car misfires during/after getting into boost SOMETIMES.

The weird part is that after boosting, it only misfires for a little bit (10-15 seconds) and starts idling fine but if i build boost again, it will repeat that process).
But sometimes, it will continue misfiring on one of the cylinders (giving me A/F ratio of 19:1 initially, but starts to go back to stoich. with still one of the cylinders misfiring). The car exhaust sounds like a subaru at this point....
And lastly, the car is fine after building boost(very rarely).

I feel like when i give a significant amount of throttle (enough to build a bit of boost), it stutters and misfires.

Car used to start up with a misfire on somedays, but now it starts up fine, and when the car gets to operating temperature it will start misfiring on one cylinder again,

It gave me a CEL code for misfire on cylinder 4. But couple weeks ago it was giving me a code for misfire on cylinder 3.

Changed spark plugs(gapped correctly), plug wires, tried two sets of injectors, all 4 cylinders showed good spark.
My guess would be something related to the electrical component of the fuel injectors?