How to make CMD+TAB activate the last active window of the selected application?

There are many wrong answers here and other places on Google. Here is the scenerio:

1. Use more than 1 window and more than 1 desktop.
2. Have browser open on monitor A. This you never want to activate, you are just reading from it
3. Have a second window of the same browser open on monitor B. This you want to tab to.
4. Have a fullscreen app like a terminal also on monitor B.
5. Activate the second browser window on monitor B
6. Tab to terminal
7. TRY TO TAB BACK TO BROWSER and end up with browser on monitor A as active and monitor B still showing the terminal.
8. At this point people suggest using CMD+~ to switch focused window. This does not work when the window I want is "hidden in an inactive desktop".

Desired effect:

CMD+TAB brings be back to the last active window of the selected application in app switcher. Meaning I could tab between the two applications/desktops on monitor B without messing with monitor A or browser window there.

How can I make it so that cmd+tab works like this? Is there a setting I am unaware of or is there maybe a tool that works like this instead?