Does anyone have a good solution for handling bash history?

What (I think) I want:
- History search for each shell searches the history of that shell first, then all other shells' history.
- I don't want to lose history from windows opened in tmux or when I'm running a bunch of shells in parallel.

What I don't care about:
- Syncing history
- Fuzzy search

What I don't want:
- Mandatory full-screen history search