Maybe it's more nerve-racking at a major airport, but planes flying final into BUF RWY 05 pass within like a half-mile of my front window, and it's really not that bad.
It's actually kinda nice since I can turn on the BUF feed on my laptop and spot without leaving my house.
There are two aspects to noise, one are the actual physical characteristics of the noise and the second one is in the perception of the listener.
I recall one event where aircraft noise seriously interfered: a symposium in a hangar (bad acoustics for speech anyway) with planes taking off every 3 minutes from the nearby end of the nearest runway (500 meters or such), interrupting the talks for 10 seconds at a time.
Some people complain when they merely hear a plane in their silent home...