The good news is there’s an easy fix: you can go into your phone’s notification settings and either mute Find My Phone alerts during certain hours (using Focus/Do Not Disturb mode on iPhone, or Scheduled Do Not Disturb on Android), OR simply turn off its notifications entirely and only open the app when you actually need it.