If you want to always show all the icons in the Windows notification area or system tray, or Taskbar, here is how you can do that. There are two ways to do that, and this article explains both ...
So, you can manually check for updates for Microsoft Store apps or simply set apps to automatic update ... show new notifications for apps on their taskbar icons or badge icons.