Hey there! If you put the image into your project's img>system folder, it will automatically appear in RPG Maker. You may need to restart RPG Maker before it appears.
If you need to add icons to an existing sheet, there's a tutorial here: https://youtu.be/AB0FxbhURME?is=tPELD2BmBvVEZlLo