Hi Vikrant,
If you are sure you are not using it, you can remove them during the upgrade at the IS_Select phase .
You might need the original SAR files for the addons you decide to remove.
Please also check SAP Note 2011192 - Uninstalling ABAP add-ons
Thanks,
Manas