Conditional Custom formatting in SSRS

I have a SSRS chart in which I need to display sometime values upto 2 decimal point sometimes need to show the data with 1000 separator without having any decimal places.

If i use Number with 1000 separator with 2 decimal places my o/p will be like this:

Please let me know if I can use any custom formatting so that based on the data both the 2 options will be possible to implement.

Thanks
Saikat