How should I distinguish this?

J and j

I call ' J ' the capital j, and j, little j.

is it right?

Capital 'j' and small 'j'.

Or you can use the terms "uppercase" and "lowercase".