The abbreviation is just about what your sort of personal style is. If you try to make the sentence sound as short and to the point use he # sign. If you want to make your sentence legnthy, then use the whole word. For the abbreviations, North America usually uses the No. for both singular and plural, but really it soesn't matter.

Me too.

You should just keep the abbreviation No. for both singular and plural.