We are talking about two different type of things , pencil and pen. Of pencil there is only one and talking about pens , there are three of them. So reasoning dictates you to say, " There was a pen and there were three pencils on the table" but while we speak we say" There was a pen and three penciild on the table". The verb " were" after pencils is" understood" or hidden in the sentence.