Without getting too technical (because I don't have the terminology), it is all about the "frame rate" or the number of complete frames that fit into the allocated area. Obviously, the larger the buffer, the more frames can fit, so the jitter percentage drops. However, it takes longer to refresh the buffer, so the latency rises. So it's a compromise between low jitter and low latency.
Bottom line – if you can't hear artefacts of any sort, a higher jitter rate is not a bad thing unless you are playing music videos where the lip synch will drift from the audio. If you are synching with video, you should aim for the lowest jitter rate, or adjust the video delay (if an option) so the audio and video are synchronised.