How concerned should I be about my blood glucose levels?

First some info about myself.  I'm a 53 YO male 5'7" 155 lbs.

I just got back the results from the physical I had earlier this week.  It shows a blood glucose level of 106 mg/dl.  I realize that depending of what source you refer to, this may be considered prediabetes.  However, my Hemoglobin A1C was 4.9%, within the standard range.  From what I understand, A1C is a better barometer of prediabetes and diabetes than just simply blood glucose.  The last reading of my glucose level was taken during my physical in Nov 2016 and it showed a reading of 109.  However, they did not take an A1C test then.  

I'll admit my diet could be a little better.  I do have a craving for sweets and desserts, so that's why I'm a bit concerned.

Thanks in advance for your replies.