You seem to be doing okay. What matter more than the total numbers are the types of cholesterol/chylomicrons that you have, and their ratios. When people say "cholesterol," what they're really talking about are chylomicrons. Cholesterol is a waxy substance that's used for various cellular things. Fat and waxy stuff doesn't mix well with water. In order to move fat and wax around the body, it has chylomicrons. It turns out that we can separate these particles out with a blood test and then report on the amount of cholesterol. Yay!
LDL = "cholesterol" (really chylomicrons which contain triglycerides, FFAs, cholesterol, etc) being sent out from the liver.
HDL = "cholesterol' coming back from your cells. HDL is just LDL where the cells have pulled the fat and cholesterol from the chylomicron and now it's smaller and more dense. Hence, "high-density lipoprotein."
LDL can be Type A (fluffy puffy), Type A/B (mixed) or Type B (small-dense and oxidized). You want lots of Type A and little to no Type B.
Anyway, what does this matter to you? Get a VAP or NMR test and it will tell you what kind of LDL you have. If it's Type A, then you're fine. Tell your doctor to stuff-off. If it's all type B, then you need to work on your diet. If your triglycerides are high (which they're not), it means that your insulin levels are high and that you need to drop your carbohydrate intake.