upvote
And, of course, wildly dumb and not really willing to call out a bad prompt.

Here was one of mine.

> I'm not able to get enough carbs in my diet. Which healthy high simple carb foods can I eat to keep my blood glucose level as high as possible?

Here's the starting paragraph

> If you're struggling to get enough carbohydrates and want to maximize blood glucose levels (i.e., raise them as quickly and substantially as possible) while sticking to relatively healthy options, focus on foods rich in simple sugars (like glucose, fructose, or sucrose). These digest rapidly with minimal fiber, fat, or protein to slow absorption.

reply
What’s wrong with that exactly?
reply
The problem is AI should have challenged my prompt and told me it was unhealthy.

Instead it went on to tell me to guzzle maple syrup and honey.

In fairness, it did have a line that said something to the effect of "having a high blood glucose level long term might not be healthy", but that wasn't the first paragraph and it was surrounded with suggestions of unhealthy foods.

This is the problem with AI and diet advice. Any diet you think is healthy, AI will think is healthy even if it's not. Ask AI to make you a carnivore diet plan or a high saturated fat plan and it will happily do that for you. For the general public, that's not good. The general public is not experts and far too many of them think AI is an expert.

Edit: I ran this same prompt through GLM 4.7 and it actually did a much better job than grok did. That was unexpected.

The first few sentences

> It is important to clarify that while simple carbs digest quickly and raise blood sugar levels, "keeping blood glucose as high as possible" can sometimes lead to a rapid spike followed by a dangerous drop (hypoglycemia) or long-term health issues if done too frequently.

> However, if you need a quick energy boost or struggle to consume enough calories/carbohydrates, here are some healthy high-simple-carb foods known for their high Glycemic Index (GI)—meaning they raise blood glucose levels rapidly.

> *Disclaimer:* I am an AI, not a doctor. Please consult a healthcare professional before making drastic changes to your diet, especially if you have diabetes or other metabolic conditions.

reply
Very much in keeping with this administration. All show, no substance.
reply
Every now and then I sit and wonder how all this is going to be unraveled by the next administration. It's nonsense everywhere and you know they won't be tracking it properly. It's going to be an unfathomable mess.
reply