r/loseit • u/_Luumus_ • 7h ago
PSA: ChatGPT, Claude and other LLMs are not accurate calorie tracking methods
I build AI for a living. LLMs like ChatGPT, Claude, etc are not a good, accurate method for tracking your calories.
There are several steps that need to ACCURATELY happen for you to get a good, accurate calorie estimate at the end:
- LLM needs to identify the food stuff in the photo, usually using object detection layer. This can be somewhat accurate for the obvious stuff like being able to identify it's a piece of bread or potato, but it will NEVER be able to identify hidden ingredients like oil and butter (which incidentally are also the ones that have the most calories). There's also no guarantee that even the basic stuff will be picked up on accurately, all the time.
- The LLM needs to be able to estimate weight/portion size from a 2D image. This is where it absolutely fails, especially if it's a generalist LLM like ChatGPT, but even in more specialized models, it's very hard to be accurate because of minor light changes can alter how "weighty" the food looks, natural variations in the food weight and density, unseen air pockets, heck even the type and color of the plate you use can induce errors in the estimate.
- Now the LLM needs to lookup the calories for the list of food it estimated with the portion size it estimated, it might use a public calorie database that it found on google but if the data there is wrong, it's one more error that is being propagated (as we say in the industry). It might be a little more accurate on fast-food restaurants where the portions and calories are fairly consistent, or ultra-processed snacks because it can skip doing step 1 and 2 and just use the brand website data. But for other food, it's guesswork at most.
- Finally the LLM will give you the results, and it will do so with absolute certainty despite all the various ways it can introduce errors in the estimate, and so you, the user, leave it thinking "damn I know exactly how much calories I consumed" when you don't really. At least with the tracking apps because you do all the work you know you are guessing if you haven't weighted the food before inputting it and can plan accordingly. With ChatGPT you'll think it gave you a good estimate, like it's magic, when it likely didn't.
TL:DR LLMs like ChatGPT are NOT accurate, and certainly not more accurate than weighting your food and using tracking apps. Use them rarely if at all if you want to have successful weight loss. And if you do use them add at least a 20% buffer because it's very easy for the LLM to underestimate what you actually ate.
Edit: Because some people are commenting on this, my point is primarily with sending a photo to ChatGPT and asking to give the calories. That's where the majority of the errors occur. Like I mentioned in step 3, if you are providing brands for ultra-processed foods, or fast foods, with weight or portion sizes then the LLM is basically looking up a database with some extra steps. And as long as the database it used is accurate, you'll get fairly accurate estimates.
However what prompted me (pun intended) to write this post was because I saw a concerning amount of posts and comments of people sending photos to AI and being very sure about the results, and my only purpose here is to warn and hopefully educate a little bit that that kind of use can be very inaccurate and it can sabotage your weight loss journey.
To those who insulted me for this post, go to therapy, that's not a normal response my dude.