Additionally to what the others already said:

LD50 and “bad for your health” are quite separate things.

Vitamin D for example has an LD50 of ~30mg per kg. So according to your logic, it’s way unhealthier than aspartame (factor ~100). Though in reality you would die without vitamin D intake.

You can almost never say that something is not dangerous, unless it’s practically mathematically proven…

This applies especially for food etc.

I think we have to be much more conservative with food and substances we put into it. A lot of (Meta-)meta-studies suggest, that processed food is a health risk.

And this may sound a little bit far-fetched, but I think a good amount of the idiocracy in (especially) the USA may be related to the food (as also a lot of studies have found connections to brain/psychological health).