Credits to Ted Ed

Why are calories considered to be "bad" by fitness folks and why do we try to avoid them as much as we can?