You haven't read the original paper, don't even understand the methodology they used to reach their conclusions and yet you "can't help but feel this research makes pretty poor use of statistics and logic"?
It seems something is bad here, but I don't think it's the nutritional research. If you can't be bothered to actually read the paper, why do you think you're able to critique it?
That wasn't quite what I said. I read and understood the first part, but I didn't understand how they tried to justify it in the second half without a causal link.
Hmm, yes, that is true. But "science" doesn't pull explanations from the air (that would be religion or superstition, ya know).
Science first finds unlikely or unexpected correlations, unlikely or unexpected measurements, and seeks to understand from whence they came. Are they artifacts of the observation process? Tainting of the measurement process? Or spurious correlations, such as the one between height and spelling ability (both of which are strongly correlated with age, up to a certain point)?
This particular research announces an unexpected correlation and goes to pains to show that it is real, and not spurious. This is the observation phase, the oh, didn't expect that phase. Explanation will come later, likely after someone designs a more accurate and precise experiment to better correlate chocolate consumption and cognitive ability.
If you go outside with a measuring tape and a stopwatch you'll discover there's an unlimited number of measurements you can make. So that can't be how scientists operate. They are guided by prior theories.
>[science] doesn't pull explanations from the air
Well, people think about problems and then ideas sometimes pop into their heads. No one understands how yet. So explanations do come out of the air, metaphorically speaking! That doesn't make them false. It's what happens afterwards that counts. Most ideas are rejected by criticism and a few go on to be tested.
you'll discover there's an unlimited number of measurements you can make
Absolutely correct.
So that can't be how scientists operate
I'm torn between writing "citation needed" and "unwarranted conclusion from stated premises" so I'll go with both.
The head of the department where I did my physics undergrad spent years, decades, measuring everything there was to measure about plasma: Energy input, energy output, temperature of the phase change (plasma is a distinct phase of matter), spectral distribution, etc., etc., etc.
He wrote many papers, primarily on his measurements, and also on how he refined and improved the measurement process. I don't recall at all well, but I don't believe there were overmany hypotheses, let alone theories. He was about data, not models.
There are theorists who spend the bulk of their time with pens and imagination, occasionally - for some, rarely - checking in with the empirically real world.
A very few of these have names we celebrate for changing the shape of the world - Darwin, Newton, Einstein. And these particular luminaries knew the shape of the real world, knew existing theory didn't fit. (Newton is famous for saying he stood on the shoulders giants. Kepler was one such. Kepler measured and measured and measured and devised a relation. No theory, just a relation to link his measurements.)
Without the many scientists who do nothing but measure, measure, measure, scientists many of us would consider tedious drudges, these luminaries could never have known that theory didn't fit data. Or that data didn't fit intuition. Or that data was just plain weird.
Science does indeed proceed this way, bottom up, from measuring anything and everything of interest (to someone - maybe not to most of us, but to someone - I invite you to read The Map that Changed the World).
Science also proceeds from the top down, from theory to measurement. But often because there was another theory that failed to align with existing measurement. Think general relativity and its better prediction of the motion of Mercury, which failed to align with Newtonian Gravitation, which itself would never have arisen had Kepler not spent so many hours measuring, measuring, measuring. (And general relativity was a generalization of special relativity, which was created to explain a particular vexing measurement, the constancy of C. Einstein did not set out to reinvent gravity, he started simply explaining how C might be constant. He got to gravitation when he generalized relativity to non-inertial reference frames (that's what the special meant: inertial reference frames only).
We measure first. Just because we are that curious.
It seems something is bad here, but I don't think it's the nutritional research. If you can't be bothered to actually read the paper, why do you think you're able to critique it?