HackerTube 中文?
Learning signals and model behavior →

Did the experiment measure what the everyday claim promises?

Start with a morning walk. Give each observation a precise verb: moved the eyes, reported a letter, measured an enzyme. When the verb changes, the research may be answering a different question.

Questions in this reading · 16
  1. Which part of the morning walk was tested?
  2. A missed letter is not a closed eyelid
  3. One study, several endpoints
  4. Two cups and a table of burgers
  5. Record the louder voice before inferring a cause
  6. A day of exposure versus a source of emissions
  7. Two levitating objects, two candidate mechanisms
  8. Two clocks and a sticking point
  9. What changed when the bed was cleared?
  10. Which question survives shuffling the labels?
  11. Does adding one ingredient back recreate the food that was tested?
  12. Do two readings really identify the same substance?
  13. Did the same individuals contribute to both observations?
  14. After observing foraging, what should the experiment count?
  15. The animal in the experiment and the human in the promise
  16. Where does “worth investigating” go in a research report?

Which part of the morning walk was tested?

A morning walk bundles several changes: your body advances, the scene moves across your field of view, and the lighting can change. Huberman explicitly says one study he cites examined eye movements, not forward walking. In his sleep episode he distinguishes alertness after caffeine from a shift of the body clock with light. Make two columns: what the experiment varied, and what changed together in the routine. How you felt after one walk cannot allocate the effect among those columns.

Passages and timestamps · 4
Now, those are eye movements. They didn't specifically look at forward ambulation
Maximizing Productivity, Physical & Mental Health with Daily Tools · ▶ 15:05–15:11
the walk and the optic flow that I talked about before.
Maximizing Productivity, Physical & Mental Health with Daily Tools · ▶ 21:13–21:17
it binds to the adenosine receptor.
Master Your Sleep & Be More Alert When Awake · ▶ 8:16–8:20
it will phase delay, it will delay your clock.
Master Your Sleep & Be More Alert When Awake · ▶ 57:27–57:29

A missed letter is not a closed eyelid

Picture R and Z flashing in a stream of digits. If someone reports R but misses Z, the recorded outcome is a missed target. An attentional blink need not involve closing an eyelid. In a different episode Huberman objects to treating physical blinking as a lie detector. Write the observation as a verb—reported, blinked—then check whether the conclusion silently replaces it. The spotlight of attention from his introductory lecture is a useful metaphor for selection; it is not what the experiment measured.

Passages and timestamps · 4
attentional blinks, not actual eye blinks.
ADHD & How Anyone Can Improve Their Focus · ▶ 72:24–72:28
be on the lookout for the letters R and Z
ADHD & How Anyone Can Improve Their Focus · ▶ 74:19–74:27
There is absolutely no evidence that blink frequency correlates with anything except alertness.
Optimizing Workspace for Productivity, Focus, & Creativity · ▶ 72:27–72:32
it's like a spotlight, except it's not one spotlight.
How Your Brain Works & Changes · ▶ 18:33–18:37

One study, several endpoints

In the diet-study discussion, an increase in fiber-digesting enzymes is a specific result. Restating it as an increase in diversity substitutes a different endpoint. Palmer's interview moves the boundary one step earlier: trials were underway at the time of recording. That describes a plan to measure, without giving even the direction of a result. Complete the phrase “there is a study”: which group, compared with whom, on which outcome, and was a result available? These are questions about interpreting evidence, not instructions for treatment.

Passages and timestamps · 4
the group assigned to the high fiber condition maintained high fiber intake for six weeks
How to Enhance Your Gut Microbiome for Brain & Overall Health · ▶ 85:29–85:34
there was an increase in these fiber digesting enzymes.
How to Enhance Your Gut Microbiome for Brain & Overall Health · ▶ 92:47–92:51
documenting efficacy in large numbers of patients with these disorders, we don't have them.
Diet & Nutrition for Mental Health | Dr. Chris Palmer · ▶ 58:14–58:21
we've got five randomized controlled trials underway
Diet & Nutrition for Mental Health | Dr. Chris Palmer · ▶ 60:49–60:57

Two cups and a table of burgers

The coffee-maker comparison holds inputs such as the water and dose steady. A burger tasting instead asks more people to judge the food, before the film turns to the feed needed for production. Recruiting additional tasters changes the evidence about taste. It supplies no measurement of resource use. Finish the sentence “this comparison lets us judge…” twice, and you may need two observations.

Passages and timestamps · 3
same water, same coffee, same amount
Drip Coffee Makers — super simple, super cheap · ▶ 22:16–22:22
I wanted a larger sample size
Feeding Bill Gates a Fake Burger (to save the world) · ▶ 7:32–7:35
you're building bone and respiration for that cow
Feeding Bill Gates a Fake Burger (to save the world) · ▶ 10:32–10:37

Record the louder voice before inferring a cause

Huberman illustrates a change in self-monitoring with people speaking louder at a party. A recording can compare volume. Distinguishing noise, social cues and a change in neural inhibition calls for additional observations. Keep separate notes on what someone could hear and what the speaker proposes to explain it.

Passages and timestamps · 2
people stop modulating their level of speech quite as much
What Alcohol Does to Your Body, Brain & Health · ▶ 22:50–22:55
the prefrontal cortex and top-down inhibition is diminished
What Alcohol Does to Your Body, Brain & Health · ▶ 24:26–24:31

A day of exposure versus a source of emissions

Chai Jing shows a filter before and after sampling. It documents a particular interval on a particular route. Her later discussion of air movement introduces a second variable: concentration at one location can change as dispersion changes. To investigate an emitting source, bring location, wind and sampling period back into the record.

Passages and timestamps · 2
After 24 hours it looked like this
Chai Jing's review: Under the Dome – Investigating China’s Smog 柴静雾霾调查:穹顶之下 (full translation) · translated subtitles · ▶ 6:48–6:51
Air movement has decreased but the same quantity of pollutants remains
Chai Jing's review: Under the Dome – Investigating China’s Smog 柴静雾霾调查:穹顶之下 (full translation) · translated subtitles · ▶ 24:40–24:42

Two levitating objects, two candidate mechanisms

A plate levitating in an alternating field also heats up. The presenter later demonstrates levitation that does not rely on induced eddy currents. Two photographs of a gap could look alike. Temperature change, material and field conditions give the observer something capable of distinguishing mechanisms.

Passages and timestamps · 2
the eddy currents in that plate generate so much heat
World's Strongest Magnet! · ▶ 10:06–10:11
nothing to do with induced eddy currents
World's Strongest Magnet! · ▶ 15:14–15:18

Two clocks and a sticking point

Sapolsky puts a clock on a neurotransmitter signal and another on symptoms. If the first changes within an hour while the second takes weeks, the fast measurement leaves a delay to explain. Walker changes resolution in a key-sequence task: a faster total can conceal one troublesome transition getting smoother. To read a plot of improvement over time, write down which clock started it, which observation ended it, and which intervening steps were actually measured.

Passages and timestamps · 4
norepinephrine signaling is changing within like an hour.
Stanford's Sapolsky On Depression in U.S. (Full Lecture) · ▶ 22:02–22:06
they don't get better for a couple of weeks.
Stanford's Sapolsky On Depression in U.S. (Full Lecture) · ▶ 22:08–22:11
people learn it, but they have these problem points
Joe Rogan Experience #1109 - Matthew Walker · ▶ 41:42–41:47
that friction point in your motor skill sort of deficit and it smooths it out.
Joe Rogan Experience #1109 - Matthew Walker · ▶ 42:37–42:42

What changed when the bed was cleared?

Grey suggests moving activities such as reading social media away from the sleep station. To evaluate that change, would you record minutes spent on the phone in bed or time taken to fall asleep? The first checks whether the new boundary was observed. The second is closer to the hoped-for outcome, and other changes to the week’s schedule could affect it. Record both columns and you can see which step actually has evidence.

Passages and timestamps · 2
the sleep station boundaries as where you go to sleep only.
Your Brain Thinks Your Whole Home Is One Room · ▶ 4:19–4:23
Make them feel like truly different spaces.
Your Brain Thinks Your Whole Home Is One Room · ▶ 9:59–10:02

Which question survives shuffling the labels?

VanderPlas holds measurements fixed and permutes their group labels to see what differences exchangeability might produce. His bootstrap instead resamples observations with replacement to study a statistic’s variability. Try both on Haidt’s online moral questionnaire: neither puts nonrespondents back into the sample. Zimbardo adds another design question: who created the setting and who could end the observation?

Passages and timestamps · 6
We first -- we shuffle the labels.
Jake Vanderplas - Statistics for Hackers - PyCon 2016.mp4 · ▶ 13:26–13:28
with replacement to generate new samples.
Jake Vanderplas - Statistics for Hackers - PyCon 2016.mp4 · ▶ 18:02–18:05
made a questionnaire, which we put up on the web
Jonathan Haidt: The moral roots of liberals and conservatives · ▶ 8:20–8:24
the slope is steeper on in-group, authority, purity
Jonathan Haidt: The moral roots of liberals and conservatives · ▶ 9:26–9:29
What does the situation bring out of them?
The psychology of evil | Philip Zimbardo · ▶ 8:46–8:48
And I ended the study the next day.
The psychology of evil | Philip Zimbardo · ▶ 20:11–20:13

Does adding one ingredient back recreate the food that was tested?

Lustig discusses removing fiber for shelf life in an earlier lecture, then compares a wheat berry’s ratio with food labels in a later interview. Adding soluble fiber back is a specific intervention, distinct from recreating the original mixture. The two recordings clarify one speaker’s reasoning. For a health outcome one still needs the foods compared, participants and measured endpoint.

Passages and timestamps · 4
The removal of fiber for shelf-life and freezing.
Fat Chance: Fructose 2.0 · ▶ 42:22–42:25
Anybody know what evaporated cane juice is?
Fat Chance: Fructose 2.0 · ▶ 77:05–77:09
the carbohydrate to fiber ratio of a wheat berry is three to one.
How Sugar & Processed Foods Impact Your Health | Dr. Robert Lustig · ▶ 190:50–190:56
If you only add the soluble fiber back
How Sugar & Processed Foods Impact Your Health | Dr. Robert Lustig · ▶ 197:03–197:05

Do two readings really identify the same substance?

In the case presentation an unusual result raises suspicion; a bromide-specific assay addresses the identity of the ion. Controls and repetitions in the PCR history offer a comparison. Repeating a potentially nonspecific measurement tests consistency, whereas a measurement distinguishing rival substances tests identification. These passages document the reasoning behind a particular investigation.

Passages and timestamps · 4
The lab blood test does it.
A man asked AI for health advice and it cooked every brain cell · ▶ 7:23–7:26
a blood test specifically for bromide arrives back from the lab
A man asked AI for health advice and it cooked every brain cell · ▶ 11:28–11:33
He didn't have any controls or do repetitions of his experiments.
The Man Who Took LSD and Changed The World · ▶ 16:56–17:00
survive the high heat of the PCR cycle
The Man Who Took LSD and Changed The World · ▶ 22:32–22:35

Did the same individuals contribute to both observations?

Sapolsky describes a change in troop behavior alongside a change in the individuals who remained. A difference between two troop averages can mix changed behavior with changed membership. Dauwalter instead gives one runner’s chronology of fatigue and a rest attempt. A before-and-after comparison needs different controls in these two settings because its observational unit has changed.

Passages and timestamps · 4
your social rank and your personality and your patterns of social affiliation
Joe Rogan Experience #965 - Robert Sapolsky · ▶ 34:06–34:07
the baboons who are left are the nice guys.
Joe Rogan Experience #965 - Robert Sapolsky · ▶ 39:27–39:31
I did the 20 minute nap
Joe Rogan Experience #1027 - Courtney Dauwalter · ▶ 21:02–21:07
There's aid stations out there
Joe Rogan Experience #1027 - Courtney Dauwalter · ▶ 76:40–76:45

After observing foraging, what should the experiment count?

Stamets recalls bees moving wood chips and approaching droplets on mycelium. Later he asks what a mushroom extract might do in bees. Match each statement to an observable outcome. Counts of visits can document foraging. A health-effect test would need a comparison, a defined exposure and a specified outcome in the bees. Those are design questions prompted by the account; the garden observation itself concerns the visits.

Passages and timestamps · 2
bees moved the wood chips aside
Joe Rogan Experience #1035 - Paul Stamets · ▶ 82:00–82:05
what would they do with bees?
Joe Rogan Experience #1035 - Paul Stamets · ▶ 87:41–87:43

The animal in the experiment and the human in the promise

Engineering mice to remove selected cells makes a causal question testable in those mice. Kurzgesagt explicitly points toward human trials. Watson draws a humbler distinction when showing an E Ink device: HDMI input is a demonstrated feature, while an effect on his sleep is something he wants to track. The two sources offer quite different kinds of evidence. For either one, separately list the intervention, the measured outcome and the person the eventual promise concerns.

Passages and timestamps · 4
scientists genetically engineered mice
How to Cure Aging – During Your Lifetime? · ▶ 1:52–1:57
we need human trials.
How to Cure Aging – During Your Lifetime? · ▶ 6:24–6:29
as an external monitor over HDMI.
E-Ink on Android, and other new things! · ▶ 1:17–1:19
see if it helps with my sleep.
E-Ink on Android, and other new things! · ▶ 2:01–2:05

Where does “worth investigating” go in a research report?

Grey asks whether accepting aging as part of life obliges us to value it, drawing a comparison with shortsightedness. That is a judgment about goals. Kurzgesagt describes an intervention on senescent cells in mice. Ask which outcomes are worth pursuing, then which outcome a particular intervention produced in which species. Agreement on the first question leaves the second open to testing.

Passages and timestamps · 3
Happiness is meaning itself.
Don't Be the Last Person to Die · ▶ 1:14–1:16
focusing our attention and shaping our tools
Don't Be the Last Person to Die · ▶ 3:46–3:53
scientists genetically engineered mice
How to Cure Aging – During Your Lifetime? · ▶ 1:52–1:57

Try it on your own example

Rewrite a research headline in four boxes: who took part, the comparison, the outcome and when it was measured. Cover the headline. Would the four boxes alone justify its everyday advice?