James P. Scanlan, Attorney at Law

Home Page

Curriculum Vitae

Publications

Published Articles

Conference Presentations

Working Papers

page1

Journal Comments

Truth in Justice Articles

Measurement Letters

Measuring Health Disp

Outline and Guide to MHD

Summary to MHD

Solutions

page3

Solutions Database

Irreducible Minimums

Pay for Performance

Between Group Variance

Concentration Index

Gini Coefficient

Reporting Heterogeneity

Cohort Considerations

Relative v Absolute Diff

Whitehall Studies

AHRQ's Vanderbilt Report

NHDR Measurement

NHDR Technical Issues

MHD A Articles

MHD B Conf Presentations

MHD D Journal Comments

Consensus/Non-Consensus

Spurious Contradictions

Institutional Corresp

page2

Scanlan's Rule

Outline and Guide to SR

Summary to SR

Bibliography

Semantic Issues

Employment Tests

Case Study

Case Study Answers

Case Study II

Subgroup Effects

Subgroup Effects NC

Illogical Premises

Illogical Premises II

Inevitable Interaction

Interactions by Age

Literacy Illustration

RERI

Feminization of Poverty S

Explanatory Theories

Mortality and Survival

Truncation Issues

Collected Illustrations

Income Illustrations

Framingham Illustrations

Life Table Illustrations

NHANES Illustrations

Mort/Surv Illustration

Credit Score Illustration

Intermediate Outcomes

Representational Disp

Statistical Signif SR

Comparing Averages

Meta-Analysis

Case Control Studies

Criminal Record Effects

Sears Case Illustration

Numeracy Illustration

Obesity Illusration

LIHTC Approval Disparitie

Recidivism Illustration

Consensus

Algorithm Fairness

Mortality and Survival 2

Mort/Survival Update

Measures of Association

Immunization Disparities

Race Health Initiative

Educational Disparities

Disparities by Subject

CUNY ISLG Eq Indicators

Harvard CRP NCLB Study

New York Proficiency Disp

Education Trust GC Study

Education Trust HA Study

AE Casey Profic Study

McKinsey Achiev Gap Study

California RICA

Nuclear Deterrence

Employment Discrimination

Job Segregation

Measuring Hiring Discr

Disparate Impact

Four-Fifths Rule

Less Discr Alt - Proc

Less Discr Altl - Subs

Fisher v. Transco Serv

Jones v. City of Boston

Bottom Line Issue

Lending Disparities

Inc & Cred Score Example

Disparities - High Income

Underadjustment Issues

Absolute Differences - L

Lathern v. NationsBank

US v. Countrywide

US v. Wells Fargo

Partial Picture Issues

Foreclosure Disparities

File Comparison Issues

FHA/VA Steering Study

CAP TARP Study

Disparities by Sector

Holder/Perez Letter

Federal Reserve Letter

Discipline Disparities

COPAA v. DeVos

Kerri K. V. California

Truancy Illustration

Disparate Treatment

Relative Absolute Diff

Offense Type Issues

Los Angeles SWPBS

Oakland Disparities

Richmond Disparities

Nashville Disparities

California Disparities

Denver Disparities

Colorado Disparities

Nor Carolina Disparitie

Aurora Disparities

Allegheny County Disp

Evansville Disparities

Maryland Disparities

St. Paul Disparities

Seattle Disparities

Minneapolis Disparities

Oregon Disparities

Beaverton Disparities

Montgomery County Disp

Henrico County Disparitie

Florida Disparities

Connecticut Disparities

Portland Disparities

Minnesota Disparities

Massachusetts Disparities

Rhode Island Disparities

South Bend Disparities

Utah Disparities

Loudoun Cty Disparities

Kern County Disparities

Milwaukee Disparities

Urbana Disparities

Illinois Disparities

Virginia Disparities

Behavior

Suburban Disparities

Preschool Disparities

Restraint Disparities

Disabilities - PL 108-446

Keep Kids in School Act

Gender Disparities

Ferguson Arrest Disp

NEPC Colorado Study

NEPC National Study

California Prison Pop

APA Zero Tolerance Study

Flawed Inferences - Disc

Oakland Agreement

DOE Equity Report

IDEA Data Center Guide

Duncan/Ali Letter

Crim Justice Disparities

U.S. Customs Search Disp

Deescalation Training

Career Criminal Study

Implicit Bias Training

Drawing Inferences

Diversion Programs

Minneapolis PD Investig

Offense Type Issues CJD

Innumerate Decree Monitor

Massachusetts CJ Disparit

Feminization of Poverty

Affirmative Action

Affirm Action for Women

Other Affirm Action

Justice John Paul Stevens

Statistical Reasoning

The Sears Case

Sears Case Documents

The AT&T Consent Decree

Cross v. ASPI

Vignettes

Times Higher Issues

Gender Diff in DADT Term

Adjustment Issues

Percentage Points

Odds Ratios

Statistical Signif Vig

Journalists & Statistics

Multiplication Definition

Prosecutorial Misconduct

Outline and Guide

Misconduct Summary

B1 Agent Cain Testimony

B1a Bev Wilsh Diversion

B2 Bk Entry re Cain Call

B3 John Mitchell Count

B3a Obscuring Msg Slips

B3b Missing Barksdale Int

B4 Park Towers

B5 Dean 1997 Motion

B6 Demery Testimony

B7 Sankin Receipts

B7a Sankin HBS App

B8 DOJ Complicity

B9 Doc Manager Complaints

B9a Fabricated Gov Exh 25

B11a DC Bar Complaint

Letters (Misconduct)

Links Page

Misconduct Profiles

Arlin M. Adams

Jo Ann Harris

Bruce C. Swartz

Swartz Addendum 2

Swartz Addendum 3

Swartz Addendum 4

Swartz Addendum 7

Robert E. O'Neill

O'Neill Addendum 7

Paula A. Sweeney

Robert J. Meyer

Lantos Hearings

Password Protected

OIC Doc Manager Material

DC Bar Materials

Temp Confidential

DV Issues

Indexes

Document Storage

Pre 1989

1989 - present

Presentations

Prosec Misc Docs

Prosec Misc Docs II

Profile PDFs

Misc Letters July 2008 on

Large Prosec Misc Docs

HUD Documents

Transcripts

Miscellaneous Documents

Unpublished Papers

Letters re MHD

Tables

MHD Comments

Figures

ASPI Documents

Web Page PDFs

Sears Documents

Pages Transfer


Relative Excess Due to Interaction (RERI)

(August 15, 2012)

Prefatory note: This subpage was prompted by an article by Vonneilich et al (Vonneilich N, Jockel K, Erberl R, et al. Does socioeconomic status affect the association of social relationships and health.  International Journal for Equity in Health 2011,10:43(doi:10/1186/1475-9276-10-43) that uses the relative excess due to interaction (RERI) to identify and measure differences in the effects of adverse social relationships on adverse health outcomes of different socioeconomic  groups.  The subpage is related to the Reporting Heterogeneity, Concentration Index, and Gini Coefficient subpages of the Measuring Health Disparities and the Subgroup Effects and Inevitability of Interaction subpages of the Scanlan’s Rule page.


The Reporting Heterogeneity subpage of the Measuring Health Disparities page (MHD) and the

Subgroup Effects subpage of the Scanlan’s Rule page (SR) explain the error in the view that it is somehow normal that a factor that similarly effects two groups with different baseline rates of experiencing an outcome will cause equal proportionate changes in rates of experiencing an outcome and that departures from that pattern reflect meaningful subgroup effects/interaction.  As explained in those subpages, for reasons related to the shape of normal distributions, there is reason to expect that a factor that diminishes health will cause a larger proportionate increase in the adverse health outcomes for the group with the lower baseline rate of experiencing that outcome (generally the higher socioeconomic  group), while causing a larger proportionate decrease in the opposite outcome for the other group.  As discussed in the Comment on Delpierre BMC Public Health 2012, identifying expected patterns (i.e., patterns to be observed when there exists no meaningful differential effect) is more difficult when effects are measured with odds ratios. 

In exploring whether and how adverse social relationships similarly affected the health of socioeconomic groups with different baseline rates for certain adverse health outcomes, Vonneilich et al. used the relative excess due to interaction (RERI).  I leave to the Vonneilich article explanation of its methodology and its findings.  This item is limited to demonstrating that the RERI is systematically affected by the prevalence of an outcome in the same way that more standard measures used to identify interaction are affected and hence is a flawed measure for determining whether a factor differently affects groups with different baseline rates of experiencing an outcome in a meaningful way. 

In order for measure to usefully appraise the size of differences between rates for purposes, for example, of determining whether a health disparity has changed over time the measure must remain the same when there occurs a change in overall prevalence akin to that effected by the lowering or raising of a cutoff on a test.  Table 1 of BSPS 2006 illustrates that the four most standard measures of difference between rates – relative differences in one outcome, relative differences in the opposite outcome, absolute differences between rates, and odds ratios.  The same values in that table are used for illustrating the problematic nature of the  Concentration Index, and Gini Coefficient (as illustrated in the MHD subpages bearing those names) as well as the Phi Coefficient and  Cohen’s Kappa (as discussed in Sections A.13 and A.13a of the Scanlan’s Rule page).

When the issue is whether a measure can effectively identify subgroup effects or interaction, the approach is slightly different.  The question regarding that issue is whether the measure will show the same changes to different baseline rates when there occurs a change in overall prevalence akin to the lowering of a cutoff (i.e., a change that involves no meaningful interaction).  But the values in BSPS Table 1 still can provide the basis for an illustration of whether a particular measures meets the criterion, as is done, for example, in Table 1 of the Subgroup Effects subpage of SR.  That table, which treats the disadvantaged group as the controls and the advantage group as the treated, shows the standard measures of change in a baseline result when an intervention has the effect of shifting the mean of the underlying distribution by.5 standard deviations.  It thus show the way various measures of difference of the change in the control group baseline rates yield different values for different baseline rates, hence illustrating the problematic nature of each measure.  That is, an effective measure would show the same value for each baseline rate.

In RERI Table 1 below, the same data are used in a somewhat different manner to test the utility of the RERI for exploring interaction is used below.  The table shows the RERI value for each baseline rate as there occurs a change in overall prevalence akin to the lowering of a cutoff.  Thus, for example, the first row  reflects the situation where a cutoff is lowered from Point 01 to Point N3, which results in an increase in the fail rate of the advantaged group (AG) from 1% (OAGF) to 3% (NDGF) and increase in the fail rate of the disadvantaged group (DG) from 3.44% (ODGF) to 8.38% (NDGF).  The situation reflected in these changes involves no meaningful.  Rather, there has there has merely occurred a change in overall prevalence effected by the lowering of a cutoff.[i]   EES figures (see Solutions sub-page of MHD)  and for the change experienced by the AG and DG would be approximately .44 (with any difference between the two figures being a result of inexactness of my methods.)  Similarly, were the RERI in fact an effective measure of interaction its value would be zero in each row.

But the RERI is not zero in each row and changes from row to row.  That the RERI changes and the manner in which it changes may warrant some exploration.  But the fact that it is not zero is what demonstrates that it is an ineffective tool for identifying interaction.

 RERI Table 1.  Illustration of RERI Values in Circumstances of Lowering of Cutoff Points in Circumstances Where Two Group Have Normal Distributions of Test Scores With Same Standard Deviation and Means that Differ by Half a Standard Deviation.

 

Row No

OrigCutPoint

NewCutPoint

OAGF

NAGF

ODGF

NDGF

RERI

1

O 1

N 3

1.00%

3.00%

3.44%

8.38%

3.47

2

N 3

M 5

3.00%

5.00%

8.38%

12.71%

1.05

3

M 5

L 10

5.00%

10.00%

12.71%

21.77%

1.41

4

L 10

K 20

10.00%

20.00%

21.77%

36.69%

1.46

5

K 20

J 30

20.00%

30.00%

36.69%

49.20%

0.84

6

J 30

I 40

30.00%

40.00%

49.20%

59.48%

0.61

7

I 40

H 50

40.00%

50.00%

59.48%

69.15%

0.66

8

H 50

G 60

50.00%

60.00%

69.15%

77.34%

0.67

9

G 60

F 70

60.00%

70.00%

77.34%

84.61%

0.84

10

F 70

E 80

70.00%

80.00%

84.61%

90.99%

1.26

11

E 80

D 90

80.00%

90.00%

90.99%

96.25%

2.64

12

D 90

C 95

90.00%

95.00%

96.25%

98.38%

2.80

13

C 95

B 97

95.00%

97.00%

98.38%

99.13%

2.12

14

B 97

A 99

97.00%

99.00%

99.13%

99.76%

7.25



[i]  Readers inclined to take issue with this proposition should keep in mind that, even if one wants to regard varying changes in different baseline rates when a cutoff is lowered as interaction, one should recognize that the reasons one might have for identifying interaction solely involve those interactions that reflect something other than changes in overall prevalence.  For example, if implementation of a remedial reading program achieves results with respect to the changes in pass/fail rates that are exactly what one would expect when a test cutoff is lowered, there is no point in searching for reasons why the program affected two groups differently.  It is when one observes patterns different from those that would typically result from the lowering of a cutoff  that there is reason to explore why that occurred.