A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard,...

25
A (Very) Brief Intro to DOE Steve Figard Bob Jones University

Transcript of A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard,...

Page 1: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

A (Very) Brief Intro to DOE

Steve Figard Bob Jones University

Page 2: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is DOE? �  It’s not

Page 3: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is DOE? � And it’s not

Page 4: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is DOE? � Design of Experiments ◦ But wait! Aren’t all experiments

“designed”?!? ◦ Well, not all… �  …are designed with the end analysis in mind,

and… �  Not all meet the primary requirement of a DOE

Page 5: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is that primary requirement?

� The ability to vary all the important input parameters to the desired levels ◦ Many types of experiments do not allow

you to set the inputs, rather, you can only observe the inputs

Page 6: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

So, what is DOE? �  “…the process of planning the

experiment so that the appropriate data that can be analyzed by statistical methods will be collected, resulting in valid and objective conclusions.” ◦ Douglas Montgomery, Design and

Analysis of Experiments, 5th ed, pg 11

Page 7: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is DOE? �  “…a planned approach for

determining cause and effect relationships.” ◦ Mark Anderson & Patrick Whitcomb, DOE

Simplified, pg ix

Page 8: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is DOE? �  “…consists of purposeful changes of

the inputs (factors) to a process in order to observe the corresponding changes in the outputs (responses).” ◦  Stephen Schmidt and Robert Launsby,

Understanding Industrial Designed Experiments, 3rd ed, pg 1-2

Page 9: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

What is DOE? �  “The generation of response data from

systematically selected combinations of input factors that are used to create mathematical models (equations) from which valid and objective conclusions about the inputs and outputs can be inferred.” ◦  Steve Figard, Biostatistics with JMP-An

Introductory Course, in process

Page 10: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Goals of DOE � To identify (screening) � To predict (RSM) ◦  “Prediction is very hard, especially when it

is about the future.” �  Yogi Berra

� To do so with minimum resources

Page 11: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Why DOE? � Best to explain by way of contrast to

OFAT ◦ Not how you respond to your significant

other’s question about how her new dress makes her look!

� One-factor-at-a-time: the time honored, traditional way of doing experiments via the scientific method

Page 12: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Why DOE? � What’s wrong with OFAT…? ◦ Can miss the true optimum ◦ Does not account for interactions ◦ Has lower statistical power of analysis

Page 13: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

OFAT

-500

50100

150200

250

300

12

34

56

78

9

2

4

6

8

Res

pons

e

Input X

Input Z

OFAT Illustration

Fix z at 4 Then, vary x

Find “optimum” at x ≈ 3.8

Page 14: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

OFAT

-500

50100

150200

250

300

12

34

56

78

9

2

4

6

8

Res

pons

e

Input X

Input Z

OFAT Illustration

Vary z with x fixed at “optimum” 3.8 and

find the process “optimum” is at z ≈ 4.

But where is the true optimum?

Page 15: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

DOE in JMP

Page 16: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Design Selection? � Determining what combinations of

factors to run

Page 17: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Modeling? � Creating the equation that connects

the input variable(s) to the response variable

Page 18: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

� Line: Linear model in 1 variable ◦  y = a + bx ◦  slope in x direction �  i.e., slope in X,Y plane ◦ no slope in z direction ◦  line for z = 0

0

2000

4000

6000

8000

02

46

810

0

1

2

3

4

5

Res

pons

e

Input X

Input Z

Linear Model

Modeling

Page 19: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

0

2

4

6

8

10

12

14

16

18

02

46

810

0

1

2

3

4

Res

pons

eInput X

Input Z

Planar Model

� Plane: Linear Model in 2 Variables ◦  y = a + bx + cz ◦ Used to analyze screening designs ◦ No curvature ◦ No interactions ◦  x and z are “Main Effects”

Modeling

Page 20: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

�  Interaction Twists Plane ◦  y = a + bx + cz + dxz ◦  Still no curvature ◦  xz is an interaction

between x and z

0

10

20

30

40

50

60

70

02

46

810

0

1

2

3

4

5R

espo

nse

Input X

Input Z

Interaction Model

Modeling

Page 21: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

� Curvature in x Variable Only ◦  y = a + bx + cz + dxz + ex2

020406080

100

120

140

160

180

02

46

810

0

1

2

3

4

5

Res

pons

e

Input X

Input Z

Curve in X

Modeling

Page 22: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

0

50

100

150

200

250

02

46

810

0

1

2

3

4

5

Res

pons

e

Input X

Input Z

Quadratic Model

� Quadratic Allows Curves In All Variables ◦  y = a + bx + cz + dxz + ex2 + fz2

◦ Used to analyze standard response surface designs ◦ Constitutes the

overwhelming majority of cases in “Nature”

Modeling

Page 23: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

-80-60-40-20

02040

60

80

100

120

02

46

810

0

1

2

3

4R

espo

nse

Input X

Input Z

Partial Cubic Model

� Partial Cubic Allows Curves Both Up and Down in All Variables ◦  y = a + bx + cz + dxz + ex2 + fz2 + gx2z + hxz2

Modeling

Page 24: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Practice DOE � Hand-Eye Coordination ◦ Two factors �  Hand: Dominant vs. Non-dominant �  Target Diameter: small vs. large ◦ Response �  The number of dots the “operator” can mark

�  in two circles �  alternating between circles �  in 10 seconds �  subtracting one from your count for each dot outside

either circle

Page 25: A Very Brief Intro to DOE - JMP User Community · A Very Brief Intro to DOE.pptx Author: Figard, Steve Created Date: 8/11/2016 12:55:54 PM ...

Practice DOE � For efficient data collection, we need… ◦ Three (3) volunteers �  Operator to make the dots �  Timer to time the 10 seconds �  Someone to count the dots while data collection

continues

� But let’s go to JMP to set up the experiment while you cogitate on which you want to volunteer to do…