In the introductory lab, we made our own measurement device and used it to estimate the length dimensions of a card. When making these measurements, we had to estimate uncertainties on each value. Most students determined those uncertainties based on the limited resolution of their ruler. This week, we want to explore a completely different type of measurement – one where the uncertainty is better estimated through repeated measurements and statistics.

In the following project, you will perform some simple experiments – dropping slips of paper from fixed heights and building pendulums – but we will use this data to develop ideas about experiment design, repeatability, systematic biases, statistical distributions, and model-testing.

In physics, theory and experiment are fundamentally intertwined: you cannot have one without the other. Experimental discoveries open new avenues for theoretical development, while at the same time new theoretical predictions motivate experimental work. Experiments are performed for various purposes. Often experiments are designed to investigate phenomena for which there exists no theoretical understanding, while other experiments are designed to test theoretical predictions. Unexpected experimental results can lead to the discovery of “new physics”. Experiments are NOT done to confirm what we already know.

Many factors go into designing, building and performing an experiment. Questions arise on which the experimenter must make decisions regarding how to proceed… questions such as the following:

• How precisely must a measurement be made? (I.e. When is an experiment finished?)
• How many data points should I take? (The answer is usually not “10” nor is it “ask the instructor”.)
• Are my results good enough? (Think about what the goal was when you started.)

Figuring out on your own how to answer the above questions in the course of doing an experiment and the subsequent interpretation of the final result of the experiment are what we will refer to as the process of “Thinking through an experiment”. Learning how to think through an experiment is one of the main goals of the lab component of this course.

One way in which experimental physics can be done is through model testing:

• A person makes observations and collects some data.
• That person (or a different person) builds a mathematical model based on some physics which attempts to explain what's going on.
• The model is used to make predictions about a different scenario.
• The predictions of the model are tested in the new scenario to see if the predictions are correct.
  • If the data are consistent with the predictions, we say the model is supported*. New predictions are made and more testing can be done.
  • If the data are inconsistent with the predictions, the model is discarded or revised (or the experiment is checked for biases or errors).
  • If the data is ambiguous – neither convincingly in agreement or convincingly in disagreement – then either more data is needed or a different experiment should be done.

We will get practice in model testing today by looking at the period of a simple pendulum.

The model we will test today is that the period $T$ of a pendulum should depend only on the length $L$ of the pendulum and the acceleration due to gravity $g$ according to the formula $T = 2\pi\sqrt{\frac{L}{g}}$. (Do not worry if you have not yet encountered pendulums in lecture; you do not need to know any theory in order to test the model.)

Our model predicts that the period should not depend on the mass of the pendulum $m$ nor the angle $\theta$ from which it is released. We will specifically test whether the period depends on the release angle.

One member of the group should click on the link below to start your group lab notebook. (You may be asked to log into your UChicago Google account if you are not already logged in.) Make sure to share the document with everyone in the group (click the “Share” button in the top right corner of the screen) so each member has access to the notebook after you leave lab.

All members of the group are expected to contribute to all aspects of the experiment, including making notes in the lab notebook. If you brought a laptop or tablet to lab, you may want to open multiple copies of the notebook so that different group members can contribute simultaneously. If you did not, then it's OK to have just one group member typing in the document at a time (though you should regularly rotate record-keeping duties… both within the lab period and from lab-to-lab.)

In the at-home experiment, you estimated uncertainties on measured quantities based on the resolution of your ruler. For this experiment, we're going to introduce a different way of estimating uncertainty based on making repeated measurements.

To get some practice – and to learn some definitions – we're going to first play with paper before moving on to the (more exciting) pendulums.

Your task is as follows: drop small paper squares from a height of 1 meter and determine how long they take to hit the floor.

• How will you measure the height?
• How will you measure the time?

Repeat the measurement several times (you will only have a few minutes) and record your data in your group notebook.

Once you have your data, discuss the question “How long did it take for the paper to hit the floor?” within your group. After a short time, your TA will lead a class discussion; be prepared to share your thoughts.

Partner up with another group in the class and compare your values. You both were trying to answer the question “How long does it take for a piece of paper to fall 1 m?” Do your two groups agree on the answer? What does agreement mean here? What criteria do you use to determine this?

Your TA will prompt a class discussion. Don't expand the following drop-down sections until instructed to do so.

Gaussian (normal) distributions

When we make observations of something which varies with random fluctuations, that data typically obeys a Gaussian (also called a Normal) distribution. Such a distribution can be characterized by parameters like the average, $\mu$, (or mean) and standard deviation, $\sigma$. The standard deviation tells us something about the typical “spread” in values. It tells us how wide the distribution is.

Suppose we a student who can collect data for a long time. The figures below show an example of how this student's Gaussian distribution evolves as they add more and more data.

10 drops	50 drops
100 drops	500 drops

As the number of drops increases, the distribution looks more and more like a smooth Gaussian and we get better estimates for both the average and the standard deviation. But notice that the standard deviation (the width of the distribution) doesn't change much; taking more data doesn't make the distribution more narrow.

For that reason, we need to define a different parameter… one that will scale as the number of data points increases to reflect the fact that our estimate of the uncertainty also improves with the number of counts. This parameter is called the standard deviation of the mean, $\sigma_{\mu}$, (or, sometimes called the standard error):

$\sigma_{\mu} = \sigma/\sqrt{N}$.

If we look now at those data distributions again, we can see that the standard deviation of the mean does decrease as we add more data. Hence, we can now more carefully state our average and its uncertainty as $\mu \pm \sigma_{\mu}$.

10 drops	50 drops
100 drops	500 drops

Using the plot with 500 drops, we can now say that the average fall time is $T = 0.997 \pm 0.006$ seconds.

Now, return to your drop data and the data from the other group you spoke with. Compute the standard deviation of the mean and use the $t^{\prime}$ criteria you learned last week to look for agreement between your average value and that of the others. Are your results in agreement with the others? In disagreement? Inconclusive?

If you are in disagreement, what could be some reasons?

You have been provided a variety of rods, clamps and other apparatus with which you can make a pendulum. Your task is to test whether or not the period of a pendulum is independent of the initial angle as predicted by the model: $T = 2\pi\sqrt{\frac{L}{g}}$. Using the apparatus provided it is possible to make very precise measurements if your experimental technique is good. Since we want you to learn how to think your way through these experiments, we are not going to specify how to best use the apparatus at your disposal. Instead it is up to you to figure out how to get the most out of the equipment in the time available to you.

Begin by constructing a pendulum and determine the predicted value for the period given your pendulum length. Measure the period for angles up to and including $\theta = 10^{\circ}$.

Use the calculation and plotting resources provided in the Google Colab notebook above to look at your data.

Your TA will be walking around the room talking with groups. Be prepared to share your techniques and results when they visit, and be ready to show that all group members are participating.

Below are some tips to get you started:

• You are going to be making multiple measurements of periods for different angles. How are you going to ensure that each trial for a given angle starts off the same? How will you ensure that you begin at the same angle each time? How will you make sure that the mass is released the same way each time? You may have to spend a little bit of time trying different techniques to determine an appropriate procedure. Don't forget to document your work in your notebook, even the attempts that you decide against using.
  
  
• How many and at what angles will you need to take data? The only way to know the answer to this sort of question is to look at your data as you take it. Within your group, designate at least one person to record the data, compute averages, and compare with predictions from the model in real time. Your data will tell you what you need to be doing in order to accomplish the stated goal of the experiment. For example, you might try taking some quick data at a relatively small angle and at a relatively large angle and look at the results to gain insight into what range of angles are needed. Using your data like this to inform your experimental procedure is an acquired skill; no one starts off especially just good at it. We cannot tell you how to do it, the only way to develop the skill is to do it yourself.
  
  
• For a given angle, how many periods do you need to measure and average? Again, you have to look at your data to determine how much is enough.  Ultimately your goal is to make the most precise measurement possible in the time available to you.

Note that there is no “right” answer to questions like “how much data do I take?”. The answer is not necessarily “I will take 10 measurements at 10 angles.” Ten is a nice round number, but it's not special; you need to balance the time it takes to collect data with the the range of data you need to have by the end of the period. Even professional research scientists do not have infinite time and resources to conduct a “perfect” experiment – whatever “perfect” may mean.

You (as well as professional scientists) are limited by the equipment and resources available. You have a finite amount of time to produce a result. Experimental physics is an iterative process of taking some data, evaluating that data to see what needs to be improved, and making adjustments to your apparatus and technique based on these intermediate results. Keep in mind what it is that you are trying to accomplish at the end of the day (or in this case, the end of the lab period).  

Ask your instructor questions and bounce ideas off of them or other students in the lab; everyone learns from interacting with one another. The instructors are there to help guide you through the experiment, but they will not tell you exactly what angles to measure or how many measurements to take. They will not tell you if your data are “good enough”. These are things you have to decide for yourself.

Make sure to submit your lab notebook by the end of the period. Download a copy of your notebook in PDF format and upload it to the appropriate spot on Canvas. Only one member of the group needs to submit to Canvas, but make sure everyone's name is on the document!

We will return to the pendulum you have built again in the next lab, but let's take a moment to reflect on what we've done so far.

Answer the questions/prompts below in a new document (not your lab notebook) and submit that as a PDF to the appropriate assignment on Canvas when you are done. You should write the answers to these questions by yourself (not in a group), though you are welcome to talk to your group mates to ask questions or to discuss.

These post-lab assignments are not meant to be long assignments. Typically, your responses will be one or two pages of text total, and we expect you to spend about 1 hour or so working on it. Ask your TA for clarification if you don't understand what a question is asking or what a prompt is suggesting.

Let's begin by getting some practice drawing conclusions.

The conclusion is your interpretation and discussion of your data.

• What do your data tell you?
• How do your data match the model (or models) you were comparing against, or to your expectations in general? (Sometimes this means using the $t^{\prime}$ test, but other times it means making qualitative comparisons.)
• Were you able to estimate uncertainties well, or do you see room to make changes or improvements in the technique?
• Do your results lead to new questions?
• Can you think of other ways to extend or improve the experiment?

In about one or two paragraphs, draw conclusions from the pendulum data you collected today. Address both the qualitative and quantitative aspects of the experiment and feel free to use plots, tables or anything else from your notebook to support your words. Don't include throw-away statements like “Looks good” or “Agrees pretty well”; instead, try to be precise.

Remember… your goal is not to discover some “correct” answer. In fact, approaching any experiment with that mind set is the wrong thing to do. You must always strive to reach conclusions which are supported by your data, regardless of what you think the “right” answer should be. Never should you state a conclusion which is contradicted by the data. Stating that the results of your experiment are inconclusive, or do not agree with theoretical predictions is completely acceptable if that is what your data indicate. Trying to shoehorn your data into agree with some preconceived expectation when you cannot support that claim is fraudulent.

Next, we want you to think a bit about the learning objectives for this lab course. These were listed on the lab homepage, but as a reminder we provide them again here.

Consider the following questions:

• The objectives of the lab course are intended to benefit students regardless of their future careers.
  • Choose at least two of the objectives from the five above. How do these objectives apply to your current career interests?
  • Do you have any personal goals for this lab course… something that you hope to learn or get better at by the end of the year?
• The overarching principle of these labs is to understand how we know, not what we know. Reflecting back on today's experiment, identify at least one thing that your group did that that helped you understand how instead of what.
• In the next lab, we will return to the pendulum to take more measurements. What is one improvement you could make – to your apparatus, to your measurement technique, to your data collection strategy, etc. – that will help you reduce your statistical uncertainties? What is one improvement you could make to help you study (or eliminate) systematic uncertainties?