Planning and Evaluating Experiments

What you'll learn

Planning and Evaluating Experiments forms a substantial component of Paper 2 (Structured Questions) and Paper 3 (School-Based Assessment) in CXC CSEC Chemistry. Questions test your ability to design fair tests, identify variables, assess risks, collect reliable data, and critically evaluate experimental procedures. Strong performance in this area distinguishes candidates who truly understand the scientific method from those who merely memorize facts.

Key terms and definitions

Independent variable — The factor deliberately changed by the experimenter to observe its effect on the dependent variable (e.g., concentration of acid in a reaction rate experiment).

Dependent variable — The factor measured or observed during an experiment that responds to changes in the independent variable (e.g., volume of gas produced).

Control variables — Factors kept constant throughout an experiment to ensure a fair test (e.g., temperature, catalyst amount, surface area of reactants).

Hypothesis — A testable prediction stating the expected relationship between variables, based on scientific knowledge (e.g., "Increasing acid concentration will increase the rate of reaction with magnesium ribbon").

Validity — The extent to which an experiment actually tests what it claims to test, achieved by controlling all relevant variables except the independent variable.

Reliability — The consistency of results when an experiment is repeated under identical conditions; reliable data shows minimal variation between trials.

Precision — The closeness of repeated measurements to each other, indicated by small differences between multiple readings.

Systematic error — A consistent error that affects all measurements in the same way, often due to faulty equipment or flawed technique (e.g., a balance that reads 0.5 g when empty).

Core concepts

Understanding variables in experimental design

Every properly designed experiment in CXC CSEC Chemistry requires clear identification of three types of variables. The independent variable represents what you deliberately change—perhaps the temperature of water when dissolving sodium chloride, or the particle size of calcium carbonate reacting with hydrochloric acid. When answering planning questions, state this variable explicitly with units where applicable.

The dependent variable measures the outcome. In a titration experiment investigating acid concentration, the dependent variable would be the volume of alkali needed to neutralize the acid. Always specify how you will measure this variable and what equipment you'll use (burette reading to ±0.05 cm³, electronic balance to ±0.01 g).

Control variables demand particular attention in CSEC examinations. Examiners consistently award marks for identifying at least three control variables and explaining how to keep them constant. In the Caribbean context, ambient temperature can vary significantly between air-conditioned laboratories and naturally ventilated ones—this must be controlled in experiments involving temperature-dependent reactions. Other typical controls include:

• Volume of solutions used
• Concentration of excess reagents
• Mass or surface area of solid reactants
• Pressure (for gas reactions)
• Presence of catalysts
• pH of solutions

Formulating testable hypotheses

A scientifically sound hypothesis predicts a specific relationship between the independent and dependent variables. Weak hypotheses simply restate the aim ("I will investigate concentration effects"), while strong hypotheses make testable predictions with scientific reasoning.

Example of a weak hypothesis: "Temperature affects reaction rate."

Example of a strong hypothesis: "As temperature increases from 20°C to 60°C, the time taken for magnesium to completely react with hydrochloric acid will decrease because particles possess more kinetic energy and collide more frequently with sufficient activation energy."

CXC examiners award marks for hypotheses that demonstrate understanding of underlying chemical principles—collision theory, Le Chatelier's principle, or solubility trends.

Planning a fair test with appropriate methodology

Examination questions frequently present scenarios requiring complete experimental plans. Your response must include:

Materials and apparatus: List specific equipment with appropriate capacities (100 cm³ measuring cylinder, not just "measuring cylinder"). For Caribbean contexts, specify locally available materials—limestone from quarries in Jamaica or Barbados for calcium carbonate investigations, or locally manufactured sodium hydroxide solutions.

Step-by-step procedure: Write numbered instructions clear enough for another student to replicate your experiment. Include:

1. Initial preparation steps (cleaning apparatus, preparing solutions)
2. Measurement of the independent variable at different levels (minimum 5 values for CSEC)
3. How you'll measure the dependent variable with precision
4. The number of repeats (typically 2-3 trials per condition)
5. Safety precautions relevant to the specific chemicals

Data collection: Specify the range of the independent variable (e.g., "Test concentrations from 0.5 mol/dm³ to 2.5 mol/dm³ in 0.5 mol/dm³ intervals"). Design a table with appropriate headings, units in headers (not with individual values), and columns for multiple trials.

Risk assessment and safety considerations

Paper 2 and Paper 3 questions regularly require identification of hazards and corresponding precautions. CSEC Chemistry examinations test awareness of common laboratory risks:

Chemical hazards:

• Corrosive substances (concentrated acids/alkalis) — wear safety goggles and gloves; add acid to water, never water to acid
• Toxic gases (chlorine, sulfur dioxide) — conduct experiment in well-ventilated areas or fume cupboards
• Flammable liquids (ethanol, propanone) — keep away from open flames; ensure no Bunsen burners nearby

Physical hazards:

• Heating equipment — use heat-proof mats; allow apparatus to cool before handling
• Glassware — check for cracks; report breakages immediately
• Hot liquids — use appropriate handling equipment like tongs or heat-proof gloves

Caribbean schools may lack fume cupboards found in better-resourced laboratories. In your planning, acknowledge this limitation and suggest alternatives: performing reactions producing irritating gases outdoors in shaded areas, or using smaller quantities of reagents to minimize exposure.

Evaluating reliability and validity

Reliability concerns the reproducibility of results. Data showing close agreement between repeated trials demonstrates reliability. Calculate the mean of multiple trials and identify anomalies—results differing significantly from others due to measurement errors or procedural mistakes. Anomalous results should be identified, excluded from calculations, and the experiment repeated.

To improve reliability:

• Increase the number of trials (minimum 3 per condition)
• Use more precise measuring instruments (burette instead of measuring cylinder for volumes)
• Ensure consistent technique between trials (same person timing reactions, same mixing method)

Validity ensures the experiment actually tests the hypothesis. An investigation might produce reliable data that's completely invalid—imagine testing temperature effects on reaction rate while unknowingly allowing water to evaporate, changing the concentration. To improve validity:

• Control all variables except the independent variable
• Use appropriate ranges for the independent variable
• Eliminate or account for systematic errors
• Ensure measurements directly relate to the hypothesis

Analyzing sources of error

CSEC examiners distinguish between random errors and systematic errors. Random errors cause measurements to vary unpredictably around the true value—human reaction time when using a stopwatch, slight variations in temperature, or reading parallax when using a burette. These are reduced by repeating measurements and calculating means.

Systematic errors consistently shift all measurements in one direction. A balance reading 0.3 g when empty adds 0.3 g to every mass measurement. A burette with a manufacturing defect delivers slightly more or less than the indicated volume consistently. These cannot be reduced by averaging—they require calibration checks or equipment replacement.

When evaluating experiments, identify specific sources of error relevant to the procedure:

• Heat loss to surroundings in calorimetry experiments (common in Caribbean schools with limited insulation materials)
• Incomplete reactions if insufficient time allowed
• Evaporation during heating, particularly significant in Trinidad's hot climate
• Impure reactants affecting stoichiometric calculations
• Parallax errors when reading scales on measuring cylinders or thermometers

Suggesting improvements

Examination questions worth 4-6 marks often require improvements to experimental procedures. Generic suggestions ("be more careful," "use better equipment") earn no marks. Specific, scientifically justified improvements earn full credit:

• "Use a digital thermometer (±0.1°C) instead of an alcohol thermometer (±0.5°C) to measure temperature changes more precisely"
• "Insulate the calorimeter with expanded polystyrene to reduce heat loss to surroundings"
• "Use a gas syringe (±1 cm³) instead of collecting gas over water, which dissolves some carbon dioxide"
• "Grind the calcium carbonate to a powder and sieve to ensure uniform particle size, controlling the surface area variable"

Connect improvements to specific experimental weaknesses. If timing a fast reaction caused large random errors, suggest using a data logger to record measurements automatically. If limestone purity varied between trials, suggest obtaining pure calcium carbonate from chemical suppliers.

Worked examples

Example 1: Planning an investigation

Question: A student wants to investigate how the concentration of hydrochloric acid affects the rate of reaction with excess marble chips (calcium carbonate) from a quarry in St. Elizabeth, Jamaica. Plan an experiment to test this relationship. Include: (a) A hypothesis [2 marks] (b) The independent, dependent, and two control variables [4 marks] (c) A step-by-step method [5 marks] (d) One safety precaution [1 mark]

Model answer:

(a) Hypothesis: As the concentration of hydrochloric acid increases, the rate of reaction with marble chips will increase because higher concentration means more acid particles per unit volume, leading to more frequent successful collisions between reactant particles.

(b)

• Independent variable: Concentration of hydrochloric acid (mol/dm³)
• Dependent variable: Time taken for a fixed volume of carbon dioxide gas to be produced (seconds) OR volume of gas produced in a fixed time
• Control variable 1: Mass/surface area of marble chips (use same-sized chips or same mass of crushed marble)
• Control variable 2: Temperature of acid (use acid from the same water bath at 25°C)
• Control variable 3: Volume of acid used (50 cm³ each trial)

(c) Method:

1. Measure 50 cm³ of 2.0 mol/dm³ hydrochloric acid using a measuring cylinder and pour into a conical flask
2. Weigh 5.0 g of marble chips and add to the flask
3. Immediately connect the flask to a gas syringe and start the stopwatch
4. Record the time taken for 50 cm³ of carbon dioxide to be collected
5. Repeat steps 1-4 using 1.5, 1.0, 0.5, and 0.25 mol/dm³ hydrochloric acid (prepared by dilution)
6. Conduct three trials for each concentration
7. Calculate mean time for each concentration
8. Plot a graph of concentration (x-axis) against 1/time (y-axis) to show rate

(d) Safety precaution: Wear safety goggles throughout the experiment as hydrochloric acid is corrosive and can damage eyes.

Example 2: Evaluating an experiment

Question: A student investigated the heat change when different masses of ammonium nitrate dissolved in 50 cm³ of water. The results showed large variation between trials. The student used a polystyrene cup as a calorimeter and a laboratory thermometer.

(a) Identify two sources of error in this experiment [2 marks] (b) Suggest two specific improvements with explanations [4 marks]

Model answer:

(a) Error 1: Heat lost to the surroundings through the sides and top of the polystyrene cup, reducing the temperature change measured

Error 2: Laboratory thermometer has limited precision (±0.5°C), causing larger random errors when reading small temperature changes

(b) Improvement 1: Place a lid on the polystyrene cup with a hole for the thermometer to reduce heat loss by convection and evaporation, making temperature measurements more accurate

Improvement 2: Use a digital thermometer or temperature probe (±0.1°C) instead of the laboratory thermometer to obtain more precise temperature readings and reduce random errors between trials

Example 3: Identifying variables and validity issues

Question: A student planned to investigate the effect of temperature on the solubility of potassium nitrate. She heated water to different temperatures, added potassium nitrate until no more dissolved, then poured the solution into an evaporating dish and evaporated all the water to find the mass of dissolved salt. Identify two factors that would make this experiment invalid. [2 marks]

Model answer:

Factor 1: Evaporating the solution would allow some potassium nitrate to decompose if heated too strongly, reducing the mass measured and making it different from the mass that was actually dissolved

Factor 2: The volume of water used might vary between trials (due to evaporation during heating or inconsistent initial measurement), affecting how much salt could dissolve independently of temperature

Common mistakes and how to avoid them

Mistake 1: Confusing independent and dependent variables — Students often state "temperature depends on reaction rate" when investigating how temperature affects rate. Correction: The independent variable is what YOU change (temperature), and the dependent variable is what RESPONDS (reaction rate/time).

Mistake 2: Listing apparatus without capacities — Writing "beaker, measuring cylinder, balance" earns no marks. Correction: Always specify sizes: "250 cm³ beaker, 100 cm³ measuring cylinder, electronic balance reading to ±0.01 g."

Mistake 3: Vague safety precautions — Stating "be careful" or "wear safety equipment" shows no specific understanding. Correction: Link the precaution to the specific hazard: "Wear safety goggles because sodium hydroxide is corrosive and can cause permanent eye damage."

Mistake 4: Not explaining improvements — Simply suggesting "better equipment" earns no marks in evaluation questions. Correction: State the specific improvement AND explain how it reduces a particular error: "Use a burette (±0.05 cm³) instead of a measuring cylinder (±0.5 cm³) to measure acid volume more precisely, reducing percentage error."

Mistake 5: Identifying "human error" as a source of error — This is too vague and implies carelessness. Correction: Identify the specific measurement difficulty: "Parallax error when reading the meniscus in the burette" or "Reaction time delay when starting/stopping the stopwatch."

Mistake 6: Proposing impractical improvements — Suggesting equipment unavailable in Caribbean schools or dangerous procedures shows poor judgment. Correction: Propose realistic improvements within CSEC practical contexts: using expanded polystyrene insulation rather than expensive vacuum flasks, or conducting reactions outdoors rather than assuming fume cupboard availability.

Exam technique for Planning and Evaluating Experiments

Command words matter: "State" requires a simple answer without explanation (1 mark). "Explain" or "Suggest" requires reasoning (2-3 marks). "Plan" or "Describe" requires multiple sequential points (4-6 marks). Budget your time accordingly—a 6-mark planning question deserves 7-8 minutes.

Structure planning answers logically: Use numbered steps for methods. Create clear headings (Apparatus, Method, Safety) even if not explicitly requested. Examiners award marks for clear communication—scattered, disorganized answers lose marks even if containing correct information.

Be specific with measurements: Never write "some acid" or "a few marble chips." State exact volumes (50 cm³), masses (2.5 g), or ranges (20°C to 60°C in 10°C intervals). Include appropriate units with every numerical value.

Connect improvements to errors: In evaluation questions, the mark scheme rewards answers showing cause-and-effect thinking. Follow this pattern: "Because [specific error occurred], we should [specific improvement], which will [expected benefit]."

Quick revision summary

Planning experiments requires identifying independent, dependent, and control variables; formulating testable hypotheses; and designing detailed procedures with specific apparatus and measurements. Always include appropriate safety precautions linked to chemical hazards. Evaluation focuses on reliability (repeatability of results) and validity (whether the experiment tests what it claims). Identify specific sources of error—distinguish random from systematic errors—and suggest targeted improvements with scientific justification. Answer evaluation questions by connecting errors to specific procedural weaknesses and proposing practical solutions within Caribbean school laboratory contexts. Remember: precision in language earns marks; vague statements do not.