Your own study: from a question to a report
Plan a study at one scale, write a one-page proposal, carry it out, and report it in a paper, a poster and a rubric sheet
The brief
Design, carry out and report a study of your own at one scale: a question you chose, a method you can defend, and a result someone else can rerun.
The course's research capstone. It certifies nothing; it gives you the evidence a mentor needs to judge whether you are ready for supervised research.
- Hand in: a one-page proposal, a reproducible repository (or an audit trail for qualitative work), a six-page paper, a poster and your rubric sheet.
- From: a question card from the question studio, one scale route (its model lab and capstone), the research studios and CK-M.
- Done when: every stage below meets its own check, CK-R's mock review is answered, and your self-check reaches Proficient on every competence.
About 20 to 40 hours of your own work, CK-R's four among them: about an hour on this page, then the study. A mentor's review and a peer-review swap are optional, and help most.
Three tracks, one rubric
Model-based
Optimization or simulation. A model of the system that answers what to do, or what would happen.
- Questions
- Prescriptive, predictive or explanatory
- Rerun
- Reruns from a clean clone; checked against a hand calculation or a published benchmark, and validated against real data.
Empirical
Data analysis, or a reproduction or replication of a published result. An analysis of observed data; or a published result rerun with its own data and code (a computational reproduction), or tested on new data (a replication).
- Questions
- Descriptive, explanatory, evaluative or predictive
- Rerun
- Reruns from a clean clone, raw data to result; a reproduction or a replication reports how close it came to the published number.
Mixed
A model or data analysis with a stakeholder or qualitative part. Numbers and people's reasons, with a plan for how each informs the other.
- Questions
- Explanatory, evaluative or prescriptive
- Rerun
- A clean-clone rerun for the numbers; an audit trail from raw notes to themes for the qualitative part.
Every track is judged on the same nine competences. A fully qualitative study is allowed with a mentor; the course teaches qualitative methods at awareness level only.
The five scale routes: a model lab and a capstone each
| Scale | Model lab | Capstone |
|---|---|---|
| S0 device and plant | M4 | C0 |
| S1 microgrid and community | M5 | C1 |
| S2 regional grid | M2 | C2 |
| S3 city and region | M12 | C3 |
| S4 nation | M13 | C4 |
Plan your study
The model-based track: about 30 hours (20 to 40). At 6 hours a week, about 5 weeks (4 to 7).
- Question · 1.5 h
- Literature · 5 h
- Method · 1.5 h
- Data · 2 h
- Build and validate · 6.5 h
- Uncertainty and accounting · 2 h
- Mock review and rerun · 4 h
- Paper and poster · 6 h
- Integrity and release · 1.5 h
Underlined: a stage that ends on a milestone (3, the one-page proposal; 7, CK-R; 8, the paper and the poster; 9, the rubric sheet).
| Your choice | Starting plan | Range |
|---|---|---|
| Track | Model-based | one of: Model-based, Empirical, Mixed |
| Scale | S1 microgrid and community | one of: S0 device and plant, S1 microgrid and community, S2 regional grid, S3 city and region, S4 nation |
| Method family | Optimization | one of R3's nine method families |
| Alternatives | Simulation, Agent-based modelling | any of the nine families |
| Uncertainty treatment | Scenarios | one of: Scenarios, Global sensitivity analysis, Monte Carlo, Stochastic or robust optimization, Intervals and robustness checks, Triangulation, One input at a time |
| Hours a week | 6 h | 2 to 20 h, in steps of 1 h |
| Mock review by | A peer (the swap) | one of: A mentor, A peer (the swap), Yourself, after a day away |
| Stages done | none | any of the nine stages |
With JavaScript on, you pick a track, a scale, a method and your hours a week, and the page sizes each stage.
Without it, plan with the table below.
| Stage | Do, then check | Studios | Hours: Model-based · Empirical · Mixed |
|---|---|---|---|
| 1. Question | Turn your question card into one you can answer at your scale, with its boundary.
|
R1, R10, R3 | 1–2 · 1–2 · 1–2 |
| 2. Literature | Search open databases, snowball from a review, and map what is known.
|
R2 | 4–6 · 4–6 · 4–6 |
| 3. Method | Choose a method family, defend it, and write the one-page proposal.
|
R3, your route's model lab | 1–2 · 1–2 · 1–2 |
| 4. Data | Get, clean and document your data, or plan and hold your interviews.
|
R4, B2 | 1–3 · 3–8 · 2–6 |
| 5. Build and validate | Build the model or analysis under version control, verify it, and validate one result.
|
R5, CK-M, K8, your route's model lab | 3–10 · 2–7 · 2–7 |
| 6. Uncertainty and accounting | Classify the uncertainties, treat each one, and put cost and carbon on one boundary.
|
R6, R7, M7, M8 | 1–3 · 1–3 · 1–3 |
| 7. Mock review and rerun | Get a written mock review of your question and method, answer it, revise, and rerun your main result.
|
CK-R | 4 · 4 · 4 |
| 8. Paper and poster | Write the paper and the poster, with each result's limits beside it.
|
R8, your route's capstone | 4–8 · 3–6 · 3–6 |
| 9. Integrity and release | Check licences, credit and conflicts; treat the people your study is about fairly; release what you may.
|
R9 | 1–2 · 1–2 · 2–4 |
| All | The study, from question to report. | The studios above | 20–40 · 20–40 · 20–40 |
The hours are the curriculum's planning ranges for a first study, not measurements; the weeks follow from your hours a week. Method families as in R3. Your plan stays in this browser and in its link.
Write your one-page proposal
- Title and plan link: the plan's link from the planner above, and the date
- Why it matters: Who would act on the answer, and what answer would change their decision.
- The plan: your question card's eight parts; the track, the scale route, the method and its alternatives, the mock review, the time and the milestones
- Assumptions: the hours a week the weeks rest on
- Sensitivity: the uncertainty treatment you plan
- What is known, and the gap: The three closest studies and what none of them answers; the size of your concept matrix and the date of your search (R2).
- Why this method, not the alternatives: What your method answers that the two alternatives cannot (name a same-family one exactly), and one limit you will mitigate (R3).
- Data and licences: Each source, its date and its licence; for interviews, who you will ask and how you will ask for consent (R4, R9).
- How you will check it: One verification check, one validation against real data or an independent reference, and the tolerance you set now (R5).
- What the study leaves out: The parts, people and years outside your boundary, and why that does not change the answer to your question.
- Integrity: Credit, conflicts, consent, and who the study affects (R9).
With JavaScript on, your question card and your plan fill in the proposal's table, and the checks say which parts are in place. Without it, write the proposal under these headings, on one page.
Go deeper · ResearcherA mentor's review and the peer-review swap
- A mentor reads three things: the proposal, the validation evidence and the final study. Send each with its rubric self-rating.
- The swap: two learners exchange proposals and review each other’s with CK-R’s review form, within a week; then answer point by point, and swap again for the paper’s draft.
- The reviewer’s duties: keep the other proposal confidential, do not use its ideas without permission, and declare any conflict (ALLEA 2023, §2.8).
- Credit: name your reviewers in the paper’s acknowledgements.
Check your study
Framing: the question
Stage 1, question · Prairie City's 2023 weatherization programme: did weatherized homes use less gas than homes on its waiting list (empirical, evaluative, S3). Write the study's question as a card. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Question: Is weatherization good for Prairie City? [1]
- Falls short: No type, no audience, no metric, no comparison: nobody could say when it is answered.
Strong · Strong
Question: Did homes weatherized in 2023 use less gas [1] in the next two winters than similar homes still on the waiting list? [2] Type: evaluative. Audience: the city's housing office, which sets next year's budget and would cut the programme if the saving is under 5%. [3] Metric: winter gas use per home, kWh, adjusted for the weather. Scale: S3; boundary: the homes' gas, not their electricity. Wrong if: the waiting-list homes' use fell as much. [4]
- Works: A metric; its units follow.
- Works: The counterfactual: homes that applied too.
- Works: Who acts on the answer, and the answer that would change the decision.
- Works: A falsification statement.
Positioning: the gap
Stage 2, literature · Prairie City's 2023 weatherization programme: did weatherized homes use less gas than homes on its waiting list (empirical, evaluative, S3). State what is known and the gap. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Gap: few studies look at weatherization in Prairie City, so this study is novel. [1]
- Falls short: Few studies is not evidence of a gap, or of novelty: the topic may be unimportant, or the search poor.
Strong · Strong
Known: of the 14 studies in my concept matrix, 9 use billing data and 3 compare with a waiting list; [1] none of the 3 is in a city with winters this cold. [2] Search: OpenAlex, with the string and the date in appendix A; two more studies found, both in milder climates. [3] Closest: a waiting-list study in a milder city; this one adds cold winters and a second winter. [4]
- Works: The map behind the claim: a matrix of more than 12 sources.
- Works: The empty cell, stated precisely.
- Works: A dated search a reviewer can repeat.
- Works: The closest prior work, engaged directly.
Method fit: the choice
Stage 3, method · A co-op's farm feeder: how much battery, and which tariff, keep the summer evening peak under the feeder's limit at least cost (model-based, prescriptive, S1). Choose the method and defend it. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Method: optimization, because I used it in M2. [1]
- Falls short: Chosen by habit.
Strong · Strong
Method: a linear program of the feeder's summer evenings: the question asks what to do, under stated rules. [1] Against simulation: it tests the designs it is given, but does not search for the cheapest. [2] Against agent-based modelling: it would capture how members respond, but needs behaviour data the co-op does not have. [3] Limit: perfect foresight flatters the battery; I rerun with a day-ahead forecast. [4]
- Works: The family fits the question's type (prescriptive); a linear program is one kind of optimization.
- Works: One alternative, and why not.
- Works: A second alternative, from another family.
- Works: A limit of the chosen method, stated and partly mitigated (perfect foresight).
Trustworthy analysis: the log
Stage 5, build and validate · A co-op's farm feeder: how much battery, and which tariff, keep the summer evening peak under the feeder's limit at least cost (model-based, prescriptive, S1). Write an entry of the verification log. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Log: checked the model; results look reasonable. [1]
- Falls short: No check named, no reference, no tolerance: nobody can repeat it.
Proficient · Proficient
Balance: holds in every hour (largest error 0.000 kW). [1] Benchmark: with no battery, the bill equals the hand calculation to the cent. [2] Validation: the feeder's metered 2025 evening peak, 2.81 MW, against the model's 2.76 MW: 1.8% low, inside the 5% set beforehand. [3] Rerun: from a clean clone, the same result. [4]
- Works: A verification check, named, with its result.
- Works: An independent reference, worked by hand.
- Works: Real data, with a tolerance set before looking.
- Works: Reproducible from the repository alone (clean clone). Strong would add a rerun by someone else.
Uncertainty: the result
Stage 6, uncertainty and accounting · The Plains Grid in a five-day heat wave: how often the reserve falls short with more air conditioning (model-based, predictive, S2). Report the main result. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Result: the reserve falls short in 4 hours of the heat wave. [1]
- Falls short: A single number, as if certain.
Proficient · Proficient
Result: in 90% of 1,000 Monte Carlo runs the reserve falls short in 1 to 9 hours of the heat wave, against 0 to 2 hours with today's air conditioning. [1] Drivers: air-conditioning growth moves it most, then the gas fleet's outage rate. [2] Kept apart: we treat a heat wave hotter than any on record as a stress scenario, because we cannot defend a probability for it. [3]
- Works: A range, how it was made, and what it is compared with.
- Works: The uncertainties that matter, ranked. Strong would add what knowing them better is worth to the decision.
- Works: Deep uncertainty kept out of the probabilities: the evidence, not the record alone, decides it.
Consistent accounting: cost and carbon
Stage 6, uncertainty and accounting · A co-op's farm feeder: how much battery, and which tariff, keep the summer evening peak under the feeder's limit at least cost (model-based, prescriptive, S1). Report cost and CO₂. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Result: the battery saves money and cuts emissions a lot. [1]
- Falls short: Whose money, on what boundary, against what?
Proficient · Proficient
Cost: against no battery, the co-op's power bill falls $250,000 a year; less the battery's annualized cost, $160,000, its yearly cost falls $90,000 (2025 dollars). [1] CO₂: 120 t a year less, location-based with the grid's hourly average factors, on the same boundary: the co-op's purchases. [2] How: it buys 2,000 MWh at night (0.39 t CO₂ per MWh) to deliver 1,800 MWh in the evening (0.50 t per MWh): 1,800 × 0.50 − 2,000 × 0.39 = 900 − 780 = 120 t. [3] Who: members pay for the battery through rates; farms on the feeder gain most. [4]
- Works: Whose money, against what, in which dollars: the bill's fall less the battery's yearly cost.
- Works: One boundary for cost and carbon; the emissions question named (location-based).
- Works: The arithmetic, its 10% losses included. With one yearly factor for every hour, the 200 MWh lost would add CO₂ instead.
- Works: Who pays and who benefits, named.
Realism: the inputs
Stage 4, data · A co-op's farm feeder: how much battery, and which tariff, keep the summer evening peak under the feeder's limit at least cost (model-based, prescriptive, S1). Say what the key inputs are, and what the study leaves out. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Inputs: the co-op's new 2 MW battery is installed in 2027. [1]
- Falls short: An option written as if it were a project that exists.
Proficient · Proficient
Battery: a design option; the co-op has decided nothing. [1] Tariff: the co-op's published 2025 tariff, dated. [2] Leaves out: the feeder's voltage limits, battery wear after year 10, and how members respond to the tariff. [3]
- Works: Evidence status: an option, not an announced or built project.
- Works: A primary document for a key input.
- Works: A list of what the analysis leaves out.
Communication: the public summary
Stage 8, paper and poster · Prairie City's 2023 weatherization programme: did weatherized homes use less gas than homes on its waiting list (empirical, evaluative, S3). Write the core of the 150-word public summary. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Summary: our study proves weatherization works and should be extended to every home. [1]
- Falls short: Proves, works, every home: no size, no limits, and a policy the study did not test.
Proficient · Proficient
Finding: weatherized homes used 9% to 15% less gas in the two winters after than similar homes still on the waiting list. [1] Limits: one city, two winters, homes that applied; gas use, not comfort or health. [2] For the housing office: the result holds for homes like those that applied; homes that never apply may differ. [3]
- Works: The finding, with its size and its comparison.
- Works: The limits beside the result.
- Works: A reading that is hard to misread.
Integrity: the statement
Stage 9, integrity and release · A co-op's community solar: why some farms joined and others did not, from sign-up records and 12 interviews (mixed, explanatory, S1). Write the integrity statement. Both fragments are illustrative; the study is fictional and its numbers are assumed, not computed.
Weak · Developing
Ethics: no issues: the data are public. [1]
- Falls short: The interviews and the co-op's records are not public: consent and licences unchecked.
Strong · Strong
Consent: the 12 interviewees signed a consent form, and the university's ethics board approved the interviews. [1] Data: the co-op's sign-up records under a data-sharing agreement, names removed; I release the code and a synthetic copy, not the records. [2] Credit: co-op staff in the acknowledgements; no funding and no conflicts. [3] Findings: the co-op saw them before publication, with no veto. [4]
- Works: Consent and ethics review for the people the study is about.
- Works: The licence checked; released where allowed (a synthetic copy).
- Works: Credit and conflicts stated.
- Works: Stakeholders treated fairly, without control of the results.
| Competence | Developing | Proficient (the bar) | Strong |
|---|---|---|---|
| Framing Look for: Your proposal's question card passes its eight checks and says what answer would change your audience's decision. |
Question vague or untyped; no audience or counterfactual. | Typed question with audience or decision-maker, metric with units, counterfactual, scale and boundary; one falsification statement. | Also explains why the question matters to its audience and what answer would change a decision. |
| Positioning Look for: Your concept matrix of 12 sources or more, and a dated search behind the gap. |
A few sources, no map. | Concept matrix of at least 12 sources; a stated gap with evidence. | The gap survives a search by a reviewer; closest prior work engaged directly. |
| Method fit Look for: Your method defended against the two alternatives in your plan, and one limit you mitigated. |
Method chosen by habit. | Method defended against two alternatives, one of them a different family. | Limits of the chosen method stated and partly mitigated. |
| Trustworthy analysis Look for: A clean-clone rerun (CK-R), a verification log and one validation, named in the paper. |
Results cannot be rerun. | Reruns from a clean clone (or a complete audit trail); verification log; one validation against real data or an independent reference. | Independent reproduction by someone else; validation on data not used to build the analysis. |
| Uncertainty Look for: The main result as a range, with how the range was made. |
Single numbers. | Uncertainties classified; scenario or global sensitivity analysis; results as ranges. | Decision-relevant uncertainty identified and its value discussed. |
| Consistent accounting Look for: Cost and emissions on one boundary where you report them, the emissions question named, and who pays and who benefits. |
Costs and emissions on different boundaries. | Cost and emissions on one boundary; emissions question named; who pays and who benefits named. | Distributional and environmental side effects estimated with stated assumptions. |
| Realism Look for: The evidence status of your key inputs, and a list of what the study leaves out. |
Assumes announced projects exist. | Evidence status of key inputs; a 'what the analysis leaves out' list. | Realism checked with a practitioner or primary documents. |
| Communication Look for: The six-page paper, its key figure, the limits paragraph and the 150-word public summary. |
Results without limits. | Six-page paper; one key figure; a limits paragraph; a 150-word public summary. | A briefing a decision-maker could act on without misreading. |
| Integrity Look for: Your integrity statement: licences, credit, conflicts and consent; what you released. |
Licences or credit unchecked. | Licences checked, credit and conflicts stated, stakeholders treated fairly. | Data and code released with documentation where allowed. |
Two statuses you can claim, in your own words
| Status | Requires | Evidence you can show |
|---|---|---|
| Completed Research Studio | The core path, the checkpoints CK-F, CK-A and CK-M, and a submitted CR with a self-assessment. | The CR repository and report, the rubric sheet. |
| Demonstrated supervised-project readiness at scale Sx | The above, plus the Sx route, CK-R, and Proficient or better on all nine rubric competences. A mentor's review of the proposal, the validation evidence and the final study is optional but recommended. | The same, plus the CK-R review and response, and the mentor's comments if any. |
The course issues no certificate or badge. A web course cannot verify who did the work or replace a mentor's judgement: it gives you a published standard and the evidence to show against it.
Numbers, sources and what’s next
Numbers used on this page
| Number | What it means | Source |
|---|---|---|
| 20 to 40 hours | The study, CK-R's four hours among them: each track's stages sum to this range. | The course's planning range |
| 12 sources | The least a concept matrix holds at the rubric's Proficient level. | The course rubric |
| 6 pages, 150 words | The paper, and its public summary, at the rubric's Proficient level. | The course rubric |
| Fragments | Every number in the weak and strong fragments: assumed for the example, not computed. The cost and CO₂ fragment shows its arithmetic. | Illustrative |
Next
Sources and further reading
- DeCarolis, J. et al. (2017). Formalizing best practice for energy system optimization modelling. Applied Energy 194, 184–198.
- Sovacool, B. K., Axsen, J. and Sorrell, S. (2018). Promoting novelty, rigor, and style in energy social science: Towards codes of practice for appropriate methods and research design. Energy Research & Social Science 45, 12–42.
- Pfenninger, S. et al. (2017). The importance of open data and software: Is energy research lagging behind? Energy Policy 101, 211–215.
- National Academies of Sciences, Engineering, and Medicine (2019). Reproducibility and Replicability in Science. The National Academies Press. Summary, p. 1:
- Reproducibility: the same input data, code and conditions of analysis give consistent computational results.
- Replicability: consistent results across studies of the same question, each with its own data.
- ALLEA (2023). The European Code of Conduct for Research Integrity, Revised Edition 2023. Berlin (CC BY 4.0): §2.8 Reviewing and Assessment.
Spotted an error, or stuck? Write to hlli@ksu.edu. Corrections are made in place and dated here.
Text licensed CC BY 4.0, code MIT: teachers and students may reuse and adapt it, with credit to Honglin Li.