· By Thesisroom
How to Check If a Student's References Are Real: A Supervisor's Method
A supervisor's method for checking a student's references: which entries to test first, free DOI, Crossref and retraction checks, and what to do when one fails.
How to check if a student’s references are real: pick the references the thesis leans on and resolve each DOI at doi.org. Search the rest in Crossref or OpenAlex, and compare authors, title, year and journal with what the student wrote. Then check the real ones for retractions. A reference that fails is a question for the student, not yet a verdict.
Why supervisors now check references at all
Chatbots can produce references that look right and do not exist. Walters and Wilder checked 636 citations in 84 short literature reviews generated with ChatGPT in 2023. They found that “55% of the GPT-3.5 citations but just 18% of the GPT-4 citations are fabricated” (Walters and Wilder, 2023).
Those figures describe 2023 models on one kind of task, so do not treat them as a rate for your students. The point is narrower. A reference list can look complete and still contain entries nobody can find. Our explainer on what hallucinated citations are covers why they look so plausible.
Which references to check first
You do not need to check all 200 entries by hand. Start where a fake would do the most damage or is most likely to hide.
- References that carry a key claim: the study behind the research gap, the main method justification or a headline statistic.
- Sources you do not recognise in a field you know well.
- Entries with no DOI where you would expect one, such as a recent journal article.
- Citations that fit the sentence too neatly, with a title that repeats the student’s own argument.
- A cluster of recent sources added late in drafting, after the student’s reading notes stop.
Check ten or fifteen of these first. If any fail, check the whole list.
The check, one reference at a time
- Resolve the DOI. Type doi.org, a slash and the DOI into your browser’s address bar. The DOI Foundation describes this as “resolving the DOI”: the system looks up the string and redirects you to the object it points to (DOI Foundation).
- Read the result. A DOI that is not registered lands on a page headed “DOI Not Found”. The page suggests “The DOI is incorrect in your source” as one reason, and invites you to search for the item by its title instead (doi.org).
- Compare the details. When the DOI resolves, check that the page shows the same authors, title, year, journal, volume and pages as the reference. A real DOI attached to a different paper is one of the signs libraries list, below.
- Search the entries with no DOI. Crossref’s free search lets you “search the metadata of journal articles, books, standards, datasets & more” (Crossref). OpenAlex describes itself as “a free and open catalog of the world’s scholarly research system” (OpenAlex). Search the exact title in quotation marks.
- Check a whole list at once if you have it. Crossref’s Simple Text Query takes a reference or a list pasted into one box. It “attempts to find exactly one DOI for each reference” (Crossref documentation).
- Check the real ones for retractions. Crossref acquired the Retraction Watch database in 2023 and made it “a public resource” (Crossref). Retraction Watch explains how to search it in its database user guide.
For the student’s side of the same task, point them to our guide on how to verify references, which walks through each registry result.
Signs that a reference may be fabricated
University libraries list the patterns to look for. Liberty University’s library describes a DOI that “does not resolve at all” or “resolves to a different article than the one cited” (Liberty University Library). The same page lists partly real references:
- “A real DOI paired with the wrong title”;
- “A real author paired with the wrong journal”;
- “A real journal paired with invented volume and page numbers”.
Olympic College’s guide for faculty adds that “pagination, volume and/or issue numbers do not correspond to the actual journal”, and that some fabricated lists use “generic, single author names” (Olympic College Library).
What a failed check does and does not prove
A reference you cannot find is not proof of fabrication. The University of Liverpool’s guidance for markers says such signs “are not definitive proof of AI-generated content but may warrant further investigation” (University of Liverpool).
The same document notes that “some references might not show up in plagiarism detection tools”, and advises markers to “cross-check unfamiliar sources manually”.
What to do when a reference does not check out
Treat the first conversation as a check, not an accusation. A script that keeps it neutral:
I could not find these three sources in Crossref or through their DOIs. Can you send me the PDFs or the pages where you found them? If any came from a chatbot or a search summary, tell me now and we will fix the list together.
Then decide on what comes back.
- The student produces the source: correct the details and move on. Add a note to check the rest of that chapter.
- The student cannot find it, and it came from a chatbot or a summary: remove the entry. Find a real source for the claim or cut the claim, then recheck the whole list before the next draft.
- There is a pattern, or the thesis is already submitted: follow your institution’s procedure. Liverpool’s guidance says “where misuse is suspected, follow the established process for academic misconduct”, and lists “allowing the student to explain the circumstances” as part of it (University of Liverpool).
If a real source turns out to be retracted, that is a different problem with its own fix. Our guide on what to do if a paper you cited is retracted sets out the options.
Build the check into supervision
Checking once, at the end, is the expensive way to do it. The UK Council for Graduate Education’s supervisory practice framework lists “encouraging candidates to write and giving appropriate feedback” among its criteria (UKCGE). Reference checks fit inside that feedback.
- Ask for a source log from the first chapter: each reference, where it was found, and whether the student read it in full.
- Spot-check five references per chapter draft, chosen from the list above.
- Agree a rule on chatbots: any reference suggested by one is checked at doi.org or Crossref before it enters the reference manager.
- Run a full check before submission, using the passes in our reference list checking guide.
If you supervise several students, keeping these checks in one place helps. Our guide on how to track PhD students’ progress covers a simple record you can keep between meetings.
What Thesisroom does with this
Thesisroom’s Citation Check draws on nine academic registries (Thesisroom method). It checks whether each work is in published research databases such as Crossref and OpenAlex, whether the DOI resolves and whether the paper has been retracted (Thesisroom). On a Lab Cohort, students share their Supervisor Report with you, a frozen snapshot of what was found, and Reference Watch re-checks their sources weekly so a later retraction is flagged. It shows what the record says. Deciding what that means for the student stays with you.
Frequently asked questions
How do I check if a DOI is real?
Type doi.org, a slash and the DOI into your browser’s address bar. A registered DOI redirects to the item. An unregistered one shows a “DOI Not Found” page. Then confirm the page shows the same authors, title and year as the reference.Can I check a whole reference list at once for free?
Crossref’s Simple Text Query accepts a pasted reference list and tries to find one DOI for each entry. Search any entry it does not match in OpenAlex or a library catalogue.Does a reference with no DOI mean it is fake?
Not on its own. Search the exact title in Crossref, OpenAlex or your library catalogue, and ask the student for a copy if you still cannot find it.Will a plagiarism checker catch fabricated references?
Not reliably. The University of Liverpool’s guidance for markers notes that some references might not show up in plagiarism detection tools, and advises checking unfamiliar sources by hand.What should I say to a student whose references I cannot find?
Name the specific sources, ask for the PDFs or the pages they came from, and ask whether any came from a chatbot. Keep it a check, not an accusation, until you see what they send.When should I report fabricated references?
When there is a pattern or the work has been submitted for assessment, follow your institution’s academic misconduct procedure. Guidance such as Liverpool’s includes letting the student explain the circumstances.Sources
- Walters and Wilder (2023), Fabrication and errors in the bibliographic citations generated by ChatGPT, Scientific Reports
- DOI Foundation: what is a DOI
- doi.org: example of a DOI Not Found page
- Crossref search
- Crossref documentation: Simple Text Query
- Crossref: Crossref and Retraction Watch
- Retraction Watch Database user guide
- OpenAlex: about
- Liberty University Library: spotting fabricated citations
- Olympic College Library: using AI, for faculty
- University of Liverpool: academic integrity process for the misuse of generative AI
- UKCGE: Good Supervisory Practice Framework
How this guide was made: Thesisroom drafted this guide with the help of AI writing tools. Every fact, figure and source in this post was checked against its original source before publishing.