Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title:

RESEARCH QUESTION

Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.

Oct 2, 2026 · 15:59 PARTIAL

30-SECOND VIEW

Final Research Answer

The proposed research addresses a critical gap in postgraduate surgical education in Pakistan by conducting a qualitative needs assessment of supervisors' perspectives to inform the design of a contextually appropriate research training and mentorship framework. Based on the evidence provided, three thesis-worthy research topics emerge: 1. **Topic**: Supervisor-informed curriculum design for surgical research training in resource-constrained settings. **Why it matters**: Current frameworks are imported from high-resource contexts and ignore surgical workload realities; a locally grounded model could improve feasibility and sustainability. *…
Read full answer
The proposed research addresses a critical gap in postgraduate surgical education in Pakistan by conducting a qualitative needs assessment of supervisors' perspectives to inform the design of a contextually appropriate research training and mentorship framework. Based on the evidence provided, three thesis-worthy research topics emerge: 1. **Topic**: Supervisor-informed curriculum design for surgical research training in resource-constrained settings. **Why it matters**: Current frameworks are imported from high-resource contexts and ignore surgical workload realities; a locally grounded model could improve feasibility and sustainability. **Existing literature**: Bakhshi et al. (2023) [C523] documents low research output among surgical trainees but excludes supervisor input. **Unresolved question**: What specific content, structure, and delivery mechanisms do surgical supervisors deem feasible and effective? **Population**: Surgical faculty at a Pakistani tertiary hospital. **Variables**: Perceived barriers, preferred mentorship models, acceptable time commitment. **Methodology**: Qualitative interviews with thematic analysis. **Feasibility**: High—aligns with institutional needs and uses accessible participants. **Supporting source**: [C523]. **Limitation**: Single-site design limits generalizability. 2. **Topic**: Structured mentorship models to overcome time constraints in surgical residency. **Why it matters**: Mentorship is inconsistently delivered and burdensome; structured alternatives (e.g., peer or near-peer models) may enhance support without overloading faculty. **Existing literature**: Thomas & Oldfield (2025) [C524] identifies time and lack of mentor training as key barriers globally. **Unresolved question**: How can mentorship be restructured to fit surgical workflows while maintaining effectiveness? **Population**: Same as above. **Variables**: Current mentorship practices, perceived burden, receptiveness to alternative models. **Methodology**: Qualitative needs assessment. **Feasibility**: Moderate—depends on institutional willingness to innovate. **Supporting source**: [C524]. **Limitation**: Mentors’ own research competence is unmeasured. 3. **Topic**: Differentiating surgical from non-surgical research training needs. **Why it matters**: Surgical training’s unique demands (long hours, apprenticeship model) may require distinct curricular adaptations not addressed in mixed-specialty studies. **Existing literature**: Bakhshi et al. (2023) [C523] pools medical and surgical residents, obscuring specialty-specific needs. **Unresolved question**: What aspects of research training must be tailored specifically for surgical trainees? **Population**: Surgical supervisors vs. implicit comparison with prior non-surgical data. **Variables**: Specialty-specific barriers, timing preferences, skill priorities. **Methodology**: Qualitative focus on surgical context. **Feasibility**: High within scope. **Supporting source**: [C523]. **Limitation**: No concurrent non-surgical supervisor data for direct comparison.
Executive summary

This study proposes a qualitative needs assessment of surgical supervisors at a Pakistani tertiary care hospital to design a feasible research training and mentorship framework for postgraduate surgical trainees. Existing literature—primarily from trainee surveys—confirms low research output and knowledge despite mandatory requirements, citing clinical workload, lack of funding, and poor data access as key barriers [C523]. However, no Pakistani study has captured supervisors’ perspectives, focused exclusively on surgical trainees, or translated findings into a structured curriculum. Global reviews affirm mentorship’s importance but highlight inconsistent implementation due to time constraints and inadequate faculty preparation [C524]. By centering supervisors’ practical insights within surgery’s unique training constraints, this research aims to close four identified gaps simultaneously: absence of supervisor voice, lack of surgery-specific focus, failure to design actionable frameworks, and limited qualitative depth at the postgraduate surgical level.

Export Research · coming later

Partial research available

Planner 2 — Llama 4 Scout: OpenRouter rate-limited this request. Please try again later. Retry

Planner 3 — Qwen3.5-27B: The model did not return a valid structured research response. Retry

semantic_scholar: Semantic Scholar retrieval failed (rate_limit). Retry

Overall confidence85%Synthesizer confidence estimate
Evidence strengthLimitedLowest reported finding strength; conflicts take precedence
Academic papers20 papers
AI agents1/3 successfulActive saved responses
ConsensusAvailable
Semantic ScholarUnavailable

2-MINUTE VIEW

Key Findings

Moderate 1 sources

Postgraduate surgical trainees in Pakistan exhibit low research output and knowledge despite mandatory requirements and positive attitudes.

Support diagnostic: academically supported

View sources

Postgraduate surgical trainees in Pakistan exhibit low research output and knowledge despite mandatory requirements and positive attitudes.

Bakhshi et al. (2023) surveyed 333 trainees across Pakistan, finding 57% scored below one-third in research knowledge and only 11–18% published, despite 61% receiving some training [C523]. This cross-sectional survey provides quantitative confirmation of the problem but lacks qualitative depth on causes.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. Open source

Strong 1 sources

No existing Pakistani study has gathered supervisors’ perspectives on surgical trainees’ research needs.

Support diagnostic: academically supported

View sources

No existing Pakistani study has gathered supervisors’ perspectives on surgical trainees’ research needs.

Multiple recent studies—Bakhshi et al. (2023), Shah (2024 cited in rationale), Mahmood et al. (2025), Ahmed et al. (2023)—explicitly limit their scope to trainees or students [C523]. Rationale correctly identifies this as an unaddressed gap.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. Open source

Moderate 1 sources

Mentorship is critical for surgical trainees’ research success but faces systemic barriers like time constraints and insufficient faculty training.

Support diagnostic: academically supported

View sources

Mentorship is critical for surgical trainees’ research success but faces systemic barriers like time constraints and insufficient faculty training.

A 2025 systematic review confirms mentorship boosts publication rates, skills, and well-being in surgical residents globally but flags limited time and untrained mentors as persistent obstacles [C524]. This supports the local problem but doesn’t address Pakistan specifically.

[C524] Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education Open source

Limited 1 sources

Surgical trainees face unique research barriers compared to other specialties due to caseload and duty hour demands.

Support diagnostic: weak support

View sources

Surgical trainees face unique research barriers compared to other specialties due to caseload and duty hour demands.

The rationale plausibly argues this based on surgical education structure, but retrieved academic evidence doesn’t directly compare surgical vs. non-surgical barriers in Pakistan. Bakhshi et al. included surgical residents but didn’t analyze them separately [C523].

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. Open source

Strong 2 sources

Structured, locally adapted research curricula informed by faculty input are absent in Pakistani surgical training.

Support diagnostic: academically supported

View sources

Structured, locally adapted research curricula informed by faculty input are absent in Pakistani surgical training.

All cited Pakistani studies stop at barrier identification without proposing or testing curricular solutions [C523]. Global examples like Clanahan et al. (2022) [C526] show needs assessments can inform leadership curricula, supporting feasibility—but none exist for research training in this context.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. Open source

[C526] Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment Open source

Evidence Overview

8 valid sources · 0 conflicting findings · 0 disagreements · 20 papers reviewed

The metrics above describe saved evidence. Source associations and agreement between models are not independent verification.

Best Academic Evidence

Saved synthesis ranking where available; otherwise Consensus order. Retrieved papers are not automatically proof of a claim.

Consensus

Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents.

S. Bakhshi, K. Abdul Rahim, A. A. Merchant, Noreen Afzal, A. A. Noorali, M. Lakhdir, S. Mahmood, Mu… · 2023 · Postgraduate medical journal

Purpose: We aimed to determine the perceptions of, barriers to, and predictors of research engagement amongst residents at a national level in Pakistan. Methods: This cross-sectional study used REDCap for online survey dissemination to residents from 12 institutes accredited by the national accred…

Read paper details

S. Bakhshi, K. Abdul Rahim, A. A. Merchant, Noreen Afzal, A. A. Noorali, M. Lakhdir, S. Mahmood, Muhammad Tariq, A. Haider

Purpose: We aimed to determine the perceptions of, barriers to, and predictors of research engagement amongst residents at a national level in Pakistan. Methods: This cross-sectional study used REDCap for online survey dissemination to residents from 12 institutes accredited by the national accreditation body (College of Physicians and Surgeons Pakistan) for core medical and surgical specialties. Logistic regression was used to estimate associations between likelihood of publications and participant characteristics. Results: The response rate was 79% (333/423), with 171 (51%) medical and 162 (49%) surgical residents. The mean ± standard deviation age was 28.8 ± 2.7 years; 137 (41%) were males and 195 (59%) females. More than half the residents, 202 (61%), had received research training, but 189 (57%) scored <33% on basic research knowledge. While most residents agreed on the positive impact of research on their careers (P = .012) and realized that they should be involved in it (P = .33), they also strongly believed that it was difficult to engage in research during training (P < .01). Only 60 (18%) trainees had published a paper in local and 37 (11%) in international journals, respectively. The most significant barriers to conducting research included time limitation due to clinical work, lack of financial support, and unavailability of data (P < .01). Conclusion: Residents have a positive attitude towards research. However, research engagement among residents is low. Improving research mentorship and creating systems that enable protected time and institutional access to data are needed to increase research output of postgraduate trainees. Key messages What is already known on this topic Postgraduate trainees benefit academically from research conducted during residency training. However, in low- and middle-income countries like Pakistan, research output among residents has remained low over the years. The nation has consistently produced very little research. What this study adds The current study helped shed light on the reasons for low research productivity amongst medical and surgical residents in Pakistan. How this study might affect research, practice, or policy The potential predictors for low research involvement highlighted in this study necessitate modification of the existing national residency curriculum to increase research engagement and productivity among residents. Not only can the potential factors be improved, but the study also helps in bringing stakeholders' attention to increasing research opportunities in Pakistan. © The Author(s) 2023. Published by Oxford University Press on behalf of Postgraduate Medical Journal. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

DOI: 10.1093/postmj/qgad062

Open source ↗
Consensus

Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education

Danielle Thomas, T. Oldfield, Hannah Bamford · 2025 · Cureus

Mentorship is a cornerstone of postgraduate surgical education, supporting the development of clinical competence, research capability, professional identity, and psychological well-being. Despite its recognised importance, access to effective mentorship during surgical training remains inconsisten…

Read paper details

Danielle Thomas, T. Oldfield, Hannah Bamford

Mentorship is a cornerstone of postgraduate surgical education, supporting the development of clinical competence, research capability, professional identity, and psychological well-being. Despite its recognised importance, access to effective mentorship during surgical training remains inconsistent. This review aimed to evaluate the role, impact, and challenges of mentorship within postgraduate surgical education. A systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Comprehensive searches of Ovid Medline, Embase, and Emcare identified studies published between 2015 and 2025 that examined mentorship in surgical residency programs. Eligible studies explored mentorship models, outcomes, and implementation strategies. Data were extracted on study design, participant characteristics, mentorship approaches, and key outcomes. Due to methodological heterogeneity, findings were synthesised narratively. In total, 13 studies met the inclusion criteria, encompassing a range of surgical specialties and mentorship formats. Mentorship demonstrated consistent benefits across multiple domains. Structured programs enhanced academic productivity, with mentored residents producing more publications, engaging in research, and achieving greater scholarly output. Mentorship also improved technical skills, procedural confidence, and reflective practice. Professionally, mentored trainees reported stronger leadership development, clearer career trajectories, and higher examination success. Psychosocially, mentorship was associated with reduced burnout, improved confidence, and greater work-life balance. Peer and near-peer mentoring models further strengthened collegiality and accessibility. However, barriers such as limited time, inadequate mentor training, and inconsistent institutional support were frequently reported. Mentorship is integral to postgraduate surgical training, offering substantial academic, clinical, and professional benefits. Structured, well-resourced programs with protected time, trained mentors, and formal institutional recognition yield the most sustainable outcomes. Future initiatives should focus on standardised evaluation frameworks, long-term impact assessment, and innovative mentorship delivery models. Embedding mentorship as a core component of surgical education is essential for cultivating competent, resilient, and future-ready surgical professionals. Copyright © 2025, Thomas et al.

DOI: 10.7759/cureus.99455

Open source ↗
Consensus

The Importance of Mentorship in Thoracic Surgery Residency

Paola Ciriaco · 2025 · Journal of Clinical Medicine

Background: Effective mentorship is a critical component of thoracic surgery training, fostering the acquisition of advanced clinical skills, professional identity, and academic growth essential for the development of future specialists. This perspective article examines the role of mentorship in t…

Read paper details

Paola Ciriaco

Background: Effective mentorship is a critical component of thoracic surgery training, fostering the acquisition of advanced clinical skills, professional identity, and academic growth essential for the development of future specialists. This perspective article examines the role of mentorship in thoracic surgery training, with a particular focus on the value perceived by residents. Methods: The research was conducted on Pubmed, using the following targeted search queries: 'mentorship and thoracic residency' and 'thoracic surgery residents' satisfaction'. Only studies published in English between 2015 and 2025 were included. Studies lacking primary data on mentorship outcomes were excluded. Results: Out of 286 studies initially identified, 25 fulfilled the inclusion criteria. Five main thematic domains emerged: Impact and Effectiveness of Mentorship (12 studies), Training Pathways and Workforce (13), Diversity, Gender, and Equity (8), Resident Well-Being and Outcomes (4), and Assessment Tools (1). Overlaps among domains were frequent, underscoring the multifaceted role of mentorship in thoracic surgery training. Conclusions: Mentorship is a key determinant of success in thoracic surgical training, enhancing technical skills, clinical performance, and academic productivity while protecting resident well-being. It also promotes diversity, equity, and inclusion, supports workforce sustainability, and strengthens professional development. Evidence confirms that mentorship should be considered an essential component of training curricula, with future efforts directed toward structured, equitable, and measurable mentorship programs.

DOI: 10.3390/jcm14207391

Open source ↗
View all papers (20)Consensus

Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment

Julie M. Clanahan, Eileen R. Smith, Rachel W. Moquin, Justin Chen, Michael M. Awad, P. Wise, J. Bla… · 2022 · Global Surgical Education - Journal of the Association for Surgical Education

PurposeAlthough leadership competency is a requirement of the Accreditation Council for Graduate Medical Education, few surgical residency programs have successfully implemented structured leadership training founded on trainees’ learning needs and experiences. We modeled a qualitative needs assess…

Read paper details

Julie M. Clanahan, Eileen R. Smith, Rachel W. Moquin, Justin Chen, Michael M. Awad, P. Wise, J. Blatnik

PurposeAlthough leadership competency is a requirement of the Accreditation Council for Graduate Medical Education, few surgical residency programs have successfully implemented structured leadership training founded on trainees’ learning needs and experiences. We modeled a qualitative needs assessment to explore surgical trainee attitudes and perceptions regarding leadership and dedicated leadership training within surgical residency to inform development of a future leadership curriculum for trainees.MethodsFifteen general surgery residents voluntarily participated in focus groups divided into two sessions of mixed trainee level to explore leadership definitions, leadership experiences and challenges, and curriculum preferences. Transcripts were inductively coded and categorized through consensus discussions from which representative themes were drawn.ResultsSix major themes were identified through thematic analysis and organized within the following framing questions: how do residents define surgeon leadership, why is dedicated leadership training important to residents, and how should we approach leadership training for residents? Six themes emerged including (1) contextualization of surgeon leadership; (2) characteristics, skills, and styles of surgeon leaders; (3) impact on team dynamics and outcomes; (4) relevance within surgical hierarchy; (5) learner-centered strategies and implementation; and (6) need for feedback and evaluation.ConclusionsSurgery residents defined the need for dedicated leadership training to promote career advancement within academic surgery as well as to impact clinical team dynamics and outcomes. Skills and styles required of surgeon leaders are varied and best promoted through self-reflection, peer discussion, and feedback strategies at all trainee levels. These results will be used to guide leadership curriculum development, and the approach can serve as a model for other programs.

DOI: 10.1007/s44186-022-00042-z

Open source ↗
Consensus

Utilizing the DiSC Assessment in Surgical Residency Leadership Training to Address Communication Skill Acquisition: A Kern Six-step Approach to Curriculum Development.

Russell J. Pepe, W. A. Burns, John Dutton, Sorasicha Nithikasem, Jenny Cai, Nell Maloney Patel · 2025 · Journal of surgical education

Objective: Effective communication is essential in delivering high-quality patient care, and in recent years, resident education has expanded to focus on nontechnical skills and communication training. The "Everything DiSC" model is a communication inventory tool used to help employers and employee…

Read paper details

Russell J. Pepe, W. A. Burns, John Dutton, Sorasicha Nithikasem, Jenny Cai, Nell Maloney Patel

Objective: Effective communication is essential in delivering high-quality patient care, and in recent years, resident education has expanded to focus on nontechnical skills and communication training. The "Everything DiSC" model is a communication inventory tool used to help employers and employees gain insight into how an individual may communicate within a team and how others may perceive similarities and differences in communication styles, comprising of Dominance (D), Influence (i), Steadiness (S), and Conscientiousness (C). In this report, we describe our experience mapping the DiSC model to the Kern 6-step framework for curriculum development and summarize residents' feedback several years following its implementation. Design: A general needs assessment was conducted to identify the problem of a lack of a formalized communication and leadership education and performed a general needs assessment. A curriculum was developed for a single academic surgical residency program to address development of nontechnical skills. We designed the leadership curriculum to be given over 4 sessions, with topics including from leadership styles, working within groups, feedback, and wellness. We utilized the DiSC tool, which is a 79-question survey, to establish communication styles of each of our residents and to determine the DiSC style. Setting: This study was conducted at a single academic institution within a surgical residency training program. Participants: This study included surgical residents at a single academic surgical training program. Results: The initial needs assessment survey was completed by 28 of 36 residents, with all residents surveyed (100%) agreeing that communication training was important. In contrast, only 21% agreed that they had received adequate training on communication during residency. 28 residents completed the DiSC Year-in-Review Survey, which indicated that overall, the residents felt that DiSC was useful throughout the year. The majority of residents listed learning and understanding other people's communication style as what they appreciated most about the DiSC sessions. Conclusions: The inclusion of behavioral assessment tools within surgical residency education can provide an opportunity for residents to evaluate their communication techniques and provide a gained awareness across various settings. Continued focus on communication skills, such as with the use of the DiSC model, can enhance patient care at any institution providing such training. This leadership curriculum aided our surgical residency program and can likely facilitate similar value within other training institutions. Copyright © 2025 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

DOI: 10.1016/j.jsurg.2024.103413

Open source ↗
Consensus

270 Breaking Down Barriers: Understanding Challenges to Surgical Research Access for Medical Students in Lower Middle Income Countries (LMICs) and Shaping the Future of Postgraduate Academic Surgery Training Pathways in LMICs

A. Khatri, S. Katuwal, B. Thapa, B. Karki · 2025 · British Journal of Surgery

To identify barriers limiting surgical research involvement among medical students in low- and middle-income countries (LMICs) and explore strategies for developing postgraduate academic surgery pathways. A cross-sectional survey was conducted among 75 participants (81.3% medical stude…

Read paper details

A. Khatri, S. Katuwal, B. Thapa, B. Karki

To identify barriers limiting surgical research involvement among medical students in low- and middle-income countries (LMICs) and explore strategies for developing postgraduate academic surgery pathways. A cross-sectional survey was conducted among 75 participants (81.3% medical students; remainder intern doctors and house officers) in various medical colleges of Nepal. Demographics, prior research experience, perceived barriers, and willingness to pursue academic surgery were collected. Only 20% of respondents reported prior research experience, and 20% considered surgical research as a primary postgraduate focus. Limited awareness (64%) and inadequate mentorship (70.7%) were frequent obstacles. Financial constraints significantly influenced avoidance of research involvement (OR=2.3, 95% CI: 1.7–3.0; p<0.001), while rural-based respondents were more likely to report poor awareness (OR=1.6, 95% CI: 1.2–2.3; p<0.05). Private-institution trainees highlighted weaker institutional support (p=0.03). Cultural factors, including undervaluing research (50.7%), compounded these challenges. Nevertheless, 61.4% expressed willingness to pursue academic surgery if supportive frameworks were implemented. Proposed solutions included mentorship programs (81.3%), financial support (72%), dedicated research time (72%), and structured career guidance (74.7%). In response, Nepal-UK surgical research collaborative and international mentorship initiatives have been introduced to address identified barriers Addressing financial, institutional, and cultural barriers can enhance surgical research engagement in LMICs. Targeted mentorship, curriculum reforms, and financial incentives, supported by international collaborations, may foster sustainable academic surgery pathways, ultimately strengthening research capacity and improving patient outcomes in resource-limited settings. These insights can inform policymakers, educators, and stakeholders striving for more equitable surgical education.

DOI: 10.1093/bjs/znaf128.590

Open source ↗
Consensus

Barriers and Facilitators to Surgical Trainee Psychological Safety

Jennifer H. Chen, Alyssa A. Pradarelli, Julie Evans, Niki Matusko, Norah N. Naughton, Roy Phitayako… · 2025 · JAMA Network Open

Importance: Although psychological safety has been shown to be imperative for effective learning, specific factors associated with its presence in surgical training have not been well characterized. Objective: To identify barriers and facilitators to psychological safety for surgical trainees in t…

Read paper details

Jennifer H. Chen, Alyssa A. Pradarelli, Julie Evans, Niki Matusko, Norah N. Naughton, Roy Phitayakorn, John T. Mullen, Lily Chang, Melissa Johnson, T. Thambi-Pillai, Jon Ryckman, Melissa Alvarez-Downing, N. M. Patel, S. Cassaro, Felicia Ivascu, David T. Hughes, Gurjit Sandhu

Importance: Although psychological safety has been shown to be imperative for effective learning, specific factors associated with its presence in surgical training have not been well characterized. Objective: To identify barriers and facilitators to psychological safety for surgical trainees in the clinical learning environment. Design, Setting, and Participants: This qualitative study was conducted from February 20 to May 2, 2024, among 25 trainees in general surgery and 3 surgical subspecialty programs at 9 teaching hospitals-4 university-based, 3 community-based, and 2 community-based, university-affiliated hospitals. Exposure: Participation in surgical training. Main Outcomes and Measures: Participants were asked to share their perspectives and experiences in training in association with psychological safety in the learning environment. Purposive sampling was used to recruit for semistructured interviews. Transcripts were coded inductively using an interpretive description method. Results: Of 25 surgical trainees (13 women [52%]), 13 (52%) were junior residents (postgraduate years 1-3) and 7 (28%) were members of racial and ethnic minority groups. Four barriers and 3 facilitators to psychological safety were identified. Trainees cited (1) public humiliation, (2) tension around questioning, (3) culture fostered by faculty, and (4) influence of flawed system factors as barriers to psychological safety. Learners described instances of mistreatment and public shaming as detrimental to establishing psychological safety. Although trainees expressed a desire to ask more questions, fear of judgment served as a major barrier to building psychological safety through question asking in the trainee-faculty relationship. Although faculty played a key role in dictating whether psychological safety was present, trainees also noted overarching system-level factors, such as understaffing and lack of resources, as obstacles to promoting psychological safety. Conversely, (1) the work involved in promoting psychological safety, (2) trust, and (3) normalizing vulnerability in the clinical learning environment were facilitators of psychological safety. Trainees highlighted intentionality of actions by chief residents and faculty that explicitly promoted psychological safety. Instances where trust was initially "on the line" (ie, at serious risk of being lost) but ultimately reinforced formed the basis for psychological safety. Furthermore, acknowledgment of shortcomings normalized open sharing of mistakes in a psychologically safe manner. Conclusions and Relevance: This qualitative study identified 7 key individual, interpersonal, and organizational factors associated with psychological safety for surgical trainees. These findings may help inform the future development of interventions aimed at promoting psychological safety in the learning environment for surgical trainees.

DOI: 10.1001/jamanetworkopen.2025.34462

Open source ↗
Consensus

EXPLORING THE RESEARCH JOURNEY: BARRIERS AND FACILITATORS FOR POSTGRADUATE MAXILLOFACIAL TRAINEES

Fahimuddin, Naveed Afzal Khan, Muslim Khan, Harmain Kayani, M. Durrani, M. Zakariya · 2025 · Khyber Journal of Medical Sciences

Objective: To explore the Barriers and Facilitators for research in Postgraduate Maxillofacial Trainees. Methodology: Exploratory Qualitative study design (Case study) was adopted. A ten-question questionnaire was developed and piloted to identify the different perceptions of maxillofacial Trainees…

Read paper details

Fahimuddin, Naveed Afzal Khan, Muslim Khan, Harmain Kayani, M. Durrani, M. Zakariya

Objective: To explore the Barriers and Facilitators for research in Postgraduate Maxillofacial Trainees. Methodology: Exploratory Qualitative study design (Case study) was adopted. A ten-question questionnaire was developed and piloted to identify the different perceptions of maxillofacial Trainees. Purposive Sampling was used to conduct eight semi-structured interviews. Thematic analysis was undertaken with Triangulation of transcripts. Results: Five main themes emerged from the data analyses. Research as a Path to Innovation showed research as a means of pushing boundaries and advancing knowledge. Motivation to Make a Difference outlined that the motivation for conducting research stems from personal passion and external pressures. Hurdles on the Research Path portrays the barriers in the research journey. Fueling Research Success highlights the facilitators in this journey. Nurturing Research Skills for Tomorrow shows the path to improve research skills among trainees. Conclusion: Maxillofacial surgery residents face significant barriers in their research journey. Despite these obstacles, their intrinsic motivation and the requirement for academic publishing drive their research efforts. To improve research outcomes, early exposure to research, continuous training, and institutional support are essential.

DOI: 10.70520/kjms.v17i4.622

Open source ↗
Consensus

Surgical palliative care training in general surgery residency: An educational needs assessment.

A. Bonanno, Laszlo Kiraly, Timothy R. Siegel, K. Brasel, M. Cook · 2019 · American journal of surgery

Introduction: There is increasing recognition that Surgical Palliative Care is an essential component of the holistic care of surgical patients and involves more than end-of-life care in the intensive care unit. General surgery residents are clinically exposed to patients with palliative care needs…

Read paper details

A. Bonanno, Laszlo Kiraly, Timothy R. Siegel, K. Brasel, M. Cook

Introduction: There is increasing recognition that Surgical Palliative Care is an essential component of the holistic care of surgical patients and involves more than end-of-life care in the intensive care unit. General surgery residents are clinically exposed to patients with palliative care needs during each year of training, but few have a dedicated surgical palliative care curriculum. We undertook this educational needs assessment as the first step towards a longitudinal curriculum. Methods: We conducted an anonymous survey of 94 general surgery residents and 115 faculty at community and university hospitals to assess their experience and comfort with surgical palliative care delivery. Residents and faculty were asked multiple choice and open-ended questions. Results: There was a 55% response rate from residents and 33% response rate from faculty. The majority (77%) of respondents were junior residents (PGY1-3) and university-based faculty (66%). Approximately half of residents felt comfortable leading conversations in goals of care (58%), comfort-focused care (52%) and delivering bad news (57%), while greater than 90% of faculty agreed that chief residents needed additional training. All residents agreed they needed additional training and 85% wanted a formal curriculum. Analysis of open-ended questions suggests a deficiency in the pre-operative setting as no residents had participated in these conversations in an outpatient setting. Conclusion: Residents and faculty believe trainees would benefit from further education in surgical palliative care with a dedicated curriculum. The outpatient, pre-operative counseling of patients was identified as a key learning need. These data support our ongoing work to develop a surgically pertinent palliative care curriculum. Copyright © 2019 Elsevier Inc. All rights reserved.

DOI: 10.1016/j.amjsurg.2019.01.008

Open source ↗
Consensus

Needs assessment study of postgraduate surgical education in Sudan: Trainees perspective

E. Kheirelseid, Reem Magzoub, Muhannad Ahmed, A. Rudwan, Mohamed S. M. Awoda, W. Cullen · 2023 · PLOS ONE

Introduction: Global interest has increased in improving the quality and increasing the number of graduates from surgical training programmes in countries with limited resources. Needs assessment of stakeholders in the training programmes represent the backbone of such process. The aim of this stud…

Read paper details

E. Kheirelseid, Reem Magzoub, Muhannad Ahmed, A. Rudwan, Mohamed S. M. Awoda, W. Cullen

Introduction: Global interest has increased in improving the quality and increasing the number of graduates from surgical training programmes in countries with limited resources. Needs assessment of stakeholders in the training programmes represent the backbone of such process. The aim of this study was to assess the surgical training in Sudan from trainees' perspective in order to inform training delivery. Methods: We adopted mixed methods design using focus group discussion for qualitative data collection and questionnaire survey for quantitative data. NVivo 20 Pro was used to organize qualitative data and SPSS 24.0 was used for quantitative data analysis. Results: Thematic analysis of qualitative data identified three themes. Trainees were overall satisfied that they will make good surgeons after completion of the programme. They identified case volume and collaborations with colleagues as the main strengths of the programme and lacking clear objectives for each year of training and academic activities as the main weaknesses. They suggested motivation of trainers and utilization of online resources and meeting platforms as solutions to improve supervision and academic activities during training. Conclusion: The gaps in training and their suggested solutions highlighted by trainees in this study should form the base for reforming the surgical training in Sudan and countries with similar circumstances. Copyright: © 2023 Kheirelseid et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

DOI: 10.1371/journal.pone.0291664

Open source ↗
Consensus

Setting Agenda for Medical Education Research in Pakistan

Sarah Ali, A. Sethi · 2021 · Pakistan Journal of Medical Sciences

Objective: To justify the allocation of human and financial resources, this study aims to identify multiple stakeholders' views of medical education research priorities in Pakistan for the next five years. Methods: This two-stage exploratory mixed-method study was conducted from Jan 2018 to Jun 20…

Read paper details

Sarah Ali, A. Sethi

Objective: To justify the allocation of human and financial resources, this study aims to identify multiple stakeholders' views of medical education research priorities in Pakistan for the next five years. Methods: This two-stage exploratory mixed-method study was conducted from Jan 2018 to Jun 2019. A purposively selected sample of 250 faculty members, research supervisors, postgraduate students, undergraduate students and policymakers actively involved in improving Medical Education were included. In Stage-I: An exploratory open-ended questionnaire asking about Medical Education Research (MER) priorities in Pakistan for the next five years was emailed. Data were thematically analyzed to identify MER areas. In Stage-II: Another questionnaire was developed based on MER areas. The participants were asked to rate their importance on a scale of one to five. Descriptive statistics were calculated using SPSS.v.24. Results: In Stage-I, 140 participants and in Stage-II, 130 participants from different stakeholder groups responded. We identified 20 research priorities grouped under eight themes: curriculum organization, content, delivery, assessment, workplace, students, faculty and educational management. Top three research priorities were identifying needs and developing effective provisions for continuous professional development of the faculty, improving assessment and communication skills. Conclusion: The study identified top MER priority areas as continuous professional development, assessment and communication skills. Some areas unique to the current study include admissions, fostering critical thinking, Islamic values in professionalism and ethics. The study provides evidence-base for decision-making about allocating time and funds for MER in Pakistan. Copyright: © Pakistan Journal of Medical Sciences.

DOI: 10.12669/pjms.37.3.3603

Open source ↗
Consensus

A nationwide survey of orthopedic residency training in Türkiye: Theoretical education, surgical exposure, faculty engagement, and mentorship influence on resident competence

Mahmut Kalem, Bedir Özgencil, E. Özbek, Ercan Şahin · 2025 · Acta Orthopaedica et Traumatologica Turcica

Objective: This study aimed to evaluate orthopedic residency training in Türkiye by analyzing the structure of clinical education, levels of faculty engagement, availability of mentorship, and residents' self-perceived competence. It further examined the influence of mentorship and faculty involvem…

Read paper details

Mahmut Kalem, Bedir Özgencil, E. Özbek, Ercan Şahin

Objective: This study aimed to evaluate orthopedic residency training in Türkiye by analyzing the structure of clinical education, levels of faculty engagement, availability of mentorship, and residents' self-perceived competence. It further examined the influence of mentorship and faculty involvement on surgical training, academic career interest, and subspecialty decisions. Methods: A cross-sectional survey was conducted among orthopedic residents across Türkiye between February 6-18, 2025. A total of 849 residents participated, covering all provinces with orthopedic training centers. Data on institutional characteristics, educational methods, surgical exposure, mentorship, and residents' self-assessed competencies were collected using an online questionnaire. The mean age of participants was 29.1 years (range: 23-35), and 95.2% were male. The mean residency year was 2.7. The primary outcomes included surgical exposure, self-assessed competence, academic interest, and mentorship impact. Results: Among participants, 8.13% reported no theoretical education, with peer-based learning (52.1%) being the dominant method. Faculty-led instruction was limited (24.6%). A mentor figure was present in 68.8% and was significantly associated with higher selfassessed competence in theoretical knowledge, surgical skills, and complication management (P < .0001). Mentored residents had greater academic interest (41.1% vs. 33.2%, P=.011) and clearer subspecialty goals (27.9% vs. 18.9%, P=.017). Only 45.7% of the fifth-year residents rated themselves as highly competent. Higher monthly operating room days and case volumes were significantly correlated with greater self-perceived competence (P=.0001). Conclusion: This study reveals substantial disparities in surgical training, faculty engagement, and mentorship across orthopedic residency programs in Türkiye. Structured mentorship initiatives, improved surgical exposure, and faculty-driven education are essential to enhance residents' professional development and preparedness for independent practice.

DOI: 10.5152/j.aott.2025.25438

Open source ↗
Consensus

Effects of Mentorship on Surgery Residents' Burnout and Well-Being: A Scoping Review.

Emmanuel D. Gaeta, Megan Gilbert, Alexandra J. Johns, Gregory J. Jurkovich, M. Wieck · 2024 · Journal of surgical education

Background: In surgical training, a mentor is a more senior and experienced surgeon who guides a surgical trainee to meet personal, professional, and educational goals. Although mentorship is widely assumed to positively affect surgical residents' professional development, a more nuanced understand…

Read paper details

Emmanuel D. Gaeta, Megan Gilbert, Alexandra J. Johns, Gregory J. Jurkovich, M. Wieck

Background: In surgical training, a mentor is a more senior and experienced surgeon who guides a surgical trainee to meet personal, professional, and educational goals. Although mentorship is widely assumed to positively affect surgical residents' professional development, a more nuanced understanding of mentorship's impact is lacking and urgently needed as burnout rates among residents increase. This study aims to summarize the current literature on the effects of mentorship on surgical residents' burnout and well-being. Methods: A comprehensive literature review was performed with key terms related to "surgical resident" and "mentor" using Pubmed, Embase, and ProQuest databases for primary studies published in the United States or Canada from January 1, 2010 to December 9, 2022 that measured outcomes related to burnout and well-being. Multiple reviewers screened titles and abstracts for relevance, then full-text articles for eligibility. Results: Initial search resulted in 1,468 unique articles, and 19 articles were included after review. Only one article was a randomized controlled trial. Twelve studies described a decrease in burnout rates or in outcomes related to burnout. In contrast, 4 studies identified negative outcomes related to burnout. Six studies showed improved well-being or related outcomes. One study was not able to show a change in self-valuation between coached and noncoached residents. Conclusion: High quality mentorship can be associated with improved well-being and decreased burnout in surgical residents, but the key elements of effective and helpful mentorship remain poorly characterized. This summary highlights the importance of making mentorship accessible to surgical residents, and training faculty to be effective mentors. Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.

DOI: 10.1016/j.jsurg.2024.08.001

Open source ↗
Consensus

Barriers to undergraduate medical students’ research engagement in Pakistan: a qualitative exploration

A. Mahmood, N. Rehman, Xiao Huang, I. Riaz · 2025 · BMC Medical Education

Background: Engaging in research is a critical component of medical education, fostering critical thinking and evidence-based practices. Despite its importance, undergraduate medical students in Pakistan face significant barriers to research engagement. This study explores the challenges hindering …

Read paper details

A. Mahmood, N. Rehman, Xiao Huang, I. Riaz

Background: Engaging in research is a critical component of medical education, fostering critical thinking and evidence-based practices. Despite its importance, undergraduate medical students in Pakistan face significant barriers to research engagement. This study explores the challenges hindering their participation in research activities. Methods: A qualitative research design was employed, utilizing semi-structured interviews with 45 undergraduate medical and dental students from a public medical university in Pakistan. Participants were purposefully selected to provide diverse perspectives. Data were analyzed thematically to identify recurring barriers and challenges. Results: Four key themes emerged: (1) Time constraints, as academic workloads and clinical rotations left limited time for research; (2) Lack of extrinsic motivation, knowledge, and research ability, including insufficient training and limited institutional incentives; (3) Inadequate financial assistance and poor maintenance of research facilities, with students highlighting a lack of funding and outdated infrastructure; and (4) Lack of support from research mentors and training, emphasizing the need for effective mentorship and structured research programs. These barriers collectively hinder students' ability to engage meaningfully in research. Conclusions: The study highlights the urgent need for systemic reforms in medical education, including integrating research training into curricula, improving mentorship programs, providing financial and infrastructural support, and incentivizing research participation. Addressing these challenges can foster a culture of inquiry, empowering students to contribute to advancements in medical science. © 2025. The Author(s).

DOI: 10.1186/s12909-025-07185-9

Open source ↗
Consensus

A Nationwide Virtual Research Education Program for Medical Students in Pakistan: Methodological Framework, Feasibility Testing, and Outcomes

A. A. Noorali, Maha Inam, Hamna Shahbaz, Hareem Rauf, F. Aamir, F. Khalid, Saadia Abbas, Abdullah S… · 2022 · Frontiers in Public Health

Introduction: Equipping young medical trainees with fundamental research skills can be a promising strategy to address the need for professionals who can understand and responsibly communicate evolving scientific evidence during a pandemic. Despite an ardent interest to partake in research, most ed…

Read paper details

A. A. Noorali, Maha Inam, Hamna Shahbaz, Hareem Rauf, F. Aamir, F. Khalid, Saadia Abbas, Abdullah Saeed, M. Musharraf, A. A. Merchant, B. Hasan, M. Rasheed, F. Jehan, M. Tariq, A. Haider

Introduction: Equipping young medical trainees with fundamental research skills can be a promising strategy to address the need for professionals who can understand and responsibly communicate evolving scientific evidence during a pandemic. Despite an ardent interest to partake in research, most educational institutions in Pakistan and other low-middle income countries have not yet adopted a comprehensive strategy for research skills education. The authors aimed to design and assess the feasibility of implementing the first nation-wide virtual research workshop for medical students in Pakistan. Methods: The course "Beginners Guide to Research," designed as a nation-wide virtual research workshop series, was conducted for medical students across Pakistan in June 2020. Four interactive live workshops took place online on alternate days from June 22nd, 2020, to June 27th, 2020, each lasting 1-2 h. Outcomes included: (i) reach, (ii) efficacy as indexed by pre-post change in score pertaining to knowledge and application of research and (iii) self-rated perceptions about understanding of research on a Likert scale. Results: 3,862 participants enrolled from 41 cities and 123 institutions. Enrolled participants belonged to the following provinces: Sindh (n = 1,852, 48.0%), Punjab (n = 1,767, 45.8%), Khyber Pakhtunkhwa (n = 109, 2.8%), Azad Jammu and Kashmir (n = 84, 2.2%) Balochistan (n = 42, 1.1%). We also saw a few registrations from international students (n = 8, 0.2%). Mean (SD) age of enrolled medical students was 21.1 (2.1) years, 2,453 (63.5%) participants were female and 2,394 (62.0%) were from private-sector medical colleges. Two thousand ninety-three participants participants filled out all four pre-test and post-test forms. The total median knowledge score improved from 39.7 to 60.3% with the highest improvements in concepts of research bioethics and literature search (p < 0.001) with greater change for females compared to males (+20.6 vs. +16.2%, p < 0.001) and private institutions compared to public ones (+16.2 vs. +22.1%, p < 0.001). Conclusion: The overwhelming enrollment and significant improvement in learning outcomes (>50% of baseline) indicate feasibility of a medical student-led research course during a pandemic, highlighting its role in catering to the research needs in the LMICs. Copyright © 2022 Noorali, Inam, Shahbaz, Rauf, Aamir, Khalid, Abbas, Saeed, Musharraf, Merchant, Hasan, Rasheed, Jehan, Tariq and Haider.

DOI: 10.3389/fpubh.2021.812130

Open source ↗
Consensus

The Imperative of research in medical education: A call to action for Pakistan.

Ahmad Shabbir, A. A. Khan, A. Mehmood · 2025 · JPMA. The Journal of the Pakistan Medical Association

Dear Madam, We are primarily concerned with promoting the inclusion of research in Pakistani medical education, extending from classrooms to clinical practice. In almost every part of human life, ranging from social practices to healthcare, technology, and economics, research is essential in illumi…

Read paper details

Ahmad Shabbir, A. A. Khan, A. Mehmood

Dear Madam, We are primarily concerned with promoting the inclusion of research in Pakistani medical education, extending from classrooms to clinical practice. In almost every part of human life, ranging from social practices to healthcare, technology, and economics, research is essential in illuminating pathways and confronting the complex challenges of the 21st century. The development of novel therapeutic approaches, diagnostic instruments, and preventative measures relies on medical research, as these are critical for tackling the wide range of global health concerns that confront societies.1  Health workers can enhance patient outcomes by staying on the newest developments in diagnosis, treatment, and preventative techniques through research. Health practitioners are better equipped to deliver individualised, evidence-based care for each patient when they perform research because it deepens their understanding of diseases, the underlying mechanisms behind them, and the selection of effective interventions.2 The educational system in Pakistan, especially in the medical field, is confronting substantial challenges in an ever-changing global environment marked by constant innovations and research breakthroughs. Pakistan's educational system frequently lags behind due to outdated curricula and  teaching techniques. This is in contrast to many inustrialised nations, where educational systems place  higher priority on innovation, critical thinking, and hands-on learning experiences. Consequently, Pakistani medical school graduates find it more challenging  to fulfil the demands of contemporary healthcare practices that could quickly adjust to changing circumstances when they join the industry. 3 Reforms that promote research education and incorporate it into undergraduate courses are necessary to improve Pakistan's medical education system. To provide students with practical training, it is imperative to include seminars and workshops in addition to specialized courses on research methods and critical thinking techniques. Furthermore, research projects must be incorporated into current curricula to promote participation and cross-disciplinary cooperation. Mentorship programs with experienced researchers and financing for student-led initiatives are essential steps.4 Diverse research opportunities will be made possible by the establishment of well-equipped research facilities and relationships with hospitals and public health organisations. Student involvement will be further encouraged by fostering a research culture through symposiums, prizes, and student-run groups. Faculty involvement in research can serve as an example for students, emphasising the importance of research in the advancement of medical knowledge. With the use of these interventions, we hope to develop a new generation of healthcare workers who are prepared to lead innovation and successfully tackle Pakistan's healthcare issues.

DOI: 10.47391/jpma.21367

Open source ↗
Consensus

Results From A Novel Surgical Ethics Curriculum for General Surgery Residents.

S. Char, Rosamond Rhodes, Alexandra Z. Agathis, Celia M. Divino · 2025 · Journal of surgical education

Objective: To identify the surgical ethics topics that general surgery residents find most challenging and design a longitudinal, resident-led curriculum to address these deficits. Design, setting, participants: We conducted a needs assessment to characterize baseline confidence with 17 key ethics…

Read paper details

S. Char, Rosamond Rhodes, Alexandra Z. Agathis, Celia M. Divino

Objective: To identify the surgical ethics topics that general surgery residents find most challenging and design a longitudinal, resident-led curriculum to address these deficits. Design, setting, participants: We conducted a needs assessment to characterize baseline confidence with 17 key ethics topics among general surgery residents at Mount Sinai Hospital, a quaternary care center. Confidence was measured on a 5-point Likert scale. We then designed 6 modules to address the identified deficits. Modules consisted of a twenty-minute didactic on an ethics concept led by a surgical resident in conjunction with a faculty ethicist, followed by a small-group discussion of a case pertaining to that principle. We then distributed a postcurriculum survey to re-assess resident confidence across the 17 topics. Changes in confidence were assessed using Wilcoxon rank sum test. Results: 50 participants (68.5% of eligible residents) completed the needs-assessment, and 46 participants subsequently completed the postcurriculum survey. Prior to implementation of the curriculum, only 29.2% of participants felt they could systematically evaluate and resolve a novel ethical dilemma. Participants reported lowest confidence in their ability to resolve dilemmas pertaining to treatment over objection (2.90 ± 1.03), disagreements with senior colleagues (2.80 ± 0.98), and concerns with a colleague's competence (2.79 ± 0.98). There were significant increases in participant confidence in 10/10 of the topics directly addressed by the curriculum (p < 0.05). There was no post curriculum change in confidence in the topics that participants initially reported greatest baseline confidence. There was strong agreement that the curriculum was valuable (90.0%) and relevant (96.0%). Conclusions: We identified the ethical challenges that residents found most vexing and designed a longitudinal, resident-led curriculum utilizing a combination of existing ethics resources produced by the American College of Surgeons and small group discussions of real cases. This educational intervention increased confidence in 10 key domains of surgical ethics. Copyright © 2025. Published by Elsevier Inc.

DOI: 10.1016/j.jsurg.2025.103688

Open source ↗
Consensus

Integrating structured research training into undergraduate medical education in Pakistan: the need of the hour.

Ayesha Wasim · 2026 · JPMA. The Journal of the Pakistan Medical Association

Medical field, with its ever-growing research, is constantly evolving, making evidence-based clinical practice essential. Rapid advancements in medicine have made it imperative to acquire skills like research methodology and critical appraisal of articles from an under-graduate level. In recent yea…

Read paper details

Ayesha Wasim

Medical field, with its ever-growing research, is constantly evolving, making evidence-based clinical practice essential. Rapid advancements in medicine have made it imperative to acquire skills like research methodology and critical appraisal of articles from an under-graduate level. In recent years, trends have shifted, with medical students in Pakistan, wanting to participate more in research, and aspiring to match their international peers, yet, they are facing significant challenges in doing so1.Currently, research exposure in Pakistan, is limited to basic methodology modules in the 4th or 5th year, which is insufficient to develop strong research skills. Alongside the lack of structured curriculum, students report hurdles, such as time constraints due to academic workload, poor mentorship, limited research knowledge, minimal institutional incentives, and inadequate funding1. Many students remain unaware of research’s importance due to its low weightage in the curriculum and it is often only after graduation that they realise its value and how far behind they are from their international peers. A few students, who do have some awareness and wish to learn earlier on resort to private courses, often led by unqualified individuals. They have to pay hefty fees for these courses, leading to both psychological and financial strain. To tackle these challenges, a standardised, revised curriculum integrating research methodology should be implemented throughout all professional years. Starting with basics like research types and sampling in the 1st year, students would gradually learn database usage and research tools, becoming confident to conduct projects by their final year. Being taught by experts within their university would also protect students from exploitation by private tutors. Additionally, dedicated credit hours for research would help students to manage their time effectively, without compromising their academics or clinical commitments 2. Moreover, official mentorship programs can be established, connecting students with their peer or faculty to guide them through each step. Research methodology workshops can also be arranged regularly to increase awareness and engagement. Research societies can also be established in universities to organize group projects and arrange local conferences for presentations.. Lastly, to remove financial barriers, universities should prioritise research funding, establish research grants and provide institutional access to databases1,2.Implementing these changes will make research more accessible and encourage more students to participate, These students will not only become well-informed doctors but may also contribute to global health solutions3. ---Continue

DOI: 10.47391/jpma.32690

Open source ↗
Consensus

Needs Assessment for the Development of a Sustainability Curriculum for Surgical Residents.

Madeline Matthys, Jane Wang, T. Sathe, Kai-Yi Wang, Seema Gandhi, Hanmin Lee, A. Alseidi · 2024 · Journal of surgical education

Introduction: The healthcare sector accounts for 8.5% of United States (U.S.) greenhouse gas emissions, of which one-third comes from operating rooms (ORs). As a result, there is great interest in decarbonizing the OR and surgical care. However, surgical residents are not routinely educated on the …

Read paper details

Madeline Matthys, Jane Wang, T. Sathe, Kai-Yi Wang, Seema Gandhi, Hanmin Lee, A. Alseidi

Introduction: The healthcare sector accounts for 8.5% of United States (U.S.) greenhouse gas emissions, of which one-third comes from operating rooms (ORs). As a result, there is great interest in decarbonizing the OR and surgical care. However, surgical residents are not routinely educated on the negative environmental impact of surgery or how to reduce it. In this paper, we present a formal needs assessment for a sustainability curriculum geared towards surgical residents. Methods: Using Kern's Six-Step Framework for curriculum development, we conducted focus groups with surgical residents to perform a targeted needs assessment on 3 main topics: 1) the current state of surgical sustainability curricula; 2) resident knowledge regarding the environmental impact of surgery and barriers to sustainable practice; and 3) preferred educational methods and topics within sustainability education. We audio-recorded all focus groups and performed thematic analysis using anonymized transcripts. Results: Fourteen residents participated in 3 focus groups, from which a qualitative analysis revealed 4 themes. First, surgery residents receive limited formal teaching on the negative environmental impact of surgical care or how to reduce this impact. Second, surgery residents have variable levels of prior education about and interest in sustainability in surgery. Third, several barriers prevent the implementation of sustainable changes in surgical practice, including a lack of institutional initiative, cultural inertia, concerns about workflow efficiency, and limited formal education. Finally, residents prefer to learn about practical ways to reduce waste, specifically through interactive approaches such as quality improvement initiatives. Conclusions: Given the increasing importance of sustainability in surgery, there is an urgent need for formal resident education on this topic. This needs assessment provides a valuable foundation for future sustainability curriculum development. Copyright © 2024. Published by Elsevier Inc.

DOI: 10.1016/j.jsurg.2024.06.020

Open source ↗
Consensus

Current Resident and Faculty Mentorship Satisfaction and Important Mentee Functions in Orthopedic Surgery: An American Orthopedic Association North American Traveling Fellowship Project.

Evan M. Miller, C. Goldstein, Scott M. Tintle, B. Ravi, M. Hogan, B. Waterman · 2021 · Journal of surgical education

Objective: While mentorship remains important in orthopedic training, few studies have delineated specific priorities for creating successful mentorship programs and reciprocal satisfaction among contemporary trainees and faculty. The purpose of this study was to define beneficial mentor qualities …

Read paper details

Evan M. Miller, C. Goldstein, Scott M. Tintle, B. Ravi, M. Hogan, B. Waterman

Objective: While mentorship remains important in orthopedic training, few studies have delineated specific priorities for creating successful mentorship programs and reciprocal satisfaction among contemporary trainees and faculty. The purpose of this study was to define beneficial mentor qualities along with specific mentee characteristics to facilitate improved mentoring relationships in orthopedic surgery. Design: This is a cross-sectional study with a 16 multi-item self-reported survey. Setting: This study was conducted at 11 tertiary orthopedic surgery training programs during the 2017 American Orthopaedic Association (AOA) North American Traveling Fellowship Tour. Participants: Eighty orthopedic resident trainees and 90 academic faculty members completed the survey. Results: Around 55.0% of residents and 48.9% of faculty acknowledged a formal mentorship program at their institution. Furthermore, 61.3% of residents and 61.1% of faculty reported having a current mentor. The top 3 qualities valued by residents were a mentor who modeled work-life balance, remained in touch with contemporary issues in training, and provided timely counseling. Faculty valued a mentor who accepted their goals and priorities, provided counseling, and enhanced exposure in their subspecialty. Surveyed faculty were more satisfied than their corresponding residents with how their mentor promoted them, enhanced their exposure, was a friend, and protected them from exploitative collaborations. Mentee participation was considered the most important variable for a successful mentor relationship, while mentee acknowledgement of their mentors was the least prioritized quality. Conclusions: Faculty had a higher overall satisfaction with their mentoring relationships in orthopedic surgery. Residents reported more favorable results when their mentor was a role model of work-life balance. For optimal success, mentors identified active participation and openness to feedback as the most important quality for a mentee to display. These qualities contribute to a heightened sense of satisfaction among mentors and mentees and can be utilized to further guide development of both formal and informal programs for residents and faculty. Copyright © 2021 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

DOI: 10.1016/j.jsurg.2021.01.018

Open source ↗

Disagreements & Limitations

Disagreements

  • No major disagreement identified.

Limitations

  • Evidence on surgical trainees’ research barriers in Pakistan is limited to one major cross-sectional survey [C523]; no qualitative studies focusing exclusively on this group were found.
  • Supervisors’ own research competencies and capacity to mentor are unexamined in the cited literature, creating uncertainty about their ability to inform curriculum design.
  • The proposed single-hospital design limits generalizability across Pakistan’s diverse surgical training environments.
  • Global mentorship reviews [C524, C525] may not reflect realities in low-resource settings like Pakistan, where funding and data infrastructure differ significantly.
  • Twelve potentially relevant papers were omitted from retrieval, so gaps may be narrower than claimed.

Sources

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents.

Postgraduate medical journal · 2023 · DOI: 10.1093/postmj/qgad062

Open source
[C524] Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education

Cureus · 2025 · DOI: 10.7759/cureus.99455

Open source
[C525] The Importance of Mentorship in Thoracic Surgery Residency

Journal of Clinical Medicine · 2025 · DOI: 10.3390/jcm14207391

Open source
[C526] Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment

Global Surgical Education - Journal of the Association for Surgical Education · 2022 · DOI: 10.1007/s44186-022-00042-z

Open source
[C527] Utilizing the DiSC Assessment in Surgical Residency Leadership Training to Address Communication Skill Acquisition: A Kern Six-step Approach to Curriculum Development.

Journal of surgical education · 2025 · DOI: 10.1016/j.jsurg.2024.103413

Open source
[C528] 270 Breaking Down Barriers: Understanding Challenges to Surgical Research Access for Medical Students in Lower Middle Income Countries (LMICs) and Shaping the Future of Postgraduate Academic Surgery Training Pathways in LMICs

British Journal of Surgery · 2025 · DOI: 10.1093/bjs/znaf128.590

Open source
[C529] Barriers and Facilitators to Surgical Trainee Psychological Safety

JAMA Network Open · 2025 · DOI: 10.1001/jamanetworkopen.2025.34462

Open source
[C530] EXPLORING THE RESEARCH JOURNEY: BARRIERS AND FACILITATORS FOR POSTGRADUATE MAXILLOFACIAL TRAINEES

Khyber Journal of Medical Sciences · 2025 · DOI: 10.70520/kjms.v17i4.622

Open source
View Detailed Research
Developer Diagnostics

PRODUCTION MODE

Research Planners

Planner 1 — Gemini 3.5 Flash
google/gemini-3.5-flash

Planner 2 — Llama 4 Scout
meta-llama/llama-4-scout

Planner 3 — Qwen3.5-27B
qwen/qwen3.5-27b

Retrieval

Semantic Scholar: Enabled
API key: Not configured (public access)

Consensus: Enabled

Synthesizer

qwen/qwen3-max
qwen/qwen3-max

Credential readiness

OpenRouter: Configured

Consensus: Configured

Manual evaluation cases and results
Individual AI responses

AI Agent Research

Independent model outputs. Planners propose searches and hypotheses, not evidence. Citations and confidence in historical answers are model-reported and unverified.

Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.

Completed

Research finished. Any provider failures are shown in their sections.

Planner 1 — Gemini 3.5 Flash google/gemini-3.5-flash View response

Problem interpretation

Despite mandatory research requirements in Pakistani postgraduate medical training, surgical trainees show limited research output and competency due to intense clinical workloads. Current literature identifies these barriers from the trainee perspective, but lacks supervisor and faculty perspectives specifically within surgical programs. To design a viable research training and mentorship framework, a qualitative needs assessment of supervisors' viewpoints is required to address surgery-specific constraints and context-specific implementation challenges.

Search queries (not evidence)

  • surgical residency research training curriculum needs assessment
  • postgraduate surgical trainees research barriers qualitative
  • surgical faculty perspectives research mentorship residency
  • medical education research training framework Pakistan
Planner diagnostics
problem_interpretation
Despite mandatory research requirements in Pakistani postgraduate medical training, surgical trainees show limited research output and competency due to intense clinical workloads. Current literature identifies these barriers from the trainee perspective, but lacks supervisor and faculty perspectives specifically within surgical programs. To design a viable research training and mentorship framework, a qualitative needs assessment of supervisors' viewpoints is required to address surgery-specific constraints and context-specific implementation challenges.
research_questions
["What are surgical supervisors' perceptions of the key barriers preventing postgraduate surgical trainees from completing high-quality research?", 'What core content and structural design do surgical supervisors recommend for a postgraduate research training framework?', 'How can mentorship be structured within a surgical residency to minimize administrative burden on supervisors while maximizing trainee support?', 'What are the perceived differences in research training needs between surgical specialties and general medical residencies?']
search_queries
['surgical residency research training curriculum needs assessment', 'postgraduate surgical trainees research barriers qualitative', 'surgical faculty perspectives research mentorship residency', 'medical education research training framework Pakistan']
keywords
['surgical trainees', 'research training', 'needs assessment', 'supervisors perspectives', 'mentorship framework', 'postgraduate medical education', 'surgical residency', 'curriculum design']
synonyms
['surgical residents', 'scholarly activity', 'faculty viewpoints', 'educational needs', 'mentorship program', 'residency curriculum', 'training barriers', 'fellowship requirements']
population_terms
['postgraduate surgical trainees', 'surgical residents', 'surgical supervisors', 'clinical faculty', 'residency program directors', 'medical educators']
intervention_or_exposure_terms
['research training curriculum', 'mentorship framework', 'structured research training', 'research methodology course', 'qualitative needs assessment']
outcome_terms
['research competence', 'publication output', 'dissertation completion', 'faculty satisfaction', 'curriculum feasibility']
possible_research_gaps
['Supervisors may overestimate the baseline research knowledge of trainees compared to trainee self-assessments.', 'An active co-design process involving surgical supervisors might yield higher curriculum adherence than standard medical education templates.', 'Structured peer-mentorship models among surgical residents could mitigate supervisor time constraints.']
uncertainties
['The exact level of protected time that hospital administration is willing to allocate for resident research.', 'Whether supervisors have sufficient training themselves to provide high-quality methodology and statistical mentorship.', 'The feasibility of implementing a standardized research curriculum across diverse surgical subspecialties.']
suggested_filters
{'year_from': 2010, 'year_to': 2025, 'fields': ['Medicine', 'Education', 'Surgery'], 'study_types': ['Qualitative', 'Needs Assessment', 'Mixed Methods', 'Survey']}

Self-reported confidence: Not assessed

Citations

  • No sources supplied by this model.
Planner 2 — Llama 4 Scout meta-llama/llama-4-scout Failed

OpenRouter rate-limited this request. Please try again later.

Planner 3 — Qwen3.5-27B qwen/qwen3.5-27b Failed

The model did not return a valid structured research response.

Full Academic Evidence

Academic Evidence

Academic papers retrieved from the providers below, shown separately from model outputs. Provider metadata is retained; a retrieved paper is not automatically proof of a claim.

Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.

consensus

20 unique papers found in this response

Utilizing the DiSC Assessment in Surgical Residency Leadership Training to Address Communication Skill Acquisition: A Kern Six-step Approach to Curriculum Development. 2025 · other

Russell J. Pepe, W. A. Burns, John Dutton, Sorasicha Nithikasem, Jenny Cai, Nell Maloney Patel

Objective: Effective communication is essential in delivering high-quality patient care, and in recent years, resident education has expanded to focus on nontechnical skills and communication training. The "Everything DiSC" model is a communication inventory tool used to help employers and employees gain insight into how an individual may communicate within a team and how others may perceive similarities and differences in communication styles, comprising of Dominance (D), Influence (i), Steadiness (S), and Conscientiousness (C). In this report, we describe our experience mapping the DiSC model to the Kern 6-step framework for curriculum development and summarize residents' feedback several years following its implementation. Design: A general needs assessment was conducted to identify the problem of a lack of a formalized communication and leadership education and performed a general needs assessment. A curriculum was developed for a single academic surgical residency program to add…

DOI: 10.1016/j.jsurg.2024.103413

Open source ↗
Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment 2022 · interview study

Julie M. Clanahan, Eileen R. Smith, Rachel W. Moquin, Justin Chen, Michael M. Awad, P. Wise, J. Blatnik

PurposeAlthough leadership competency is a requirement of the Accreditation Council for Graduate Medical Education, few surgical residency programs have successfully implemented structured leadership training founded on trainees’ learning needs and experiences. We modeled a qualitative needs assessment to explore surgical trainee attitudes and perceptions regarding leadership and dedicated leadership training within surgical residency to inform development of a future leadership curriculum for trainees.MethodsFifteen general surgery residents voluntarily participated in focus groups divided into two sessions of mixed trainee level to explore leadership definitions, leadership experiences and challenges, and curriculum preferences. Transcripts were inductively coded and categorized through consensus discussions from which representative themes were drawn.ResultsSix major themes were identified through thematic analysis and organized within the following framing questions: how do reside…

DOI: 10.1007/s44186-022-00042-z

Open source ↗
Needs Assessment for the Development of a Sustainability Curriculum for Surgical Residents. 2024 · interview study

Madeline Matthys, Jane Wang, T. Sathe, Kai-Yi Wang, Seema Gandhi, Hanmin Lee, A. Alseidi

Introduction: The healthcare sector accounts for 8.5% of United States (U.S.) greenhouse gas emissions, of which one-third comes from operating rooms (ORs). As a result, there is great interest in decarbonizing the OR and surgical care. However, surgical residents are not routinely educated on the negative environmental impact of surgery or how to reduce it. In this paper, we present a formal needs assessment for a sustainability curriculum geared towards surgical residents. Methods: Using Kern's Six-Step Framework for curriculum development, we conducted focus groups with surgical residents to perform a targeted needs assessment on 3 main topics: 1) the current state of surgical sustainability curricula; 2) resident knowledge regarding the environmental impact of surgery and barriers to sustainable practice; and 3) preferred educational methods and topics within sustainability education. We audio-recorded all focus groups and performed thematic analysis using anonymized transcripts.…

DOI: 10.1016/j.jsurg.2024.06.020

Open source ↗
Surgical palliative care training in general surgery residency: An educational needs assessment. 2019 · cross-sectional study

A. Bonanno, Laszlo Kiraly, Timothy R. Siegel, K. Brasel, M. Cook

Introduction: There is increasing recognition that Surgical Palliative Care is an essential component of the holistic care of surgical patients and involves more than end-of-life care in the intensive care unit. General surgery residents are clinically exposed to patients with palliative care needs during each year of training, but few have a dedicated surgical palliative care curriculum. We undertook this educational needs assessment as the first step towards a longitudinal curriculum. Methods: We conducted an anonymous survey of 94 general surgery residents and 115 faculty at community and university hospitals to assess their experience and comfort with surgical palliative care delivery. Residents and faculty were asked multiple choice and open-ended questions. Results: There was a 55% response rate from residents and 33% response rate from faculty. The majority (77%) of respondents were junior residents (PGY1-3) and university-based faculty (66%). Approximately half of residents …

DOI: 10.1016/j.amjsurg.2019.01.008

Open source ↗
Results From A Novel Surgical Ethics Curriculum for General Surgery Residents. 2025 · field study

S. Char, Rosamond Rhodes, Alexandra Z. Agathis, Celia M. Divino

Objective: To identify the surgical ethics topics that general surgery residents find most challenging and design a longitudinal, resident-led curriculum to address these deficits. Design, setting, participants: We conducted a needs assessment to characterize baseline confidence with 17 key ethics topics among general surgery residents at Mount Sinai Hospital, a quaternary care center. Confidence was measured on a 5-point Likert scale. We then designed 6 modules to address the identified deficits. Modules consisted of a twenty-minute didactic on an ethics concept led by a surgical resident in conjunction with a faculty ethicist, followed by a small-group discussion of a case pertaining to that principle. We then distributed a postcurriculum survey to re-assess resident confidence across the 17 topics. Changes in confidence were assessed using Wilcoxon rank sum test. Results: 50 participants (68.5% of eligible residents) completed the needs-assessment, and 46 participants subsequentl…

DOI: 10.1016/j.jsurg.2025.103688

Open source ↗
EXPLORING THE RESEARCH JOURNEY: BARRIERS AND FACILITATORS FOR POSTGRADUATE MAXILLOFACIAL TRAINEES 2025 · case study

Fahimuddin, Naveed Afzal Khan, Muslim Khan, Harmain Kayani, M. Durrani, M. Zakariya

Objective: To explore the Barriers and Facilitators for research in Postgraduate Maxillofacial Trainees. Methodology: Exploratory Qualitative study design (Case study) was adopted. A ten-question questionnaire was developed and piloted to identify the different perceptions of maxillofacial Trainees. Purposive Sampling was used to conduct eight semi-structured interviews. Thematic analysis was undertaken with Triangulation of transcripts. Results: Five main themes emerged from the data analyses. Research as a Path to Innovation showed research as a means of pushing boundaries and advancing knowledge. Motivation to Make a Difference outlined that the motivation for conducting research stems from personal passion and external pressures. Hurdles on the Research Path portrays the barriers in the research journey. Fueling Research Success highlights the facilitators in this journey. Nurturing Research Skills for Tomorrow shows the path to improve research skills among trainees. Conclusion: …

DOI: 10.70520/kjms.v17i4.622

Open source ↗
Barriers and Facilitators to Surgical Trainee Psychological Safety 2025 · interview study

Jennifer H. Chen, Alyssa A. Pradarelli, Julie Evans, Niki Matusko, Norah N. Naughton, Roy Phitayakorn, John T. Mullen, Lily Chang, Melissa Johnson, T. Thambi-Pillai, Jon Ryckman, Melissa Alvarez-Downing, N. M. Patel, S. Cassaro, Felicia Ivascu, David T. Hughes, Gurjit Sandhu

Importance: Although psychological safety has been shown to be imperative for effective learning, specific factors associated with its presence in surgical training have not been well characterized. Objective: To identify barriers and facilitators to psychological safety for surgical trainees in the clinical learning environment. Design, Setting, and Participants: This qualitative study was conducted from February 20 to May 2, 2024, among 25 trainees in general surgery and 3 surgical subspecialty programs at 9 teaching hospitals-4 university-based, 3 community-based, and 2 community-based, university-affiliated hospitals. Exposure: Participation in surgical training. Main Outcomes and Measures: Participants were asked to share their perspectives and experiences in training in association with psychological safety in the learning environment. Purposive sampling was used to recruit for semistructured interviews. Transcripts were coded inductively using an interpretive description me…

DOI: 10.1001/jamanetworkopen.2025.34462

Open source ↗
Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. 2023 · cross-sectional study

S. Bakhshi, K. Abdul Rahim, A. A. Merchant, Noreen Afzal, A. A. Noorali, M. Lakhdir, S. Mahmood, Muhammad Tariq, A. Haider

Purpose: We aimed to determine the perceptions of, barriers to, and predictors of research engagement amongst residents at a national level in Pakistan. Methods: This cross-sectional study used REDCap for online survey dissemination to residents from 12 institutes accredited by the national accreditation body (College of Physicians and Surgeons Pakistan) for core medical and surgical specialties. Logistic regression was used to estimate associations between likelihood of publications and participant characteristics. Results: The response rate was 79% (333/423), with 171 (51%) medical and 162 (49%) surgical residents. The mean ± standard deviation age was 28.8 ± 2.7 years; 137 (41%) were males and 195 (59%) females. More than half the residents, 202 (61%), had received research training, but 189 (57%) scored <33% on basic research knowledge. While most residents agreed on the positive impact of research on their careers (P = .012) and realized that they should be involved in it (P = …

DOI: 10.1093/postmj/qgad062

Open source ↗
Needs assessment study of postgraduate surgical education in Sudan: Trainees perspective 2023 · mixed methods study

E. Kheirelseid, Reem Magzoub, Muhannad Ahmed, A. Rudwan, Mohamed S. M. Awoda, W. Cullen

Introduction: Global interest has increased in improving the quality and increasing the number of graduates from surgical training programmes in countries with limited resources. Needs assessment of stakeholders in the training programmes represent the backbone of such process. The aim of this study was to assess the surgical training in Sudan from trainees' perspective in order to inform training delivery. Methods: We adopted mixed methods design using focus group discussion for qualitative data collection and questionnaire survey for quantitative data. NVivo 20 Pro was used to organize qualitative data and SPSS 24.0 was used for quantitative data analysis. Results: Thematic analysis of qualitative data identified three themes. Trainees were overall satisfied that they will make good surgeons after completion of the programme. They identified case volume and collaborations with colleagues as the main strengths of the programme and lacking clear objectives for each year of training …

DOI: 10.1371/journal.pone.0291664

Open source ↗
270 Breaking Down Barriers: Understanding Challenges to Surgical Research Access for Medical Students in Lower Middle Income Countries (LMICs) and Shaping the Future of Postgraduate Academic Surgery Training Pathways in LMICs 2025

A. Khatri, S. Katuwal, B. Thapa, B. Karki

To identify barriers limiting surgical research involvement among medical students in low- and middle-income countries (LMICs) and explore strategies for developing postgraduate academic surgery pathways. A cross-sectional survey was conducted among 75 participants (81.3% medical students; remainder intern doctors and house officers) in various medical colleges of Nepal. Demographics, prior research experience, perceived barriers, and willingness to pursue academic surgery were collected. Only 20% of respondents reported prior research experience, and 20% considered surgical research as a primary postgraduate focus. Limited awareness (64%) and inadequate mentorship (70.7%) were frequent obstacles. Financial constraints significantly influenced avoidance of research involvement (OR=2.3, 95% CI: 1.7–3.0; p<0.001), while rural-based respondents were more likely to report poor awareness (OR=1.6, 95% CI: 1.2–2.3; p<0.05). Private-institution trainees highlighted weaker …

DOI: 10.1093/bjs/znaf128.590

Open source ↗
Current Resident and Faculty Mentorship Satisfaction and Important Mentee Functions in Orthopedic Surgery: An American Orthopedic Association North American Traveling Fellowship Project. 2021 · cross-sectional study

Evan M. Miller, C. Goldstein, Scott M. Tintle, B. Ravi, M. Hogan, B. Waterman

Objective: While mentorship remains important in orthopedic training, few studies have delineated specific priorities for creating successful mentorship programs and reciprocal satisfaction among contemporary trainees and faculty. The purpose of this study was to define beneficial mentor qualities along with specific mentee characteristics to facilitate improved mentoring relationships in orthopedic surgery. Design: This is a cross-sectional study with a 16 multi-item self-reported survey. Setting: This study was conducted at 11 tertiary orthopedic surgery training programs during the 2017 American Orthopaedic Association (AOA) North American Traveling Fellowship Tour. Participants: Eighty orthopedic resident trainees and 90 academic faculty members completed the survey. Results: Around 55.0% of residents and 48.9% of faculty acknowledged a formal mentorship program at their institution. Furthermore, 61.3% of residents and 61.1% of faculty reported having a current mentor. The top…

DOI: 10.1016/j.jsurg.2021.01.018

Open source ↗
Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education 2025 · systematic review

Danielle Thomas, T. Oldfield, Hannah Bamford

Mentorship is a cornerstone of postgraduate surgical education, supporting the development of clinical competence, research capability, professional identity, and psychological well-being. Despite its recognised importance, access to effective mentorship during surgical training remains inconsistent. This review aimed to evaluate the role, impact, and challenges of mentorship within postgraduate surgical education. A systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Comprehensive searches of Ovid Medline, Embase, and Emcare identified studies published between 2015 and 2025 that examined mentorship in surgical residency programs. Eligible studies explored mentorship models, outcomes, and implementation strategies. Data were extracted on study design, participant characteristics, mentorship approaches, and key outcomes. Due to methodological heterogeneity, findings were synthesised narratively. In total, 13 s…

DOI: 10.7759/cureus.99455

Open source ↗
A nationwide survey of orthopedic residency training in Türkiye: Theoretical education, surgical exposure, faculty engagement, and mentorship influence on resident competence 2025 · cross-sectional study

Mahmut Kalem, Bedir Özgencil, E. Özbek, Ercan Şahin

Objective: This study aimed to evaluate orthopedic residency training in Türkiye by analyzing the structure of clinical education, levels of faculty engagement, availability of mentorship, and residents' self-perceived competence. It further examined the influence of mentorship and faculty involvement on surgical training, academic career interest, and subspecialty decisions. Methods: A cross-sectional survey was conducted among orthopedic residents across Türkiye between February 6-18, 2025. A total of 849 residents participated, covering all provinces with orthopedic training centers. Data on institutional characteristics, educational methods, surgical exposure, mentorship, and residents' self-assessed competencies were collected using an online questionnaire. The mean age of participants was 29.1 years (range: 23-35), and 95.2% were male. The mean residency year was 2.7. The primary outcomes included surgical exposure, self-assessed competence, academic interest, and mentorship imp…

DOI: 10.5152/j.aott.2025.25438

Open source ↗
Effects of Mentorship on Surgery Residents' Burnout and Well-Being: A Scoping Review. 2024 · systematic review

Emmanuel D. Gaeta, Megan Gilbert, Alexandra J. Johns, Gregory J. Jurkovich, M. Wieck

Background: In surgical training, a mentor is a more senior and experienced surgeon who guides a surgical trainee to meet personal, professional, and educational goals. Although mentorship is widely assumed to positively affect surgical residents' professional development, a more nuanced understanding of mentorship's impact is lacking and urgently needed as burnout rates among residents increase. This study aims to summarize the current literature on the effects of mentorship on surgical residents' burnout and well-being. Methods: A comprehensive literature review was performed with key terms related to "surgical resident" and "mentor" using Pubmed, Embase, and ProQuest databases for primary studies published in the United States or Canada from January 1, 2010 to December 9, 2022 that measured outcomes related to burnout and well-being. Multiple reviewers screened titles and abstracts for relevance, then full-text articles for eligibility. Results: Initial search resulted in 1,468 u…

DOI: 10.1016/j.jsurg.2024.08.001

Open source ↗
The Importance of Mentorship in Thoracic Surgery Residency 2025 · systematic review

Paola Ciriaco

Background: Effective mentorship is a critical component of thoracic surgery training, fostering the acquisition of advanced clinical skills, professional identity, and academic growth essential for the development of future specialists. This perspective article examines the role of mentorship in thoracic surgery training, with a particular focus on the value perceived by residents. Methods: The research was conducted on Pubmed, using the following targeted search queries: 'mentorship and thoracic residency' and 'thoracic surgery residents' satisfaction'. Only studies published in English between 2015 and 2025 were included. Studies lacking primary data on mentorship outcomes were excluded. Results: Out of 286 studies initially identified, 25 fulfilled the inclusion criteria. Five main thematic domains emerged: Impact and Effectiveness of Mentorship (12 studies), Training Pathways and Workforce (13), Diversity, Gender, and Equity (8), Resident Well-Being and Outcomes (4), and Assessme…

DOI: 10.3390/jcm14207391

Open source ↗
Integrating structured research training into undergraduate medical education in Pakistan: the need of the hour. 2026 · commentary or perspective

Ayesha Wasim

Medical field, with its ever-growing research, is constantly evolving, making evidence-based clinical practice essential. Rapid advancements in medicine have made it imperative to acquire skills like research methodology and critical appraisal of articles from an under-graduate level. In recent years, trends have shifted, with medical students in Pakistan, wanting to participate more in research, and aspiring to match their international peers, yet, they are facing significant challenges in doing so1.Currently, research exposure in Pakistan, is limited to basic methodology modules in the 4th or 5th year, which is insufficient to develop strong research skills. Alongside the lack of structured curriculum, students report hurdles, such as time constraints due to academic workload, poor mentorship, limited research knowledge, minimal institutional incentives, and inadequate funding1. Many students remain unaware of research’s importance due to its low weightage in the curriculum and it i…

DOI: 10.47391/jpma.32690

Open source ↗
Barriers to undergraduate medical students’ research engagement in Pakistan: a qualitative exploration 2025 · interview study

A. Mahmood, N. Rehman, Xiao Huang, I. Riaz

Background: Engaging in research is a critical component of medical education, fostering critical thinking and evidence-based practices. Despite its importance, undergraduate medical students in Pakistan face significant barriers to research engagement. This study explores the challenges hindering their participation in research activities. Methods: A qualitative research design was employed, utilizing semi-structured interviews with 45 undergraduate medical and dental students from a public medical university in Pakistan. Participants were purposefully selected to provide diverse perspectives. Data were analyzed thematically to identify recurring barriers and challenges. Results: Four key themes emerged: (1) Time constraints, as academic workloads and clinical rotations left limited time for research; (2) Lack of extrinsic motivation, knowledge, and research ability, including insufficient training and limited institutional incentives; (3) Inadequate financial assistance and poor m…

DOI: 10.1186/s12909-025-07185-9

Open source ↗
The Imperative of research in medical education: A call to action for Pakistan. 2025 · commentary or perspective

Ahmad Shabbir, A. A. Khan, A. Mehmood

Dear Madam, We are primarily concerned with promoting the inclusion of research in Pakistani medical education, extending from classrooms to clinical practice. In almost every part of human life, ranging from social practices to healthcare, technology, and economics, research is essential in illuminating pathways and confronting the complex challenges of the 21st century. The development of novel therapeutic approaches, diagnostic instruments, and preventative measures relies on medical research, as these are critical for tackling the wide range of global health concerns that confront societies.1  Health workers can enhance patient outcomes by staying on the newest developments in diagnosis, treatment, and preventative techniques through research. Health practitioners are better equipped to deliver individualised, evidence-based care for each patient when they perform research because it deepens their understanding of diseases, the underlying mechanisms behind them, and the selection …

DOI: 10.47391/jpma.21367

Open source ↗
A Nationwide Virtual Research Education Program for Medical Students in Pakistan: Methodological Framework, Feasibility Testing, and Outcomes 2022 · field study

A. A. Noorali, Maha Inam, Hamna Shahbaz, Hareem Rauf, F. Aamir, F. Khalid, Saadia Abbas, Abdullah Saeed, M. Musharraf, A. A. Merchant, B. Hasan, M. Rasheed, F. Jehan, M. Tariq, A. Haider

Introduction: Equipping young medical trainees with fundamental research skills can be a promising strategy to address the need for professionals who can understand and responsibly communicate evolving scientific evidence during a pandemic. Despite an ardent interest to partake in research, most educational institutions in Pakistan and other low-middle income countries have not yet adopted a comprehensive strategy for research skills education. The authors aimed to design and assess the feasibility of implementing the first nation-wide virtual research workshop for medical students in Pakistan. Methods: The course "Beginners Guide to Research," designed as a nation-wide virtual research workshop series, was conducted for medical students across Pakistan in June 2020. Four interactive live workshops took place online on alternate days from June 22nd, 2020, to June 27th, 2020, each lasting 1-2 h. Outcomes included: (i) reach, (ii) efficacy as indexed by pre-post change in score pertaini…

DOI: 10.3389/fpubh.2021.812130

Open source ↗
Setting Agenda for Medical Education Research in Pakistan 2021 · mixed methods study

Sarah Ali, A. Sethi

Objective: To justify the allocation of human and financial resources, this study aims to identify multiple stakeholders' views of medical education research priorities in Pakistan for the next five years. Methods: This two-stage exploratory mixed-method study was conducted from Jan 2018 to Jun 2019. A purposively selected sample of 250 faculty members, research supervisors, postgraduate students, undergraduate students and policymakers actively involved in improving Medical Education were included. In Stage-I: An exploratory open-ended questionnaire asking about Medical Education Research (MER) priorities in Pakistan for the next five years was emailed. Data were thematically analyzed to identify MER areas. In Stage-II: Another questionnaire was developed based on MER areas. The participants were asked to rate their importance on a scale of one to five. Descriptive statistics were calculated using SPSS.v.24. Results: In Stage-I, 140 participants and in Stage-II, 130 participants fr…

DOI: 10.12669/pjms.37.3.3603

Open source ↗

semantic_scholar

Semantic Scholar retrieval failed (rate_limit).

semantic_scholar unavailable

Semantic Scholar retrieval failed (rate_limit).

Judge/Synthesizer details

Final Research Answer

Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.

The proposed research addresses a critical gap in postgraduate surgical education in Pakistan by conducting a qualitative needs assessment of supervisors' perspectives to inform the design of a contextually appropriate research training and mentorship framework. Based on the evidence provided, three thesis-worthy research topics emerge: 1. **Topic**: Supervisor-informed curriculum design for surgical research training in resource-constrained settings. **Why it matters**: Current frameworks are imported from high-resource contexts and ignore surgical workload realities; a locally grounded model could improve feasibility and sustainability. **Existing literature**: Bakhshi et al. (2023) [C523] documents low research output among surgical trainees but excludes supervisor input. **Unresolved question**: What specific content, structure, and delivery mechanisms do surgical supervisors deem feasible and effective? **Population**: Surgical faculty at a Pakistani tertiary hospital. **Variables**: Perceived barriers, preferred mentorship models, acceptable time commitment. **Methodology**: Qualitative interviews with thematic analysis. **Feasibility**: High—aligns with institutional needs and uses accessible participants. **Supporting source**: [C523]. **Limitation**: Single-site design limits generalizability. 2. **Topic**: Structured mentorship models to overcome time constraints in surgical residency. **Why it matters**: Mentorship is inconsistently delivered and burdensome; structured alternatives (e.g., peer or near-peer models) may enhance support without overloading faculty. **Existing literature**: Thomas & Oldfield (2025) [C524] identifies time and lack of mentor training as key barriers globally. **Unresolved question**: How can mentorship be restructured to fit surgical workflows while maintaining effectiveness? **Population**: Same as above. **Variables**: Current mentorship practices, perceived burden, receptiveness to alternative models. **Methodology**: Qualitative needs assessment. **Feasibility**: Moderate—depends on institutional willingness to innovate. **Supporting source**: [C524]. **Limitation**: Mentors’ own research competence is unmeasured. 3. **Topic**: Differentiating surgical from non-surgical research training needs. **Why it matters**: Surgical training’s unique demands (long hours, apprenticeship model) may require distinct curricular adaptations not addressed in mixed-specialty studies. **Existing literature**: Bakhshi et al. (2023) [C523] pools medical and surgical residents, obscuring specialty-specific needs. **Unresolved question**: What aspects of research training must be tailored specifically for surgical trainees? **Population**: Surgical supervisors vs. implicit comparison with prior non-surgical data. **Variables**: Specialty-specific barriers, timing preferences, skill priorities. **Methodology**: Qualitative focus on surgical context. **Feasibility**: High within scope. **Supporting source**: [C523]. **Limitation**: No concurrent non-surgical supervisor data for direct comparison.

This study proposes a qualitative needs assessment of surgical supervisors at a Pakistani tertiary care hospital to design a feasible research training and mentorship framework for postgraduate surgical trainees. Existing literature—primarily from trainee surveys—confirms low research output and knowledge despite mandatory requirements, citing clinical workload, lack of funding, and poor data access as key barriers [C523]. However, no Pakistani study has captured supervisors’ perspectives, focused exclusively on surgical trainees, or translated findings into a structured curriculum. Global reviews affirm mentorship’s importance but highlight inconsistent implementation due to time constraints and inadequate faculty preparation [C524]. By centering supervisors’ practical insights within surgery’s unique training constraints, this research aims to close four identified gaps simultaneously: absence of supervisor voice, lack of surgery-specific focus, failure to design actionable frameworks, and limited qualitative depth at the postgraduate surgical level.

Confidence: 85/100

The synthesizer's estimate, not a statistical probability. Evidence strength is shown for each finding.

Key Findings

Moderate evidence

Postgraduate surgical trainees in Pakistan exhibit low research output and knowledge despite mandatory requirements and positive attitudes.

Bakhshi et al. (2023) surveyed 333 trainees across Pakistan, finding 57% scored below one-third in research knowledge and only 11–18% published, despite 61% receiving some training [C523]. This cross-sectional survey provides quantitative confirmation of the problem but lacks qualitative depth on causes.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: moderate. Judge-declared strength: moderate.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. · Postgraduate medical journal · 2023 · DOI: 10.1093/postmj/qgad062 Open source

Strong evidence

No existing Pakistani study has gathered supervisors’ perspectives on surgical trainees’ research needs.

Multiple recent studies—Bakhshi et al. (2023), Shah (2024 cited in rationale), Mahmood et al. (2025), Ahmed et al. (2023)—explicitly limit their scope to trainees or students [C523]. Rationale correctly identifies this as an unaddressed gap.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: limited. Judge-declared strength: strong.

Strong-evidence mismatch: the cited academic evidence does not meet the configured diagnostic threshold.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. · Postgraduate medical journal · 2023 · DOI: 10.1093/postmj/qgad062 Open source

Moderate evidence

Mentorship is critical for surgical trainees’ research success but faces systemic barriers like time constraints and insufficient faculty training.

A 2025 systematic review confirms mentorship boosts publication rates, skills, and well-being in surgical residents globally but flags limited time and untrained mentors as persistent obstacles [C524]. This supports the local problem but doesn’t address Pakistan specifically.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: moderate. Judge-declared strength: moderate.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C524] Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education · Cureus · 2025 · DOI: 10.7759/cureus.99455 Open source

Limited evidence

Surgical trainees face unique research barriers compared to other specialties due to caseload and duty hour demands.

The rationale plausibly argues this based on surgical education structure, but retrieved academic evidence doesn’t directly compare surgical vs. non-surgical barriers in Pakistan. Bakhshi et al. included surgical residents but didn’t analyze them separately [C523].

Support review: weak_support

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: limited. Judge-declared strength: limited.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. · Postgraduate medical journal · 2023 · DOI: 10.1093/postmj/qgad062 Open source

Strong evidence

Structured, locally adapted research curricula informed by faculty input are absent in Pakistani surgical training.

All cited Pakistani studies stop at barrier identification without proposing or testing curricular solutions [C523]. Global examples like Clanahan et al. (2022) [C526] show needs assessments can inform leadership curricula, supporting feasibility—but none exist for research training in this context.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: strong. Judge-declared strength: strong.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. · Postgraduate medical journal · 2023 · DOI: 10.1093/postmj/qgad062 Open source

[C526] Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment · Global Surgical Education - Journal of the Association for Surgical Education · 2022 · DOI: 10.1007/s44186-022-00042-z Open source

Sources

  1. [C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents.

    Postgraduate medical journal · 2023

    DOI: 10.1093/postmj/qgad062

    Open source ↗
  2. [C524] Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education

    Cureus · 2025

    DOI: 10.7759/cureus.99455

    Open source ↗
  3. [C525] The Importance of Mentorship in Thoracic Surgery Residency

    Journal of Clinical Medicine · 2025

    DOI: 10.3390/jcm14207391

    Open source ↗
  4. [C526] Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment

    Global Surgical Education - Journal of the Association for Surgical Education · 2022

    DOI: 10.1007/s44186-022-00042-z

    Open source ↗
  5. [C527] Utilizing the DiSC Assessment in Surgical Residency Leadership Training to Address Communication Skill Acquisition: A Kern Six-step Approach to Curriculum Development.

    Journal of surgical education · 2025

    DOI: 10.1016/j.jsurg.2024.103413

    Open source ↗
  6. [C528] 270 Breaking Down Barriers: Understanding Challenges to Surgical Research Access for Medical Students in Lower Middle Income Countries (LMICs) and Shaping the Future of Postgraduate Academic Surgery Training Pathways in LMICs

    British Journal of Surgery · 2025

    DOI: 10.1093/bjs/znaf128.590

    Open source ↗
  7. [C529] Barriers and Facilitators to Surgical Trainee Psychological Safety

    JAMA Network Open · 2025

    DOI: 10.1001/jamanetworkopen.2025.34462

    Open source ↗
  8. [C530] EXPLORING THE RESEARCH JOURNEY: BARRIERS AND FACILITATORS FOR POSTGRADUATE MAXILLOFACIAL TRAINEES

    Khyber Journal of Medical Sciences · 2025

    DOI: 10.70520/kjms.v17i4.622

    Open source ↗

Agreements / Disagreements

Agreement between AI models is not independent verification.

No disagreements were reported by the synthesizer.

Limitations

  • Evidence on surgical trainees’ research barriers in Pakistan is limited to one major cross-sectional survey [C523]; no qualitative studies focusing exclusively on this group were found.
  • Supervisors’ own research competencies and capacity to mentor are unexamined in the cited literature, creating uncertainty about their ability to inform curriculum design.
  • The proposed single-hospital design limits generalizability across Pakistan’s diverse surgical training environments.
  • Global mentorship reviews [C524, C525] may not reflect realities in low-resource settings like Pakistan, where funding and data infrastructure differ significantly.
  • Twelve potentially relevant papers were omitted from retrieval, so gaps may be narrower than claimed.

Recommended interpretation

The proposed study fills a genuine and multi-faceted gap in the literature by targeting supervisors’ perspectives on research training for surgical residents in Pakistan—a combination absent in current evidence. The problem is well-documented quantitatively among trainees [C523], and global literature affirms mentorship’s importance [C524]. However, the uniqueness of the surgical training environment in Pakistan remains inferred rather than empirically contrasted with other specialties. A supervisor-focused needs assessment is therefore justified and likely to yield actionable insights for local curriculum design, though findings should be validated in broader contexts later.

Evidence preparation details

Priority scores organize the context; they do not decide the answer.

C523 · Priority

C524 · Priority

C525 · Priority

C526 · Priority

C527 · Priority

C528 · Priority

C529 · Priority

C530 · Priority

Omitted papers: 12. Omitted agents: .

Retry controls

Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.

Stage: PARTIAL

Partial research available. Review failures below; retry controls are available.

Latest Planner 2 — Llama 4 Scout attempt failed: OpenRouter rate-limited this request. Please try again later. Any earlier successful result remains active.

Latest Planner 3 — Qwen3.5-27B attempt failed: The model did not return a valid structured research response. Any earlier successful result remains active.

Latest semantic_scholar attempt failed: Semantic Scholar retrieval failed (rate_limit). Any earlier successful result remains active.

Retries make new API requests and may incur charges. Provider retries preserve the accepted answer; re-run synthesis afterward to incorporate changed evidence.

Provider attempt history (5)

Active means the latest successful attempt. A newer failure does not replace it.

#149 · semantic_scholar · academic-graph-search · Oct. 2, 2026, 4:01 p.m. · Latest · Failed

Semantic Scholar retrieval failed (rate_limit).

This attempt is displayed in the semantic_scholar results above.

#148 · consensus · search-v1 · Oct. 2, 2026, 4:01 p.m. · Latest · Active · Succeeded

This attempt is displayed in the consensus results above.

#147 · Planner 3 — Qwen3.5-27B · qwen/qwen3.5-27b · Oct. 2, 2026, 4 p.m. · Latest · Failed

The model did not return a valid structured research response.

This attempt is displayed in the Planner 3 — Qwen3.5-27B results above.

#146 · Planner 2 — Llama 4 Scout · meta-llama/llama-4-scout · Oct. 2, 2026, 4 p.m. · Latest · Failed

OpenRouter rate-limited this request. Please try again later.

This attempt is displayed in the Planner 2 — Llama 4 Scout results above.

#145 · Planner 1 — Gemini 3.5 Flash · google/gemini-3.5-flash · Oct. 2, 2026, 4 p.m. · Latest · Active · Succeeded

This attempt is displayed in the Planner 1 — Gemini 3.5 Flash results above.

Synthesis history (1)
#29 · qwen/qwen3-max · Oct. 2, 2026, 4:01 p.m. · Succeeded · Latest · Active / latest accepted

Model: qwen/qwen3-max · Latency: 29343 ms · Estimated cost: 0.0156889200 USD

Input tokens: 11239 · Output tokens: 1775

The proposed research addresses a critical gap in postgraduate surgical education in Pakistan by conducting a qualitative needs assessment of supervisors' perspectives to inform the design of a contextually appropriate research training and mentorship framework. Based on the evidence provided, three thesis-worthy research topics emerge: 1. **Topic**: Supervisor-informed curriculum design for surgical research training in resource-constrained settings. **Why it matters**: Current frameworks are imported from high-resource contexts and ignore surgical workload realities; a locally grounded model could improve feasibility and sustainability. **Existing literature**: Bakhshi et al. (2023) [C523] documents low research output among surgical trainees but excludes supervisor input. **Unresolved question**: What specific content, structure, and delivery mechanisms do surgical supervisors deem feasible and effective? **Population**: Surgical faculty at a Pakistani tertiary hospital. **Variables**: Perceived barriers, preferred mentorship models, acceptable time commitment. **Methodology**: Qualitative interviews with thematic analysis. **Feasibility**: High—aligns with institutional needs and uses accessible participants. **Supporting source**: [C523]. **Limitation**: Single-site design limits generalizability. 2. **Topic**: Structured mentorship models to overcome time constraints in surgical residency. **Why it matters**: Mentorship is inconsistently delivered and burdensome; structured alternatives (e.g., peer or near-peer models) may enhance support without overloading faculty. **Existing literature**: Thomas & Oldfield (2025) [C524] identifies time and lack of mentor training as key barriers globally. **Unresolved question**: How can mentorship be restructured to fit surgical workflows while maintaining effectiveness? **Population**: Same as above. **Variables**: Current mentorship practices, perceived burden, receptiveness to alternative models. **Methodology**: Qualitative needs assessment. **Feasibility**: Moderate—depends on institutional willingness to innovate. **Supporting source**: [C524]. **Limitation**: Mentors’ own research competence is unmeasured. 3. **Topic**: Differentiating surgical from non-surgical research training needs. **Why it matters**: Surgical training’s unique demands (long hours, apprenticeship model) may require distinct curricular adaptations not addressed in mixed-specialty studies. **Existing literature**: Bakhshi et al. (2023) [C523] pools medical and surgical residents, obscuring specialty-specific needs. **Unresolved question**: What aspects of research training must be tailored specifically for surgical trainees? **Population**: Surgical supervisors vs. implicit comparison with prior non-surgical data. **Variables**: Specialty-specific barriers, timing preferences, skill priorities. **Methodology**: Qualitative focus on surgical context. **Feasibility**: High within scope. **Supporting source**: [C523]. **Limitation**: No concurrent non-surgical supervisor data for direct comparison.

Rejected source IDs: None recorded

Confidence: 85.0

This study proposes a qualitative needs assessment of surgical supervisors at a Pakistani tertiary care hospital to design a feasible research training and mentorship framework for postgraduate surgical trainees. Existing literature—primarily from trainee surveys—confirms low research output and knowledge despite mandatory requirements, citing clinical workload, lack of funding, and poor data access as key barriers [C523]. However, no Pakistani study has captured supervisors’ perspectives, focused exclusively on surgical trainees, or translated findings into a structured curriculum. Global reviews affirm mentorship’s importance but highlight inconsistent implementation due to time constraints and inadequate faculty preparation [C524]. By centering supervisors’ practical insights within surgery’s unique training constraints, this research aims to close four identified gaps simultaneously: absence of supervisor voice, lack of surgery-specific focus, failure to design actionable frameworks, and limited qualitative depth at the postgraduate surgical level.

Postgraduate surgical trainees in Pakistan exhibit low research output and knowledge despite mandatory requirements and positive attitudes. · moderate

Bakhshi et al. (2023) surveyed 333 trainees across Pakistan, finding 57% scored below one-third in research knowledge and only 11–18% published, despite 61% receiving some training [C523]. This cross-sectional survey provides quantitative confirmation of the problem but lacks qualitative depth on causes.

Supporting sources selected by synthesizer: C523

No existing Pakistani study has gathered supervisors’ perspectives on surgical trainees’ research needs. · strong

Multiple recent studies—Bakhshi et al. (2023), Shah (2024 cited in rationale), Mahmood et al. (2025), Ahmed et al. (2023)—explicitly limit their scope to trainees or students [C523]. Rationale correctly identifies this as an unaddressed gap.

Supporting sources selected by synthesizer: C523

Mentorship is critical for surgical trainees’ research success but faces systemic barriers like time constraints and insufficient faculty training. · moderate

A 2025 systematic review confirms mentorship boosts publication rates, skills, and well-being in surgical residents globally but flags limited time and untrained mentors as persistent obstacles [C524]. This supports the local problem but doesn’t address Pakistan specifically.

Supporting sources selected by synthesizer: C524

Surgical trainees face unique research barriers compared to other specialties due to caseload and duty hour demands. · limited

The rationale plausibly argues this based on surgical education structure, but retrieved academic evidence doesn’t directly compare surgical vs. non-surgical barriers in Pakistan. Bakhshi et al. included surgical residents but didn’t analyze them separately [C523].

Supporting sources selected by synthesizer: C523

Structured, locally adapted research curricula informed by faculty input are absent in Pakistani surgical training. · strong

All cited Pakistani studies stop at barrier identification without proposing or testing curricular solutions [C523]. Global examples like Clanahan et al. (2022) [C526] show needs assessments can inform leadership curricula, supporting feasibility—but none exist for research training in this context.

Supporting sources selected by synthesizer: C523, C526

[C523] Barriers to research productivity amongst postgraduate trainees: results from a survey of 333 medical and surgical residents. · Postgraduate medical journal Open source

[C524] Unpacking Mentorship: A Review of Its Role in Contemporary Postgraduate Surgical Education · Cureus Open source

[C525] The Importance of Mentorship in Thoracic Surgery Residency · Journal of Clinical Medicine Open source

[C526] Leading from within: shaping a resident-driven leadership curriculum for surgical trainees using a qualitative needs assessment · Global Surgical Education - Journal of the Association for Surgical Education Open source

[C527] Utilizing the DiSC Assessment in Surgical Residency Leadership Training to Address Communication Skill Acquisition: A Kern Six-step Approach to Curriculum Development. · Journal of surgical education Open source

[C528] 270 Breaking Down Barriers: Understanding Challenges to Surgical Research Access for Medical Students in Lower Middle Income Countries (LMICs) and Shaping the Future of Postgraduate Academic Surgery Training Pathways in LMICs · British Journal of Surgery Open source

[C529] Barriers and Facilitators to Surgical Trainee Psychological Safety · JAMA Network Open Open source

[C530] EXPLORING THE RESEARCH JOURNEY: BARRIERS AND FACILITATORS FOR POSTGRADUATE MAXILLOFACIAL TRAINEES · Khyber Journal of Medical Sciences Open source

Agreements:

Disagreements:

Limitations: Evidence on surgical trainees’ research barriers in Pakistan is limited to one major cross-sectional survey [C523]; no qualitative studies focusing exclusively on this group were found.; Supervisors’ own research competencies and capacity to mentor are unexamined in the cited literature, creating uncertainty about their ability to inform curriculum design.; The proposed single-hospital design limits generalizability across Pakistan’s diverse surgical training environments.; Global mentorship reviews [C524, C525] may not reflect realities in low-resource settings like Pakistan, where funding and data infrastructure differ significantly.; Twelve potentially relevant papers were omitted from retrieval, so gaps may be narrower than claimed.

The proposed study fills a genuine and multi-faceted gap in the literature by targeting supervisors’ perspectives on research training for surgical residents in Pakistan—a combination absent in current evidence. The problem is well-documented quantitatively among trainees [C523], and global literature affirms mentorship’s importance [C524]. However, the uniqueness of the surgical training environment in Pakistan remains inferred rather than empirically contrasted with other specialties. A supervisor-focused needs assessment is therefore justified and likely to yield actionable insights for local curriculum design, though findings should be validated in broader contexts later.

Developer evaluation (manual)

Ratings do not affect synthesis. Rate the active answer and evidence you reviewed.

Developer diagnostics

Balanced primary: qwen/qwen3-max. Fallback: openai/o4-mini.

Fallback triggered: No. Reason: None. Accepted synthesizer: qwen/qwen3-max.

Synthesis routing latency: 29343 ms. Total routing cost (USD): 0.0156889200.

Plan-and-Solve diagnostics

Generated queries: 4; retrieval queries: 4; duplicates removed: 0; unique papers: 20.

semantic_scholar: 1 requests; 0 results; 1 failed requests.

consensus: 4 requests; 20 results; 0 failed requests.

Normalized ResearchPlan
original_question
Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.
canonical_search_queries
['surgical residency research training curriculum needs assessment', 'postgraduate surgical trainees research barriers qualitative', 'surgical faculty perspectives research mentorship residency', 'medical education research training framework Pakistan']
keywords
['surgical trainees', 'research training', 'needs assessment', 'supervisors perspectives', 'mentorship framework', 'postgraduate medical education', 'surgical residency', 'curriculum design']
synonyms
['surgical residents', 'scholarly activity', 'faculty viewpoints', 'educational needs', 'mentorship program', 'residency curriculum', 'training barriers', 'fellowship requirements']
research_subquestions
["What are surgical supervisors' perceptions of the key barriers preventing postgraduate surgical trainees from completing high-quality research?", 'What core content and structural design do surgical supervisors recommend for a postgraduate research training framework?', 'How can mentorship be structured within a surgical residency to minimize administrative burden on supervisors while maximizing trainee support?', 'What are the perceived differences in research training needs between surgical specialties and general medical residencies?']
candidate_gap_hypotheses
['Supervisors may overestimate the baseline research knowledge of trainees compared to trainee self-assessments.', 'An active co-design process involving surgical supervisors might yield higher curriculum adherence than standard medical education templates.', 'Structured peer-mentorship models among surgical residents could mitigate supervisor time constraints.']
uncertainties
['The exact level of protected time that hospital administration is willing to allocate for resident research.', 'Whether supervisors have sufficient training themselves to provide high-quality methodology and statistical mentorship.', 'The feasibility of implementing a standardized research curriculum across diverse surgical subspecialties.']
filters
{'suggestions': [{'year_from': 2010, 'year_to': 2025, 'fields': ['Medicine', 'Education', 'Surgery'], 'study_types': ['Qualitative', 'Needs Assessment', 'Mixed Methods', 'Survey']}], 'policy': 'Advisory only; configured provider filters apply.'}
generated_query_count
4
successful_planners
1

Retrieval is incomplete; absence of results is not proof of absence.

Provider counts describe latest attempts; evidence and answer metrics describe active results. Duration and costs include all attempts, including retries. Cost is USD, OpenRouter only; Consensus billing is not estimated. Unknown is not zero.

total_duration_ms
115200
interrupted_execution_metrics_incomplete
False
successful_providers
2
failed_providers
3
successful_agents
1
consensus_success
True
synthesis_success
True
paper_count
20
total_estimated_openrouter_cost
Unknown / not applicable
known_cost_subtotal
0.0445519950
attempts_missing_cost
1
valid_source_percent
100.0
removed_source_ids
0
agreements_count
0
disagreements_count
0
evidence_strength_distribution
{'moderate': 2, 'strong': 2, 'limited': 1}
judge_confidence
85.0
answer_length
3073
Attempt / modelSuccessLatency msInput / output / total tokensCost USDError
#149 academic-graph-searchNo1037? / ? / ?Unknown rate_limit: Semantic Scholar retrieval failed (rate_limit).
#148 search-v1Yes24439? / ? / ?Unknown :
#147 qwen/qwen3.5-27bNo377152513 / 2184 / 46970.0038970750 reportedmalformed_response: The model did not return a valid structured research response.
#146 meta-llama/llama-4-scoutNo670? / ? / ?Unknown rate_limit: OpenRouter rate-limited this request. Please try again later.
#145 google/gemini-3.5-flashYes217963294 / 2225 / 55190.0249660000 reported:
#29 qwen/qwen3-maxYes2934311239 / 1775 / 130140.0156889200 reported:

Judge: qwen/qwen3-max. Papers used: 8. Papers omitted by limit: 12.

Rejected source IDs: None recorded

RESEARCH QUESTION

State a research question from the document

Oct 2, 2026 · 16:07 PARTIAL

30-SECOND VIEW

Final Research Answer

How can research questions be effectively extracted, detected, or generated from scientific articles that often lack clearly defined research questions?
Executive summary

The retrieved literature indicates a recognized gap in the consistent formulation and explicit declaration of research questions (RQs) in scientific articles. Multiple studies highlight challenges in identifying study objectives within manuscripts and propose methodological solutions. One paper directly addresses this by proposing a framework for extracting, detecting, and generating RQs from scientific texts, noting many studies lack proper RQ definition [C550]. Other works discuss frameworks like PICO for formulating strong RQs [C546], emphasize their role in directing study design [C548], and explore automated methods to identify hypotheses and new knowledge in literature [C547]. This supports a research focus on improving RQ identification and generation to enhance scholarly communication and literature synthesis.

Export Research · coming later

Partial research available

Planner 2 — Llama 4 Scout: OpenRouter rate-limited this request. Please try again later. Retry

semantic_scholar: Semantic Scholar retrieval failed (rate_limit). Retry

Overall confidence85%Synthesizer confidence estimate
Evidence strengthLimitedLowest reported finding strength; conflicts take precedence
Academic papers25 papers
AI agents2/3 successfulActive saved responses
ConsensusAvailable
Semantic ScholarUnavailable

2-MINUTE VIEW

Key Findings

Moderate 1 sources

Many academic articles lack clearly defined research questions.

Support diagnostic: academically supported

View sources

Many academic articles lack clearly defined research questions.

Paper C550 explicitly states that 'many academic studies lack a proper definition of RQs in their articles,' forming the basis for their proposed extraction and generation framework.

[C550] Extracting, Detecting, and Generating Research Questions for Scientific Articles Open source

Moderate 2 sources

Frameworks exist for formulating effective research questions, but their application is not universal.

Support diagnostic: academically supported

View sources

Frameworks exist for formulating effective research questions, but their application is not universal.

C546 reviews the PICO framework and its adaptations across study designs, while C548 discusses best practices for writing RQs, implying variability in current practice.

[C546] Formulating Research Questions for Evidence-Based Studies Open source

[C548] A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles Open source

Limited 1 sources

Automated methods are being developed to identify research components like hypotheses and new knowledge in scientific text.

Support diagnostic: weak support

View sources

Automated methods are being developed to identify research components like hypotheses and new knowledge in scientific text.

C547 demonstrates a supervised text-mining approach to extract 'Research Hypothesis' and 'New Knowledge' with high accuracy in biomedical corpora, suggesting feasibility for similar RQ detection tasks.

[C547] Identification of research hypotheses and new knowledge from scientific literature Open source

Moderate 2 sources

AI tools are increasingly involved in scholarly writing and peer review, raising transparency concerns.

Support diagnostic: academically supported

View sources

AI tools are increasingly involved in scholarly writing and peer review, raising transparency concerns.

C545 emphasizes the need for declaring generative AI use in academic writing, and C549 evaluates LLMs as peer reviewers, highlighting impacts on manuscript evaluation integrity.

[C545] The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing. Open source

[C549] Large language models for peer review in biotechnology. Open source

Limited 1 sources

Automation of systematic literature reviews remains partial, with gaps in planning and reporting phases.

Support diagnostic: weak support

View sources

Automation of systematic literature reviews remains partial, with gaps in planning and reporting phases.

C543 notes that while study selection is commonly automated, no studies were found automating the planning and reporting stages of SLRs, where RQ formulation occurs.

[C543] Automation of systematic literature reviews: A systematic literature review Open source

Evidence Overview

8 valid sources · 0 conflicting findings · 0 disagreements · 25 papers reviewed

The metrics above describe saved evidence. Source associations and agreement between models are not independent verification.

Best Academic Evidence

Saved synthesis ranking where available; otherwise Consensus order. Retrieved papers are not automatically proof of a claim.

Consensus

Automation of systematic literature reviews: A systematic literature review

B. Tekinerdoğan, Ç. Çatal · 2021 · Inf. Softw. Technol.

A B S T R A C T Context: Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further and broader insight into the investigated domain. Multiple SLR studies have been conducted in several domains, such…

Read paper details

B. Tekinerdoğan, Ç. Çatal

A B S T R A C T Context: Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further and broader insight into the investigated domain. Multiple SLR studies have been conducted in several domains, such as software engineering, medicine, and pharmacy. Conducting an SLR is a time-consuming, laborious, and costly effort. As such, several researchers developed different techniques to automate the SLR process. However, a systematic overview of the current state-of-the-art in SLR automation seems to be lacking. Objective: This study aims to collect and synthesize the studies that focus on the automation of SLR to pave the way for further research. Method: A systematic literature review is conducted on published primary studies on the automation of SLR studies, in which 41 primary studies have been analyzed. Results: This SLR identifies the objectives of automation studies, application domains, automated steps of the SLR, automation techniques, and challenges and solution directions. Conclusion: According to our study, the leading automated step is the Selection of Primary Studies . Although many studies have provided automation approaches for systematic literature reviews, no study has been found to apply automation techniques in the planning and reporting phase. Further research is needed to support the automation of the other activities of the SLR process.

DOI: 10.1016/j.infsof.2021.106589

Open source ↗
Consensus

Literature review as a research methodology: An overview and guidelines

H. Snyder · 2019 · Journal of Business Research

Abstract Knowledge production within the field of business research is accelerating at a tremendous speed while at the same time remaining fragmented and interdisciplinary. This makes it hard to keep up with state-of-the-art and to be at the forefront of research, as well as to assess the collectiv…

Read paper details

H. Snyder

Abstract Knowledge production within the field of business research is accelerating at a tremendous speed while at the same time remaining fragmented and interdisciplinary. This makes it hard to keep up with state-of-the-art and to be at the forefront of research, as well as to assess the collective evidence in a particular area of business research. This is why the literature review as a research method is more relevant than ever. Traditional literature reviews often lack thoroughness and rigor and are conducted ad hoc, rather than following a specific methodology. Therefore, questions can be raised about the quality and trustworthiness of these types of reviews. This paper discusses literature review as a methodology for conducting research and offers an overview of different types of reviews, as well as some guidelines to how to both conduct and evaluate a literature review paper. It also discusses common pitfalls and how to get literature reviews published.

DOI: 10.1016/j.jbusres.2019.07.039

Open source ↗
Consensus

The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing.

A. Tang, Kin-Kit Li, K. Kwok, Liujiao Cao, Stanley Luong, W. Tam · 2023 · Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing

The integration of generative artificial intelligence (AI) into academic research writing has revolutionized the field, offering powerful tools like ChatGPT and Bard to aid researchers in content generation and idea enhancement. We explore the current state of transparency regarding generative AI u…

Read paper details

A. Tang, Kin-Kit Li, K. Kwok, Liujiao Cao, Stanley Luong, W. Tam

The integration of generative artificial intelligence (AI) into academic research writing has revolutionized the field, offering powerful tools like ChatGPT and Bard to aid researchers in content generation and idea enhancement. We explore the current state of transparency regarding generative AI use in nursing academic research journals, emphasizing the need for explicitly declaring the use of generative AI by authors in the manuscript. Out of 125 nursing studies journals, 37.6% required explicit statements about generative AI use in their authors' guidelines. No significant differences in impact factors or journal categories were found between journals with and without such requirement. A similar evaluation of medicine, general and internal journals showed a lower percentage (14.5%) including the information about generative AI usage. Declaring generative AI tool usage is crucial for maintaining the transparency and credibility in academic writing. Additionally, extending the requirement for AI usage declarations to journal reviewers can enhance the quality of peer review and combat predatory journals in the academic publishing landscape. Our study highlights the need for active participation from nursing researchers in discussions surrounding standardization of generative AI declaration in academic research writing. © 2023 The Authors. Journal of Nursing Scholarship published by Wiley Periodicals LLC on behalf of Sigma Theta Tau International.

DOI: 10.1111/jnu.12938

Open source ↗
View all papers (25)Consensus

Formulating Research Questions for Evidence-Based Studies

Mohammad-Salar Hosseini, F. Jahanshahlou, M. Akbarzadeh, Mahdi Zarei, Y. Vaez-Gharamaleki · 2023 · Journal of Medicine, Surgery, and Public Health

Formulating a research question is a crucial step in directing any scientific study. The classical evidence-based approach to formulating a question uses the PICO framework, consisting of population, intervention, comparison, and outcome. However, the PICO framework is not suitable for formulating …

Read paper details

Mohammad-Salar Hosseini, F. Jahanshahlou, M. Akbarzadeh, Mahdi Zarei, Y. Vaez-Gharamaleki

Formulating a research question is a crucial step in directing any scientific study. The classical evidence-based approach to formulating a question uses the PICO framework, consisting of population, intervention, comparison, and outcome. However, the PICO framework is not suitable for formulating research questions in some types of evidence and studies. This paper reviews and summarizes different frameworks introduced for formulating research questions over time. For this purpose, we explore the complete application of the PICO framework, clarifying its flexibility and subtleties for various research designs. Also, this review navigates the complexities of creating research questions, clarifying the minor variations needed within the PICO framework for various study designs through a thorough analysis and synthesis of the existing literature. Clarifying these customized strategies is intended to assist researchers, physicians, and scholars in appropriately formulating questions, improving the strength and relevance of research findings throughout the scientific investigation spectrum.Top of Form

DOI: 10.1016/j.glmedi.2023.100046

Open source ↗
Consensus

Identification of research hypotheses and new knowledge from scientific literature

M. Shardlow, R. Batista-Navarro, Paul Thompson, Raheel Nawaz, J. McNaught, S. Ananiadou · 2018 · BMC Medical Informatics and Decision Making

Background: Text mining (TM) methods have been used extensively to extract relations and events from the literature. In addition, TM techniques have been used to extract various types or dimensions of interpretative information, known as Meta-Knowledge (MK), from the context of relations and events…

Read paper details

M. Shardlow, R. Batista-Navarro, Paul Thompson, Raheel Nawaz, J. McNaught, S. Ananiadou

Background: Text mining (TM) methods have been used extensively to extract relations and events from the literature. In addition, TM techniques have been used to extract various types or dimensions of interpretative information, known as Meta-Knowledge (MK), from the context of relations and events, e.g. negation, speculation, certainty and knowledge type. However, most existing methods have focussed on the extraction of individual dimensions of MK, without investigating how they can be combined to obtain even richer contextual information. In this paper, we describe a novel, supervised method to extract new MK dimensions that encode Research Hypotheses (an author's intended knowledge gain) and New Knowledge (an author's findings). The method incorporates various features, including a combination of simple MK dimensions. Methods: We identify previously explored dimensions and then use a random forest to combine these with linguistic features into a classification model. To facilitate evaluation of the model, we have enriched two existing corpora annotated with relations and events, i.e., a subset of the GENIA-MK corpus and the EU-ADR corpus, by adding attributes to encode whether each relation or event corresponds to Research Hypothesis or New Knowledge. In the GENIA-MK corpus, these new attributes complement simpler MK dimensions that had previously been annotated. Results: We show that our approach is able to assign different types of MK dimensions to relations and events with a high degree of accuracy. Firstly, our method is able to improve upon the previously reported state of the art performance for an existing dimension, i.e., Knowledge Type. Secondly, we also demonstrate high F1-score in predicting the new dimensions of Research Hypothesis (GENIA: 0.914, EU-ADR 0.802) and New Knowledge (GENIA: 0.829, EU-ADR 0.836). Conclusion: We have presented a novel approach for predicting New Knowledge and Research Hypothesis, which combines simple MK dimensions to achieve high F1-scores. The extraction of such information is valuable for a number of practical TM applications.

DOI: 10.1186/s12911-018-0639-1

Open source ↗
Consensus

A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

E. Barroga, Glafera Janet Matanguihan · 2022 · Journal of Korean Medical Science

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on…

Read paper details

E. Barroga, Glafera Janet Matanguihan

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarify the main purpose and specific objectives of the study, which in turn dictate the design of the study, its direction, and outcome. Studies developed from good research questions and hypotheses will have trustworthy outcomes with wide-ranging social and health implications. © 2022 The Korean Academy of Medical Sciences.

DOI: 10.3346/jkms.2022.37.e121

Open source ↗
Consensus

Large language models for peer review in biotechnology.

Wenyu Li, Runyu Zhao, Pei Sun, Jeffrey Lee, Olivia Lu, Sophia Yuan, Pavan Sureshkumar, Yi-Xin Chen,… · 2026 · New biotechnology

As researchers use Large Language Models (LLMs) for rapid manuscript feedback, a key question is whether they can function as reliable peer reviewers in biotechnology. This study tested AI peer review using 763 preprints (398 with open peer reviews) and 12 grant proposals provided by the authors, i…

Read paper details

Wenyu Li, Runyu Zhao, Pei Sun, Jeffrey Lee, Olivia Lu, Sophia Yuan, Pavan Sureshkumar, Yi-Xin Chen, Zhengyang Xiao, Yinjie J. Tang

As researchers use Large Language Models (LLMs) for rapid manuscript feedback, a key question is whether they can function as reliable peer reviewers in biotechnology. This study tested AI peer review using 763 preprints (398 with open peer reviews) and 12 grant proposals provided by the authors, including three resubmissions. We found that AI reviewers (GPT-5, Qwen-Plus, and Gemini 2.5 Pro) all provided substantive and well-structured comments, with a strong emphasis on experimental design and statistical analysis; however, they tended to be more lenient overall than human reviewers. AI reviewers are less likely than humans to critique paper positioning or ask for more citations. LLMs often rate grant proposals more favorably than humans (i.e. clustering at 3.2-3.8 vs human average 2.5 in scale of 1-4) and have less variation in word choices. AI detectors failed to reliably identify AI-generated text in review comments, as simple rewording bypassed them and detectors usually lagged behind fast-evolving LLMs. Our results suggest that: (1) AI can serve as a valuable and less biased ad hoc reviewer; (2) the use of public LLMs in peer review introduces privacy and copyright concerns; (3) it is important to develop a review agent capable of identifying AI-generated content and verifying that all scientific claims are rigorously evidence-based; and (4) clearer guidelines and sustained human oversight are essential, along with greater transparency through open peer review. Nevertheless, as artificial general intelligence continues to advance, future AI systems may match, or even surpass, human researchers in evaluating scientific manuscripts. Copyright © 2026 The Authors. Published by Elsevier B.V. All rights reserved.

DOI: 10.1016/j.nbt.2026.03.007

Open source ↗
Consensus

Extracting, Detecting, and Generating Research Questions for Scientific Articles

Sina Taslimi, Artemis Çapari, H. Azarbonyad, Zi-Long Zhu, Zubair Afzal, Evangelos Kanoulas, G. Tsat… · 2025 ·

The volume of academic articles is increasing rapidly, reflecting the growing emphasis on research and scholarship across different science disciplines. This rapid growth necessitates the development of tools for more efficient and rapid understanding of these articles. Clear and well-defined Resea…

Read paper details

Sina Taslimi, Artemis Çapari, H. Azarbonyad, Zi-Long Zhu, Zubair Afzal, Evangelos Kanoulas, G. Tsatsaronis

The volume of academic articles is increasing rapidly, reflecting the growing emphasis on research and scholarship across different science disciplines. This rapid growth necessitates the development of tools for more efficient and rapid understanding of these articles. Clear and well-defined Research Questions (RQs) in re-searcharticlescanhelpguidescholarlyinquiries. However, many academic studies lack a proper definition of RQs in their articles. This research addresses this gap by presenting a comprehensive framework for the systematic extraction, detection, and generation of RQs from scientific articles. The extraction component uses a set of regular expressions to identify articles containing well-defined RQs. The detection component aims to identify more complex RQs in articles, beyond those captured by the rule-based extraction method. The RQ generation focuses on creating RQs for articles that lack them. We integrate all these components to build a pipeline to extract RQs or generate them based on the articles’ full text. We evaluate the performance of the designed pipeline on a set of metrics designed to assess the quality of RQs. Our results indicate that the proposed pipeline can reliably detect RQs and generate high-quality ones.

Open source ↗
Consensus

The role of large language models in the peer-review process: opportunities and challenges for medical journal reviewers and editors

Jisoo Lee, Jieun Lee, Jeong-Ju Yoo · 2025 · Journal of Educational Evaluation for Health Professions

The peer review process ensures the integrity of scientific research. This is particularly important in the medical field, where research findings directly impact patient care. However, the rapid growth of publications has strained reviewers, causing delays and potential declines in quality. Genera…

Read paper details

Jisoo Lee, Jieun Lee, Jeong-Ju Yoo

The peer review process ensures the integrity of scientific research. This is particularly important in the medical field, where research findings directly impact patient care. However, the rapid growth of publications has strained reviewers, causing delays and potential declines in quality. Generative artificial intelligence, especially large language models (LLMs) such as ChatGPT, may assist researchers with efficient, high-quality reviews. This review explores the integration of LLMs into peer review, highlighting their strengths in linguistic tasks and challenges in assessing scientific validity, particularly in clinical medicine. Key points for integration include initial screening, reviewer matching, feedback support, and language review. However, implementing LLMs for these purposes will necessitate addressing biases, privacy concerns, and data confidentiality. We recommend using LLMs as complementary tools under clear guidelines to support, not replace, human expertise in maintaining rigorous peer review standards.

DOI: 10.3352/jeehp.2025.22.4

Open source ↗
Consensus

Rising adoption of artificial intelligence in scientific publishing: evaluating the role, risks, and ethical implications in paper drafting and review process

A. Carobene, A. Padoan, Federico Cabitza, G. Banfi, Mario Plebani · 2023 · Clinical Chemistry and Laboratory Medicine (CCLM)

Background: In the rapid evolving landscape of artificial intelligence (AI), scientific publishing is experiencing significant transformations. AI tools, while offering unparalleled efficiencies in paper drafting and peer review, also introduce notable ethical concerns. Content: This study delinea…

Read paper details

A. Carobene, A. Padoan, Federico Cabitza, G. Banfi, Mario Plebani

Background: In the rapid evolving landscape of artificial intelligence (AI), scientific publishing is experiencing significant transformations. AI tools, while offering unparalleled efficiencies in paper drafting and peer review, also introduce notable ethical concerns. Content: This study delineates AI's dual role in scientific publishing: as a co-creator in the writing and review of scientific papers and as an ethical challenge. We first explore the potential of AI as an enhancer of efficiency, efficacy, and quality in creating scientific papers. A critical assessment follows, evaluating the risks vs. rewards for researchers, especially those early in their careers, emphasizing the need to maintain a balance between AI's capabilities and fostering independent reasoning and creativity. Subsequently, we delve into the ethical dilemmas of AI's involvement, particularly concerning originality, plagiarism, and preserving the genuine essence of scientific discourse. The evolving dynamics further highlight an overlooked aspect: the inadequate recognition of human reviewers in the academic community. With the increasing volume of scientific literature, tangible metrics and incentives for reviewers are proposed as essential to ensure a balanced academic environment. Summary: AI's incorporation in scientific publishing is promising yet comes with significant ethical and operational challenges. The role of human reviewers is accentuated, ensuring authenticity in an AI-influenced environment. Outlook: As the scientific community treads the path of AI integration, a balanced symbiosis between AI's efficiency and human discernment is pivotal. Emphasizing human expertise, while exploit artificial intelligence responsibly, will determine the trajectory of an ethically sound and efficient AI-augmented future in scientific publishing. © 2023 Walter de Gruyter GmbH, Berlin/Boston.

DOI: 10.1515/cclm-2023-1136

Open source ↗
Consensus

Exploiting large language models in peer review: indirect prompt injection attacks and integrity probes

Federico Torrielli, Stefano Locci, Amon Rapp, Luigi Di Caro · 2026 · Scientometrics

Large language models are beginning to enter peer review as tools for summarizing manuscripts, drafting evaluations, and reducing reviewer workload. Yet this use creates a security problem specific to evaluative settings: the manuscript being judged can also contain hidden instructions that shape t…

Read paper details

Federico Torrielli, Stefano Locci, Amon Rapp, Luigi Di Caro

Large language models are beginning to enter peer review as tools for summarizing manuscripts, drafting evaluations, and reducing reviewer workload. Yet this use creates a security problem specific to evaluative settings: the manuscript being judged can also contain hidden instructions that shape the model’s judgment. We investigate this risk through indirect prompt injection, where hidden text embedded in a manuscript is processed like a benign prompt by a public chatbot during review generation. We introduce an Author-Reviewer-Organizer framework that distinguishes author-side manipulation from organizer-side integrity checks, and use it to evaluate both offensive payloads, which steer reviews toward positive or negative judgments, and integrity-probing payloads, which trigger refusal, watermarking, or external-site redirection. The redirection payload is introduced here as a novel integrity-check mechanism. In experiments on 100 OpenReview papers, two public chatbot systems, five payload families, two custom prompt approaches, three injection positions, and five repeated runs per condition, we generate 42000 model outputs. Hidden instructions are highly effective: positive steering, refusal, and external-site redirection exceed 98% success on both systems; watermarking remains high but less reliable, reaching 94.27% on ChatGPT and 88.17% on Gemini; and negative steering is near-ceiling on ChatGPT but lower on Gemini. Vulnerability varies with payload design, model, and document position. These findings show that current models exhibit “contextual blindness”: they do not reliably separate manuscript content from embedded control text. This weakness threatens the validity of AI-assisted review, while also creating a dual-use channel that organizers may repurpose for detection. Peer-review systems that rely on public LLMs therefore require stronger safeguards between document content and instructions before they can be trusted in evaluative workflows.

DOI: 10.1007/s11192-026-05695-x

Open source ↗
Consensus

ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing

Brady D. Lund, Ting Wang, Nishith Reddy Mannuru, Bing Nie, S. Shimray, Ziang Wang · 2023 · Journal of the Association for Information Science and Technology

This article discusses OpenAI's ChatGPT, a generative pre‐trained transformer, which uses natural language processing to fulfill text‐based user requests (i.e., a “chatbot”). The history and principles behind ChatGPT and similar models are discussed. This technology is then discussed in relation to…

Read paper details

Brady D. Lund, Ting Wang, Nishith Reddy Mannuru, Bing Nie, S. Shimray, Ziang Wang

This article discusses OpenAI's ChatGPT, a generative pre‐trained transformer, which uses natural language processing to fulfill text‐based user requests (i.e., a “chatbot”). The history and principles behind ChatGPT and similar models are discussed. This technology is then discussed in relation to its potential impact on academia and scholarly research and publishing. ChatGPT is seen as a potential model for the automated preparation of essays and other types of scholarly manuscripts. Potential ethical issues that could arise with the emergence of large language models like GPT‐3, the underlying technology behind ChatGPT, and its usage by academics and researchers, are discussed and situated within the context of broader advancements in artificial intelligence, machine learning, and natural language processing for research and scholarly publishing.

DOI: 10.1002/asi.24750

Open source ↗
Consensus

Artificial intelligence-assisted academic writing: recommendations for ethical use

Adam Cheng, Aaron Calhoun, Gabriel Reedy · 2025 · Advances in Simulation

Generative artificial intelligence (AI) tools have been selectively adopted across the academic community to help researchers complete tasks in a more efficient manner. The widespread release of the Chat Generative Pre-trained Transformer (ChatGPT) platform in 2022 has made these tools more accessi…

Read paper details

Adam Cheng, Aaron Calhoun, Gabriel Reedy

Generative artificial intelligence (AI) tools have been selectively adopted across the academic community to help researchers complete tasks in a more efficient manner. The widespread release of the Chat Generative Pre-trained Transformer (ChatGPT) platform in 2022 has made these tools more accessible to scholars around the world. Despite their tremendous potential, studies have uncovered that large language model (LLM)-based generative AI tools have issues with plagiarism, AI hallucinations, and inaccurate or fabricated references. This raises legitimate concern about the utility, accuracy, and integrity of AI when used to write academic manuscripts. Currently, there is little clear guidance for healthcare simulation scholars outlining the ways that generative AI could be used to legitimately support the production of academic literature. In this paper, we discuss how widely available, LLM-powered generative AI tools (e.g. ChatGPT) can help in the academic writing process. We first explore how academic publishers are positioning the use of generative AI tools and then describe potential issues with using these tools in the academic writing process. Finally, we discuss three categories of specific ways generative AI tools can be used in an ethically sound manner and offer four key principles that can help guide researchers to produce high-quality research outputs with the highest of academic integrity. © 2025. The Author(s).

DOI: 10.1186/s41077-025-00350-6

Open source ↗
Consensus

What’s Your Problem? Writing Effective Research Questions for Quality Publications

Alison Purvis, V. Nicholas, Joanna Tai · 2024 · Journal of University Teaching and Learning Practice

Research questions play a central role in papers, indicating the phenomenon or problem that is being addressed, and clearly stating what is being investigated. Indeed, the presence of research questions within a research article is an established quality indicator, and research questions form the b…

Read paper details

Alison Purvis, V. Nicholas, Joanna Tai

Research questions play a central role in papers, indicating the phenomenon or problem that is being addressed, and clearly stating what is being investigated. Indeed, the presence of research questions within a research article is an established quality indicator, and research questions form the basis of determining hypotheses, methodology, methods, and how interpretations and analysis of outcomes are undertaken. Given the key purpose of a research article is to communicate the phenomenon or problem that is being addressed, research questions play a central role in clearly stating what is being investigated. The Journal of University Teaching and Learning Practice (JUTLP) seeks to publish high quality research papers which offer impactful guidance for teaching and learning practice in higher education. In this editorial, we explore what research questions are, how they are used, their key characteristics, different types of questions, and how to write them. We also make practical recommendations for authors, reviewers, and editors in how to use research questions, what to look out for when reviewing manuscripts and making decisions, and how to best support authors in producing quality publications by ensuring impactful research questions are included.

DOI: 10.53761/j64xa573

Open source ↗
Consensus

How common are explicit research questions in journal articles?

M. Thelwall, Amalia Más-Bleda · 2020 · Quantitative Science Studies

Although explicitly labeled research questions seem to be central to some fields, others do not need them. This may confuse authors, editors, readers, and reviewers of multidisciplinary research. This article assesses the extent to which research questions are explicitly mentioned in 17 out of 22 a…

Read paper details

M. Thelwall, Amalia Más-Bleda

Although explicitly labeled research questions seem to be central to some fields, others do not need them. This may confuse authors, editors, readers, and reviewers of multidisciplinary research. This article assesses the extent to which research questions are explicitly mentioned in 17 out of 22 areas of scholarship from 2000 to 2018 by searching over a million full-text open access journal articles. Research questions were almost never explicitly mentioned (under 2%) by articles in engineering and physical, life, and medical sciences, and were the exception (always under 20%) for the broad fields in which they were least rare: computing, philosophy, theology, and social sciences. Nevertheless, research questions were increasingly mentioned explicitly in all fields investigated, despite a rate of 1.8% overall (1.1% after correcting for irrelevant matches). Other terminology for an article’s purpose may be more widely used instead, including aims, objectives, goals, hypotheses, and purposes, although no terminology occurs in a majority of articles in any broad field tested. Authors, editors, readers, and reviewers should therefore be aware that the use of explicitly labeled research questions or other explicit research purpose terminology is nonstandard in most or all broad fields, although it is becoming less rare.

DOI: 10.1162/qss_a_00041

Open source ↗
Consensus

Semi-Extractive Text Summarization Approach to Extract Research Objective of Academic Literature

S. Abdullah · 2022 · International Journal of Computing and Digital Systems

: The task of literature review is an important for all research areas. The volume of academic literature published in the scientific journals, books and conference proceedings is increasing rapidly. It has become very di ffi cult for researchers to analyze huge amount of published research papers …

Read paper details

S. Abdullah

: The task of literature review is an important for all research areas. The volume of academic literature published in the scientific journals, books and conference proceedings is increasing rapidly. It has become very di ffi cult for researchers to analyze huge amount of published research papers and draw conclusions. Therefore, an automatic system able to extract the research objectives that recap the meaning and the definition of research from the article published is needed. The main challenge is to deal with the highly multiplicity of authors’ writing style used in forming the objective sentences. A semi-extractive approach for precisely extracting research objective from the research abstract is proposed. The extraction process is performed in two tasks, search for pre-collected Key Expressions and verify the findings using pre-built General Key Phrases. An extensive evaluation has been conducted to find out how well it is performing using special dataset that includes diversified writing styles. The results showed that the method is a promising and able to extract objective sentence accurately.

DOI: 10.12785/ijcds/120154

Open source ↗
Consensus

Techniques for supercharging academic writing with generative AI

Zhicheng Lin · 2023 · Nature Biomedical Engineering

Generalist large language models can elevate the quality and efficiency of academic writing.

Read paper details

Zhicheng Lin

Generalist large language models can elevate the quality and efficiency of academic writing.

DOI: 10.1038/s41551-024-01185-8

Open source ↗
Consensus

Ensuring peer review integrity in the era of large language models: A critical stocktaking of challenges, red flags, and recommendations

B. Koçak, M. Onur, S. Park, P. Baltzer, Matthias Dietzel · 2025 · European Journal of Radiology Artificial Intelligence

The rise of large language models (LLMs) like ChatGPT offers promising academic opportunities but also raises peer review concerns. Reviewers increasingly use LLMs to refine language or draft reviews, blurring the line between using artificial intelligence (AI) as a supportive tool and a leading ro…

Read paper details

B. Koçak, M. Onur, S. Park, P. Baltzer, Matthias Dietzel

The rise of large language models (LLMs) like ChatGPT offers promising academic opportunities but also raises peer review concerns. Reviewers increasingly use LLMs to refine language or draft reviews, blurring the line between using artificial intelligence (AI) as a supportive tool and a leading role in the peer review of manuscripts. Given the impracticality of enforcing a ban on reviewers' use of LLMs, this obscurity poses challenges for editorial teams in maintaining peer review integrity. Based on the literature and authors' editorial experience, this brief paper examines the challenges of detecting LLM-shaped reviews, highlights key indicators, and offers recommendations to uphold the rigor of peer review—an imperfect system, yet still the best we have in scholarly publishing. • LLMs may provide significant benefits but can cause major challenges for peer review. • Detecting LLM-shaped reviews remains complex. • Several findings may signal AI involvement. • Clear policies on AI in peer review are essential. • LLMs should assist, not replace, human reviewers.

DOI: 10.1016/j.ejrai.2025.100018

Open source ↗
Consensus

Designing the literature review for a strong contribution

H. Snyder · 2023 · Journal of Decision Systems

ABSTRACT A literature review is an excellent research methodology. For example, a review can synthesise research findings and identify areas where more research is needed, thus providing the basis for a conceptual model, and informing policy and practice. However, despite their potential, the contr…

Read paper details

H. Snyder

ABSTRACT A literature review is an excellent research methodology. For example, a review can synthesise research findings and identify areas where more research is needed, thus providing the basis for a conceptual model, and informing policy and practice. However, despite their potential, the contribution and knowledge development of literature reviews are often weak. Time and again, literature reviews provide only a summary of descriptive statistics that does not facilitate knowledge development or inform policy and practice. This short paper examines common dilemmas and problems when it comes to the contribution of literature reviews. Different approaches are suggested and discussed, with the aim of helping researchers develop more meaningful contributions and thereby facilitate the advancement of research fields and knowledge development. The suggestions may be used by researchers, supporting them in moving from writing summary descriptions towards a more efficient approach to analysis and, therefore, stronger contributions.

DOI: 10.1080/12460125.2023.2197704

Open source ↗
Consensus

The ethics of disclosing the use of artificial intelligence tools in writing scholarly manuscripts

Mohammad Hosseini, D. Resnik, Kristi L. Holmes · 2023 · Research ethics

In this article, we discuss ethical issues related to using and disclosing artificial intelligence (AI) tools, such as ChatGPT and other systems based on large language models (LLMs), to write or edit scholarly manuscripts. Some journals, such as Science, have banned the use of LLMs because of the …

Read paper details

Mohammad Hosseini, D. Resnik, Kristi L. Holmes

In this article, we discuss ethical issues related to using and disclosing artificial intelligence (AI) tools, such as ChatGPT and other systems based on large language models (LLMs), to write or edit scholarly manuscripts. Some journals, such as Science, have banned the use of LLMs because of the ethical problems they raise concerning responsible authorship. We argue that this is not a reasonable response to the moral conundrums created by the use of LLMs because bans are unenforceable and would encourage undisclosed use of LLMs. Furthermore, LLMs can be useful in writing, reviewing and editing text, and promote equity in science. Others have argued that LLMs should be mentioned in the acknowledgments since they do not meet all the authorship criteria. We argue that naming LLMs as authors or mentioning them in the acknowledgments are both inappropriate forms of recognition because LLMs do not have free will and therefore cannot be held morally or legally responsible for what they do. Tools in general, and software in particular, are usually cited in-text, followed by being mentioned in the references. We provide suggestions to improve APA Style for referencing ChatGPT to specifically indicate the contributor who used LLMs (because interactions are stored on personal user accounts), the used version and model (because the same version could use different language models and generate dissimilar responses, e.g., ChatGPT May 12 Version GPT3.5 or GPT4), and the time of usage (because LLMs evolve fast and generate dissimilar responses over time). We recommend that researchers who use LLMs: (1) disclose their use in the introduction or methods section to transparently describe details such as used prompts and note which parts of the text are affected, (2) use in-text citations and references (to recognize their used applications and improve findability and indexing), and (3) record and submit their relevant interactions with LLMs as supplementary material or appendices.

DOI: 10.1177/17470161231180449

Open source ↗
Consensus

Exploring the affordances of generative AI large language models for stance and engagement in academic writing

Zhishan Mo, Peter Crosthwaite · 2025 · Journal of English for Academic Purposes

Large pre-trained models like ChatGPT demonstrate remarkable capabilities in generating coherent text across various domains, posing serious implications for teaching academic writing, given the potential for student plagiarism and reliance on software for developing writing skills. However, the li…

Read paper details

Zhishan Mo, Peter Crosthwaite

Large pre-trained models like ChatGPT demonstrate remarkable capabilities in generating coherent text across various domains, posing serious implications for teaching academic writing, given the potential for student plagiarism and reliance on software for developing writing skills. However, the linguistic properties and strategies these models employ remain largely unexplored. We investigate how three available large language models (LLMs) express stance and engage with readers in their writing, providing insights into their abilities to produce contextually appropriate and discipline-specific academic writing. 30 academic essays produced by each model were compared with those of human writers on identical topics using detailed prompts, before annotating each text for stance and engagement following Hyland's (2005) taxonomy. Results indicate that LLMs generally use a narrower and more repetitive range of stance and engagement features than human writers, with significant variation also across each LLM. Disciplinary use of stance and engagement is largely in line with human writing except for the philosophy discipline. Implications for teaching academic writing are discussed, particularly regarding identifying potential LLM-related plagiarism and inconsistencies in academic stance and engagement.

DOI: 10.1016/j.jeap.2025.101499

Open source ↗
Consensus

Evaluating the potential risks of employing large language models in peer review

Lingxuan Zhu, Yancheng Lai, Jiarui Xie, Weiming Mou, Lihaoyun Huang, Chang Qi, Tao Yang, Aimin Jian… · 2025 · Clinical and Translational Discovery

This study aims to systematically investigate the potential harms of Large Language Models (LLMs) in the peer review process.LLMs are increasingly used in academic processes, including peer review. While they can address challenges like reviewer scarcity and review efficiency, concerns about fairne…

Read paper details

Lingxuan Zhu, Yancheng Lai, Jiarui Xie, Weiming Mou, Lihaoyun Huang, Chang Qi, Tao Yang, Aimin Jiang, Wenyi Gan, Dongqiang Zeng, Bufu Tang, Mingjia Xiao, G. Chu, Zao-bin Liu, Quan Cheng, Anqi Lin, Peng Luo

This study aims to systematically investigate the potential harms of Large Language Models (LLMs) in the peer review process.LLMs are increasingly used in academic processes, including peer review. While they can address challenges like reviewer scarcity and review efficiency, concerns about fairness, transparency and potential biases in LLM‐generated reviews have not been thoroughly investigated.Claude 2.0 was used to generate peer review reports, rejection recommendations, citation requests and refutations for 20 original, unmodified cancer biology manuscripts obtained from eLife's new publishing model. Artificial intelligence (AI) detection tools (zeroGPT and GPTzero) assessed whether the reviews were identifiable as LLM‐generated.All LLM‐generated outputs were evaluated for reasonableness by two expert on a five‐point Likert scale.LLM‐generated reviews were somewhat consistent with human reviews but lacked depth, especially in detailed critique. The model proved highly proficient at generating convincing rejection comments and could create plausible citation requests, including requests for unrelated references. AI detectors struggled to identify LLM‐generated reviews, with 82.8% of responses classified as human‐written by GPTzero.LLMs can be readily misused to undermine the peer review process by generating biased, manipulative, and difficult‐to‐detect content, posing a significant threat to academic integrity. Guidelines and detection tools are needed to ensure LLMs enhance rather than harm the peer review process.

DOI: 10.1002/ctd2.70067

Open source ↗
Consensus

GenAI et al.: Cocreation, Authorship, Ownership, Academic Ethics and Integrity in a Time of Generative AI

Aras Bozkurt · 2024 · Open Praxis

This paper investigates the complex interplay between generative artificial intelligence (AI) and human intellect in academic writing and publishing. It examines the ‘organic versus synthetic’ paradox, emphasizing the implications of using generative AI tools in educational and academic integrity c…

Read paper details

Aras Bozkurt

This paper investigates the complex interplay between generative artificial intelligence (AI) and human intellect in academic writing and publishing. It examines the ‘organic versus synthetic’ paradox, emphasizing the implications of using generative AI tools in educational and academic integrity contexts. The paper critiques the prevalent ‘publish or perish’ culture in academia, highlighting the need for systemic reevaluation due to generative AI’s emerging role in academic writing and reporting. It delves into the legal and ethical challenges of authorship and ownership, especially in relation to copyright laws and AI-generated content. The paper discusses generative AI’s diverse roles and advocates for transparent reporting to uphold academic integrity. Additionally, it calls for a broader examination of generative AI tools and stresses the need for new mechanisms to identify generative AI use and ensure adherence to academic integrity and ethics. The implications of generative AI are also explored, suggesting the need for innovative AI-inclusive strategies in academia. The paper concludes by emphasizing the significance of generative AI in various information-processing domains, highlighting the urgency to adapt and transform academic practices in an era of rapid generative AI-driven

DOI: 10.55982/openpraxis.16.1.654

Open source ↗
Consensus

Responsible Artificial Intelligence and Journal Publishing

Shirley Gregor · 2024 · J. Assoc. Inf. Syst.

The aim of this opinion piece is to examine the responsible use of artificial intelligence (AI) in relation to academic journal publishing. The work discusses approaches to AI with particular attention to recent developments with generative AI. Consensus is noted around eight normative themes for p…

Read paper details

Shirley Gregor

The aim of this opinion piece is to examine the responsible use of artificial intelligence (AI) in relation to academic journal publishing. The work discusses approaches to AI with particular attention to recent developments with generative AI. Consensus is noted around eight normative themes for principles for responsible AI and their associated risks. A framework from Shneiderman (2022) for human-centered AI is employed to consider journal publishing practices that can address the principles of responsible AI at different levels. The resultant AI principled governance matrix (AI-PGM) for journal publishing shows how countermeasures for risks can be employed at the levels of the author-researcher team, the organization, the industry, and by government regulation. The AI-PGM allows a structured approach to responsible AI and may be modified as developments with AI unfold. It shows how the whole publishing ecosystem should be considered when looking at the responsible use of AI—not just journal policy itself.

DOI: 10.17705/1jais.00863

Open source ↗
Consensus

Generating scholarly content with ChatGPT: ethical challenges for medical publishing.

M. Liebrenz, R. Schleifer, A. Buadze, D. Bhugra, Alexander Smith · 2023 · The Lancet. Digital health

The impact of generative artificial intelligence (AI) on medical publishing practices is currently unknown. However, as our experiences underline, generative AI could have substantial ethical implications.

Read paper details

M. Liebrenz, R. Schleifer, A. Buadze, D. Bhugra, Alexander Smith

The impact of generative artificial intelligence (AI) on medical publishing practices is currently unknown. However, as our experiences underline, generative AI could have substantial ethical implications.

DOI: 10.1016/s2589-7500(23)00019-5

Open source ↗

Disagreements & Limitations

Disagreements

  • No major disagreement identified.

Limitations

  • No single document provides a definitive research question; the question is synthesized from multiple sources addressing related gaps.
  • Most evidence comes from methodology-focused reviews or theoretical/computational studies rather than empirical investigations of RQ prevalence across disciplines.
  • The document set lacks field-specific analyses outside biomedicine, nursing, and software engineering, limiting generalizability.
  • Several highly relevant papers (e.g., C550, C549) are very recent or forthcoming (2025–2026), so their long-term validity and methodological robustness are not yet established.
  • The absence of studies on automated RQ generation in certain fields may reflect a true gap or merely retrieval limitations, as noted by the system’s warning about incomplete retrieval.

Sources

[C543] Automation of systematic literature reviews: A systematic literature review

Inf. Softw. Technol. · 2021 · DOI: 10.1016/j.infsof.2021.106589

Open source
[C544] Literature review as a research methodology: An overview and guidelines

Journal of Business Research · 2019 · DOI: 10.1016/j.jbusres.2019.07.039

Open source
[C545] The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing.

Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing · 2023 · DOI: 10.1111/jnu.12938

Open source
[C546] Formulating Research Questions for Evidence-Based Studies

Journal of Medicine, Surgery, and Public Health · 2023 · DOI: 10.1016/j.glmedi.2023.100046

Open source
[C547] Identification of research hypotheses and new knowledge from scientific literature

BMC Medical Informatics and Decision Making · 2018 · DOI: 10.1186/s12911-018-0639-1

Open source
[C548] A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

Journal of Korean Medical Science · 2022 · DOI: 10.3346/jkms.2022.37.e121

Open source
[C549] Large language models for peer review in biotechnology.

New biotechnology · 2026 · DOI: 10.1016/j.nbt.2026.03.007

Open source
[C550] Extracting, Detecting, and Generating Research Questions for Scientific Articles

· 2025

Open source
View Detailed Research
Developer Diagnostics

PRODUCTION MODE

Research Planners

Planner 1 — Gemini 3.5 Flash
google/gemini-3.5-flash

Planner 2 — Llama 4 Scout
meta-llama/llama-4-scout

Planner 3 — Qwen3.5-27B
qwen/qwen3.5-27b

Retrieval

Semantic Scholar: Enabled
API key: Not configured (public access)

Consensus: Enabled

Synthesizer

qwen/qwen3-max
qwen/qwen3-max

Credential readiness

OpenRouter: Configured

Consensus: Configured

Manual evaluation cases and results
Individual AI responses

AI Agent Research

Independent model outputs. Planners propose searches and hypotheses, not evidence. Citations and confidence in historical answers are model-reported and unverified.

State a research question from the document

Completed

Research finished. Any provider failures are shown in their sections.

Planner 1 — Gemini 3.5 Flash google/gemini-3.5-flash View response

Problem interpretation

Evaluating the impact of generative artificial intelligence on academic writing standards, peer review integrity, and scholarly publishing ethics.

Search queries (not evidence)

  • generative AI academic writing standards
  • large language models peer review integrity
  • artificial intelligence scholarly publishing ethics
Planner diagnostics
problem_interpretation
Evaluating the impact of generative artificial intelligence on academic writing standards, peer review integrity, and scholarly publishing ethics.
research_questions
['How does the integration of large language models in the manuscript drafting phase affect the overall quality and reliability of published scientific literature?']
search_queries
['generative AI academic writing standards', 'large language models peer review integrity', 'artificial intelligence scholarly publishing ethics']
keywords
['generative AI', 'academic writing', 'peer review', 'scholarly publishing']
synonyms
['large language models', 'scientific writing', 'manuscript evaluation', 'academic journals']
population_terms
['researchers', 'peer reviewers', 'academic editors', 'journal publishers']
intervention_or_exposure_terms
['generative AI tools', 'large language models', 'AI-assisted writing', 'ChatGPT']
outcome_terms
['writing quality', 'review integrity', 'plagiarism rates', 'ethical standards']
possible_research_gaps
['Long-term effects of AI reliance on the critical thinking and writing development of early-career researchers.']
uncertainties
['The ultimate reliability and false positive rates of AI-generated text detectors in editorial workflows.']
suggested_filters
{'year_from': 2020, 'year_to': 2024, 'fields': ['Education', 'Computer Science', 'Social Sciences'], 'study_types': ['Empirical Study', 'Literature Review', 'Case Study']}

Self-reported confidence: Not assessed

Citations

  • No sources supplied by this model.
Planner 2 — Llama 4 Scout meta-llama/llama-4-scout Failed

OpenRouter rate-limited this request. Please try again later.

Planner 3 — Qwen3.5-27B qwen/qwen3.5-27b View response

Problem interpretation

User requests extraction of a research question from an unspecified document, requiring a methodological search strategy due to missing context.

Search queries (not evidence)

  • identifying research questions in academic papers
  • extracting research objectives from literature
  • structure of research questions in manuscripts
  • methods for locating study aims in articles
Planner diagnostics
intervention_or_exposure_terms
['text analysis', 'document review', 'reading strategies']
keywords
['research question', 'academic document', 'study objective', 'literature analysis']
outcome_terms
['identified research question', 'extracted objective']
population_terms
['researchers', 'students', 'reviewers']
possible_research_gaps
['Automated extraction of research questions from unstructured text', 'Standardization of research question placement in manuscripts']
problem_interpretation
User requests extraction of a research question from an unspecified document, requiring a methodological search strategy due to missing context.
research_questions
['How are research questions typically formulated in academic documents?', 'What methods exist for identifying study objectives in literature?']
search_queries
['identifying research questions in academic papers', 'extracting research objectives from literature', 'structure of research questions in manuscripts', 'methods for locating study aims in articles']
suggested_filters
{'fields': ['methodology', 'education', 'information science'], 'study_types': ['review', 'guideline', 'methodological study'], 'year_from': 2018, 'year_to': 2023}
synonyms
['research aim', 'hypothesis', 'inquiry', 'manuscript', 'article']
uncertainties
['Specific document content unavailable', 'Field of study unspecified', 'Document type undefined']

Self-reported confidence: Not assessed

Citations

  • No sources supplied by this model.
Full Academic Evidence

Academic Evidence

Academic papers retrieved from the providers below, shown separately from model outputs. Provider metadata is retained; a retrieved paper is not automatically proof of a claim.

State a research question from the document

consensus

25 unique papers found in this response

Artificial intelligence-assisted academic writing: recommendations for ethical use 2025 · other

Adam Cheng, Aaron Calhoun, Gabriel Reedy

Generative artificial intelligence (AI) tools have been selectively adopted across the academic community to help researchers complete tasks in a more efficient manner. The widespread release of the Chat Generative Pre-trained Transformer (ChatGPT) platform in 2022 has made these tools more accessible to scholars around the world. Despite their tremendous potential, studies have uncovered that large language model (LLM)-based generative AI tools have issues with plagiarism, AI hallucinations, and inaccurate or fabricated references. This raises legitimate concern about the utility, accuracy, and integrity of AI when used to write academic manuscripts. Currently, there is little clear guidance for healthcare simulation scholars outlining the ways that generative AI could be used to legitimately support the production of academic literature. In this paper, we discuss how widely available, LLM-powered generative AI tools (e.g. ChatGPT) can help in the academic writing process. We first e…

DOI: 10.1186/s41077-025-00350-6

Open source ↗
The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing. 2023 · cross-sectional study

A. Tang, Kin-Kit Li, K. Kwok, Liujiao Cao, Stanley Luong, W. Tam

The integration of generative artificial intelligence (AI) into academic research writing has revolutionized the field, offering powerful tools like ChatGPT and Bard to aid researchers in content generation and idea enhancement. We explore the current state of transparency regarding generative AI use in nursing academic research journals, emphasizing the need for explicitly declaring the use of generative AI by authors in the manuscript. Out of 125 nursing studies journals, 37.6% required explicit statements about generative AI use in their authors' guidelines. No significant differences in impact factors or journal categories were found between journals with and without such requirement. A similar evaluation of medicine, general and internal journals showed a lower percentage (14.5%) including the information about generative AI usage. Declaring generative AI tool usage is crucial for maintaining the transparency and credibility in academic writing. Additionally, extending the requir…

DOI: 10.1111/jnu.12938

Open source ↗
Techniques for supercharging academic writing with generative AI 2023 · theoretical, modeling, or simulation study

Zhicheng Lin

Generalist large language models can elevate the quality and efficiency of academic writing.

DOI: 10.1038/s41551-024-01185-8

Open source ↗
GenAI et al.: Cocreation, Authorship, Ownership, Academic Ethics and Integrity in a Time of Generative AI 2024 · commentary or perspective

Aras Bozkurt

This paper investigates the complex interplay between generative artificial intelligence (AI) and human intellect in academic writing and publishing. It examines the ‘organic versus synthetic’ paradox, emphasizing the implications of using generative AI tools in educational and academic integrity contexts. The paper critiques the prevalent ‘publish or perish’ culture in academia, highlighting the need for systemic reevaluation due to generative AI’s emerging role in academic writing and reporting. It delves into the legal and ethical challenges of authorship and ownership, especially in relation to copyright laws and AI-generated content. The paper discusses generative AI’s diverse roles and advocates for transparent reporting to uphold academic integrity. Additionally, it calls for a broader examination of generative AI tools and stresses the need for new mechanisms to identify generative AI use and ensure adherence to academic integrity and ethics. The implications of generative AI …

DOI: 10.55982/openpraxis.16.1.654

Open source ↗
Exploring the affordances of generative AI large language models for stance and engagement in academic writing 2025 · other

Zhishan Mo, Peter Crosthwaite

Large pre-trained models like ChatGPT demonstrate remarkable capabilities in generating coherent text across various domains, posing serious implications for teaching academic writing, given the potential for student plagiarism and reliance on software for developing writing skills. However, the linguistic properties and strategies these models employ remain largely unexplored. We investigate how three available large language models (LLMs) express stance and engage with readers in their writing, providing insights into their abilities to produce contextually appropriate and discipline-specific academic writing. 30 academic essays produced by each model were compared with those of human writers on identical topics using detailed prompts, before annotating each text for stance and engagement following Hyland's (2005) taxonomy. Results indicate that LLMs generally use a narrower and more repetitive range of stance and engagement features than human writers, with significant variation al…

DOI: 10.1016/j.jeap.2025.101499

Open source ↗
What’s Your Problem? Writing Effective Research Questions for Quality Publications 2024 · commentary or perspective

Alison Purvis, V. Nicholas, Joanna Tai

Research questions play a central role in papers, indicating the phenomenon or problem that is being addressed, and clearly stating what is being investigated. Indeed, the presence of research questions within a research article is an established quality indicator, and research questions form the basis of determining hypotheses, methodology, methods, and how interpretations and analysis of outcomes are undertaken. Given the key purpose of a research article is to communicate the phenomenon or problem that is being addressed, research questions play a central role in clearly stating what is being investigated. The Journal of University Teaching and Learning Practice (JUTLP) seeks to publish high quality research papers which offer impactful guidance for teaching and learning practice in higher education. In this editorial, we explore what research questions are, how they are used, their key characteristics, different types of questions, and how to write them. We also make practical rec…

DOI: 10.53761/j64xa573

Open source ↗
A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles 2022 · other

E. Barroga, Glafera Janet Matanguihan

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarif…

DOI: 10.3346/jkms.2022.37.e121

Open source ↗
Extracting, Detecting, and Generating Research Questions for Scientific Articles 2025

Sina Taslimi, Artemis Çapari, H. Azarbonyad, Zi-Long Zhu, Zubair Afzal, Evangelos Kanoulas, G. Tsatsaronis

The volume of academic articles is increasing rapidly, reflecting the growing emphasis on research and scholarship across different science disciplines. This rapid growth necessitates the development of tools for more efficient and rapid understanding of these articles. Clear and well-defined Research Questions (RQs) in re-searcharticlescanhelpguidescholarlyinquiries. However, many academic studies lack a proper definition of RQs in their articles. This research addresses this gap by presenting a comprehensive framework for the systematic extraction, detection, and generation of RQs from scientific articles. The extraction component uses a set of regular expressions to identify articles containing well-defined RQs. The detection component aims to identify more complex RQs in articles, beyond those captured by the rule-based extraction method. The RQ generation focuses on creating RQs for articles that lack them. We integrate all these components to build a pipeline to extract RQs or g…

Open source ↗
How common are explicit research questions in journal articles? 2020 · cross-sectional study

M. Thelwall, Amalia Más-Bleda

Although explicitly labeled research questions seem to be central to some fields, others do not need them. This may confuse authors, editors, readers, and reviewers of multidisciplinary research. This article assesses the extent to which research questions are explicitly mentioned in 17 out of 22 areas of scholarship from 2000 to 2018 by searching over a million full-text open access journal articles. Research questions were almost never explicitly mentioned (under 2%) by articles in engineering and physical, life, and medical sciences, and were the exception (always under 20%) for the broad fields in which they were least rare: computing, philosophy, theology, and social sciences. Nevertheless, research questions were increasingly mentioned explicitly in all fields investigated, despite a rate of 1.8% overall (1.1% after correcting for irrelevant matches). Other terminology for an article’s purpose may be more widely used instead, including aims, objectives, goals, hypotheses, and pu…

DOI: 10.1162/qss_a_00041

Open source ↗
Formulating Research Questions for Evidence-Based Studies 2023 · literature review

Mohammad-Salar Hosseini, F. Jahanshahlou, M. Akbarzadeh, Mahdi Zarei, Y. Vaez-Gharamaleki

Formulating a research question is a crucial step in directing any scientific study. The classical evidence-based approach to formulating a question uses the PICO framework, consisting of population, intervention, comparison, and outcome. However, the PICO framework is not suitable for formulating research questions in some types of evidence and studies. This paper reviews and summarizes different frameworks introduced for formulating research questions over time. For this purpose, we explore the complete application of the PICO framework, clarifying its flexibility and subtleties for various research designs. Also, this review navigates the complexities of creating research questions, clarifying the minor variations needed within the PICO framework for various study designs through a thorough analysis and synthesis of the existing literature. Clarifying these customized strategies is intended to assist researchers, physicians, and scholars in appropriately formulating questions, impr…

DOI: 10.1016/j.glmedi.2023.100046

Open source ↗
The role of large language models in the peer-review process: opportunities and challenges for medical journal reviewers and editors 2025

Jisoo Lee, Jieun Lee, Jeong-Ju Yoo

The peer review process ensures the integrity of scientific research. This is particularly important in the medical field, where research findings directly impact patient care. However, the rapid growth of publications has strained reviewers, causing delays and potential declines in quality. Generative artificial intelligence, especially large language models (LLMs) such as ChatGPT, may assist researchers with efficient, high-quality reviews. This review explores the integration of LLMs into peer review, highlighting their strengths in linguistic tasks and challenges in assessing scientific validity, particularly in clinical medicine. Key points for integration include initial screening, reviewer matching, feedback support, and language review. However, implementing LLMs for these purposes will necessitate addressing biases, privacy concerns, and data confidentiality. We recommend using LLMs as complementary tools under clear guidelines to support, not replace, human expertise in main…

DOI: 10.3352/jeehp.2025.22.4

Open source ↗
Ensuring peer review integrity in the era of large language models: A critical stocktaking of challenges, red flags, and recommendations 2025

B. Koçak, M. Onur, S. Park, P. Baltzer, Matthias Dietzel

The rise of large language models (LLMs) like ChatGPT offers promising academic opportunities but also raises peer review concerns. Reviewers increasingly use LLMs to refine language or draft reviews, blurring the line between using artificial intelligence (AI) as a supportive tool and a leading role in the peer review of manuscripts. Given the impracticality of enforcing a ban on reviewers' use of LLMs, this obscurity poses challenges for editorial teams in maintaining peer review integrity. Based on the literature and authors' editorial experience, this brief paper examines the challenges of detecting LLM-shaped reviews, highlights key indicators, and offers recommendations to uphold the rigor of peer review—an imperfect system, yet still the best we have in scholarly publishing. • LLMs may provide significant benefits but can cause major challenges for peer review. • Detecting LLM-shaped reviews remains complex. • Several findings may signal AI involvement. • Clear policies on AI i…

DOI: 10.1016/j.ejrai.2025.100018

Open source ↗
Large language models for peer review in biotechnology. 2026 · other

Wenyu Li, Runyu Zhao, Pei Sun, Jeffrey Lee, Olivia Lu, Sophia Yuan, Pavan Sureshkumar, Yi-Xin Chen, Zhengyang Xiao, Yinjie J. Tang

As researchers use Large Language Models (LLMs) for rapid manuscript feedback, a key question is whether they can function as reliable peer reviewers in biotechnology. This study tested AI peer review using 763 preprints (398 with open peer reviews) and 12 grant proposals provided by the authors, including three resubmissions. We found that AI reviewers (GPT-5, Qwen-Plus, and Gemini 2.5 Pro) all provided substantive and well-structured comments, with a strong emphasis on experimental design and statistical analysis; however, they tended to be more lenient overall than human reviewers. AI reviewers are less likely than humans to critique paper positioning or ask for more citations. LLMs often rate grant proposals more favorably than humans (i.e. clustering at 3.2-3.8 vs human average 2.5 in scale of 1-4) and have less variation in word choices. AI detectors failed to reliably identify AI-generated text in review comments, as simple rewording bypassed them and detectors usually lagged b…

DOI: 10.1016/j.nbt.2026.03.007

Open source ↗
Exploiting large language models in peer review: indirect prompt injection attacks and integrity probes 2026 · other

Federico Torrielli, Stefano Locci, Amon Rapp, Luigi Di Caro

Large language models are beginning to enter peer review as tools for summarizing manuscripts, drafting evaluations, and reducing reviewer workload. Yet this use creates a security problem specific to evaluative settings: the manuscript being judged can also contain hidden instructions that shape the model’s judgment. We investigate this risk through indirect prompt injection, where hidden text embedded in a manuscript is processed like a benign prompt by a public chatbot during review generation. We introduce an Author-Reviewer-Organizer framework that distinguishes author-side manipulation from organizer-side integrity checks, and use it to evaluate both offensive payloads, which steer reviews toward positive or negative judgments, and integrity-probing payloads, which trigger refusal, watermarking, or external-site redirection. The redirection payload is introduced here as a novel integrity-check mechanism. In experiments on 100 OpenReview papers, two public chatbot systems, five p…

DOI: 10.1007/s11192-026-05695-x

Open source ↗
Evaluating the potential risks of employing large language models in peer review 2025

Lingxuan Zhu, Yancheng Lai, Jiarui Xie, Weiming Mou, Lihaoyun Huang, Chang Qi, Tao Yang, Aimin Jiang, Wenyi Gan, Dongqiang Zeng, Bufu Tang, Mingjia Xiao, G. Chu, Zao-bin Liu, Quan Cheng, Anqi Lin, Peng Luo

This study aims to systematically investigate the potential harms of Large Language Models (LLMs) in the peer review process.LLMs are increasingly used in academic processes, including peer review. While they can address challenges like reviewer scarcity and review efficiency, concerns about fairness, transparency and potential biases in LLM‐generated reviews have not been thoroughly investigated.Claude 2.0 was used to generate peer review reports, rejection recommendations, citation requests and refutations for 20 original, unmodified cancer biology manuscripts obtained from eLife's new publishing model. Artificial intelligence (AI) detection tools (zeroGPT and GPTzero) assessed whether the reviews were identifiable as LLM‐generated.All LLM‐generated outputs were evaluated for reasonableness by two expert on a five‐point Likert scale.LLM‐generated reviews were somewhat consistent with human reviews but lacked depth, especially in detailed critique. The model proved highly proficient …

DOI: 10.1002/ctd2.70067

Open source ↗
Semi-Extractive Text Summarization Approach to Extract Research Objective of Academic Literature 2022 · theoretical, modeling, or simulation study

S. Abdullah

: The task of literature review is an important for all research areas. The volume of academic literature published in the scientific journals, books and conference proceedings is increasing rapidly. It has become very di ffi cult for researchers to analyze huge amount of published research papers and draw conclusions. Therefore, an automatic system able to extract the research objectives that recap the meaning and the definition of research from the article published is needed. The main challenge is to deal with the highly multiplicity of authors’ writing style used in forming the objective sentences. A semi-extractive approach for precisely extracting research objective from the research abstract is proposed. The extraction process is performed in two tasks, search for pre-collected Key Expressions and verify the findings using pre-built General Key Phrases. An extensive evaluation has been conducted to find out how well it is performing using special dataset that includes diversifi…

DOI: 10.12785/ijcds/120154

Open source ↗
Designing the literature review for a strong contribution 2023 · other

H. Snyder

ABSTRACT A literature review is an excellent research methodology. For example, a review can synthesise research findings and identify areas where more research is needed, thus providing the basis for a conceptual model, and informing policy and practice. However, despite their potential, the contribution and knowledge development of literature reviews are often weak. Time and again, literature reviews provide only a summary of descriptive statistics that does not facilitate knowledge development or inform policy and practice. This short paper examines common dilemmas and problems when it comes to the contribution of literature reviews. Different approaches are suggested and discussed, with the aim of helping researchers develop more meaningful contributions and thereby facilitate the advancement of research fields and knowledge development. The suggestions may be used by researchers, supporting them in moving from writing summary descriptions towards a more efficient approach to anal…

DOI: 10.1080/12460125.2023.2197704

Open source ↗
Automation of systematic literature reviews: A systematic literature review 2021 · systematic review

B. Tekinerdoğan, Ç. Çatal

A B S T R A C T Context: Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further and broader insight into the investigated domain. Multiple SLR studies have been conducted in several domains, such as software engineering, medicine, and pharmacy. Conducting an SLR is a time-consuming, laborious, and costly effort. As such, several researchers developed different techniques to automate the SLR process. However, a systematic overview of the current state-of-the-art in SLR automation seems to be lacking. Objective: This study aims to collect and synthesize the studies that focus on the automation of SLR to pave the way for further research. Method: A systematic literature review is conducted on published primary studies on the automation of SLR studies, in which 41 primary studies have been analyzed. Results: This SLR identifies the objectives of automation studies, application domains, …

DOI: 10.1016/j.infsof.2021.106589

Open source ↗
Identification of research hypotheses and new knowledge from scientific literature 2018 · theoretical, modeling, or simulation study

M. Shardlow, R. Batista-Navarro, Paul Thompson, Raheel Nawaz, J. McNaught, S. Ananiadou

Background: Text mining (TM) methods have been used extensively to extract relations and events from the literature. In addition, TM techniques have been used to extract various types or dimensions of interpretative information, known as Meta-Knowledge (MK), from the context of relations and events, e.g. negation, speculation, certainty and knowledge type. However, most existing methods have focussed on the extraction of individual dimensions of MK, without investigating how they can be combined to obtain even richer contextual information. In this paper, we describe a novel, supervised method to extract new MK dimensions that encode Research Hypotheses (an author's intended knowledge gain) and New Knowledge (an author's findings). The method incorporates various features, including a combination of simple MK dimensions. Methods: We identify previously explored dimensions and then use a random forest to combine these with linguistic features into a classification model. To facilitate…

DOI: 10.1186/s12911-018-0639-1

Open source ↗
Literature review as a research methodology: An overview and guidelines 2019 · literature review

H. Snyder

Abstract Knowledge production within the field of business research is accelerating at a tremendous speed while at the same time remaining fragmented and interdisciplinary. This makes it hard to keep up with state-of-the-art and to be at the forefront of research, as well as to assess the collective evidence in a particular area of business research. This is why the literature review as a research method is more relevant than ever. Traditional literature reviews often lack thoroughness and rigor and are conducted ad hoc, rather than following a specific methodology. Therefore, questions can be raised about the quality and trustworthiness of these types of reviews. This paper discusses literature review as a methodology for conducting research and offers an overview of different types of reviews, as well as some guidelines to how to both conduct and evaluate a literature review paper. It also discusses common pitfalls and how to get literature reviews published.

DOI: 10.1016/j.jbusres.2019.07.039

Open source ↗
The ethics of disclosing the use of artificial intelligence tools in writing scholarly manuscripts 2023 · commentary or perspective

Mohammad Hosseini, D. Resnik, Kristi L. Holmes

In this article, we discuss ethical issues related to using and disclosing artificial intelligence (AI) tools, such as ChatGPT and other systems based on large language models (LLMs), to write or edit scholarly manuscripts. Some journals, such as Science, have banned the use of LLMs because of the ethical problems they raise concerning responsible authorship. We argue that this is not a reasonable response to the moral conundrums created by the use of LLMs because bans are unenforceable and would encourage undisclosed use of LLMs. Furthermore, LLMs can be useful in writing, reviewing and editing text, and promote equity in science. Others have argued that LLMs should be mentioned in the acknowledgments since they do not meet all the authorship criteria. We argue that naming LLMs as authors or mentioning them in the acknowledgments are both inappropriate forms of recognition because LLMs do not have free will and therefore cannot be held morally or legally responsible for what they do.…

DOI: 10.1177/17470161231180449

Open source ↗
Generating scholarly content with ChatGPT: ethical challenges for medical publishing. 2023 · commentary or perspective

M. Liebrenz, R. Schleifer, A. Buadze, D. Bhugra, Alexander Smith

The impact of generative artificial intelligence (AI) on medical publishing practices is currently unknown. However, as our experiences underline, generative AI could have substantial ethical implications.

DOI: 10.1016/s2589-7500(23)00019-5

Open source ↗
Rising adoption of artificial intelligence in scientific publishing: evaluating the role, risks, and ethical implications in paper drafting and review process 2023

A. Carobene, A. Padoan, Federico Cabitza, G. Banfi, Mario Plebani

Background: In the rapid evolving landscape of artificial intelligence (AI), scientific publishing is experiencing significant transformations. AI tools, while offering unparalleled efficiencies in paper drafting and peer review, also introduce notable ethical concerns. Content: This study delineates AI's dual role in scientific publishing: as a co-creator in the writing and review of scientific papers and as an ethical challenge. We first explore the potential of AI as an enhancer of efficiency, efficacy, and quality in creating scientific papers. A critical assessment follows, evaluating the risks vs. rewards for researchers, especially those early in their careers, emphasizing the need to maintain a balance between AI's capabilities and fostering independent reasoning and creativity. Subsequently, we delve into the ethical dilemmas of AI's involvement, particularly concerning originality, plagiarism, and preserving the genuine essence of scientific discourse. The evolving dynamics…

DOI: 10.1515/cclm-2023-1136

Open source ↗
ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing 2023 · other

Brady D. Lund, Ting Wang, Nishith Reddy Mannuru, Bing Nie, S. Shimray, Ziang Wang

This article discusses OpenAI's ChatGPT, a generative pre‐trained transformer, which uses natural language processing to fulfill text‐based user requests (i.e., a “chatbot”). The history and principles behind ChatGPT and similar models are discussed. This technology is then discussed in relation to its potential impact on academia and scholarly research and publishing. ChatGPT is seen as a potential model for the automated preparation of essays and other types of scholarly manuscripts. Potential ethical issues that could arise with the emergence of large language models like GPT‐3, the underlying technology behind ChatGPT, and its usage by academics and researchers, are discussed and situated within the context of broader advancements in artificial intelligence, machine learning, and natural language processing for research and scholarly publishing.

DOI: 10.1002/asi.24750

Open source ↗
Responsible Artificial Intelligence and Journal Publishing 2024 · other

Shirley Gregor

The aim of this opinion piece is to examine the responsible use of artificial intelligence (AI) in relation to academic journal publishing. The work discusses approaches to AI with particular attention to recent developments with generative AI. Consensus is noted around eight normative themes for principles for responsible AI and their associated risks. A framework from Shneiderman (2022) for human-centered AI is employed to consider journal publishing practices that can address the principles of responsible AI at different levels. The resultant AI principled governance matrix (AI-PGM) for journal publishing shows how countermeasures for risks can be employed at the levels of the author-researcher team, the organization, the industry, and by government regulation. The AI-PGM allows a structured approach to responsible AI and may be modified as developments with AI unfold. It shows how the whole publishing ecosystem should be considered when looking at the responsible use of AI—not jus…

DOI: 10.17705/1jais.00863

Open source ↗

semantic_scholar

Semantic Scholar retrieval failed (rate_limit).

semantic_scholar unavailable

Semantic Scholar retrieval failed (rate_limit).

Judge/Synthesizer details

Final Research Answer

State a research question from the document

How can research questions be effectively extracted, detected, or generated from scientific articles that often lack clearly defined research questions?

The retrieved literature indicates a recognized gap in the consistent formulation and explicit declaration of research questions (RQs) in scientific articles. Multiple studies highlight challenges in identifying study objectives within manuscripts and propose methodological solutions. One paper directly addresses this by proposing a framework for extracting, detecting, and generating RQs from scientific texts, noting many studies lack proper RQ definition [C550]. Other works discuss frameworks like PICO for formulating strong RQs [C546], emphasize their role in directing study design [C548], and explore automated methods to identify hypotheses and new knowledge in literature [C547]. This supports a research focus on improving RQ identification and generation to enhance scholarly communication and literature synthesis.

Confidence: 85/100

The synthesizer's estimate, not a statistical probability. Evidence strength is shown for each finding.

Key Findings

Moderate evidence

Many academic articles lack clearly defined research questions.

Paper C550 explicitly states that 'many academic studies lack a proper definition of RQs in their articles,' forming the basis for their proposed extraction and generation framework.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: moderate. Judge-declared strength: moderate.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C550] Extracting, Detecting, and Generating Research Questions for Scientific Articles · · 2025 Open source

Moderate evidence

Frameworks exist for formulating effective research questions, but their application is not universal.

C546 reviews the PICO framework and its adaptations across study designs, while C548 discusses best practices for writing RQs, implying variability in current practice.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: moderate. Judge-declared strength: moderate.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C546] Formulating Research Questions for Evidence-Based Studies · Journal of Medicine, Surgery, and Public Health · 2023 · DOI: 10.1016/j.glmedi.2023.100046 Open source

[C548] A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles · Journal of Korean Medical Science · 2022 · DOI: 10.3346/jkms.2022.37.e121 Open source

Limited evidence

Automated methods are being developed to identify research components like hypotheses and new knowledge in scientific text.

C547 demonstrates a supervised text-mining approach to extract 'Research Hypothesis' and 'New Knowledge' with high accuracy in biomedical corpora, suggesting feasibility for similar RQ detection tasks.

Support review: weak_support

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: limited. Judge-declared strength: limited.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C547] Identification of research hypotheses and new knowledge from scientific literature · BMC Medical Informatics and Decision Making · 2018 · DOI: 10.1186/s12911-018-0639-1 Open source

Moderate evidence

AI tools are increasingly involved in scholarly writing and peer review, raising transparency concerns.

C545 emphasizes the need for declaring generative AI use in academic writing, and C549 evaluates LLMs as peer reviewers, highlighting impacts on manuscript evaluation integrity.

Support review: academically_supported

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: moderate. Judge-declared strength: moderate.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C545] The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing. · Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing · 2023 · DOI: 10.1111/jnu.12938 Open source

[C549] Large language models for peer review in biotechnology. · New biotechnology · 2026 · DOI: 10.1016/j.nbt.2026.03.007 Open source

Limited evidence

Automation of systematic literature reviews remains partial, with gaps in planning and reporting phases.

C543 notes that while study selection is commonly automated, no studies were found automating the planning and reporting stages of SLRs, where RQ formulation occurs.

Support review: weak_support

Diagnostic source association and simple English word overlap only; not verification of truth, study quality or entailment.

Diagnostic evidence strength: limited. Judge-declared strength: limited.

Supporting sources selected by synthesizer

A source association is not proof that the source supports this claim. Review the source text and its limitations.

[C543] Automation of systematic literature reviews: A systematic literature review · Inf. Softw. Technol. · 2021 · DOI: 10.1016/j.infsof.2021.106589 Open source

Sources

  1. [C543] Automation of systematic literature reviews: A systematic literature review

    Inf. Softw. Technol. · 2021

    DOI: 10.1016/j.infsof.2021.106589

    Open source ↗
  2. [C544] Literature review as a research methodology: An overview and guidelines

    Journal of Business Research · 2019

    DOI: 10.1016/j.jbusres.2019.07.039

    Open source ↗
  3. [C545] The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing.

    Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing · 2023

    DOI: 10.1111/jnu.12938

    Open source ↗
  4. [C546] Formulating Research Questions for Evidence-Based Studies

    Journal of Medicine, Surgery, and Public Health · 2023

    DOI: 10.1016/j.glmedi.2023.100046

    Open source ↗
  5. [C547] Identification of research hypotheses and new knowledge from scientific literature

    BMC Medical Informatics and Decision Making · 2018

    DOI: 10.1186/s12911-018-0639-1

    Open source ↗
  6. [C548] A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

    Journal of Korean Medical Science · 2022

    DOI: 10.3346/jkms.2022.37.e121

    Open source ↗
  7. [C549] Large language models for peer review in biotechnology.

    New biotechnology · 2026

    DOI: 10.1016/j.nbt.2026.03.007

    Open source ↗
  8. [C550] Extracting, Detecting, and Generating Research Questions for Scientific Articles

    · 2025

    Open source ↗

Agreements / Disagreements

Agreement between AI models is not independent verification.

No disagreements were reported by the synthesizer.

Limitations

  • No single document provides a definitive research question; the question is synthesized from multiple sources addressing related gaps.
  • Most evidence comes from methodology-focused reviews or theoretical/computational studies rather than empirical investigations of RQ prevalence across disciplines.
  • The document set lacks field-specific analyses outside biomedicine, nursing, and software engineering, limiting generalizability.
  • Several highly relevant papers (e.g., C550, C549) are very recent or forthcoming (2025–2026), so their long-term validity and methodological robustness are not yet established.
  • The absence of studies on automated RQ generation in certain fields may reflect a true gap or merely retrieval limitations, as noted by the system’s warning about incomplete retrieval.

Recommended interpretation

The strongest candidate research question emerges from C550, which directly tackles the problem of missing or unclear RQs in scientific literature through computational methods. Supporting evidence from C546, C547, and C548 confirms the recognized importance and methodological complexity of research question formulation and identification.

Evidence preparation details

Priority scores organize the context; they do not decide the answer.

C543 · Priority

C544 · Priority

C545 · Priority

C546 · Priority

C547 · Priority

C548 · Priority

C549 · Priority

C550 · Priority

Omitted papers: 17. Omitted agents: .

Retry controls

State a research question from the document

Stage: PARTIAL

Partial research available. Review failures below; retry controls are available.

Latest Planner 2 — Llama 4 Scout attempt failed: OpenRouter rate-limited this request. Please try again later. Any earlier successful result remains active.

Latest semantic_scholar attempt failed: Semantic Scholar retrieval failed (rate_limit). Any earlier successful result remains active.

Retries make new API requests and may incur charges. Provider retries preserve the accepted answer; re-run synthesis afterward to incorporate changed evidence.

Provider attempt history (5)

Active means the latest successful attempt. A newer failure does not replace it.

#154 · semantic_scholar · academic-graph-search · Oct. 2, 2026, 4:10 p.m. · Latest · Failed

Semantic Scholar retrieval failed (rate_limit).

This attempt is displayed in the semantic_scholar results above.

#153 · consensus · search-v1 · Oct. 2, 2026, 4:10 p.m. · Latest · Active · Succeeded

This attempt is displayed in the consensus results above.

#152 · Planner 3 — Qwen3.5-27B · qwen/qwen3.5-27b · Oct. 2, 2026, 4:09 p.m. · Latest · Active · Succeeded

This attempt is displayed in the Planner 3 — Qwen3.5-27B results above.

#151 · Planner 2 — Llama 4 Scout · meta-llama/llama-4-scout · Oct. 2, 2026, 4:07 p.m. · Latest · Failed

OpenRouter rate-limited this request. Please try again later.

This attempt is displayed in the Planner 2 — Llama 4 Scout results above.

#150 · Planner 1 — Gemini 3.5 Flash · google/gemini-3.5-flash · Oct. 2, 2026, 4:07 p.m. · Latest · Active · Succeeded

This attempt is displayed in the Planner 1 — Gemini 3.5 Flash results above.

Synthesis history (1)
#30 · qwen/qwen3-max · Oct. 2, 2026, 4:10 p.m. · Succeeded · Latest · Active / latest accepted

Model: qwen/qwen3-max · Latency: 16129 ms · Estimated cost: 0.0084294600 USD

Input tokens: 5947 · Output tokens: 972

How can research questions be effectively extracted, detected, or generated from scientific articles that often lack clearly defined research questions?

Rejected source IDs: None recorded

Confidence: 85.0

The retrieved literature indicates a recognized gap in the consistent formulation and explicit declaration of research questions (RQs) in scientific articles. Multiple studies highlight challenges in identifying study objectives within manuscripts and propose methodological solutions. One paper directly addresses this by proposing a framework for extracting, detecting, and generating RQs from scientific texts, noting many studies lack proper RQ definition [C550]. Other works discuss frameworks like PICO for formulating strong RQs [C546], emphasize their role in directing study design [C548], and explore automated methods to identify hypotheses and new knowledge in literature [C547]. This supports a research focus on improving RQ identification and generation to enhance scholarly communication and literature synthesis.

Many academic articles lack clearly defined research questions. · moderate

Paper C550 explicitly states that 'many academic studies lack a proper definition of RQs in their articles,' forming the basis for their proposed extraction and generation framework.

Supporting sources selected by synthesizer: C550

Frameworks exist for formulating effective research questions, but their application is not universal. · moderate

C546 reviews the PICO framework and its adaptations across study designs, while C548 discusses best practices for writing RQs, implying variability in current practice.

Supporting sources selected by synthesizer: C546, C548

Automated methods are being developed to identify research components like hypotheses and new knowledge in scientific text. · limited

C547 demonstrates a supervised text-mining approach to extract 'Research Hypothesis' and 'New Knowledge' with high accuracy in biomedical corpora, suggesting feasibility for similar RQ detection tasks.

Supporting sources selected by synthesizer: C547

AI tools are increasingly involved in scholarly writing and peer review, raising transparency concerns. · moderate

C545 emphasizes the need for declaring generative AI use in academic writing, and C549 evaluates LLMs as peer reviewers, highlighting impacts on manuscript evaluation integrity.

Supporting sources selected by synthesizer: C545, C549

Automation of systematic literature reviews remains partial, with gaps in planning and reporting phases. · limited

C543 notes that while study selection is commonly automated, no studies were found automating the planning and reporting stages of SLRs, where RQ formulation occurs.

Supporting sources selected by synthesizer: C543

[C543] Automation of systematic literature reviews: A systematic literature review · Inf. Softw. Technol. Open source

[C544] Literature review as a research methodology: An overview and guidelines · Journal of Business Research Open source

[C545] The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing. · Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing Open source

[C546] Formulating Research Questions for Evidence-Based Studies · Journal of Medicine, Surgery, and Public Health Open source

[C547] Identification of research hypotheses and new knowledge from scientific literature · BMC Medical Informatics and Decision Making Open source

[C548] A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles · Journal of Korean Medical Science Open source

[C549] Large language models for peer review in biotechnology. · New biotechnology Open source

[C550] Extracting, Detecting, and Generating Research Questions for Scientific Articles · Open source

Agreements:

Disagreements:

Limitations: No single document provides a definitive research question; the question is synthesized from multiple sources addressing related gaps.; Most evidence comes from methodology-focused reviews or theoretical/computational studies rather than empirical investigations of RQ prevalence across disciplines.; The document set lacks field-specific analyses outside biomedicine, nursing, and software engineering, limiting generalizability.; Several highly relevant papers (e.g., C550, C549) are very recent or forthcoming (2025–2026), so their long-term validity and methodological robustness are not yet established.; The absence of studies on automated RQ generation in certain fields may reflect a true gap or merely retrieval limitations, as noted by the system’s warning about incomplete retrieval.

The strongest candidate research question emerges from C550, which directly tackles the problem of missing or unclear RQs in scientific literature through computational methods. Supporting evidence from C546, C547, and C548 confirms the recognized importance and methodological complexity of research question formulation and identification.

Developer evaluation (manual)

Ratings do not affect synthesis. Rate the active answer and evidence you reviewed.

Developer diagnostics

Balanced primary: qwen/qwen3-max. Fallback: openai/o4-mini.

Fallback triggered: No. Reason: None. Accepted synthesizer: qwen/qwen3-max.

Synthesis routing latency: 16129 ms. Total routing cost (USD): 0.0084294600.

Plan-and-Solve diagnostics

Generated queries: 7; retrieval queries: 5; duplicates removed: 0; unique papers: 25.

semantic_scholar: 1 requests; 0 results; 1 failed requests.

consensus: 5 requests; 25 results; 0 failed requests.

Normalized ResearchPlan
original_question
State a research question from the document
canonical_search_queries
['generative AI academic writing standards', 'identifying research questions in academic papers', 'large language models peer review integrity', 'extracting research objectives from literature', 'artificial intelligence scholarly publishing ethics']
keywords
['generative AI', 'academic writing', 'peer review', 'scholarly publishing', 'research question', 'academic document', 'study objective', 'literature analysis']
synonyms
['large language models', 'scientific writing', 'manuscript evaluation', 'academic journals', 'research aim', 'hypothesis', 'inquiry', 'manuscript', 'article']
research_subquestions
['How does the integration of large language models in the manuscript drafting phase affect the overall quality and reliability of published scientific literature?', 'How are research questions typically formulated in academic documents?', 'What methods exist for identifying study objectives in literature?']
candidate_gap_hypotheses
['Long-term effects of AI reliance on the critical thinking and writing development of early-career researchers.', 'Automated extraction of research questions from unstructured text', 'Standardization of research question placement in manuscripts']
uncertainties
['The ultimate reliability and false positive rates of AI-generated text detectors in editorial workflows.', 'Specific document content unavailable', 'Field of study unspecified', 'Document type undefined']
filters
{'suggestions': [{'year_from': 2020, 'year_to': 2024, 'fields': ['Education', 'Computer Science', 'Social Sciences'], 'study_types': ['Empirical Study', 'Literature Review', 'Case Study']}, {'fields': ['methodology', 'education', 'information science'], 'study_types': ['review', 'guideline', 'methodological study'], 'year_from': 2018, 'year_to': 2023}], 'policy': 'Advisory only; configured provider filters apply.'}
generated_query_count
7
successful_planners
2

Retrieval is incomplete; absence of results is not proof of absence.

Provider counts describe latest attempts; evidence and answer metrics describe active results. Duration and costs include all attempts, including retries. Cost is USD, OpenRouter only; Consensus billing is not estimated. Unknown is not zero.

total_duration_ms
176806
interrupted_execution_metrics_incomplete
False
successful_providers
3
failed_providers
2
successful_agents
2
consensus_success
True
synthesis_success
True
paper_count
25
total_estimated_openrouter_cost
Unknown / not applicable
known_cost_subtotal
0.0315534600
attempts_missing_cost
1
valid_source_percent
100.0
removed_source_ids
0
agreements_count
0
disagreements_count
0
evidence_strength_distribution
{'moderate': 3, 'limited': 2}
judge_confidence
85.0
answer_length
152
Attempt / modelSuccessLatency msInput / output / total tokensCost USDError
#154 academic-graph-searchNo673? / ? / ?Unknown rate_limit: Semantic Scholar retrieval failed (rate_limit).
#153 search-v1Yes31432? / ? / ?Unknown :
#152 qwen/qwen3.5-27bYes108944330 / 2595 / 29250.0052725000 reported:
#151 meta-llama/llama-4-scoutNo847? / ? / ?Unknown rate_limit: OpenRouter rate-limited this request. Please try again later.
#150 google/gemini-3.5-flashYes185121185 / 1786 / 29710.0178515000 reported:
#30 qwen/qwen3-maxYes161295947 / 972 / 69190.0084294600 reported:

Judge: qwen/qwen3-max. Papers used: 8. Papers omitted by limit: 17.

Rejected source IDs: None recorded

RESEARCH QUESTION

Need to make a research question

Oct 2, 2026 · 16:18 PARTIAL

30-SECOND VIEW

Final Research Answer

Final synthesis unavailable. Collected research is still available.

Partial research available

Synthesis could not complete

The synthesizer reached its output limit before completing the structured answer.

Reason: truncated_response

Review and re-run synthesis

Planner 2 — Llama 4 Scout: OpenRouter rate-limited this request. Please try again later. Retry

semantic_scholar: Semantic Scholar retrieval failed (rate_limit). Retry

Overall confidenceNot assessedSynthesizer confidence estimate
Evidence strengthNot assessedLowest reported finding strength; conflicts take precedence
Academic papers23 papers
AI agents2/3 successfulActive saved responses
ConsensusAvailable
Semantic ScholarUnavailable

2-MINUTE VIEW

Key Findings

No individual findings are available yet.

Evidence Overview

20 valid sources · 0 conflicting findings · 0 disagreements · 23 papers reviewed

The metrics above describe saved evidence. Source associations and agreement between models are not independent verification.

Best Academic Evidence

Saved synthesis ranking where available; otherwise Consensus order. Retrieved papers are not automatically proof of a claim.

Consensus

A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking

T. Balart, Brayan Díaz, Kristi J. Shryock · 2026 · Algorithms

Critical Thinking (CT) is recognized as a foundational competency for professional readiness, innovation, and ethical reasoning in higher education, enabling students to analyze information, evaluate evidence, and make reasoned decisions in complex environments. The rapid integration of Generative …

Read paper details

T. Balart, Brayan Díaz, Kristi J. Shryock

Critical Thinking (CT) is recognized as a foundational competency for professional readiness, innovation, and ethical reasoning in higher education, enabling students to analyze information, evaluate evidence, and make reasoned decisions in complex environments. The rapid integration of Generative Artificial Intelligence (GenAI) tools, such as large language models, presents new opportunities and risks for CT development. This study conducts a systematic literature review to synthesize empirical evidence on the pedagogical implications and cognitive impact of GenAI on students’ CT. Following PRISMA guidelines, and search terms around GenAI Tools, Critical Thinking And Higher Education, on five major education research databases—Web of Science; Scopus; EBSCOhost (Education Source, ERIC, and APA PsycInfo); and Compendex and Inspec (Elsevier)—63 empirical studies published between January 2023 and April 2025 were analyzed across higher education contexts, disciplines, and intervention designs. Results indicate that GenAI offers notable cognitive affordances, including scaffolding reflective reasoning, promoting self-regulation, and facilitating iterative dialogue and argument evaluation. Pedagogical strategies clustered into four primary integration typologies: AI-based feedback prompts, dialogue simulation and reflection, AI-supported peer review, and critical engagement with AI-generated content. Nearly half of the studies reported statistically significant CT improvements, particularly when GenAI use was guided by structured prompts, reflective activities, and performance-based assessment. However, multiple risks persist, including cognitive offloading, uncritical acceptance of AI outputs, and diminished intellectual autonomy, especially in unguided or surface-level usage. This review highlights the need for intentional pedagogical design, validated CT assessment tools, and longitudinal studies to ensure GenAI acts as a catalyst rather than a substitute for human reasoning. By identifying effective integration strategies and outlining potential pitfalls, this study provides evidence-informed guidance for educators and institutions aiming to responsibly leverage GenAI to strengthen students’ CT skills.

DOI: 10.3390/a19030179

Open source ↗
Consensus

Generative AI in Higher Education: Balancing Innovation and Integrity

Nigel J. Francis, Sue Jones, David P. Smith · 2025 · British Journal of Biomedical Science

Generative Artificial Intelligence (GenAI) is rapidly transforming the landscape of higher education, offering novel opportunities for personalised learning and innovative assessment methods. This paper explores the dual-edged nature of GenAI's integration into educational practices, focusing on bo…

Read paper details

Nigel J. Francis, Sue Jones, David P. Smith

Generative Artificial Intelligence (GenAI) is rapidly transforming the landscape of higher education, offering novel opportunities for personalised learning and innovative assessment methods. This paper explores the dual-edged nature of GenAI's integration into educational practices, focusing on both its potential to enhance student engagement and learning outcomes and the significant challenges it poses to academic integrity and equity. Through a comprehensive review of current literature, we examine the implications of GenAI on assessment practices, highlighting the need for robust ethical frameworks to guide its use. Our analysis is framed within pedagogical theories, including social constructivism and competency-based learning, highlighting the importance of balancing human expertise and AI capabilities. We also address broader ethical concerns associated with GenAI, such as the risks of bias, the digital divide, and the environmental impact of AI technologies. This paper argues that while GenAI can provide substantial benefits in terms of automation and efficiency, its integration must be managed with care to avoid undermining the authenticity of student work and exacerbating existing inequalities. Finally, we propose a set of recommendations for educational institutions, including developing GenAI literacy programmes, revising assessment designs to incorporate critical thinking and creativity, and establishing transparent policies that ensure fairness and accountability in GenAI use. By fostering a responsible approach to GenAI, higher education can harness its potential while safeguarding the core values of academic integrity and inclusive education. Copyright © 2025 Francis, Jones and Smith.

DOI: 10.3389/bjbs.2024.14048

Open source ↗
Consensus

Formulating the Research Question and Framing the Hypothesis

L. D. Willis · 2023 · Respiratory Care

An understanding of the research process is an essential skill for designing a study and developing the research protocol. Poor study design can lead to fatal flaws in research methodology, ultimately resulting in rejection for publication or limiting the reliability of the results. Following the s…

Read paper details

L. D. Willis

An understanding of the research process is an essential skill for designing a study and developing the research protocol. Poor study design can lead to fatal flaws in research methodology, ultimately resulting in rejection for publication or limiting the reliability of the results. Following the steps of the research process and devising the research question and hypothesis prior to study initiation can avoid common problems encountered with research questions and study design. Formulating the research question is the first step in the research process and provides the foundation for framing the hypothesis. Research questions should be feasible, interesting, novel, ethical, and relevant (FINER). Application of the FINER criteria can assist with ensuring the question is valid and will generate new knowledge that has clinical impact. Utilization of the population, intervention, comparison, and outcome (PICO) format helps to structure the question as well as refine and narrow the focus from a broad topic. The hypothesis is derived from the research question and is used to determine the experiments or interventions that will answer the question. This aim of this paper is to provide guidance for developing research questions and forming a testable hypothesis through application of the FINER criteria and the PICO process. Copyright © 2023 by Daedalus Enterprises.

DOI: 10.4187/respcare.10975

Open source ↗
View all papers (23)Consensus

Mapping the use of artificial intelligence in medical education: a scoping review

Erwin Hernando Hernández Rincón, Daniel Jiménez, Lizeth Alexandra Chavarro Aguilar, J. Flórez, Á. T… · 2025 · BMC Medical Education

Introduction: The integration of artificial intelligence (AI) in healthcare has transformed clinical practices and medical education, with technologies like diagnostic algorithms and clinical decision support increasingly incorporated into curricula. However, there is still a gap in preparing futur…

Read paper details

Erwin Hernando Hernández Rincón, Daniel Jiménez, Lizeth Alexandra Chavarro Aguilar, J. Flórez, Á. Tapia, Claudia Liliana Jaimes Peñuela

Introduction: The integration of artificial intelligence (AI) in healthcare has transformed clinical practices and medical education, with technologies like diagnostic algorithms and clinical decision support increasingly incorporated into curricula. However, there is still a gap in preparing future physicians to use these technologies effectively and ethically. Objective: This scoping review maps the integration of artificial intelligence (AI) in undergraduate medical education (UME), focusing on curriculum development, student competency enhancement, and institutional barriers to AI adoption. Materials and methods: A comprehensive search in PubMed, Scopus, and BIREME included articles from 2019 onwards, limited to English and Spanish publications on AI in UME. Exclusions applied to studies focused on postgraduate education or non-medical fields. Data were analyzed using thematic analysis to identify patterns in AI curriculum development and implementation. Results: A total of 34 studies were reviewed, representing diverse regions and methodologies, including cross-sectional studies, narrative reviews, and intervention studies. Findings revealed a lack of standardized AI curriculum frameworks and notable global discrepancies. Key elements such as ethical training, collaborative learning, and digital competence were identified as essential, with an emphasis on transversal skills that support AI as a tool rather than a standalone subject. Conclusions: This review underscores the need for a standardized, adaptable AI curriculum in UME that prioritizes transversal skills, including digital competence and ethical awareness, to support AI's gradual integration. Embedding AI as a practical tool within interdisciplinary, patient-centered frameworks fosters a balanced approach to technology in healthcare. Further regional research is recommended to develop frameworks that align with cultural and educational needs, ensuring AI integration in UME promotes both technical and ethical competencies. © 2025. The Author(s).

DOI: 10.1186/s12909-025-07089-8

Open source ↗
Consensus

Generative AI and the future of higher education: a threat to academic integrity or reformation? Evidence from multicultural perspectives

Abdullahi Yusuf, Nasrin Pervin, Marcos Román-González · 2024 · International Journal of Educational Technology in Higher Education

In recent years, higher education (HE) globally has witnessed extensive adoption of technology, particularly in teaching and research. The emergence of generative Artificial Intelligence (GenAI) further accelerates this trend. However, the increasing sophistication of GenAI tools has raised concern…

Read paper details

Abdullahi Yusuf, Nasrin Pervin, Marcos Román-González

In recent years, higher education (HE) globally has witnessed extensive adoption of technology, particularly in teaching and research. The emergence of generative Artificial Intelligence (GenAI) further accelerates this trend. However, the increasing sophistication of GenAI tools has raised concerns about their potential to automate teaching and research processes. Despite widespread research on GenAI in various fields, there is a lack of multicultural perspectives on its impact and concerns in HE. This study addresses this gap by examining the usage, benefits, and concerns of GenAI in higher education from a multicultural standpoint. We employed an online survey that collected responses from 1217 participants across 76 countries, encompassing a broad range of gender categories, academic disciplines, geographical locations, and cultural orientations. Our findings revealed a high level of awareness and familiarity with GenAI tools among respondents. A significant portion had prior experience and expressed the intention to continue using these tools, primarily for information retrieval and text paraphrasing. The study emphasizes the importance of GenAI integration in higher education, highlighting both its potential benefits and concerns. Notably, there is a strong correlation between cultural dimensions and respondents’ views on the benefits and concerns related to GenAI, including its potential as academic dishonesty and the need for ethical guidelines. We, therefore, argued that responsible use of GenAI tools can enhance learning processes, but addressing concerns may require robust policies that are responsive to cultural expectations. We discussed the findings and offered recommendations for researchers, educators, and policymakers, aiming to promote the ethical and effective integration of GenAI tools in higher education.

DOI: 10.1186/s41239-024-00453-6

Open source ↗
Consensus

The choice between research question and hypothesis for paradigm harmony

A. Tasci, Wei Wei, A. Milman · 2025 · Journal of Hospitality and Tourism Horizons

PurposeThe purpose of this viewpoint is to distinguish between the roles of research questions and hypotheses in different paradigms of research and guide future research for the proper use of these research elements to avoid paradigmatic contradiction and achieve paradigmatic harmony.Design/method…

Read paper details

A. Tasci, Wei Wei, A. Milman

PurposeThe purpose of this viewpoint is to distinguish between the roles of research questions and hypotheses in different paradigms of research and guide future research for the proper use of these research elements to avoid paradigmatic contradiction and achieve paradigmatic harmony.Design/methodology/approachRecent tourism and hospitality journal publications using both research questions and hypotheses were acquired through convenience sampling on Google Scholar. These articles were analyzed to identify their paradigms based on the methodology described and to conclude if the use of both research questions and hypotheses was leading to paradigm contradiction or harmony.FindingsMany studies published in tourism and hospitality journals use both research questions and hypotheses while they are purely positivist research that needs to be guided by only research hypotheses. Examples are provided to guide future research for the proper use of research questions and hypotheses to avoid paradigmatic contradiction and achieve paradigmatic harmony.Originality/valueEven though the use of both research questions and hypotheses in purely positivist research is a pervasive issue in scientific research, a clarifying argument on the proper uses of research questions and hypotheses together in scientific research has not been provided so far. This viewpoint is intended to guide researchers in the proper use of these research elements for paradigm harmony.

DOI: 10.1108/jhth-01-2025-0013

Open source ↗
Consensus

The impact of generative AI on academic integrity of authentic assessments within a higher education context

Alexander K. Kofinas, C. Tsay, D. Pike · 2025 · Br. J. Educ. Technol.

Generative AI (hereinafter GenAI) technology, such as ChatGPT, is already influencing the higher education sector. In this work, we focused on the impact of GenAI on the academic integrity of assessments within higher education institutions, as GenAI can be used to circumvent assessment approaches …

Read paper details

Alexander K. Kofinas, C. Tsay, D. Pike

Generative AI (hereinafter GenAI) technology, such as ChatGPT, is already influencing the higher education sector. In this work, we focused on the impact of GenAI on the academic integrity of assessments within higher education institutions, as GenAI can be used to circumvent assessment approaches within the sector, compromising their quality. The purpose of our research was threefold: first, to determine the extent to which the use of GenAI can be detected via the marking and moderation process; second, to understand whether the presence of GenAI affects the marking process; and finally, to establish whether authentic assessments can safeguard academic integrity. We used a series of experiments in the context of two UK‐based universities to examine these issues. Our findings indicate that markers, in general, are not able to distinguish assessments that have had GenAI input from assessments that did not, even though the presence of GenAI affects the way markers approach the marking process. Our findings also suggest that the level of authenticity in an assessment has no impact on the ability to safeguard against or detect GenAI usage in assessment creation. In conclusion, we suggest that current approaches to assessments in higher education are susceptible to GenAI manipulation and that the higher education sector cannot rely on authentic assessments alone to control the impact of GenAI on academic integrity. Thus, we recommend giving more critical attention to assessment design and placing more emphasis on assessments that rely on social experiential learning and are performative rather than output‐based and asynchronously written. What is already known about this topic GenAI has enabled students to complete higher education assessments quickly and with good quality, leading to challenges in academic integrity. GenAI has transformed the requirements and considerations in assessment design in higher education. Authentic assessments are seen as a prominent way to tackle the GenAI challenge. What this paper adds We provide quantitative and qualitative experimental evidence suggesting that GenAI can generate authentic assessments that pass the scrutiny of experienced academics. We demonstrate how the use of authentic assessments alone does not protect the academic integrity of students in higher education. Our qualitative analysis indicates that markers may generate false positive and false negative results if they suspect GenAI tampering in an assessment. Thus, students' learning is not assessed correctly. Implications for practice and/or policy When universities and national organisations design policies regarding GenAI, authentic assessments are not the panacea; the focus must remain on assessment design. Assessments of learning need to shift from assessing output to focusing on process and relevance to the workplace. That would mean a paradigmatic shift from written assessments to synchronous interpersonal assessments. The move away from written assessments has implications that are far reaching for the academy if written assessments cannot be trusted as a reliable indicator for and of learning.

DOI: 10.1111/bjet.13585

Open source ↗
Consensus

Formulating Research Questions for Evidence-Based Studies

Mohammad-Salar Hosseini, F. Jahanshahlou, M. Akbarzadeh, Mahdi Zarei, Y. Vaez-Gharamaleki · 2023 · Journal of Medicine, Surgery, and Public Health

Formulating a research question is a crucial step in directing any scientific study. The classical evidence-based approach to formulating a question uses the PICO framework, consisting of population, intervention, comparison, and outcome. However, the PICO framework is not suitable for formulating …

Read paper details

Mohammad-Salar Hosseini, F. Jahanshahlou, M. Akbarzadeh, Mahdi Zarei, Y. Vaez-Gharamaleki

Formulating a research question is a crucial step in directing any scientific study. The classical evidence-based approach to formulating a question uses the PICO framework, consisting of population, intervention, comparison, and outcome. However, the PICO framework is not suitable for formulating research questions in some types of evidence and studies. This paper reviews and summarizes different frameworks introduced for formulating research questions over time. For this purpose, we explore the complete application of the PICO framework, clarifying its flexibility and subtleties for various research designs. Also, this review navigates the complexities of creating research questions, clarifying the minor variations needed within the PICO framework for various study designs through a thorough analysis and synthesis of the existing literature. Clarifying these customized strategies is intended to assist researchers, physicians, and scholars in appropriately formulating questions, improving the strength and relevance of research findings throughout the scientific investigation spectrum.Top of Form

DOI: 10.1016/j.glmedi.2023.100046

Open source ↗
Consensus

Back to the basics: guidance for formulating good research questions

J. Covvey, Chyna McClendon, M. Gionfriddo · 2023 · Research in social & administrative pharmacy : RSAP

Good science is driven by rigorous questions. Much like the foundation of a house, a research question must be carefully constructed to prevent downstream problems in project execution. And yet, pharmacy researchers and scholars across all career stages may find themselves struggling when developin…

Read paper details

J. Covvey, Chyna McClendon, M. Gionfriddo

Good science is driven by rigorous questions. Much like the foundation of a house, a research question must be carefully constructed to prevent downstream problems in project execution. And yet, pharmacy researchers and scholars across all career stages may find themselves struggling when developing research questions. The purpose of this commentary is to provide useful guidance on composing and evaluating rigorous research questions. A variety of frameworks, such as PICO (Patient/population; Intervention; Comparison; Outcome), are available to researchers and can assist them in ensuring that their research question has covered all relevant components. Additionally, the FINER (Feasible; Interesting; Novel; Ethical; and Relevant) criteria can help researchers with evaluating their research questions for practical considerations. Finally, building awareness of common pitfalls when composing research questions can aid researchers to avoid issues that they may not otherwise discover until their manuscript undergoes peer review. Copyright © 2023 Elsevier Inc. All rights reserved.

DOI: 10.1016/j.sapharm.2023.09.009

Open source ↗
Consensus

Developing a hypothesis and research question

B. Kolb · 2021 · Absolute Essentials of Marketing Research

A hypothesis is an assumption on the cause of an organization’s marketing problem. Aclearly written research question states what needs to be learned to solve the problem. Conducting successful cross-cultural research may require a different methodology and translation of all research materials. Th…

Read paper details

B. Kolb

A hypothesis is an assumption on the cause of an organization’s marketing problem. Aclearly written research question states what needs to be learned to solve the problem. Conducting successful cross-cultural research may require a different methodology and translation of all research materials. The research proposal explains to both researchers and managers how the research will be conducted

DOI: 10.4324/9781003165194-3

Open source ↗
Consensus

ChatGPT as an AI Assistant Tool to Enhance University Students’ Teaching, Assessment and Academic Achievements: A Case Study of an EAP Lecturer

N. S. Eljack, Neven A. Altahir, Nazzik I. M. Mohammed, Shahinaz Osman · 2025 · Journal of Language Teaching and Research

This study investigates the potential role of ChatGPT as an instructional assistant to support an English for Academic Purposes (EAP) lecturer in delivering an English for Architecture Design (EAD) course. It also examines ChatGPT's usefulness in student assessment and its impact on enhancing acade…

Read paper details

N. S. Eljack, Neven A. Altahir, Nazzik I. M. Mohammed, Shahinaz Osman

This study investigates the potential role of ChatGPT as an instructional assistant to support an English for Academic Purposes (EAP) lecturer in delivering an English for Architecture Design (EAD) course. It also examines ChatGPT's usefulness in student assessment and its impact on enhancing academic achievements. Out of a population of 92 students, 81 were able to join a Telegram group for course participation. Three data collection methods were employed: prompt crafting, an open quiz, and a final exam. Data was analyzed through descriptive and thematic analysis, statistical analysis, and manual grading. Results indicated that ChatGPT significantly supported the EAP lecturer in teaching methods, quiz and exam design, and enhancing students’ learning outcomes. Recommendations are put forth to both students and educators to develop two essential skills of prompt crafting and critical thinking when integrating ChatGPT into academic settings. Exploring ChatGPT teaching potential, sharing findings with colleagues, and continuously contrasting outcomes with emerging research would open the door to larger future studies.

DOI: 10.17507/jltr.1606.03

Open source ↗
Consensus

ChatGPT’s impact on student learning outcomes: a meta-analysis of 35 experimental studies

Xinning Wu, Peixia Zhu, Jin-Liang Zhang, Mengwei Yin, Yingxi Wang · 2026 · Humanities and Social Sciences Communications

With the rapid advancement of generative artificial intelligence (GenAI) technology, the potential educational applications of Chat generative pre-trained transformers (ChatGPT) have attracted significant attention. However, the research on the specific effects of ChatGPT on student learning outcom…

Read paper details

Xinning Wu, Peixia Zhu, Jin-Liang Zhang, Mengwei Yin, Yingxi Wang

With the rapid advancement of generative artificial intelligence (GenAI) technology, the potential educational applications of Chat generative pre-trained transformers (ChatGPT) have attracted significant attention. However, the research on the specific effects of ChatGPT on student learning outcomes and its moderating factors remains insufficient. This study aimed to quantify the effects of ChatGPT on student learning outcomes and explore relevant moderating variables using a meta-analysis approach. The analysis included 35 studies published between 2022 and 2024, involving 4193 participants. The results indicated a moderately positive effect of ChatGPT on student learning outcomes (g = 0.670), significantly enhancing both cognitive and non-cognitive skills. In the analysis of moderating variables, the subject, experimental duration, and instructional mode had significant positive effects on student learning outcomes, whereas educational level and knowledge type did not show significant effects. Additionally, the publication bias test revealed no significant publication bias. This meta-analysis confirmed the effectiveness of ChatGPT in improving student learning outcomes and highlighted the roles of the subjects, experimental duration, and instructional mode as key moderating factors. Despite the risks of sample selection bias and limitations in fully covering the multidimensional moderating factors and higher-order thinking, the findings provided important empirical support for applying ChatGPT in education. Future research should investigate the mechanisms behind the impact of ChatGPT and consider a wider range of moderating factors to thoroughly evaluate its long-term effects on student learning outcomes.

DOI: 10.1057/s41599-026-07019-z

Open source ↗
Consensus

Evaluating the impact of AI on the critical thinking skills among the higher education students by combining the TAM model and critical thinking theory

Patni Ninghardjanti, M. C. Umam, Anton Subarno, Winarno Winarno, Novedi Risanti Langgi, Jumiyanto W… · 2025 · Frontiers in Education

The following research analyzes the relation between the utilization of Artificial Intelligence (AI) tools among university students and their relation with critical thinking skills by combining the Technology Acceptance Model (TAM) model and critical thinking theory. This research introduced t…

Read paper details

Patni Ninghardjanti, M. C. Umam, Anton Subarno, Winarno Winarno, Novedi Risanti Langgi, Jumiyanto Widodo

The following research analyzes the relation between the utilization of Artificial Intelligence (AI) tools among university students and their relation with critical thinking skills by combining the Technology Acceptance Model (TAM) model and critical thinking theory. This research introduced the Metacognitive TAM (Meta-TAM) integrated with the Information Systems (IS) Success model as a theoretical innovation. The current research was carried out with a quantitative method approach, with 200 respondents from the Office Administration Education Department, Universitas Sebelas Maret, Indonesia. The research data were analyzed using the SEM with SmartPLS 4.0 software. The key constructs of attitude toward use (ATU), motivation to use (MTU), perceived usefulness (PU), perceived ease of use (PEOU), and behavioral intention (BI) were analyzed to assess the primary factors that influence the adoption of the AI-based tools. The findings emphasize that the TAM constructs significantly influenced behavioral intention, whereas critical thinking played a crucial mediating role. The strongest path was observed from attitude toward use to behavioral intention (β = 0.737), which emphasizes the importance of affective and evaluative assessment in students' decision-making. Then, it can be concluded that not only the usability or utility, but also students' strategic thinking, epistemic vigilance, and intellectual autonomy have a significant impact on the AI adoption among higher education students. This study offers practical implications for AI-integrated curriculum design and ethical technology implementation in learning environments. This research contributes a novel perspective to educational technology literature and encourages future cross-cultural, longitudinal studies that examine AI's cognitive impact while safeguarding critical thinking development in diverse academic contexts.

DOI: 10.3389/feduc.2025.1719625

Open source ↗
Consensus

Formulating design research questions: A framework

G. Goldschmidt, Ben Matthews · 2022 · Design Studies

This research note addresses the formulation of questions in design research. On the premise that well formulated research questions have far-reaching implications for other aspects of the development and impact of research, articulating quality research questions is an issue of the highest concern…

Read paper details

G. Goldschmidt, Ben Matthews

This research note addresses the formulation of questions in design research. On the premise that well formulated research questions have far-reaching implications for other aspects of the development and impact of research, articulating quality research questions is an issue of the highest concern. In this note we propose a framework for the formulation of research questions, adapted from clinical research and tailored to empirical design research. The framework, RIN. AFE, pertains to criteria for effective research questions: on the substance side, Relevant, Interesting and Novel; on the methodological execution side, Appropriate, Feasible and Ethical. The application of this framework is demonstrated through an analysis of an award-winning Design Studies paper.

DOI: 10.1016/j.destud.2021.101062

Open source ↗
Consensus

Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda

Kyle Bittle, Omar El-Gayar · 2025 · Inf.

This systematic literature review rigorously evaluates the impact of Generative AI (GenAI) on academic integrity within higher education settings. The primary objective is to synthesize how GenAI technologies influence student behavior and academic honesty, assessing the benefits and risks associat…

Read paper details

Kyle Bittle, Omar El-Gayar

This systematic literature review rigorously evaluates the impact of Generative AI (GenAI) on academic integrity within higher education settings. The primary objective is to synthesize how GenAI technologies influence student behavior and academic honesty, assessing the benefits and risks associated with their integration. We defined clear inclusion and exclusion criteria, focusing on studies explicitly discussing GenAI’s role in higher education from January 2021 to December 2024. Databases included ABI/INFORM, ACM Digital Library, IEEE Xplore, and JSTOR, with the last search conducted in May 2024. A total of 41 studies met our precise inclusion criteria. Our synthesis methods involved qualitative analysis to identify common themes and quantify trends where applicable. The results indicate that while GenAI can enhance educational engagement and efficiency, it also poses significant risks of academic dishonesty. We critically assessed the risk of bias in included studies and noted a limitation in the diversity of databases, which might have restricted the breadth of perspectives. Key implications suggest enhancing digital literacy and developing robust detection tools to effectively manage GenAI’s dual impacts. No external funding was received for this review. Future research should expand database sources and include more diverse study designs to overcome current limitations and refine policy recommendations.

DOI: 10.3390/info16040296

Open source ↗
Consensus

Mastering knowledge: the impact of generative AI on student learning outcomes

J. Pallant, J. Blijlevens, Alexander Campbell, R. Jopp · 2025 · Studies in Higher Education

ABSTRACT Generative AI (GenAI) has had a significant impact across industries since the launch of ChatGPT in late 2022. Much of the focus of existing research in the higher education space has considered the impact GenAI has had on academics and institutions. Conversely, research has been less focu…

Read paper details

J. Pallant, J. Blijlevens, Alexander Campbell, R. Jopp

ABSTRACT Generative AI (GenAI) has had a significant impact across industries since the launch of ChatGPT in late 2022. Much of the focus of existing research in the higher education space has considered the impact GenAI has had on academics and institutions. Conversely, research has been less focused on the impact this technology will have on students. Our research investigates how GenAI impacts student learning outcomes in higher education. We applied a quasi-experimental lens to analyse qualitative data of 192 student reflections and apply quantitative content analysis (QCA). Results indicate that a higher level of learning occurs when students use GenAI to construct and augment knowledge (mastery approach). In contrast, lower-level learning outcomes resulted from using GenAI procedurally without augmenting knowledge (procedural approach). Through a practical lens, the course curriculum can be designed to include GenAI to scaffold students’ learning from basic knowledge construction tasks to more complex augmentation of knowledge. Assessment design can be adjusted to promote mastery goal structures, encouraging students to critically engage with GenAI outputs rather than simply reproducing them, fostering optimal learning outcomes.

DOI: 10.1080/03075079.2025.2487570

Open source ↗
Consensus

An investigation of teachers' perceptions of using ChatGPT as a supporting tool for teaching and learning in the digital era

Areej Elsayary · 2023 · J. Comput. Assist. Learn.

The widespread use of information and communication technology (ICT) has led to significant changes in societal aspects, resulting in the emergence of a “knowledge society.” However, students and teachers have faced challenges in adapting to this digitalization. In the United Arab Emirates (UAE), t…

Read paper details

Areej Elsayary

The widespread use of information and communication technology (ICT) has led to significant changes in societal aspects, resulting in the emergence of a “knowledge society.” However, students and teachers have faced challenges in adapting to this digitalization. In the United Arab Emirates (UAE), transitioning to a knowledge‐based economy is a primary national agenda goal, aligning with Sustainable Development Goal 4 (SDG4) of ensuring high‐quality education.This research investigates teachers' perceptions of using ChatGPT as a digital supporting tool for teaching and learning practices. This includes lesson planning, teaching and learning activities, assessment and feedback and the challenges and benefits explored.This study employs an explanatory sequential mixed‐methods design involving quantitative and qualitative data collection methods. An online survey was used with closed‐ended items to collect quantitative data, while semi‐structured interviews were conducted to collect qualitative data. The study participants are middle and high school teachers (n1 = 40) from different Dubai and Abu Dhabi private schools.The most noticeable result is that teachers feel the benefits of using ChatGPT in lesson planning, teaching and learning and less in assessment and feedback. Some challenges and benefits were highlighted in each area and recommendations were suggested. However, teachers' biggest challenge was the bias and accuracy of information received and the lack of human interaction.The findings provide valuable insights into the potential of ChatGPT in education and inform future research in this area. Specifically, the study provided insights into the effectiveness of ChatGPT in enhancing students' learning outcomes, engagement and motivation, as well as its impact on teaching practices and paedagogical beliefs.

DOI: 10.1111/jcal.12926

Open source ↗
Consensus

The AI-driven classroom: A review of 21st century curriculum trends

John Jairo Jaramillo, Andrés Chiappe · 2024 · PROSPECTS

This article describes a systematic literature review focused on identifying substantial drawbacks in the current curricula and on the challenges to developing AI-driven curricula. One hundred thirty articles were read in depth and qualitatively analyzed. The results suggest that educational stakeh…

Read paper details

John Jairo Jaramillo, Andrés Chiappe

This article describes a systematic literature review focused on identifying substantial drawbacks in the current curricula and on the challenges to developing AI-driven curricula. One hundred thirty articles were read in depth and qualitatively analyzed. The results suggest that educational stakeholders should integrate AI into the curriculum with the aim of developing students’ critical thinking and interdisciplinary and real-world problem-solving in alignment with digital and contemporary educational settings. The study also seeks to catalyze the development of future, related impact studies.

DOI: 10.1007/s11125-024-09704-w

Open source ↗
Consensus

A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

E. Barroga, Glafera Janet Matanguihan · 2022 · Journal of Korean Medical Science

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on…

Read paper details

E. Barroga, Glafera Janet Matanguihan

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarify the main purpose and specific objectives of the study, which in turn dictate the design of the study, its direction, and outcome. Studies developed from good research questions and hypotheses will have trustworthy outcomes with wide-ranging social and health implications. © 2022 The Korean Academy of Medical Sciences.

DOI: 10.3346/jkms.2022.37.e121

Open source ↗
Consensus

Research Problems and Hypotheses in Empirical Research

Thorleif Lund · 2021 · Scandinavian Journal of Educational Research

ABSTRACT Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are nece…

Read paper details

Thorleif Lund

ABSTRACT Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are necessary, research hypotheses are unjustified, and that (2) in basic/general quantitative hypothesis-testing research, research hypotheses are sufficient, while research problems are unjustified. These arguments are partly related to the distinction between taking knowledge for granted and regarding knowledge as being on trial. The paper illustrates the central role played by the study’s general aim and its relation to existing knowledge in the research domain.

DOI: 10.1080/00313831.2021.1982765

Open source ↗
Consensus

Critical literacy and curriculum reform in the digital age: a pedagogical framework for artificial intelligence-integrated education

P. Abellán, Maria Abellán · 2026 · International Journal of Evaluation and Research in Education (IJERE)

Artificial intelligence (AI) is reshaping education and challenging traditional curriculum models, prompting new attention to critical literacy. However, most current approaches emphasize technical proficiency while neglecting ethical, epistemological, and civic dimensions. This article addresses t…

Read paper details

P. Abellán, Maria Abellán

Artificial intelligence (AI) is reshaping education and challenging traditional curriculum models, prompting new attention to critical literacy. However, most current approaches emphasize technical proficiency while neglecting ethical, epistemological, and civic dimensions. This article addresses this gap by proposing a conceptual framework for integrating AI into curriculum design through critical pedagogy and advanced learning theory. Using a theory-driven literature review, the study synthesizes global policy frameworks and educational innovations to develop a four-part model for AI-informed critical literacy. The guiding principles include: i) interrogation of AI outputs and logics; ii) development of multiliteracies and digital semiotics; iii) promotion of democratic dialogue and participatory ethics; and iv) design of adaptive, inquiry-based learning environments. Grounded in constructivist, connectivist, and Freirean theories, the framework positions AI as a context for critical inquiry and educational transformation. The article concludes with strategies for educators and policymakers to foster equity, agency, and ethical reflection in AI-integrated learning environments, and proposes directions for future empirical research.

DOI: 10.11591/ijere.v15i3.36952

Open source ↗
Consensus

What can ChatGPT not do in education? Evaluating its effectiveness in assessing educational learning outcomes

S. Fabiyi · 2024 · Innovations in Education and Teaching International

ABSTRACT This paper examines ChatGPT’s capability in evaluating educational learning outcomes, investigating its effectiveness in assessing SMART criteria alignment and identifying the presence of fundamental components. The hypothesis posits that ChatGPT can proficiently accomplish these tasks, of…

Read paper details

S. Fabiyi

ABSTRACT This paper examines ChatGPT’s capability in evaluating educational learning outcomes, investigating its effectiveness in assessing SMART criteria alignment and identifying the presence of fundamental components. The hypothesis posits that ChatGPT can proficiently accomplish these tasks, offering potential benefits to educational design and assessment processes. Through exemplar learning outcomes, the study showcases ChatGPT’s ability to discern SMART criteria alignment. Furthermore, it demonstrates ChatGPT’s competence in identifying the fundamental components, substantiated by cogent explanations. The analysis underscores the congruence between ChatGPT’s evaluations and human assessors’ judgements, underscoring its potential utility in educational quality assurance. Implications for educational practice emphasise ChatGPT’s potential to assist educators in formulating effective learning objectives, meeting SMART criteria and encapsulating crucial components. While ChatGPT’s capabilities are promising, human expertise remains vital for nuanced evaluation. In conclusion, this paper illuminates ChatGPT’s role in shaping educational outcomes and encourages further exploration into AI’s potential impact on educational processes.

DOI: 10.1080/14703297.2024.2333395

Open source ↗
Consensus

ChatGPT and the Rise of Generative AI: Threat to Academic Integrity?

Damian Okaibedi · 2023 · Journal of Responsible Technology

The emergence of OpenAI's ChatGPT has put intense spotlight on Generative AI (Gen-AI) systems and their possible impacts on Academic integrity. This paper provides an overview of the current arguments around ChatGPT and Academic integrity and concludes that although these technologies are capable o…

Read paper details

Damian Okaibedi

The emergence of OpenAI's ChatGPT has put intense spotlight on Generative AI (Gen-AI) systems and their possible impacts on Academic integrity. This paper provides an overview of the current arguments around ChatGPT and Academic integrity and concludes that although these technologies are capable of revolutionising academia, the way ChatGPT and other generative AI systems are used could surely undermine academic integrity. However, to ensure that the risks to academic integrity are mitigated for greater maximisation, institutional and multi-stakeholder efforts are required.

DOI: 10.1016/j.jrt.2023.100060

Open source ↗

Disagreements & Limitations

Disagreements

  • No major disagreement identified.

Limitations

  • No specific limitations reported. This does not establish completeness or certainty.

Sources

No sources were cited by the synthesizer.

View Detailed Research
Developer Diagnostics

PRODUCTION MODE

Research Planners

Planner 1 — Gemini 3.5 Flash
google/gemini-3.5-flash

Planner 2 — Llama 4 Scout
meta-llama/llama-4-scout

Planner 3 — Qwen3.5-27B
qwen/qwen3.5-27b

Retrieval

Semantic Scholar: Enabled
API key: Not configured (public access)

Consensus: Enabled

Synthesizer

anthropic/claude-sonnet-5
anthropic/claude-sonnet-5

Credential readiness

OpenRouter: Configured

Consensus: Configured

Manual evaluation cases and results
Individual AI responses

AI Agent Research

Independent model outputs. Planners propose searches and hypotheses, not evidence. Citations and confidence in historical answers are model-reported and unverified.

Need to make a research question

Completed

Research finished. Any provider failures are shown in their sections.

Planner 1 — Gemini 3.5 Flash google/gemini-3.5-flash View response

Problem interpretation

Structuring a research framework to investigate the impact of generative artificial intelligence on academic integrity and learning outcomes in higher education.

Search queries (not evidence)

  • "generative AI" AND "higher education" AND "academic integrity"
  • "ChatGPT" AND "student learning outcomes" AND "assessment"
  • "artificial intelligence" AND "critical thinking" AND "curriculum design"
Planner diagnostics
problem_interpretation
Structuring a research framework to investigate the impact of generative artificial intelligence on academic integrity and learning outcomes in higher education.
research_questions
['How does the integration of generative AI tools in university curricula affect student critical thinking and learning outcomes?', 'What strategies are effective in mitigating academic dishonesty related to AI usage while maintaining pedagogical utility?']
search_queries
['"generative AI" AND "higher education" AND "academic integrity"', '"ChatGPT" AND "student learning outcomes" AND "assessment"', '"artificial intelligence" AND "critical thinking" AND "curriculum design"']
keywords
['generative AI', 'higher education', 'academic integrity', 'learning outcomes', 'assessment', 'critical thinking']
synonyms
['artificial intelligence', 'tertiary education', 'academic honesty', 'educational outcomes', 'evaluation', 'analytical skills']
population_terms
['higher education students', 'university students', 'college instructors', 'educators']
intervention_or_exposure_terms
['generative AI tools', 'ChatGPT usage', 'AI-assisted writing', 'AI curriculum integration']
outcome_terms
['academic performance', 'critical thinking skills', 'plagiarism rates', 'assessment reliability']
possible_research_gaps
['Long-term longitudinal studies on cognitive offloading due to generative AI usage.', 'Comparative efficacy of AI-detector software versus alternative authentic assessment methods.']
uncertainties
['The rapidly evolving nature of AI model capabilities outpacing academic policy development.', 'Generalizability of findings across different academic disciplines.']
suggested_filters
{'year_from': 2020, 'year_to': 2024, 'fields': ['Education', 'Computer Science', 'Social Sciences'], 'study_types': ['Empirical Study', 'Systematic Review', 'Case Study']}

Self-reported confidence: Not assessed

Citations

  • No sources supplied by this model.
Planner 2 — Llama 4 Scout meta-llama/llama-4-scout Failed

OpenRouter rate-limited this request. Please try again later.

Planner 3 — Qwen3.5-27B qwen/qwen3.5-27b View response

Problem interpretation

User requires assistance in constructing an academic research question without specifying a domain or topic.

Search queries (not evidence)

  • best practices for formulating research questions
  • difference between research question and hypothesis
  • criteria for evaluating research question quality
  • guidelines for writing research questions in social sciences
Planner diagnostics
problem_interpretation
User requires assistance in constructing an academic research question without specifying a domain or topic.
research_questions
['What are the essential elements of a well-formulated academic research question?', 'How does the PICO framework assist in narrowing broad topics into specific inquiries?']
search_queries
['best practices for formulating research questions', 'difference between research question and hypothesis', 'criteria for evaluating research question quality', 'guidelines for writing research questions in social sciences']
keywords
['research question', 'academic inquiry', 'study design', 'topic selection', 'methodology']
synonyms
['investigative query', 'research objective', 'study aim', 'central question']
population_terms
['students', 'novice researchers', 'graduate scholars', 'academics']
intervention_or_exposure_terms
['writing workshops', 'methodological training', 'supervision', 'framework application']
outcome_terms
['question clarity', 'feasibility', 'scope definition', 'research validity']
possible_research_gaps
['Insufficient literature on iterative refinement processes for undergraduate questions', 'Limited cross-disciplinary comparisons of research question structures', 'Gap between pedagogical advice and empirical outcomes in thesis completion']
uncertainties
['Subject matter discipline is unspecified', 'Target academic level is unknown', 'Preferred research paradigm (qualitative/quantitative) is unclear']
suggested_filters
{'year_from': 2019, 'year_to': 2024, 'fields': ['Education', 'Library Science', 'Research Methodology'], 'study_types': ['Review', 'Guideline', 'Conceptual Paper']}

Self-reported confidence: Not assessed

Citations

  • No sources supplied by this model.
Full Academic Evidence

Academic Evidence

Academic papers retrieved from the providers below, shown separately from model outputs. Provider metadata is retained; a retrieved paper is not automatically proof of a claim.

Need to make a research question

consensus

25 unique papers found in this response

The impact of generative AI on academic integrity of authentic assessments within a higher education context 2025 · other

Alexander K. Kofinas, C. Tsay, D. Pike

Generative AI (hereinafter GenAI) technology, such as ChatGPT, is already influencing the higher education sector. In this work, we focused on the impact of GenAI on the academic integrity of assessments within higher education institutions, as GenAI can be used to circumvent assessment approaches within the sector, compromising their quality. The purpose of our research was threefold: first, to determine the extent to which the use of GenAI can be detected via the marking and moderation process; second, to understand whether the presence of GenAI affects the marking process; and finally, to establish whether authentic assessments can safeguard academic integrity. We used a series of experiments in the context of two UK‐based universities to examine these issues. Our findings indicate that markers, in general, are not able to distinguish assessments that have had GenAI input from assessments that did not, even though the presence of GenAI affects the way markers approach the marking p…

DOI: 10.1111/bjet.13585

Open source ↗
Generative AI and the future of higher education: a threat to academic integrity or reformation? Evidence from multicultural perspectives 2024 · cross-sectional study

Abdullahi Yusuf, Nasrin Pervin, Marcos Román-González

In recent years, higher education (HE) globally has witnessed extensive adoption of technology, particularly in teaching and research. The emergence of generative Artificial Intelligence (GenAI) further accelerates this trend. However, the increasing sophistication of GenAI tools has raised concerns about their potential to automate teaching and research processes. Despite widespread research on GenAI in various fields, there is a lack of multicultural perspectives on its impact and concerns in HE. This study addresses this gap by examining the usage, benefits, and concerns of GenAI in higher education from a multicultural standpoint. We employed an online survey that collected responses from 1217 participants across 76 countries, encompassing a broad range of gender categories, academic disciplines, geographical locations, and cultural orientations. Our findings revealed a high level of awareness and familiarity with GenAI tools among respondents. A significant portion had prior expe…

DOI: 10.1186/s41239-024-00453-6

Open source ↗
Generative AI in Higher Education: Balancing Innovation and Integrity 2025 · literature review

Nigel J. Francis, Sue Jones, David P. Smith

Generative Artificial Intelligence (GenAI) is rapidly transforming the landscape of higher education, offering novel opportunities for personalised learning and innovative assessment methods. This paper explores the dual-edged nature of GenAI's integration into educational practices, focusing on both its potential to enhance student engagement and learning outcomes and the significant challenges it poses to academic integrity and equity. Through a comprehensive review of current literature, we examine the implications of GenAI on assessment practices, highlighting the need for robust ethical frameworks to guide its use. Our analysis is framed within pedagogical theories, including social constructivism and competency-based learning, highlighting the importance of balancing human expertise and AI capabilities. We also address broader ethical concerns associated with GenAI, such as the risks of bias, the digital divide, and the environmental impact of AI technologies. This paper argues …

DOI: 10.3389/bjbs.2024.14048

Open source ↗
Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda 2025 · systematic review

Kyle Bittle, Omar El-Gayar

This systematic literature review rigorously evaluates the impact of Generative AI (GenAI) on academic integrity within higher education settings. The primary objective is to synthesize how GenAI technologies influence student behavior and academic honesty, assessing the benefits and risks associated with their integration. We defined clear inclusion and exclusion criteria, focusing on studies explicitly discussing GenAI’s role in higher education from January 2021 to December 2024. Databases included ABI/INFORM, ACM Digital Library, IEEE Xplore, and JSTOR, with the last search conducted in May 2024. A total of 41 studies met our precise inclusion criteria. Our synthesis methods involved qualitative analysis to identify common themes and quantify trends where applicable. The results indicate that while GenAI can enhance educational engagement and efficiency, it also poses significant risks of academic dishonesty. We critically assessed the risk of bias in included studies and noted a …

DOI: 10.3390/info16040296

Open source ↗
ChatGPT and the Rise of Generative AI: Threat to Academic Integrity? 2023 · commentary or perspective

Damian Okaibedi

The emergence of OpenAI's ChatGPT has put intense spotlight on Generative AI (Gen-AI) systems and their possible impacts on Academic integrity. This paper provides an overview of the current arguments around ChatGPT and Academic integrity and concludes that although these technologies are capable of revolutionising academia, the way ChatGPT and other generative AI systems are used could surely undermine academic integrity. However, to ensure that the risks to academic integrity are mitigated for greater maximisation, institutional and multi-stakeholder efforts are required.

DOI: 10.1016/j.jrt.2023.100060

Open source ↗
Formulating Research Questions for Evidence-Based Studies 2023 · literature review

Mohammad-Salar Hosseini, F. Jahanshahlou, M. Akbarzadeh, Mahdi Zarei, Y. Vaez-Gharamaleki

Formulating a research question is a crucial step in directing any scientific study. The classical evidence-based approach to formulating a question uses the PICO framework, consisting of population, intervention, comparison, and outcome. However, the PICO framework is not suitable for formulating research questions in some types of evidence and studies. This paper reviews and summarizes different frameworks introduced for formulating research questions over time. For this purpose, we explore the complete application of the PICO framework, clarifying its flexibility and subtleties for various research designs. Also, this review navigates the complexities of creating research questions, clarifying the minor variations needed within the PICO framework for various study designs through a thorough analysis and synthesis of the existing literature. Clarifying these customized strategies is intended to assist researchers, physicians, and scholars in appropriately formulating questions, impr…

DOI: 10.1016/j.glmedi.2023.100046

Open source ↗
Back to the basics: guidance for formulating good research questions 2023 · commentary or perspective

J. Covvey, Chyna McClendon, M. Gionfriddo

Good science is driven by rigorous questions. Much like the foundation of a house, a research question must be carefully constructed to prevent downstream problems in project execution. And yet, pharmacy researchers and scholars across all career stages may find themselves struggling when developing research questions. The purpose of this commentary is to provide useful guidance on composing and evaluating rigorous research questions. A variety of frameworks, such as PICO (Patient/population; Intervention; Comparison; Outcome), are available to researchers and can assist them in ensuring that their research question has covered all relevant components. Additionally, the FINER (Feasible; Interesting; Novel; Ethical; and Relevant) criteria can help researchers with evaluating their research questions for practical considerations. Finally, building awareness of common pitfalls when composing research questions can aid researchers to avoid issues that they may not otherwise discover until…

DOI: 10.1016/j.sapharm.2023.09.009

Open source ↗
A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles 2022 · other

E. Barroga, Glafera Janet Matanguihan

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarif…

DOI: 10.3346/jkms.2022.37.e121

Open source ↗
Formulating the Research Question and Framing the Hypothesis 2023 · other

L. D. Willis

An understanding of the research process is an essential skill for designing a study and developing the research protocol. Poor study design can lead to fatal flaws in research methodology, ultimately resulting in rejection for publication or limiting the reliability of the results. Following the steps of the research process and devising the research question and hypothesis prior to study initiation can avoid common problems encountered with research questions and study design. Formulating the research question is the first step in the research process and provides the foundation for framing the hypothesis. Research questions should be feasible, interesting, novel, ethical, and relevant (FINER). Application of the FINER criteria can assist with ensuring the question is valid and will generate new knowledge that has clinical impact. Utilization of the population, intervention, comparison, and outcome (PICO) format helps to structure the question as well as refine and narrow the focus …

DOI: 10.4187/respcare.10975

Open source ↗
Formulating design research questions: A framework 2022 · other

G. Goldschmidt, Ben Matthews

This research note addresses the formulation of questions in design research. On the premise that well formulated research questions have far-reaching implications for other aspects of the development and impact of research, articulating quality research questions is an issue of the highest concern. In this note we propose a framework for the formulation of research questions, adapted from clinical research and tailored to empirical design research. The framework, RIN. AFE, pertains to criteria for effective research questions: on the substance side, Relevant, Interesting and Novel; on the methodological execution side, Appropriate, Feasible and Ethical. The application of this framework is demonstrated through an analysis of an award-winning Design Studies paper.

DOI: 10.1016/j.destud.2021.101062

Open source ↗
What can ChatGPT not do in education? Evaluating its effectiveness in assessing educational learning outcomes 2024

S. Fabiyi

ABSTRACT This paper examines ChatGPT’s capability in evaluating educational learning outcomes, investigating its effectiveness in assessing SMART criteria alignment and identifying the presence of fundamental components. The hypothesis posits that ChatGPT can proficiently accomplish these tasks, offering potential benefits to educational design and assessment processes. Through exemplar learning outcomes, the study showcases ChatGPT’s ability to discern SMART criteria alignment. Furthermore, it demonstrates ChatGPT’s competence in identifying the fundamental components, substantiated by cogent explanations. The analysis underscores the congruence between ChatGPT’s evaluations and human assessors’ judgements, underscoring its potential utility in educational quality assurance. Implications for educational practice emphasise ChatGPT’s potential to assist educators in formulating effective learning objectives, meeting SMART criteria and encapsulating crucial components. While ChatGPT’s c…

DOI: 10.1080/14703297.2024.2333395

Open source ↗
ChatGPT’s impact on student learning outcomes: a meta-analysis of 35 experimental studies 2026 · meta-analysis

Xinning Wu, Peixia Zhu, Jin-Liang Zhang, Mengwei Yin, Yingxi Wang

With the rapid advancement of generative artificial intelligence (GenAI) technology, the potential educational applications of Chat generative pre-trained transformers (ChatGPT) have attracted significant attention. However, the research on the specific effects of ChatGPT on student learning outcomes and its moderating factors remains insufficient. This study aimed to quantify the effects of ChatGPT on student learning outcomes and explore relevant moderating variables using a meta-analysis approach. The analysis included 35 studies published between 2022 and 2024, involving 4193 participants. The results indicated a moderately positive effect of ChatGPT on student learning outcomes (g = 0.670), significantly enhancing both cognitive and non-cognitive skills. In the analysis of moderating variables, the subject, experimental duration, and instructional mode had significant positive effects on student learning outcomes, whereas educational level and knowledge type did not show signific…

DOI: 10.1057/s41599-026-07019-z

Open source ↗
An investigation of teachers' perceptions of using ChatGPT as a supporting tool for teaching and learning in the digital era 2023 · mixed methods study

Areej Elsayary

The widespread use of information and communication technology (ICT) has led to significant changes in societal aspects, resulting in the emergence of a “knowledge society.” However, students and teachers have faced challenges in adapting to this digitalization. In the United Arab Emirates (UAE), transitioning to a knowledge‐based economy is a primary national agenda goal, aligning with Sustainable Development Goal 4 (SDG4) of ensuring high‐quality education.This research investigates teachers' perceptions of using ChatGPT as a digital supporting tool for teaching and learning practices. This includes lesson planning, teaching and learning activities, assessment and feedback and the challenges and benefits explored.This study employs an explanatory sequential mixed‐methods design involving quantitative and qualitative data collection methods. An online survey was used with closed‐ended items to collect quantitative data, while semi‐structured interviews were conducted to collect quali…

DOI: 10.1111/jcal.12926

Open source ↗
ChatGPT as an AI Assistant Tool to Enhance University Students’ Teaching, Assessment and Academic Achievements: A Case Study of an EAP Lecturer 2025 · case study

N. S. Eljack, Neven A. Altahir, Nazzik I. M. Mohammed, Shahinaz Osman

This study investigates the potential role of ChatGPT as an instructional assistant to support an English for Academic Purposes (EAP) lecturer in delivering an English for Architecture Design (EAD) course. It also examines ChatGPT's usefulness in student assessment and its impact on enhancing academic achievements. Out of a population of 92 students, 81 were able to join a Telegram group for course participation. Three data collection methods were employed: prompt crafting, an open quiz, and a final exam. Data was analyzed through descriptive and thematic analysis, statistical analysis, and manual grading. Results indicated that ChatGPT significantly supported the EAP lecturer in teaching methods, quiz and exam design, and enhancing students’ learning outcomes. Recommendations are put forth to both students and educators to develop two essential skills of prompt crafting and critical thinking when integrating ChatGPT into academic settings. Exploring ChatGPT teaching potential, sharin…

DOI: 10.17507/jltr.1606.03

Open source ↗
Mastering knowledge: the impact of generative AI on student learning outcomes 2025 · other

J. Pallant, J. Blijlevens, Alexander Campbell, R. Jopp

ABSTRACT Generative AI (GenAI) has had a significant impact across industries since the launch of ChatGPT in late 2022. Much of the focus of existing research in the higher education space has considered the impact GenAI has had on academics and institutions. Conversely, research has been less focused on the impact this technology will have on students. Our research investigates how GenAI impacts student learning outcomes in higher education. We applied a quasi-experimental lens to analyse qualitative data of 192 student reflections and apply quantitative content analysis (QCA). Results indicate that a higher level of learning occurs when students use GenAI to construct and augment knowledge (mastery approach). In contrast, lower-level learning outcomes resulted from using GenAI procedurally without augmenting knowledge (procedural approach). Through a practical lens, the course curriculum can be designed to include GenAI to scaffold students’ learning from basic knowledge constructio…

DOI: 10.1080/03075079.2025.2487570

Open source ↗
A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles 2022 · other

E. Barroga, Glafera Janet Matanguihan

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarif…

DOI: 10.3346/jkms.2022.37.e121

Open source ↗
Formulating the Research Question and Framing the Hypothesis 2023 · other

L. D. Willis

An understanding of the research process is an essential skill for designing a study and developing the research protocol. Poor study design can lead to fatal flaws in research methodology, ultimately resulting in rejection for publication or limiting the reliability of the results. Following the steps of the research process and devising the research question and hypothesis prior to study initiation can avoid common problems encountered with research questions and study design. Formulating the research question is the first step in the research process and provides the foundation for framing the hypothesis. Research questions should be feasible, interesting, novel, ethical, and relevant (FINER). Application of the FINER criteria can assist with ensuring the question is valid and will generate new knowledge that has clinical impact. Utilization of the population, intervention, comparison, and outcome (PICO) format helps to structure the question as well as refine and narrow the focus …

DOI: 10.4187/respcare.10975

Open source ↗
The choice between research question and hypothesis for paradigm harmony 2025 · systematic review

A. Tasci, Wei Wei, A. Milman

PurposeThe purpose of this viewpoint is to distinguish between the roles of research questions and hypotheses in different paradigms of research and guide future research for the proper use of these research elements to avoid paradigmatic contradiction and achieve paradigmatic harmony.Design/methodology/approachRecent tourism and hospitality journal publications using both research questions and hypotheses were acquired through convenience sampling on Google Scholar. These articles were analyzed to identify their paradigms based on the methodology described and to conclude if the use of both research questions and hypotheses was leading to paradigm contradiction or harmony.FindingsMany studies published in tourism and hospitality journals use both research questions and hypotheses while they are purely positivist research that needs to be guided by only research hypotheses. Examples are provided to guide future research for the proper use of research questions and hypotheses to avoid …

DOI: 10.1108/jhth-01-2025-0013

Open source ↗
Developing a hypothesis and research question 2021 · other

B. Kolb

A hypothesis is an assumption on the cause of an organization’s marketing problem. Aclearly written research question states what needs to be learned to solve the problem. Conducting successful cross-cultural research may require a different methodology and translation of all research materials. The research proposal explains to both researchers and managers how the research will be conducted

DOI: 10.4324/9781003165194-3

Open source ↗
Research Problems and Hypotheses in Empirical Research 2021 · theoretical, modeling, or simulation study

Thorleif Lund

ABSTRACT Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are necessary, research hypotheses are unjustified, and that (2) in basic/general quantitative hypothesis-testing research, research hypotheses are sufficient, while research problems are unjustified. These arguments are partly related to the distinction between taking knowledge for granted and regarding knowledge as being on trial. The paper illustrates the central role played by the study’s general aim and its relation to existing knowledge in the research domain.

DOI: 10.1080/00313831.2021.1982765

Open source ↗
The AI-driven classroom: A review of 21st century curriculum trends 2024 · systematic review

John Jairo Jaramillo, Andrés Chiappe

This article describes a systematic literature review focused on identifying substantial drawbacks in the current curricula and on the challenges to developing AI-driven curricula. One hundred thirty articles were read in depth and qualitatively analyzed. The results suggest that educational stakeholders should integrate AI into the curriculum with the aim of developing students’ critical thinking and interdisciplinary and real-world problem-solving in alignment with digital and contemporary educational settings. The study also seeks to catalyze the development of future, related impact studies.

DOI: 10.1007/s11125-024-09704-w

Open source ↗
Mapping the use of artificial intelligence in medical education: a scoping review 2025 · systematic review

Erwin Hernando Hernández Rincón, Daniel Jiménez, Lizeth Alexandra Chavarro Aguilar, J. Flórez, Á. Tapia, Claudia Liliana Jaimes Peñuela

Introduction: The integration of artificial intelligence (AI) in healthcare has transformed clinical practices and medical education, with technologies like diagnostic algorithms and clinical decision support increasingly incorporated into curricula. However, there is still a gap in preparing future physicians to use these technologies effectively and ethically. Objective: This scoping review maps the integration of artificial intelligence (AI) in undergraduate medical education (UME), focusing on curriculum development, student competency enhancement, and institutional barriers to AI adoption. Materials and methods: A comprehensive search in PubMed, Scopus, and BIREME included articles from 2019 onwards, limited to English and Spanish publications on AI in UME. Exclusions applied to studies focused on postgraduate education or non-medical fields. Data were analyzed using thematic analysis to identify patterns in AI curriculum development and implementation. Results: A total of 34 …

DOI: 10.1186/s12909-025-07089-8

Open source ↗
Critical literacy and curriculum reform in the digital age: a pedagogical framework for artificial intelligence-integrated education 2026 · theoretical, modeling, or simulation study

P. Abellán, Maria Abellán

Artificial intelligence (AI) is reshaping education and challenging traditional curriculum models, prompting new attention to critical literacy. However, most current approaches emphasize technical proficiency while neglecting ethical, epistemological, and civic dimensions. This article addresses this gap by proposing a conceptual framework for integrating AI into curriculum design through critical pedagogy and advanced learning theory. Using a theory-driven literature review, the study synthesizes global policy frameworks and educational innovations to develop a four-part model for AI-informed critical literacy. The guiding principles include: i) interrogation of AI outputs and logics; ii) development of multiliteracies and digital semiotics; iii) promotion of democratic dialogue and participatory ethics; and iv) design of adaptive, inquiry-based learning environments. Grounded in constructivist, connectivist, and Freirean theories, the framework positions AI as a context for critica…

DOI: 10.11591/ijere.v15i3.36952

Open source ↗
Evaluating the impact of AI on the critical thinking skills among the higher education students by combining the TAM model and critical thinking theory 2025 · cross-sectional study

Patni Ninghardjanti, M. C. Umam, Anton Subarno, Winarno Winarno, Novedi Risanti Langgi, Jumiyanto Widodo

The following research analyzes the relation between the utilization of Artificial Intelligence (AI) tools among university students and their relation with critical thinking skills by combining the Technology Acceptance Model (TAM) model and critical thinking theory. This research introduced the Metacognitive TAM (Meta-TAM) integrated with the Information Systems (IS) Success model as a theoretical innovation. The current research was carried out with a quantitative method approach, with 200 respondents from the Office Administration Education Department, Universitas Sebelas Maret, Indonesia. The research data were analyzed using the SEM with SmartPLS 4.0 software. The key constructs of attitude toward use (ATU), motivation to use (MTU), perceived usefulness (PU), perceived ease of use (PEOU), and behavioral intention (BI) were analyzed to assess the primary factors that influence the adoption of the AI-based tools. The findings emphasize that the TAM constructs significantly inf…

DOI: 10.3389/feduc.2025.1719625

Open source ↗
A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking 2026 · systematic review

T. Balart, Brayan Díaz, Kristi J. Shryock

Critical Thinking (CT) is recognized as a foundational competency for professional readiness, innovation, and ethical reasoning in higher education, enabling students to analyze information, evaluate evidence, and make reasoned decisions in complex environments. The rapid integration of Generative Artificial Intelligence (GenAI) tools, such as large language models, presents new opportunities and risks for CT development. This study conducts a systematic literature review to synthesize empirical evidence on the pedagogical implications and cognitive impact of GenAI on students’ CT. Following PRISMA guidelines, and search terms around GenAI Tools, Critical Thinking And Higher Education, on five major education research databases—Web of Science; Scopus; EBSCOhost (Education Source, ERIC, and APA PsycInfo); and Compendex and Inspec (Elsevier)—63 empirical studies published between January 2023 and April 2025 were analyzed across higher education contexts, disciplines, and intervention de…

DOI: 10.3390/a19030179

Open source ↗

semantic_scholar

Semantic Scholar retrieval failed (rate_limit).

semantic_scholar unavailable

Semantic Scholar retrieval failed (rate_limit).

Judge/Synthesizer details

Final Research Answer

Need to make a research question

Final synthesis unavailable

The synthesizer reached its output limit before completing the structured answer.

Any collected model responses and academic evidence remain below.

Retry controls

Need to make a research question

Stage: PARTIAL

Partial research available. Review failures below; retry controls are available.

Latest Planner 2 — Llama 4 Scout attempt failed: OpenRouter rate-limited this request. Please try again later. Any earlier successful result remains active.

Latest semantic_scholar attempt failed: Semantic Scholar retrieval failed (rate_limit). Any earlier successful result remains active.

Retries make new API requests and may incur charges. Provider retries preserve the accepted answer; re-run synthesis afterward to incorporate changed evidence.

Provider attempt history (5)

Active means the latest successful attempt. A newer failure does not replace it.

#159 · semantic_scholar · academic-graph-search · Oct. 2, 2026, 4:19 p.m. · Latest · Failed

Semantic Scholar retrieval failed (rate_limit).

This attempt is displayed in the semantic_scholar results above.

#158 · consensus · search-v1 · Oct. 2, 2026, 4:19 p.m. · Latest · Active · Succeeded

This attempt is displayed in the consensus results above.

#157 · Planner 3 — Qwen3.5-27B · qwen/qwen3.5-27b · Oct. 2, 2026, 4:19 p.m. · Latest · Active · Succeeded

This attempt is displayed in the Planner 3 — Qwen3.5-27B results above.

#156 · Planner 2 — Llama 4 Scout · meta-llama/llama-4-scout · Oct. 2, 2026, 4:18 p.m. · Latest · Failed

OpenRouter rate-limited this request. Please try again later.

This attempt is displayed in the Planner 2 — Llama 4 Scout results above.

#155 · Planner 1 — Gemini 3.5 Flash · google/gemini-3.5-flash · Oct. 2, 2026, 4:18 p.m. · Latest · Active · Succeeded

This attempt is displayed in the Planner 1 — Gemini 3.5 Flash results above.

Synthesis history (3)
#33 · Claude Sonnet 5 · Oct. 2, 2026, 4:44 p.m. · Failed · Latest

Model: anthropic/claude-sonnet-5 · Latency: 58015 ms · Estimated cost: 0.1012240000 USD

Evidence items supplied: 20 · Omitted due to context budget: 3 · No usable text: 0.

Input tokens: 20612 · Output tokens: 6000

The synthesizer reached its output limit before completing the structured answer.

Rejected source IDs: None recorded

Confidence: Unknown

[C568] A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking · Algorithms Open source

[C569] Generative AI in Higher Education: Balancing Innovation and Integrity · British Journal of Biomedical Science Open source

[C570] Formulating the Research Question and Framing the Hypothesis · Respiratory Care Open source

[C571] Mapping the use of artificial intelligence in medical education: a scoping review · BMC Medical Education Open source

[C572] Generative AI and the future of higher education: a threat to academic integrity or reformation? Evidence from multicultural perspectives · International Journal of Educational Technology in Higher Education Open source

[C573] The choice between research question and hypothesis for paradigm harmony · Journal of Hospitality and Tourism Horizons Open source

[C574] The impact of generative AI on academic integrity of authentic assessments within a higher education context · Br. J. Educ. Technol. Open source

[C575] Formulating Research Questions for Evidence-Based Studies · Journal of Medicine, Surgery, and Public Health Open source

[C576] Back to the basics: guidance for formulating good research questions · Research in social & administrative pharmacy : RSAP Open source

[C577] Developing a hypothesis and research question · Absolute Essentials of Marketing Research Open source

[C578] ChatGPT as an AI Assistant Tool to Enhance University Students’ Teaching, Assessment and Academic Achievements: A Case Study of an EAP Lecturer · Journal of Language Teaching and Research Open source

[C579] ChatGPT’s impact on student learning outcomes: a meta-analysis of 35 experimental studies · Humanities and Social Sciences Communications Open source

[C580] Evaluating the impact of AI on the critical thinking skills among the higher education students by combining the TAM model and critical thinking theory · Frontiers in Education Open source

[C581] Formulating design research questions: A framework · Design Studies Open source

[C582] Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda · Inf. Open source

[C583] Mastering knowledge: the impact of generative AI on student learning outcomes · Studies in Higher Education Open source

[C584] An investigation of teachers' perceptions of using ChatGPT as a supporting tool for teaching and learning in the digital era · J. Comput. Assist. Learn. Open source

[C585] The AI-driven classroom: A review of 21st century curriculum trends · PROSPECTS Open source

[C586] A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles · Journal of Korean Medical Science Open source

[C587] Research Problems and Hypotheses in Empirical Research · Scandinavian Journal of Educational Research Open source

Agreements:

Disagreements:

Limitations:

#32 · DeepSeek R1 · Oct. 2, 2026, 4:33 p.m. · Failed

Model: deepseek/deepseek-r1 · Latency: 122383 ms · Estimated cost: 0.0129045000 USD

Evidence items supplied: 8 · Omitted due to context budget: 15 · No usable text: 0.

Input tokens: 6810 · Output tokens: 3255

The synthesizer returned an invalid structured answer.

Rejected source IDs: None recorded

Confidence: Unknown

[C568] A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking · Algorithms Open source

[C569] Generative AI in Higher Education: Balancing Innovation and Integrity · British Journal of Biomedical Science Open source

[C570] Formulating the Research Question and Framing the Hypothesis · Respiratory Care Open source

[C571] Mapping the use of artificial intelligence in medical education: a scoping review · BMC Medical Education Open source

[C572] Generative AI and the future of higher education: a threat to academic integrity or reformation? Evidence from multicultural perspectives · International Journal of Educational Technology in Higher Education Open source

[C573] The choice between research question and hypothesis for paradigm harmony · Journal of Hospitality and Tourism Horizons Open source

[C574] The impact of generative AI on academic integrity of authentic assessments within a higher education context · Br. J. Educ. Technol. Open source

[C575] Formulating Research Questions for Evidence-Based Studies · Journal of Medicine, Surgery, and Public Health Open source

Agreements:

Disagreements:

Limitations:

#31 · DeepSeek R1 · Oct. 2, 2026, 4:22 p.m. · Failed

Model: deepseek/deepseek-r1 · Latency: 190191 ms · Estimated cost: 0.0147770000 USD

Evidence items supplied: 8 · Omitted due to context budget: 15 · No usable text: 0.

Input tokens: 6810 · Output tokens: 4004

The synthesizer returned an invalid structured answer.

Rejected source IDs: None recorded

Confidence: Unknown

[C568] A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking · Algorithms Open source

[C569] Generative AI in Higher Education: Balancing Innovation and Integrity · British Journal of Biomedical Science Open source

[C570] Formulating the Research Question and Framing the Hypothesis · Respiratory Care Open source

[C571] Mapping the use of artificial intelligence in medical education: a scoping review · BMC Medical Education Open source

[C572] Generative AI and the future of higher education: a threat to academic integrity or reformation? Evidence from multicultural perspectives · International Journal of Educational Technology in Higher Education Open source

[C573] The choice between research question and hypothesis for paradigm harmony · Journal of Hospitality and Tourism Horizons Open source

[C574] The impact of generative AI on academic integrity of authentic assessments within a higher education context · Br. J. Educ. Technol. Open source

[C575] Formulating Research Questions for Evidence-Based Studies · Journal of Medicine, Surgery, and Public Health Open source

Agreements:

Disagreements:

Limitations:

Developer evaluation (manual)

Ratings do not affect synthesis. Rate the active answer and evidence you reviewed.

Developer diagnostics

Plan-and-Solve diagnostics

Generated queries: 7; retrieval queries: 5; duplicates removed: 2; unique papers: 23.

semantic_scholar: 1 requests; 0 results; 1 failed requests.

consensus: 5 requests; 25 results; 0 failed requests.

Normalized ResearchPlan
original_question
Need to make a research question
canonical_search_queries
['"generative AI" AND "higher education" AND "academic integrity"', 'best practices for formulating research questions', '"ChatGPT" AND "student learning outcomes" AND "assessment"', 'difference between research question and hypothesis', '"artificial intelligence" AND "critical thinking" AND "curriculum design"']
keywords
['generative AI', 'higher education', 'academic integrity', 'learning outcomes', 'assessment', 'critical thinking', 'research question', 'academic inquiry', 'study design', 'topic selection', 'methodology']
synonyms
['artificial intelligence', 'tertiary education', 'academic honesty', 'educational outcomes', 'evaluation', 'analytical skills', 'investigative query', 'research objective', 'study aim', 'central question']
research_subquestions
['How does the integration of generative AI tools in university curricula affect student critical thinking and learning outcomes?', 'What strategies are effective in mitigating academic dishonesty related to AI usage while maintaining pedagogical utility?', 'What are the essential elements of a well-formulated academic research question?', 'How does the PICO framework assist in narrowing broad topics into specific inquiries?']
candidate_gap_hypotheses
['Long-term longitudinal studies on cognitive offloading due to generative AI usage.', 'Comparative efficacy of AI-detector software versus alternative authentic assessment methods.', 'Insufficient literature on iterative refinement processes for undergraduate questions', 'Limited cross-disciplinary comparisons of research question structures', 'Gap between pedagogical advice and empirical outcomes in thesis completion']
uncertainties
['The rapidly evolving nature of AI model capabilities outpacing academic policy development.', 'Generalizability of findings across different academic disciplines.', 'Subject matter discipline is unspecified', 'Target academic level is unknown', 'Preferred research paradigm (qualitative/quantitative) is unclear']
filters
{'suggestions': [{'year_from': 2020, 'year_to': 2024, 'fields': ['Education', 'Computer Science', 'Social Sciences'], 'study_types': ['Empirical Study', 'Systematic Review', 'Case Study']}, {'year_from': 2019, 'year_to': 2024, 'fields': ['Education', 'Library Science', 'Research Methodology'], 'study_types': ['Review', 'Guideline', 'Conceptual Paper']}], 'policy': 'Advisory only; configured provider filters apply.'}
generated_query_count
7
successful_planners
2

Synthesis failure: The synthesizer reached its output limit before completing the structured answer. · truncated_response · malformed_response · json_parsing

Model: anthropic/claude-sonnet-5. Rejected source IDs: None recorded.

Provider counts describe latest attempts; evidence and answer metrics describe active results. Duration and costs include all attempts, including retries. Cost is USD, OpenRouter only; Consensus billing is not estimated. Unknown is not zero.

total_duration_ms
437184
interrupted_execution_metrics_incomplete
False
successful_providers
3
failed_providers
2
successful_agents
2
consensus_success
True
synthesis_success
False
paper_count
23
total_estimated_openrouter_cost
Unknown / not applicable
known_cost_subtotal
0.1464443250
attempts_missing_cost
1
valid_source_percent
Unknown / not applicable
removed_source_ids
0
agreements_count
0
disagreements_count
0
evidence_strength_distribution
{}
judge_confidence
Unknown / not applicable
answer_length
0
Attempt / modelSuccessLatency msInput / output / total tokensCost USDError
#159 academic-graph-searchNo642? / ? / ?Unknown rate_limit: Semantic Scholar retrieval failed (rate_limit).
#158 search-v1Yes29712? / ? / ?Unknown :
#157 qwen/qwen3.5-27bYes25748331 / 2413 / 27440.0038288250 reported:
#156 meta-llama/llama-4-scoutNo627? / ? / ?Unknown rate_limit: OpenRouter rate-limited this request. Please try again later.
#155 google/gemini-3.5-flashYes94531184 / 1326 / 25100.0137100000 reported:
#33 anthropic/claude-sonnet-5No5801520612 / 6000 / 266120.1012240000 reportedmalformed_response: The synthesizer reached its output limit before completing the structured answer.
#32 deepseek/deepseek-r1No1223836810 / 3255 / 100650.0129045000 reportedmalformed_response: The synthesizer returned an invalid structured answer.
#31 deepseek/deepseek-r1No1901916810 / 4004 / 108140.0147770000 reportedmalformed_response: The synthesizer returned an invalid structured answer.

Judge: anthropic/claude-sonnet-5. Papers used: 0. Papers omitted by limit: 3.

Rejected source IDs: None recorded

Conversation history
User
Identify the topic Developing a Research Training Curriculum for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital Working title: "Informing the Design of a Research Training and Mentorship Framework for Postgraduate Surgical Trainees: A Qualitative Needs Assessment of Supervisors' Perspectives at a Tertiary Care Hospital. 2. Rationale 2.1 The problem. Research competence is treated as a core outcome of postgraduate medical training, not an optional add-on. In Pakistan, professional bodies such as the College of Physicians and Surgeons Pakistan require postgraduate trainees to complete a research project or dissertation as part of fellowship training, and research participation is widely recognized as important for career progression, evidence-based medical practice, and eligibility for subspecialty fellowships. Despite this, postgraduate medical trainees continue to show low research output and limited research competence in practice. Bakhshi et al.'s (2023) multicentered survey of 333 postgraduate trainees across 12 accredited Pakistani institutions included 171 medical and162 surgical residents. They found that, despite 61% having received some research training, 57% of trainees still scored below one-third in basic research knowledge, and only 18% published locally and 11% internationally, indicating that research training is not being delivered. Still, neither builds competence nor produces publishable output. The most commonly cited barriers were time constraints caused to clinical workload, lack of financial support, and lack of data availability. Shah's (2024) mixed-methods study of postgraduate trainees at a tertiary care hospital in Karachi similarly found that supervisor support for research varied substantially, with clinical trainees receiving markedly less supervisor assistance than basic-science trainees, and cited workload and scheduling constraints as the main barrier to active participation. Khan et al.'s (2025) national survey extends the same picture beyond training into independent practice, reporting that Pakistani doctors continue to struggle to conduct and complete research well after graduation. Surgical training arguably faces this problem more acutely than other specialties: operative caseload requirements, long duty hours, and the apprenticeship structure of surgical education leave comparatively little unstructured time for research, yet no study reviewed here examines surgical trainees as a distinct group facing these particular constraints. Taken together, this evidence shows a persistent, well-documented gap between what postgraduate surgical training expects of trainees and what trainees are actually able to achieve. 2.2 The gap. Gap 1 — No study has asked supervisors. The closest match, Bakhshi et al.'s (2023) survey of 333 Pakistani postgraduate residents across 12 institutions (162 of whom were surgical), found low research output and insight despite positive attitudes — but the authors explicitly flag that "faculty and supervisor viewpoints were excluded" as a limitation of their study. Every other Pakistani study found has the same shape: Shah (2023) at a Karachi tertiary care hospital, Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) all capture trainees' or students' perspectives, never supervisors. This study is the first to flip that concept on its head and ask the people who actually design and deliver training what should be in it. Gap 2 — No surgery-specific focus. Bakhshi et al. (2024) pool medical and surgical residents together; Shah (2024) pools clinical and basic-science trainees together. Nobody has identified postgraduate surgical trainees as a distinct group with their own research-training needs, even though surgical training has well-documented time and workload constraints that probably influence what's feasible in a research curriculum differently than in other specialties. Gap 3 — Nobody closes the loop from problem to design. Every study above Bakhshi et al. (2023), Shah (2024), Mahmood et al. (2025) at Nishtar Medical University, and Ahmed et al. (2023) stops at identifying barriers: time, funding, mentorship, data access. None of them takes the next step of translating findings into an actual structured training framework. That's precisely what "Informing the Design of..." in the title commits: nothing in the literature has done it yet for this population. Gap 4 — Qualitative depth exists in Pakistan only at the undergraduate level. Ahmed et al. (2023) and Mahmood et al. (2025) show qualitative methods are now being used to understand research barriers in Pakistani medical education — but only with undergraduates. Nobody has taken that same qualitative depth to the postgraduate surgical level. Shah (2023) does carry a qualitative component at the postgraduate level. The defensible claim is that no published Pakistani study has used a standalone qualitative design with postgraduate trainees, and none at any level has taken supervisors as the unit of analysis. That's a genuinely well-differentiated gap, not just a rephrased version of existing work. 2.3 The impact. By asking supervisors directly what postgraduate surgical trainees need, and what a structured training and mentorship framework should include, this study will produce something the existing survey-based literature cannot: a locally grounded, practitioner-informed basis for designing research training that is realistic within the constraints of surgical training, rather than one adapted from contexts with different workload and resource conditions. For the tertiary care hospital where the study is based, findings can directly inform the structure, content, and delivery of a research training and mentorship framework, addressing the barriers Bakhshi et al. (2023) and Shah (2024) documented but did not resolve. For supervisors who currently mentor research largely through their own experience rather than any structured institutional support, the study provides an opportunity to develop a tool that could reduce that load rather than add to it, and to have their practical, workload-sensitive knowledge formally incorporated into training design rather than left implicit. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements, such as the CPSP dissertation, while building research competence that is more likely to persist into independent surgical practice. For accrediting and professional bodies, a locally validated, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs facing the same documented constraints. More broadly, by combining a supervisor perspective, a surgery-specific focus, a postgraduate population, and a designed output in a single study, this needs assessment closes four gaps in the existing literature at once, and offers a transferable model that other tertiary care surgical training programs could adapt. 3. Statement of the Problem Despite requirements from training bodies such as the College of Physicians and Surgeons Pakistan for postgraduate trainees to complete a research project during fellowship training, and despite wide recognition of research competence as a core outcome of surgical training, postgraduate surgical trainees in Pakistan continue to show low research output and limited research knowledge, with barriers including clinical workload, inadequate funding, and limited institutional support well documented in survey-based literature (Bakhshi et al., 2023; Khan et al., 2025). What remains unknown is how to design a training framework that tackles these barriers within the time and workload constraints specific to surgical training, because the perspectives of supervisors, who are ultimately responsible for delivering and sustaining any such framework, have not been involved in any national or international publication. Existing research also treats postgraduate trainees as one undifferentiated group or combines surgical residents with medical or basic-science trainees, obscuring needs specific to surgical training, and stops at identifying barriers rather than translating the findings into an actionable curriculum. This leaves tertiary care hospitals without a locally grounded, supervisor-informed basis for designing research training that is realistic and likely to be sustained, rather than one adapted from contexts with different resource and workload conditions. 4. Research question What are supervisors' perspectives on the research training needs of postgraduate surgical trainees at a tertiary care hospital, and what should a structured research training framework developed for these trainees include? Fit with FINER criteria: Feasible — a purposive sample of surgical faculty supervisors at a single tertiary care hospital is achievable within a thesis timeline. Interesting — it directly addresses a gap that the most closely related Pakistani study (Bakhshi et al., 2023; Shah et al., 2024) itself identified as a limitation of its design. No published Pakistani or, as far as this review is found, international study has interviewed supervisors specifically about postgraduate surgical trainees' research training and mentorship needs. Ethical standard qualitative safeguards (informed consent, confidentiality, right to withdraw) are sufficient; supervisors participate in a professional capacity, and the study poses no more than minimal risk. Relevant — findings directly inform a real institutional deliverable, a research training and mentorship framework that supports CPSP-type requirements and evidence-based surgical practice. 5. Research objectives General Objective: To explore supervisors' perspectives on the research training needs of postgraduate surgical trainees, to inform the design of a structured research training framework at a tertiary care hospital. Specific Objectives: 1. To explore supervisors' perceptions of the current barriers and gaps in postgraduate surgical trainees' research training. 2. To identify, from supervisors' perspectives, the content, structure, and delivery methods that should be included in a research training framework for postgraduate surgical trainees. 6. Significance of study For the tertiary care hospital and its surgical training program, this study will provide a concrete, supervisor-validated basis for designing a research training framework, rather than adapting curricula developed for different resource and workload contexts. For supervisors, who currently mentor research largely through individual experience rather than systematic support, the findings will translate that practical knowledge into a usable tool, perhaps reducing the burden of ad hoc, inconsistent mentorship. For postgraduate surgical trainees, a better-designed framework could improve their ability to meet research requirements such as the CPSP dissertation, while building research competence more likely to persist into independent practice. For the College of Physicians and Surgeons Pakistan and comparable bodies, a locally grounded, supervisor-informed model offers a possible template for strengthening research training standards across other surgical programs. Realistically, this needs assessment can identify what a framework should contain and how it should be delivered; it cannot, by itself, demonstrate that the framework improves trainees' research output, which would require a separate evaluation once implemented.
User
State a research question from the document
User
Need to make a research question

Three AI perspectives + academic evidence · Check sources before relying on them

Manage research